Document (#34921)

Author

Wilson, M.L.
Schraefel, M.C.
White, R.W.

Title

Evaluating advanced search interfaces using established information-seeking models

Source

Journal of the American Society for Information Science and Technology. 60(2009) no.7, S.1407-1422

Year

2009

Abstract

When users have poorly defined or complex goals, search interfaces that offer only keyword-searching facilities provide inadequate support to help them reach their information-seeking objectives. The emergence of interfaces with more advanced capabilities, such as faceted browsing and result clustering, can go some way toward addressing such problems. The evaluation of these interfaces, however, is challenging because they generally offer diverse and versatile search environments that introduce overwhelming amounts of independent variables to user studies; choosing the interface object as the only independent variable in a study would reveal very little about why one design outperforms another. Nonetheless, if we could effectively compare these interfaces, then we would have a way to determine which was best for a given scenario and begin to learn why. In this article, we present a formative inspection framework for the evaluation of advanced search interfaces through the quantification of the strengths and weaknesses of the interfaces in supporting user tactics and varying user conditions. This framework combines established models of users and their needs and behaviors to achieve this. The framework is applied to evaluate three search interfaces and demonstrates the potential value of this approach to interactive information retrieval evaluation.

Theme

Suchoberflächen

Similar documents (author)

1. White, H.D.; Bates, M.J.; Wilson, P.: For information specialists : interpretations of reference and bibliographic work (1992) 3.80

   3.7981238 = sum of:
     3.7981238 = sum of:
       1.7970399 = weight(author_txt:wilson in 7742) [ClassicSimilarity], result of:
         1.7970399 = score(doc=7742,freq=1.0), product of:
           0.681331 = queryWeight, product of:
             7.033448 = idf(docFreq=105, maxDocs=44218)
             0.09687012 = queryNorm
           2.6375432 = fieldWeight in 7742, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.033448 = idf(docFreq=105, maxDocs=44218)
             0.375 = fieldNorm(doc=7742)
       2.001084 = weight(author_txt:white in 7742) [ClassicSimilarity], result of:
         2.001084 = score(doc=7742,freq=1.0), product of:
           0.73197556 = queryWeight, product of:
             1.0364999 = boost
             7.290168 = idf(docFreq=81, maxDocs=44218)
             0.09687012 = queryNorm
           2.7338128 = fieldWeight in 7742, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.290168 = idf(docFreq=81, maxDocs=44218)
             0.375 = fieldNorm(doc=7742)
   

2. White, H.D.; Boell, S.K.; Yu, H.; Davis, M.; Wilson, C.S.; Cole, F.T.H.: Libcitations : a measure for comparative assessment of book publications in the humanities and social sciences (2009) 2.53

   2.5320826 = sum of:
     2.5320826 = sum of:
       1.1980265 = weight(author_txt:wilson in 2846) [ClassicSimilarity], result of:
         1.1980265 = score(doc=2846,freq=1.0), product of:
           0.681331 = queryWeight, product of:
             7.033448 = idf(docFreq=105, maxDocs=44218)
             0.09687012 = queryNorm
           1.758362 = fieldWeight in 2846, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.033448 = idf(docFreq=105, maxDocs=44218)
             0.25 = fieldNorm(doc=2846)
       1.3340561 = weight(author_txt:white in 2846) [ClassicSimilarity], result of:
         1.3340561 = score(doc=2846,freq=1.0), product of:
           0.73197556 = queryWeight, product of:
             1.0364999 = boost
             7.290168 = idf(docFreq=81, maxDocs=44218)
             0.09687012 = queryNorm
           1.822542 = fieldWeight in 2846, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.290168 = idf(docFreq=81, maxDocs=44218)
             0.25 = fieldNorm(doc=2846)
   

3. Wilson, M.J.; Wilson, M.L.: ¬A comparison of techniques for measuring sensemaking and learning within participant-generated summaries (2013) 1.69

   1.6942652 = sum of:
     1.6942652 = product of:
       3.3885305 = sum of:
         3.3885305 = weight(author_txt:wilson in 612) [ClassicSimilarity], result of:
           3.3885305 = score(doc=612,freq=2.0), product of:
             0.681331 = queryWeight, product of:
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.09687012 = queryNorm
             4.9733987 = fieldWeight in 612, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.5 = fieldNorm(doc=612)
       0.5 = coord(1/2)
   

4. White, H.S.: OCR software : an introduction (1991) 1.67

   1.6675702 = sum of:
     1.6675702 = product of:
       3.3351405 = sum of:
         3.3351405 = weight(author_txt:white in 3760) [ClassicSimilarity], result of:
           3.3351405 = score(doc=3760,freq=1.0), product of:
             0.73197556 = queryWeight, product of:
               1.0364999 = boost
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.09687012 = queryNorm
             4.556355 = fieldWeight in 3760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.625 = fieldNorm(doc=3760)
       0.5 = coord(1/2)
   

5. White, S.: Compton's affiliate's program : a new type of publisher/developer partnership emerges (1993) 1.67

   1.6675702 = sum of:
     1.6675702 = product of:
       3.3351405 = sum of:
         3.3351405 = weight(author_txt:white in 4634) [ClassicSimilarity], result of:
           3.3351405 = score(doc=4634,freq=1.0), product of:
             0.73197556 = queryWeight, product of:
               1.0364999 = boost
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.09687012 = queryNorm
             4.556355 = fieldWeight in 4634, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.290168 = idf(docFreq=81, maxDocs=44218)
               0.625 = fieldNorm(doc=4634)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Research and advanced technology for digital libraries : 8th European conference, ECDL 2004, Bath, UK, September 12-17, 2004 : proceedings (2004) 0.23

   0.22785942 = sum of:
     0.22785942 = product of:
       0.7120607 = sum of:
         0.010331863 = weight(abstract_txt:information in 2427) [ClassicSimilarity], result of:
           0.010331863 = score(doc=2427,freq=1.0), product of:
             0.045522086 = queryWeight, product of:
               1.0152715 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018520588 = queryNorm
             0.22696373 = fieldWeight in 2427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=2427)
         0.048543125 = weight(abstract_txt:models in 2427) [ClassicSimilarity], result of:
           0.048543125 = score(doc=2427,freq=1.0), product of:
             0.11155555 = queryWeight, product of:
               1.2976904 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.018520588 = queryNorm
             0.43514758 = fieldWeight in 2427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.09375 = fieldNorm(doc=2427)
         0.013640908 = weight(abstract_txt:this in 2427) [ClassicSimilarity], result of:
           0.013640908 = score(doc=2427,freq=1.0), product of:
             0.060299195 = queryWeight, product of:
               1.3492619 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.018520588 = queryNorm
             0.2262204 = fieldWeight in 2427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.09375 = fieldNorm(doc=2427)
         0.051467814 = weight(abstract_txt:user in 2427) [ClassicSimilarity], result of:
           0.051467814 = score(doc=2427,freq=2.0), product of:
             0.10538615 = queryWeight, product of:
               1.5447668 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018520588 = queryNorm
             0.48837358 = fieldWeight in 2427, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.09375 = fieldNorm(doc=2427)
         0.065738656 = weight(abstract_txt:evaluation in 2427) [ClassicSimilarity], result of:
           0.065738656 = score(doc=2427,freq=1.0), product of:
             0.15630887 = queryWeight, product of:
               1.8813213 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018520588 = queryNorm
             0.42056894 = fieldWeight in 2427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=2427)
         0.14712295 = weight(abstract_txt:advanced in 2427) [ClassicSimilarity], result of:
           0.14712295 = score(doc=2427,freq=1.0), product of:
             0.26743814 = queryWeight, product of:
               2.460837 = boost
               5.8679414 = idf(docFreq=339, maxDocs=44218)
               0.018520588 = queryNorm
             0.5501195 = fieldWeight in 2427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8679414 = idf(docFreq=339, maxDocs=44218)
               0.09375 = fieldNorm(doc=2427)
         0.05940481 = weight(abstract_txt:search in 2427) [ClassicSimilarity], result of:
           0.05940481 = score(doc=2427,freq=1.0), product of:
             0.17322095 = queryWeight, product of:
               2.556794 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.018520588 = queryNorm
             0.34294242 = fieldWeight in 2427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.09375 = fieldNorm(doc=2427)
         0.31581056 = weight(abstract_txt:interfaces in 2427) [ClassicSimilarity], result of:
           0.31581056 = score(doc=2427,freq=1.0), product of:
             0.61713064 = queryWeight, product of:
               6.104415 = boost
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.018520588 = queryNorm
             0.5117402 = fieldWeight in 2427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.09375 = fieldNorm(doc=2427)
       0.32 = coord(8/25)
   

2. Rose, D.E.: Reconciling information-seeking behavior with search user interfaces for the Web (2006) 0.20

   0.19856977 = sum of:
     0.19856977 = product of:
       0.8273741 = sum of:
         0.017046703 = weight(abstract_txt:information in 5296) [ClassicSimilarity], result of:
           0.017046703 = score(doc=5296,freq=2.0), product of:
             0.045522086 = queryWeight, product of:
               1.0152715 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018520588 = queryNorm
             0.37447104 = fieldWeight in 5296, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.109375 = fieldNorm(doc=5296)
         0.015914392 = weight(abstract_txt:this in 5296) [ClassicSimilarity], result of:
           0.015914392 = score(doc=5296,freq=1.0), product of:
             0.060299195 = queryWeight, product of:
               1.3492619 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.018520588 = queryNorm
             0.2639238 = fieldWeight in 5296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.109375 = fieldNorm(doc=5296)
         0.0746952 = weight(abstract_txt:seeking in 5296) [ClassicSimilarity], result of:
           0.0746952 = score(doc=5296,freq=1.0), product of:
             0.13416418 = queryWeight, product of:
               1.4231275 = boost
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.018520588 = queryNorm
             0.5567447 = fieldWeight in 5296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.109375 = fieldNorm(doc=5296)
         0.06004578 = weight(abstract_txt:user in 5296) [ClassicSimilarity], result of:
           0.06004578 = score(doc=5296,freq=2.0), product of:
             0.10538615 = queryWeight, product of:
               1.5447668 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018520588 = queryNorm
             0.56976914 = fieldWeight in 5296, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.109375 = fieldNorm(doc=5296)
         0.13861123 = weight(abstract_txt:search in 5296) [ClassicSimilarity], result of:
           0.13861123 = score(doc=5296,freq=4.0), product of:
             0.17322095 = queryWeight, product of:
               2.556794 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.018520588 = queryNorm
             0.800199 = fieldWeight in 5296, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.109375 = fieldNorm(doc=5296)
         0.5210608 = weight(abstract_txt:interfaces in 5296) [ClassicSimilarity], result of:
           0.5210608 = score(doc=5296,freq=2.0), product of:
             0.61713064 = queryWeight, product of:
               6.104415 = boost
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.018520588 = queryNorm
             0.8443283 = fieldWeight in 5296, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.109375 = fieldNorm(doc=5296)
       0.24 = coord(6/25)
   

3. Huurdeman, H.C.; Kamps, J.: Designing multistage search systems to support the information seeking process (2020) 0.18

   0.17924549 = sum of:
     0.17924549 = product of:
       0.56014216 = sum of:
         0.01687186 = weight(abstract_txt:information in 5882) [ClassicSimilarity], result of:
           0.01687186 = score(doc=5882,freq=6.0), product of:
             0.045522086 = queryWeight, product of:
               1.0152715 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018520588 = queryNorm
             0.3706302 = fieldWeight in 5882, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=5882)
         0.032362085 = weight(abstract_txt:models in 5882) [ClassicSimilarity], result of:
           0.032362085 = score(doc=5882,freq=1.0), product of:
             0.11155555 = queryWeight, product of:
               1.2976904 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.018520588 = queryNorm
             0.2900984 = fieldWeight in 5882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.0625 = fieldNorm(doc=5882)
         0.012860771 = weight(abstract_txt:this in 5882) [ClassicSimilarity], result of:
           0.012860771 = score(doc=5882,freq=2.0), product of:
             0.060299195 = queryWeight, product of:
               1.3492619 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.018520588 = queryNorm
             0.21328263 = fieldWeight in 5882, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=5882)
         0.09544202 = weight(abstract_txt:seeking in 5882) [ClassicSimilarity], result of:
           0.09544202 = score(doc=5882,freq=5.0), product of:
             0.13416418 = queryWeight, product of:
               1.4231275 = boost
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.018520588 = queryNorm
             0.71138227 = fieldWeight in 5882, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.0625 = fieldNorm(doc=5882)
         0.02426216 = weight(abstract_txt:user in 5882) [ClassicSimilarity], result of:
           0.02426216 = score(doc=5882,freq=1.0), product of:
             0.10538615 = queryWeight, product of:
               1.5447668 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018520588 = queryNorm
             0.23022151 = fieldWeight in 5882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=5882)
         0.07924742 = weight(abstract_txt:framework in 5882) [ClassicSimilarity], result of:
           0.07924742 = score(doc=5882,freq=3.0), product of:
             0.16085958 = queryWeight, product of:
               1.9085107 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.018520588 = queryNorm
             0.49264967 = fieldWeight in 5882, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=5882)
         0.08855546 = weight(abstract_txt:search in 5882) [ClassicSimilarity], result of:
           0.08855546 = score(doc=5882,freq=5.0), product of:
             0.17322095 = queryWeight, product of:
               2.556794 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.018520588 = queryNorm
             0.5112284 = fieldWeight in 5882, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=5882)
         0.21054038 = weight(abstract_txt:interfaces in 5882) [ClassicSimilarity], result of:
           0.21054038 = score(doc=5882,freq=1.0), product of:
             0.61713064 = queryWeight, product of:
               6.104415 = boost
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.018520588 = queryNorm
             0.34116015 = fieldWeight in 5882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.0625 = fieldNorm(doc=5882)
       0.32 = coord(8/25)
   

4. Hearst, M.A.: Search user interfaces (2009) 0.18

   0.17848863 = sum of:
     0.17848863 = product of:
       0.74370265 = sum of:
         0.01789531 = weight(abstract_txt:information in 4029) [ClassicSimilarity], result of:
           0.01789531 = score(doc=4029,freq=3.0), product of:
             0.045522086 = queryWeight, product of:
               1.0152715 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018520588 = queryNorm
             0.3931127 = fieldWeight in 4029, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=4029)
         0.019291157 = weight(abstract_txt:this in 4029) [ClassicSimilarity], result of:
           0.019291157 = score(doc=4029,freq=2.0), product of:
             0.060299195 = queryWeight, product of:
               1.3492619 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.018520588 = queryNorm
             0.31992394 = fieldWeight in 4029, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.09375 = fieldNorm(doc=4029)
         0.064024456 = weight(abstract_txt:seeking in 4029) [ClassicSimilarity], result of:
           0.064024456 = score(doc=4029,freq=1.0), product of:
             0.13416418 = queryWeight, product of:
               1.4231275 = boost
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.018520588 = queryNorm
             0.47720975 = fieldWeight in 4029, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.090237 = idf(docFreq=739, maxDocs=44218)
               0.09375 = fieldNorm(doc=4029)
         0.06303494 = weight(abstract_txt:user in 4029) [ClassicSimilarity], result of:
           0.06303494 = score(doc=4029,freq=3.0), product of:
             0.10538615 = queryWeight, product of:
               1.5447668 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018520588 = queryNorm
             0.598133 = fieldWeight in 4029, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.09375 = fieldNorm(doc=4029)
         0.1328332 = weight(abstract_txt:search in 4029) [ClassicSimilarity], result of:
           0.1328332 = score(doc=4029,freq=5.0), product of:
             0.17322095 = queryWeight, product of:
               2.556794 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.018520588 = queryNorm
             0.7668426 = fieldWeight in 4029, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.09375 = fieldNorm(doc=4029)
         0.44662356 = weight(abstract_txt:interfaces in 4029) [ClassicSimilarity], result of:
           0.44662356 = score(doc=4029,freq=2.0), product of:
             0.61713064 = queryWeight, product of:
               6.104415 = boost
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.018520588 = queryNorm
             0.72370994 = fieldWeight in 4029, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.09375 = fieldNorm(doc=4029)
       0.24 = coord(6/25)
   

5. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.17

   0.17403315 = sum of:
     0.17403315 = product of:
       0.621547 = sum of:
         0.008609885 = weight(abstract_txt:information in 2021) [ClassicSimilarity], result of:
           0.008609885 = score(doc=2021,freq=1.0), product of:
             0.045522086 = queryWeight, product of:
               1.0152715 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018520588 = queryNorm
             0.18913643 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.016075963 = weight(abstract_txt:this in 2021) [ClassicSimilarity], result of:
           0.016075963 = score(doc=2021,freq=2.0), product of:
             0.060299195 = queryWeight, product of:
               1.3492619 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.018520588 = queryNorm
             0.2666033 = fieldWeight in 2021, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.052529115 = weight(abstract_txt:user in 2021) [ClassicSimilarity], result of:
           0.052529115 = score(doc=2021,freq=3.0), product of:
             0.10538615 = queryWeight, product of:
               1.5447668 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018520588 = queryNorm
             0.49844417 = fieldWeight in 2021, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.06901715 = weight(abstract_txt:established in 2021) [ClassicSimilarity], result of:
           0.06901715 = score(doc=2021,freq=1.0), product of:
             0.15928133 = queryWeight, product of:
               1.5506291 = boost
               5.5462847 = idf(docFreq=468, maxDocs=44218)
               0.018520588 = queryNorm
             0.43330348 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5462847 = idf(docFreq=468, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.1549475 = weight(abstract_txt:evaluation in 2021) [ClassicSimilarity], result of:
           0.1549475 = score(doc=2021,freq=8.0), product of:
             0.15630887 = queryWeight, product of:
               1.8813213 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018520588 = queryNorm
             0.9912905 = fieldWeight in 2021, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.057191905 = weight(abstract_txt:framework in 2021) [ClassicSimilarity], result of:
           0.057191905 = score(doc=2021,freq=1.0), product of:
             0.16085958 = queryWeight, product of:
               1.9085107 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.018520588 = queryNorm
             0.3555393 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.2631755 = weight(abstract_txt:interfaces in 2021) [ClassicSimilarity], result of:
           0.2631755 = score(doc=2021,freq=1.0), product of:
             0.61713064 = queryWeight, product of:
               6.104415 = boost
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.018520588 = queryNorm
             0.4264502 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4585624 = idf(docFreq=511, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
       0.28 = coord(7/25)