Document (#24690)

Author

MacCall, S.L.
Cleveland, A.D.

Title

¬A relevance-based quantitative measure for Internet information retrieval evaluation

Source

Knowledge: creation, organization and use. Proceedings of the 62nd Annual Meeting of the American Society for Information Science, 31.10.-4.11.1999. Ed.: L. Woods

Imprint

Medford, NJ : Information Today

Year

1999

Pages

S.763-768

Series

Proceedings of the American Society for Information Science; vol36

Abstract

An important indicator of a maturating Internet is the development of metrics for its evaluation as a practical tool for enduser information retrieval. However, the Internet presents specific problems for traditional IR measures, such as the need to deal with the variety of classes of retrieval tools. This paper presents a metric for comparing the performance of common classes of Internet information retrieval tool, including human indexed catalogs of web resources and automatically indexed databases of web pages. The metric uses a relevance-based quantitative measure to compare the performance of endusers using these Internet information retrieval tools. The benefit of the proposed metric is that it is relevance-based (using enduser relevance judgments), and it facilitates the comparison of the performance of different classes of IIR tools

Theme

Retrievalstudien

Similar documents (author)

1. Cleveland, A.D.; Cleveland, D.B.: ¬A test of Buck's prime number coding scheme (1979) 6.72

   6.7205143 = sum of:
     6.7205143 = weight(author_txt:cleveland in 5491) [ClassicSimilarity], result of:
       6.7205143 = fieldWeight in 5491, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.5 = fieldNorm(doc=5491)
   

2. Cleveland, D.B.; Cleveland, A.D.: Introduction to abstracting and indexing (2001) 6.72

   6.7205143 = sum of:
     6.7205143 = weight(author_txt:cleveland in 1316) [ClassicSimilarity], result of:
       6.7205143 = fieldWeight in 1316, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.5 = fieldNorm(doc=1316)
   

3. Cleveland, D.B.; Cleveland, A.D.: Introduction to abstracting and indexing (1990) 6.72

   6.7205143 = sum of:
     6.7205143 = weight(author_txt:cleveland in 1317) [ClassicSimilarity], result of:
       6.7205143 = fieldWeight in 1317, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.5 = fieldNorm(doc=1317)
   

4. Swain, L.; Cleveland, G.: Overview of the Internet : origins, future, and issues (1994) 4.75

   4.7521214 = sum of:
     4.7521214 = weight(author_txt:cleveland in 7051) [ClassicSimilarity], result of:
       4.7521214 = fieldWeight in 7051, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.5 = fieldNorm(doc=7051)
   

5. Shera, J.H.; Cleveland, D.B.: History and foundations of information science (1977) 4.75

   4.7521214 = sum of:
     4.7521214 = weight(author_txt:cleveland in 271) [ClassicSimilarity], result of:
       4.7521214 = fieldWeight in 271, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.5 = fieldNorm(doc=271)
   

Similar documents (content)

1. Spink, A.; Greisdorf, H.: Regions and levels : Measuring and mapping users' relevance judgements (2001) 0.30

   0.2962163 = sum of:
     0.2962163 = product of:
       0.925676 = sum of:
         0.13148938 = weight(abstract_txt:judgments in 6586) [ClassicSimilarity], result of:
           0.13148938 = score(doc=6586,freq=6.0), product of:
             0.12481643 = queryWeight, product of:
               1.1441009 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.015854193 = queryNorm
             1.0534621 = fieldWeight in 6586, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.013611458 = weight(abstract_txt:using in 6586) [ClassicSimilarity], result of:
           0.013611458 = score(doc=6586,freq=1.0), product of:
             0.063000135 = queryWeight, product of:
               1.1495138 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.015854193 = queryNorm
             0.21605442 = fieldWeight in 6586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.04188873 = weight(abstract_txt:evaluation in 6586) [ClassicSimilarity], result of:
           0.04188873 = score(doc=6586,freq=2.0), product of:
             0.10579371 = queryWeight, product of:
               1.4896127 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.015854193 = queryNorm
             0.39594725 = fieldWeight in 6586, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.0131902695 = weight(abstract_txt:information in 6586) [ClassicSimilarity], result of:
           0.0131902695 = score(doc=6586,freq=2.0), product of:
             0.061693702 = queryWeight, product of:
               1.6087141 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015854193 = queryNorm
             0.21380253 = fieldWeight in 6586, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.074859746 = weight(abstract_txt:measure in 6586) [ClassicSimilarity], result of:
           0.074859746 = score(doc=6586,freq=2.0), product of:
             0.15579754 = queryWeight, product of:
               1.8076892 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.015854193 = queryNorm
             0.48049375 = fieldWeight in 6586, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.034611616 = weight(abstract_txt:retrieval in 6586) [ClassicSimilarity], result of:
           0.034611616 = score(doc=6586,freq=1.0), product of:
             0.15929407 = queryWeight, product of:
               2.8901026 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015854193 = queryNorm
             0.21728125 = fieldWeight in 6586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.29536992 = weight(abstract_txt:relevance in 6586) [ClassicSimilarity], result of:
           0.29536992 = score(doc=6586,freq=14.0), product of:
             0.25622207 = queryWeight, product of:
               3.2784362 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015854193 = queryNorm
             1.1527888 = fieldWeight in 6586, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.32065484 = weight(abstract_txt:enduser in 6586) [ClassicSimilarity], result of:
           0.32065484 = score(doc=6586,freq=1.0), product of:
             0.51772237 = queryWeight, product of:
               3.2952769 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.015854193 = queryNorm
             0.61935675 = fieldWeight in 6586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
       0.32 = coord(8/25)
   

2. An, X.; Huang, J.X.: geNov : a new metric for measuring novelty and relevancy in biomedical information retrieval (2017) 0.27

   0.2689309 = sum of:
     0.2689309 = product of:
       0.74703026 = sum of:
         0.036528196 = weight(abstract_txt:comparing in 4921) [ClassicSimilarity], result of:
           0.036528196 = score(doc=4921,freq=1.0), product of:
             0.0965637 = queryWeight, product of:
               1.0063183 = boost
               6.0524936 = idf(docFreq=283, maxDocs=44421)
               0.015854193 = queryNorm
             0.37828085 = fieldWeight in 4921, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0524936 = idf(docFreq=283, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
         0.06684788 = weight(abstract_txt:metrics in 4921) [ClassicSimilarity], result of:
           0.06684788 = score(doc=4921,freq=2.0), product of:
             0.11466833 = queryWeight, product of:
               1.096605 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.015854193 = queryNorm
             0.5829673 = fieldWeight in 4921, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
         0.0662319 = weight(abstract_txt:evaluation in 4921) [ClassicSimilarity], result of:
           0.0662319 = score(doc=4921,freq=5.0), product of:
             0.10579371 = queryWeight, product of:
               1.4896127 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.015854193 = queryNorm
             0.6260476 = fieldWeight in 4921, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
         0.015939957 = weight(abstract_txt:based in 4921) [ClassicSimilarity], result of:
           0.015939957 = score(doc=4921,freq=1.0), product of:
             0.08012356 = queryWeight, product of:
               1.5877028 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.015854193 = queryNorm
             0.1989422 = fieldWeight in 4921, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
         0.016154714 = weight(abstract_txt:information in 4921) [ClassicSimilarity], result of:
           0.016154714 = score(doc=4921,freq=3.0), product of:
             0.061693702 = queryWeight, product of:
               1.6087141 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015854193 = queryNorm
             0.26185355 = fieldWeight in 4921, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
         0.052933834 = weight(abstract_txt:measure in 4921) [ClassicSimilarity], result of:
           0.052933834 = score(doc=4921,freq=1.0), product of:
             0.15579754 = queryWeight, product of:
               1.8076892 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.015854193 = queryNorm
             0.3397604 = fieldWeight in 4921, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
         0.048730902 = weight(abstract_txt:performance in 4921) [ClassicSimilarity], result of:
           0.048730902 = score(doc=4921,freq=1.0), product of:
             0.16877383 = queryWeight, product of:
               2.304314 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015854193 = queryNorm
             0.28873494 = fieldWeight in 4921, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
         0.05994907 = weight(abstract_txt:retrieval in 4921) [ClassicSimilarity], result of:
           0.05994907 = score(doc=4921,freq=3.0), product of:
             0.15929407 = queryWeight, product of:
               2.8901026 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015854193 = queryNorm
             0.37634215 = fieldWeight in 4921, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
         0.38371378 = weight(abstract_txt:metric in 4921) [ClassicSimilarity], result of:
           0.38371378 = score(doc=4921,freq=4.0), product of:
             0.420811 = queryWeight, product of:
               3.6385858 = boost
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.015854193 = queryNorm
             0.91184354 = fieldWeight in 4921, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.0625 = fieldNorm(doc=4921)
       0.36 = coord(9/25)
   

3. Sakai, T.: On the reliability of information retrieval metrics based on graded relevance (2007) 0.25

   0.24657348 = sum of:
     0.24657348 = product of:
       0.77054214 = sum of:
         0.13211973 = weight(abstract_txt:metrics in 1910) [ClassicSimilarity], result of:
           0.13211973 = score(doc=1910,freq=5.0), product of:
             0.11466833 = queryWeight, product of:
               1.096605 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.015854193 = queryNorm
             1.1521902 = fieldWeight in 1910, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.017014321 = weight(abstract_txt:using in 1910) [ClassicSimilarity], result of:
           0.017014321 = score(doc=1910,freq=1.0), product of:
             0.063000135 = queryWeight, product of:
               1.1495138 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.015854193 = queryNorm
             0.27006802 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.039849892 = weight(abstract_txt:based in 1910) [ClassicSimilarity], result of:
           0.039849892 = score(doc=1910,freq=4.0), product of:
             0.08012356 = queryWeight, product of:
               1.5877028 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.015854193 = queryNorm
             0.4973555 = fieldWeight in 1910, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.011658661 = weight(abstract_txt:information in 1910) [ClassicSimilarity], result of:
           0.011658661 = score(doc=1910,freq=1.0), product of:
             0.061693702 = queryWeight, product of:
               1.6087141 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015854193 = queryNorm
             0.18897653 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.066167295 = weight(abstract_txt:measure in 1910) [ClassicSimilarity], result of:
           0.066167295 = score(doc=1910,freq=1.0), product of:
             0.15579754 = queryWeight, product of:
               1.8076892 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.015854193 = queryNorm
             0.4247005 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.043264516 = weight(abstract_txt:retrieval in 1910) [ClassicSimilarity], result of:
           0.043264516 = score(doc=1910,freq=1.0), product of:
             0.15929407 = queryWeight, product of:
               2.8901026 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015854193 = queryNorm
             0.27160156 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.22064662 = weight(abstract_txt:relevance in 1910) [ClassicSimilarity], result of:
           0.22064662 = score(doc=1910,freq=5.0), product of:
             0.25622207 = queryWeight, product of:
               3.2784362 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015854193 = queryNorm
             0.86115384 = fieldWeight in 1910, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.2398211 = weight(abstract_txt:metric in 1910) [ClassicSimilarity], result of:
           0.2398211 = score(doc=1910,freq=1.0), product of:
             0.420811 = queryWeight, product of:
               3.6385858 = boost
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.015854193 = queryNorm
             0.5699022 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
       0.32 = coord(8/25)
   

4. Hobson, S.P.; Dorr, B.J.; Monz, C.; Schwartz, R.: Task-based evaluation of text summarization using Relevance Prediction (2007) 0.22

   0.21899348 = sum of:
     0.21899348 = product of:
       0.68435466 = sum of:
         0.013611458 = weight(abstract_txt:using in 1938) [ClassicSimilarity], result of:
           0.013611458 = score(doc=1938,freq=1.0), product of:
             0.063000135 = queryWeight, product of:
               1.1495138 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.015854193 = queryNorm
             0.21605442 = fieldWeight in 1938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.0625 = fieldNorm(doc=1938)
         0.051303003 = weight(abstract_txt:evaluation in 1938) [ClassicSimilarity], result of:
           0.051303003 = score(doc=1938,freq=3.0), product of:
             0.10579371 = queryWeight, product of:
               1.4896127 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.015854193 = queryNorm
             0.48493436 = fieldWeight in 1938, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=1938)
         0.027608816 = weight(abstract_txt:based in 1938) [ClassicSimilarity], result of:
           0.027608816 = score(doc=1938,freq=3.0), product of:
             0.08012356 = queryWeight, product of:
               1.5877028 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.015854193 = queryNorm
             0.344578 = fieldWeight in 1938, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=1938)
         0.12966089 = weight(abstract_txt:measure in 1938) [ClassicSimilarity], result of:
           0.12966089 = score(doc=1938,freq=6.0), product of:
             0.15579754 = queryWeight, product of:
               1.8076892 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.015854193 = queryNorm
             0.8322396 = fieldWeight in 1938, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.0625 = fieldNorm(doc=1938)
         0.04351584 = weight(abstract_txt:tools in 1938) [ClassicSimilarity], result of:
           0.04351584 = score(doc=1938,freq=1.0), product of:
             0.15650699 = queryWeight, product of:
               2.218993 = boost
               4.448705 = idf(docFreq=1411, maxDocs=44421)
               0.015854193 = queryNorm
             0.27804407 = fieldWeight in 1938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.448705 = idf(docFreq=1411, maxDocs=44421)
               0.0625 = fieldNorm(doc=1938)
         0.068915896 = weight(abstract_txt:performance in 1938) [ClassicSimilarity], result of:
           0.068915896 = score(doc=1938,freq=2.0), product of:
             0.16877383 = queryWeight, product of:
               2.304314 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015854193 = queryNorm
             0.40833285 = fieldWeight in 1938, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=1938)
         0.15788186 = weight(abstract_txt:relevance in 1938) [ClassicSimilarity], result of:
           0.15788186 = score(doc=1938,freq=4.0), product of:
             0.25622207 = queryWeight, product of:
               3.2784362 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015854193 = queryNorm
             0.6161915 = fieldWeight in 1938, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1938)
         0.19185689 = weight(abstract_txt:metric in 1938) [ClassicSimilarity], result of:
           0.19185689 = score(doc=1938,freq=1.0), product of:
             0.420811 = queryWeight, product of:
               3.6385858 = boost
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.015854193 = queryNorm
             0.45592177 = fieldWeight in 1938, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.0625 = fieldNorm(doc=1938)
       0.32 = coord(8/25)
   

5. Gao, R.; Ge, Y.; Sha, C.: FAIR: Fairness-aware information retrieval evaluation (2022) 0.22

   0.21550824 = sum of:
     0.21550824 = product of:
       0.7696723 = sum of:
         0.09453718 = weight(abstract_txt:metrics in 1670) [ClassicSimilarity], result of:
           0.09453718 = score(doc=1670,freq=4.0), product of:
             0.11466833 = queryWeight, product of:
               1.096605 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.015854193 = queryNorm
             0.82444024 = fieldWeight in 1670, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=1670)
         0.022542503 = weight(abstract_txt:based in 1670) [ClassicSimilarity], result of:
           0.022542503 = score(doc=1670,freq=2.0), product of:
             0.08012356 = queryWeight, product of:
               1.5877028 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.015854193 = queryNorm
             0.28134674 = fieldWeight in 1670, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=1670)
         0.016154714 = weight(abstract_txt:information in 1670) [ClassicSimilarity], result of:
           0.016154714 = score(doc=1670,freq=3.0), product of:
             0.061693702 = queryWeight, product of:
               1.6087141 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015854193 = queryNorm
             0.26185355 = fieldWeight in 1670, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=1670)
         0.052933834 = weight(abstract_txt:measure in 1670) [ClassicSimilarity], result of:
           0.052933834 = score(doc=1670,freq=1.0), product of:
             0.15579754 = queryWeight, product of:
               1.8076892 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.015854193 = queryNorm
             0.3397604 = fieldWeight in 1670, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.0625 = fieldNorm(doc=1670)
         0.034611616 = weight(abstract_txt:retrieval in 1670) [ClassicSimilarity], result of:
           0.034611616 = score(doc=1670,freq=1.0), product of:
             0.15929407 = queryWeight, product of:
               2.8901026 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.015854193 = queryNorm
             0.21728125 = fieldWeight in 1670, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1670)
         0.07894093 = weight(abstract_txt:relevance in 1670) [ClassicSimilarity], result of:
           0.07894093 = score(doc=1670,freq=1.0), product of:
             0.25622207 = queryWeight, product of:
               3.2784362 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015854193 = queryNorm
             0.30809575 = fieldWeight in 1670, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1670)
         0.4699515 = weight(abstract_txt:metric in 1670) [ClassicSimilarity], result of:
           0.4699515 = score(doc=1670,freq=6.0), product of:
             0.420811 = queryWeight, product of:
               3.6385858 = boost
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.015854193 = queryNorm
             1.1167758 = fieldWeight in 1670, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.0625 = fieldNorm(doc=1670)
       0.28 = coord(7/25)