Document (#33037)

Author

Kekäläinen, J.

Title

Binary and graded relevance in IR evaluations : comparison of the effects on ranking of IR systems

Source

Information processing and management. 41(2005) no.5, S.1019-1034

Year

2005

Abstract

In this study the rankings of IR systems based on binary and graded relevance in TREC 7 and 8 data are compared. Relevance of a sample TREC results is reassessed using a relevance scale with four levels: non-relevant, marginally relevant, fairly relevant, highly relevant. Twenty-one topics and 90 systems from TREC 7 and 20 topics and 121 systems from TREC 8 form the data. Binary precision, and cumulated gain, discounted cumulated gain and normalised discounted cumulated gain are the measures compared. Different weighting schemes for relevance levels are tested with cumulated gain measures. Kendall's rank correlations are computed to determine to what extent the rankings produced by different measures are similar. Weighting schemes from binary to emphasising highly relevant documents form a continuum, where the measures correlate strongly in the binary end, and less in the heavily weighted end. The results show the different character of the measures.

Theme

Retrievalalgorithmen

Similar documents (content)

1. Sakai, T.: On the reliability of information retrieval metrics based on graded relevance (2007) 0.48

   0.47648963 = sum of:
     0.47648963 = product of:
       1.3235823 = sum of:
         0.0076498366 = weight(abstract_txt:from in 1910) [ClassicSimilarity], result of:
           0.0076498366 = score(doc=1910,freq=1.0), product of:
             0.03548523 = queryWeight, product of:
               1.0759101 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.011952456 = queryNorm
             0.21557805 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.10811528 = weight(abstract_txt:normalised in 1910) [ClassicSimilarity], result of:
           0.10811528 = score(doc=1910,freq=1.0), product of:
             0.14382371 = queryWeight, product of:
               1.2505665 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.011952456 = queryNorm
             0.7517208 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.039282814 = weight(abstract_txt:highly in 1910) [ClassicSimilarity], result of:
           0.039282814 = score(doc=1910,freq=1.0), product of:
             0.092267945 = queryWeight, product of:
               1.4165502 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.011952456 = queryNorm
             0.42574716 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.078810774 = weight(abstract_txt:rankings in 1910) [ClassicSimilarity], result of:
           0.078810774 = score(doc=1910,freq=1.0), product of:
             0.14677075 = queryWeight, product of:
               1.7865957 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.011952456 = queryNorm
             0.53696513 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.31494987 = weight(abstract_txt:graded in 1910) [ClassicSimilarity], result of:
           0.31494987 = score(doc=1910,freq=4.0), product of:
             0.23283954 = queryWeight, product of:
               2.2502713 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.011952456 = queryNorm
             1.3526477 = fieldWeight in 1910, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.1806544 = weight(abstract_txt:discounted in 1910) [ClassicSimilarity], result of:
           0.1806544 = score(doc=1910,freq=1.0), product of:
             0.25516132 = queryWeight, product of:
               2.3556674 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.011952456 = queryNorm
             0.7080008 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.16253972 = weight(abstract_txt:relevance in 1910) [ClassicSimilarity], result of:
           0.16253972 = score(doc=1910,freq=5.0), product of:
             0.18874644 = queryWeight, product of:
               3.203435 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011952456 = queryNorm
             0.86115384 = fieldWeight in 1910, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.19483618 = weight(abstract_txt:gain in 1910) [ClassicSimilarity], result of:
           0.19483618 = score(doc=1910,freq=2.0), product of:
             0.26834625 = queryWeight, product of:
               3.4164047 = boost
               6.571569 = idf(docFreq=168, maxDocs=44421)
               0.011952456 = queryNorm
             0.72606266 = fieldWeight in 1910, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.571569 = idf(docFreq=168, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
         0.2367435 = weight(abstract_txt:binary in 1910) [ClassicSimilarity], result of:
           0.2367435 = score(doc=1910,freq=1.0), product of:
             0.41471317 = queryWeight, product of:
               4.7484345 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.011952456 = queryNorm
             0.5708608 = fieldWeight in 1910, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.078125 = fieldNorm(doc=1910)
       0.36 = coord(9/25)
   

2. Della Mea, V.; Mizzaro, S.: Measuring retrieval effectiveness : a new proposal and a first experimental validation (2004) 0.25

   0.2505823 = sum of:
     0.2505823 = product of:
       0.8949368 = sum of:
         0.009179804 = weight(abstract_txt:from in 3263) [ClassicSimilarity], result of:
           0.009179804 = score(doc=3263,freq=1.0), product of:
             0.03548523 = queryWeight, product of:
               1.0759101 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.011952456 = queryNorm
             0.25869364 = fieldWeight in 3263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.0327006 = weight(abstract_txt:systems in 3263) [ClassicSimilarity], result of:
           0.0327006 = score(doc=3263,freq=2.0), product of:
             0.07230452 = queryWeight, product of:
               1.7733899 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.011952456 = queryNorm
             0.4522622 = fieldWeight in 3263, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.07226897 = weight(abstract_txt:relevant in 3263) [ClassicSimilarity], result of:
           0.07226897 = score(doc=3263,freq=1.0), product of:
             0.1664982 = queryWeight, product of:
               3.0087168 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.011952456 = queryNorm
             0.4340526 = fieldWeight in 3263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.08722796 = weight(abstract_txt:relevance in 3263) [ClassicSimilarity], result of:
           0.08722796 = score(doc=3263,freq=1.0), product of:
             0.18874644 = queryWeight, product of:
               3.203435 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011952456 = queryNorm
             0.46214363 = fieldWeight in 3263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.17554168 = weight(abstract_txt:trec in 3263) [ClassicSimilarity], result of:
           0.17554168 = score(doc=3263,freq=1.0), product of:
             0.27929196 = queryWeight, product of:
               3.485385 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.011952456 = queryNorm
             0.62852395 = fieldWeight in 3263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.11625072 = weight(abstract_txt:measures in 3263) [ClassicSimilarity], result of:
           0.11625072 = score(doc=3263,freq=1.0), product of:
             0.22858025 = queryWeight, product of:
               3.5252986 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.011952456 = queryNorm
             0.5085773 = fieldWeight in 3263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.40176705 = weight(abstract_txt:binary in 3263) [ClassicSimilarity], result of:
           0.40176705 = score(doc=3263,freq=2.0), product of:
             0.41471317 = queryWeight, product of:
               4.7484345 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.011952456 = queryNorm
             0.9687829 = fieldWeight in 3263, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
       0.28 = coord(7/25)
   

3. Ferro, N.; Silvello, G.; Keskustalo, H.; Pirkola, A.; Järvelin, K.: ¬The twist measure for IR evaluation : taking user's effort into account (2016) 0.24

   0.24475378 = sum of:
     0.24475378 = product of:
       0.67987156 = sum of:
         0.008654802 = weight(abstract_txt:from in 3771) [ClassicSimilarity], result of:
           0.008654802 = score(doc=3771,freq=2.0), product of:
             0.03548523 = queryWeight, product of:
               1.0759101 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.011952456 = queryNorm
             0.2438987 = fieldWeight in 3771, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
         0.014277325 = weight(abstract_txt:different in 3771) [ClassicSimilarity], result of:
           0.014277325 = score(doc=3771,freq=1.0), product of:
             0.06241909 = queryWeight, product of:
               1.426957 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.011952456 = queryNorm
             0.2287333 = fieldWeight in 3771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
         0.01541521 = weight(abstract_txt:systems in 3771) [ClassicSimilarity], result of:
           0.01541521 = score(doc=3771,freq=1.0), product of:
             0.07230452 = queryWeight, product of:
               1.7733899 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.011952456 = queryNorm
             0.21319844 = fieldWeight in 3771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
         0.12597995 = weight(abstract_txt:graded in 3771) [ClassicSimilarity], result of:
           0.12597995 = score(doc=3771,freq=1.0), product of:
             0.23283954 = queryWeight, product of:
               2.2502713 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.011952456 = queryNorm
             0.5410591 = fieldWeight in 3771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
         0.048179317 = weight(abstract_txt:relevant in 3771) [ClassicSimilarity], result of:
           0.048179317 = score(doc=3771,freq=1.0), product of:
             0.1664982 = queryWeight, product of:
               3.0087168 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.011952456 = queryNorm
             0.2893684 = fieldWeight in 3771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
         0.058151975 = weight(abstract_txt:relevance in 3771) [ClassicSimilarity], result of:
           0.058151975 = score(doc=3771,freq=1.0), product of:
             0.18874644 = queryWeight, product of:
               3.203435 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011952456 = queryNorm
             0.30809575 = fieldWeight in 3771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
         0.11021599 = weight(abstract_txt:gain in 3771) [ClassicSimilarity], result of:
           0.11021599 = score(doc=3771,freq=1.0), product of:
             0.26834625 = queryWeight, product of:
               3.4164047 = boost
               6.571569 = idf(docFreq=168, maxDocs=44421)
               0.011952456 = queryNorm
             0.41072306 = fieldWeight in 3771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.571569 = idf(docFreq=168, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
         0.10960223 = weight(abstract_txt:measures in 3771) [ClassicSimilarity], result of:
           0.10960223 = score(doc=3771,freq=2.0), product of:
             0.22858025 = queryWeight, product of:
               3.5252986 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.011952456 = queryNorm
             0.47949123 = fieldWeight in 3771, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
         0.1893948 = weight(abstract_txt:binary in 3771) [ClassicSimilarity], result of:
           0.1893948 = score(doc=3771,freq=1.0), product of:
             0.41471317 = queryWeight, product of:
               4.7484345 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.011952456 = queryNorm
             0.45668864 = fieldWeight in 3771, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.0625 = fieldNorm(doc=3771)
       0.36 = coord(9/25)
   

4. Talvensaari, T.; Juhola, M.; Laurikkala, J.; Järvelin, K.: Corpus-based cross-language information retrieval in retrieval of highly relevant documents (2007) 0.22

   0.2209147 = sum of:
     0.2209147 = product of:
       0.55228674 = sum of:
         0.006119869 = weight(abstract_txt:from in 1139) [ClassicSimilarity], result of:
           0.006119869 = score(doc=1139,freq=1.0), product of:
             0.03548523 = queryWeight, product of:
               1.0759101 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.011952456 = queryNorm
             0.17246243 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.02440958 = weight(abstract_txt:compared in 1139) [ClassicSimilarity], result of:
           0.02440958 = score(doc=1139,freq=1.0), product of:
             0.077964336 = queryWeight, product of:
               1.3021306 = boost
               5.0093837 = idf(docFreq=805, maxDocs=44421)
               0.011952456 = queryNorm
             0.31308648 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0093837 = idf(docFreq=805, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.02752114 = weight(abstract_txt:levels in 1139) [ClassicSimilarity], result of:
           0.02752114 = score(doc=1139,freq=1.0), product of:
             0.08445656 = queryWeight, product of:
               1.3552619 = boost
               5.2137837 = idf(docFreq=656, maxDocs=44421)
               0.011952456 = queryNorm
             0.32586148 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2137837 = idf(docFreq=656, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.0628525 = weight(abstract_txt:highly in 1139) [ClassicSimilarity], result of:
           0.0628525 = score(doc=1139,freq=4.0), product of:
             0.092267945 = queryWeight, product of:
               1.4165502 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.011952456 = queryNorm
             0.68119544 = fieldWeight in 1139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.014277325 = weight(abstract_txt:different in 1139) [ClassicSimilarity], result of:
           0.014277325 = score(doc=1139,freq=1.0), product of:
             0.06241909 = queryWeight, product of:
               1.426957 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.011952456 = queryNorm
             0.2287333 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.01541521 = weight(abstract_txt:systems in 1139) [ClassicSimilarity], result of:
           0.01541521 = score(doc=1139,freq=1.0), product of:
             0.07230452 = queryWeight, product of:
               1.7733899 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.011952456 = queryNorm
             0.21319844 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.063048616 = weight(abstract_txt:rankings in 1139) [ClassicSimilarity], result of:
           0.063048616 = score(doc=1139,freq=1.0), product of:
             0.14677075 = queryWeight, product of:
               1.7865957 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.011952456 = queryNorm
             0.4295721 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.12597995 = weight(abstract_txt:graded in 1139) [ClassicSimilarity], result of:
           0.12597995 = score(doc=1139,freq=1.0), product of:
             0.23283954 = queryWeight, product of:
               2.2502713 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.011952456 = queryNorm
             0.5410591 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.096358635 = weight(abstract_txt:relevant in 1139) [ClassicSimilarity], result of:
           0.096358635 = score(doc=1139,freq=4.0), product of:
             0.1664982 = queryWeight, product of:
               3.0087168 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.011952456 = queryNorm
             0.5787368 = fieldWeight in 1139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.11630395 = weight(abstract_txt:relevance in 1139) [ClassicSimilarity], result of:
           0.11630395 = score(doc=1139,freq=4.0), product of:
             0.18874644 = queryWeight, product of:
               3.203435 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011952456 = queryNorm
             0.6161915 = fieldWeight in 1139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
       0.4 = coord(10/25)
   

5. Kekäläinen, J.; Järvelin, K.: Using graded relevance assessments in IR evaluation (2002) 0.19

   0.19297338 = sum of:
     0.19297338 = product of:
       0.6891906 = sum of:
         0.006119869 = weight(abstract_txt:from in 225) [ClassicSimilarity], result of:
           0.006119869 = score(doc=225,freq=1.0), product of:
             0.03548523 = queryWeight, product of:
               1.0759101 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.011952456 = queryNorm
             0.17246243 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.03142625 = weight(abstract_txt:highly in 225) [ClassicSimilarity], result of:
           0.03142625 = score(doc=225,freq=1.0), product of:
             0.092267945 = queryWeight, product of:
               1.4165502 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.011952456 = queryNorm
             0.34059772 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.12597995 = weight(abstract_txt:graded in 225) [ClassicSimilarity], result of:
           0.12597995 = score(doc=225,freq=1.0), product of:
             0.23283954 = queryWeight, product of:
               2.2502713 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.011952456 = queryNorm
             0.5410591 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.048179317 = weight(abstract_txt:relevant in 225) [ClassicSimilarity], result of:
           0.048179317 = score(doc=225,freq=1.0), product of:
             0.1664982 = queryWeight, product of:
               3.0087168 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.011952456 = queryNorm
             0.2893684 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.15385567 = weight(abstract_txt:relevance in 225) [ClassicSimilarity], result of:
           0.15385567 = score(doc=225,freq=7.0), product of:
             0.18874644 = queryWeight, product of:
               3.203435 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.011952456 = queryNorm
             0.8151447 = fieldWeight in 225, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.13423477 = weight(abstract_txt:measures in 225) [ClassicSimilarity], result of:
           0.13423477 = score(doc=225,freq=3.0), product of:
             0.22858025 = queryWeight, product of:
               3.5252986 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.011952456 = queryNorm
             0.58725446 = fieldWeight in 225, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.1893948 = weight(abstract_txt:binary in 225) [ClassicSimilarity], result of:
           0.1893948 = score(doc=225,freq=1.0), product of:
             0.41471317 = queryWeight, product of:
               4.7484345 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.011952456 = queryNorm
             0.45668864 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
       0.28 = coord(7/25)