Document (#27559)

Author

Egghe, L.

Title

¬A universal method of information retrieval evaluation : the "missing" link M and the universal IR surface

Source

Information processing and management. 40(2004) no.1, S.21-30

Year

2004

Abstract

The paper shows that the present evaluation methods in information retrieval (basically recall R and precision P and in some cases fallout F ) lack universal comparability in the sense that their values depend on the generality of the IR problem. A solution is given by using all "parts" of the database, including the non-relevant documents and also the not-retrieved documents. It turns out that the solution is given by introducing the measure M being the fraction of the not-retrieved documents that are relevant (hence the "miss" measure). We prove that - independent of the IR problem or of the IR action - the quadruple (P,R,F,M) belongs to a universal IR surface, being the same for all IR-activities. This universality is then exploited by defining a new measure for evaluation in IR allowing for unbiased comparisons of all IR results. We also show that only using one, two or even three measures from the set {P,R,F,M} necessary leads to evaluation measures that are non-universal and hence not capable of comparing different IR situations.

Similar documents (author)

1. Egghe, L.: Little science, big science and beyond (1994) 4.74

   4.744121 = sum of:
     4.744121 = weight(author_txt:egghe in 6882) [ClassicSimilarity], result of:
       4.744121 = fieldWeight in 6882, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.590594 = idf(docFreq=60, maxDocs=44421)
         0.625 = fieldNorm(doc=6882)
   

2. Egghe, L.: Expansion of the field of informetrics : the second special issue (2006) 4.74

   4.744121 = sum of:
     4.744121 = weight(author_txt:egghe in 7118) [ClassicSimilarity], result of:
       4.744121 = fieldWeight in 7118, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.590594 = idf(docFreq=60, maxDocs=44421)
         0.625 = fieldNorm(doc=7118)
   

3. Egghe, L.: Expansion of the field of informetrics : origins and consequences (2005) 4.74

   4.744121 = sum of:
     4.744121 = weight(author_txt:egghe in 1978) [ClassicSimilarity], result of:
       4.744121 = fieldWeight in 1978, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.590594 = idf(docFreq=60, maxDocs=44421)
         0.625 = fieldNorm(doc=1978)
   

4. Egghe, L.: ¬The amount of actions needed for shelving and reshelving (1996) 4.74

   4.744121 = sum of:
     4.744121 = weight(author_txt:egghe in 4462) [ClassicSimilarity], result of:
       4.744121 = fieldWeight in 4462, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.590594 = idf(docFreq=60, maxDocs=44421)
         0.625 = fieldNorm(doc=4462)
   

5. Egghe, L.: Special features of the author - publication relationship and a new explanation of Lotka's law based on convolution theory (1994) 4.74

   4.744121 = sum of:
     4.744121 = weight(author_txt:egghe in 5136) [ClassicSimilarity], result of:
       4.744121 = fieldWeight in 5136, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.590594 = idf(docFreq=60, maxDocs=44421)
         0.625 = fieldNorm(doc=5136)
   

Similar documents (content)

1. Egghe, L.: Existence theorem of the quadruple (P, R, F, M) : precision, recall, fallout and miss (2007) 0.32

   0.31531972 = sum of:
     0.31531972 = product of:
       0.9853741 = sum of:
         0.18001498 = weight(abstract_txt:miss in 3011) [ClassicSimilarity], result of:
           0.18001498 = score(doc=3011,freq=3.0), product of:
             0.19312719 = queryWeight, product of:
               1.1660955 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.019234668 = queryNorm
             0.93210584 = fieldWeight in 3011, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.047732897 = weight(abstract_txt:given in 3011) [ClassicSimilarity], result of:
           0.047732897 = score(doc=3011,freq=2.0), product of:
             0.11496261 = queryWeight, product of:
               1.2723475 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.019234668 = queryNorm
             0.4152037 = fieldWeight in 3011, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.24209592 = weight(abstract_txt:fallout in 3011) [ClassicSimilarity], result of:
           0.24209592 = score(doc=3011,freq=3.0), product of:
             0.23530398 = queryWeight, product of:
               1.2871437 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.019234668 = queryNorm
             1.0288645 = fieldWeight in 3011, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.051982988 = weight(abstract_txt:measures in 3011) [ClassicSimilarity], result of:
           0.051982988 = score(doc=3011,freq=1.0), product of:
             0.15331885 = queryWeight, product of:
               1.4693497 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.019234668 = queryNorm
             0.3390515 = fieldWeight in 3011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.14240706 = weight(abstract_txt:surface in 3011) [ClassicSimilarity], result of:
           0.14240706 = score(doc=3011,freq=1.0), product of:
             0.30017585 = queryWeight, product of:
               2.0559628 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.019234668 = queryNorm
             0.4744121 = fieldWeight in 3011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.030148104 = weight(abstract_txt:that in 3011) [ClassicSimilarity], result of:
           0.030148104 = score(doc=3011,freq=4.0), product of:
             0.101983696 = queryWeight, product of:
               2.2419546 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.019234668 = queryNorm
             0.2956169 = fieldWeight in 3011, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.05854115 = weight(abstract_txt:evaluation in 3011) [ClassicSimilarity], result of:
           0.05854115 = score(doc=3011,freq=1.0), product of:
             0.2090927 = queryWeight, product of:
               2.4266763 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.019234668 = queryNorm
             0.279977 = fieldWeight in 3011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.23245093 = weight(abstract_txt:universal in 3011) [ClassicSimilarity], result of:
           0.23245093 = score(doc=3011,freq=2.0), product of:
             0.44827613 = queryWeight, product of:
               3.9725578 = boost
               5.866657 = idf(docFreq=341, maxDocs=44421)
               0.019234668 = queryNorm
             0.5185441 = fieldWeight in 3011, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.866657 = idf(docFreq=341, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
       0.32 = coord(8/25)
   

2. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.28

   0.28129923 = sum of:
     0.28129923 = product of:
       0.78138673 = sum of:
         0.13427669 = weight(abstract_txt:generality in 5514) [ClassicSimilarity], result of:
           0.13427669 = score(doc=5514,freq=1.0), product of:
             0.19742636 = queryWeight, product of:
               1.1790032 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.019234668 = queryNorm
             0.68013555 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.040394988 = weight(abstract_txt:relevant in 5514) [ClassicSimilarity], result of:
           0.040394988 = score(doc=5514,freq=1.0), product of:
             0.111677684 = queryWeight, product of:
               1.2540377 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.019234668 = queryNorm
             0.3617105 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.042190325 = weight(abstract_txt:given in 5514) [ClassicSimilarity], result of:
           0.042190325 = score(doc=5514,freq=1.0), product of:
             0.11496261 = queryWeight, product of:
               1.2723475 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.019234668 = queryNorm
             0.3669917 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.17471766 = weight(abstract_txt:fallout in 5514) [ClassicSimilarity], result of:
           0.17471766 = score(doc=5514,freq=1.0), product of:
             0.23530398 = queryWeight, product of:
               1.2871437 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.019234668 = queryNorm
             0.74251896 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.06497873 = weight(abstract_txt:measures in 5514) [ClassicSimilarity], result of:
           0.06497873 = score(doc=5514,freq=1.0), product of:
             0.15331885 = queryWeight, product of:
               1.4693497 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.019234668 = queryNorm
             0.4238144 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.07557615 = weight(abstract_txt:retrieved in 5514) [ClassicSimilarity], result of:
           0.07557615 = score(doc=5514,freq=1.0), product of:
             0.16956566 = queryWeight, product of:
               1.5452415 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.019234668 = queryNorm
             0.44570434 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.060528833 = weight(abstract_txt:documents in 5514) [ClassicSimilarity], result of:
           0.060528833 = score(doc=5514,freq=2.0), product of:
             0.13286483 = queryWeight, product of:
               1.675244 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019234668 = queryNorm
             0.455567 = fieldWeight in 5514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.1698808 = weight(abstract_txt:measure in 5514) [ClassicSimilarity], result of:
           0.1698808 = score(doc=5514,freq=3.0), product of:
             0.23094094 = queryWeight, product of:
               2.2086327 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.019234668 = queryNorm
             0.73560286 = fieldWeight in 5514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.018842565 = weight(abstract_txt:that in 5514) [ClassicSimilarity], result of:
           0.018842565 = score(doc=5514,freq=1.0), product of:
             0.101983696 = queryWeight, product of:
               2.2419546 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.019234668 = queryNorm
             0.18476056 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
       0.36 = coord(9/25)
   

3. Egghe, L.: ¬The measures precision, recall, fallout and miss as a function of the number of retrieved documents and their mutual interrelations (2008) 0.19

   0.19476788 = sum of:
     0.19476788 = product of:
       0.81153286 = sum of:
         0.25457963 = weight(abstract_txt:miss in 3067) [ClassicSimilarity], result of:
           0.25457963 = score(doc=3067,freq=6.0), product of:
             0.19312719 = queryWeight, product of:
               1.1660955 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.019234668 = queryNorm
             1.3181968 = fieldWeight in 3067, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
         0.34237534 = weight(abstract_txt:fallout in 3067) [ClassicSimilarity], result of:
           0.34237534 = score(doc=3067,freq=6.0), product of:
             0.23530398 = queryWeight, product of:
               1.2871437 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.019234668 = queryNorm
             1.4550341 = fieldWeight in 3067, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
         0.07351504 = weight(abstract_txt:measures in 3067) [ClassicSimilarity], result of:
           0.07351504 = score(doc=3067,freq=2.0), product of:
             0.15331885 = queryWeight, product of:
               1.4693497 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.019234668 = queryNorm
             0.47949123 = fieldWeight in 3067, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
         0.08550466 = weight(abstract_txt:retrieved in 3067) [ClassicSimilarity], result of:
           0.08550466 = score(doc=3067,freq=2.0), product of:
             0.16956566 = queryWeight, product of:
               1.5452415 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.019234668 = queryNorm
             0.5042569 = fieldWeight in 3067, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
         0.03424028 = weight(abstract_txt:documents in 3067) [ClassicSimilarity], result of:
           0.03424028 = score(doc=3067,freq=1.0), product of:
             0.13286483 = queryWeight, product of:
               1.675244 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019234668 = queryNorm
             0.25770763 = fieldWeight in 3067, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
         0.021317929 = weight(abstract_txt:that in 3067) [ClassicSimilarity], result of:
           0.021317929 = score(doc=3067,freq=2.0), product of:
             0.101983696 = queryWeight, product of:
               2.2419546 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.019234668 = queryNorm
             0.20903271 = fieldWeight in 3067, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
       0.24 = coord(6/25)
   

4. Robertson, S.E.: ¬The parametric description of retrieval tests : Part II: Overall measures (1969) 0.19

   0.19366156 = sum of:
     0.19366156 = product of:
       0.80692315 = sum of:
         0.1009978 = weight(abstract_txt:turns in 4224) [ClassicSimilarity], result of:
           0.1009978 = score(doc=4224,freq=1.0), product of:
             0.1632849 = queryWeight, product of:
               1.0722238 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.019234668 = queryNorm
             0.6185373 = fieldWeight in 4224, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.13427669 = weight(abstract_txt:generality in 4224) [ClassicSimilarity], result of:
           0.13427669 = score(doc=4224,freq=1.0), product of:
             0.19742636 = queryWeight, product of:
               1.1790032 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.019234668 = queryNorm
             0.68013555 = fieldWeight in 4224, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.24708807 = weight(abstract_txt:fallout in 4224) [ClassicSimilarity], result of:
           0.24708807 = score(doc=4224,freq=2.0), product of:
             0.23530398 = queryWeight, product of:
               1.2871437 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.019234668 = queryNorm
             1.0500803 = fieldWeight in 4224, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.11254648 = weight(abstract_txt:measures in 4224) [ClassicSimilarity], result of:
           0.11254648 = score(doc=4224,freq=3.0), product of:
             0.15331885 = queryWeight, product of:
               1.4693497 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.019234668 = queryNorm
             0.7340681 = fieldWeight in 4224, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.1698808 = weight(abstract_txt:measure in 4224) [ClassicSimilarity], result of:
           0.1698808 = score(doc=4224,freq=3.0), product of:
             0.23094094 = queryWeight, product of:
               2.2086327 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.019234668 = queryNorm
             0.73560286 = fieldWeight in 4224, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.042133257 = weight(abstract_txt:that in 4224) [ClassicSimilarity], result of:
           0.042133257 = score(doc=4224,freq=5.0), product of:
             0.101983696 = queryWeight, product of:
               2.2419546 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.019234668 = queryNorm
             0.4131372 = fieldWeight in 4224, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
       0.24 = coord(6/25)
   

5. Fricke, M.: Measuring recall (1998) 0.18

   0.18097357 = sum of:
     0.18097357 = product of:
       0.6463342 = sum of:
         0.056552984 = weight(abstract_txt:relevant in 4802) [ClassicSimilarity], result of:
           0.056552984 = score(doc=4802,freq=1.0), product of:
             0.111677684 = queryWeight, product of:
               1.2540377 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.019234668 = queryNorm
             0.5063947 = fieldWeight in 4802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.109375 = fieldNorm(doc=4802)
         0.10580661 = weight(abstract_txt:retrieved in 4802) [ClassicSimilarity], result of:
           0.10580661 = score(doc=4802,freq=1.0), product of:
             0.16956566 = queryWeight, product of:
               1.5452415 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.019234668 = queryNorm
             0.62398607 = fieldWeight in 4802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.109375 = fieldNorm(doc=4802)
         0.059920494 = weight(abstract_txt:documents in 4802) [ClassicSimilarity], result of:
           0.059920494 = score(doc=4802,freq=1.0), product of:
             0.13286483 = queryWeight, product of:
               1.675244 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019234668 = queryNorm
             0.45098835 = fieldWeight in 4802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.109375 = fieldNorm(doc=4802)
         0.15791446 = weight(abstract_txt:hence in 4802) [ClassicSimilarity], result of:
           0.15791446 = score(doc=4802,freq=1.0), product of:
             0.22145082 = queryWeight, product of:
               1.7658998 = boost
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.019234668 = queryNorm
             0.7130904 = fieldWeight in 4802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.519684 = idf(docFreq=177, maxDocs=44421)
               0.109375 = fieldNorm(doc=4802)
         0.13731302 = weight(abstract_txt:measure in 4802) [ClassicSimilarity], result of:
           0.13731302 = score(doc=4802,freq=1.0), product of:
             0.23094094 = queryWeight, product of:
               2.2086327 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.019234668 = queryNorm
             0.5945807 = fieldWeight in 4802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.109375 = fieldNorm(doc=4802)
         0.02637959 = weight(abstract_txt:that in 4802) [ClassicSimilarity], result of:
           0.02637959 = score(doc=4802,freq=1.0), product of:
             0.101983696 = queryWeight, product of:
               2.2419546 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.019234668 = queryNorm
             0.2586648 = fieldWeight in 4802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=4802)
         0.10244701 = weight(abstract_txt:evaluation in 4802) [ClassicSimilarity], result of:
           0.10244701 = score(doc=4802,freq=1.0), product of:
             0.2090927 = queryWeight, product of:
               2.4266763 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.019234668 = queryNorm
             0.48995975 = fieldWeight in 4802, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.109375 = fieldNorm(doc=4802)
       0.28 = coord(7/25)