Document (#13220)

Author

Lesk, M.E.
Salton, G.

Title

Relevance assements and retrieval system evaluation

Source

Information storage and retrieval. 4(1969), S.343-359

Year

1969

Abstract

Two widerly used criteria for evaluating the effectiveness of information retrieval systems are, respectively, the recall and the precision. Since the determiniation of these measures is dependent on a distinction between documents which are relevant to a given query and documents which are not relevant to that query, it has sometimes been claimed that an accurate, generally valid evaluation cannot be based on recall and precision measure. A study was made to determine the effect of variations in relevance assesments do not produce significant variations in average recall and precision. It thus appears that properly computed recall and precision data may represent effectiveness indicators which are gemerally valid for many distinct user classes.

Theme

Retrievalstudien

Object

SMART

Similar documents (author)

1. Salton, G.: Another look at automatic text-retrieval systems (1986) 4.87

   4.8684025 = sum of:
     4.8684025 = weight(author_txt:salton in 1355) [ClassicSimilarity], result of:
       4.8684025 = score(doc=1355,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.12837885 = queryNorm
         4.868403 = fieldWeight in 1355, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.625 = fieldNorm(doc=1355)
   

2. Salton, G.: ¬A new comparison between conventional indexing (MEDLARS) and automatic text processing (SMART) (1972) 4.87

   4.8684025 = sum of:
     4.8684025 = weight(author_txt:salton in 2324) [ClassicSimilarity], result of:
       4.8684025 = score(doc=2324,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.12837885 = queryNorm
         4.868403 = fieldWeight in 2324, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.625 = fieldNorm(doc=2324)
   

3. Salton, G.: Future prospects for text-based information retrieval (1990) 4.87

   4.8684025 = sum of:
     4.8684025 = weight(author_txt:salton in 2326) [ClassicSimilarity], result of:
       4.8684025 = score(doc=2326,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.12837885 = queryNorm
         4.868403 = fieldWeight in 2326, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.625 = fieldNorm(doc=2326)
   

4. Salton, G.: Fast document classification in automatic information retrieval (1978) 4.87

   4.8684025 = sum of:
     4.8684025 = weight(author_txt:salton in 2330) [ClassicSimilarity], result of:
       4.8684025 = score(doc=2330,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.12837885 = queryNorm
         4.868403 = fieldWeight in 2330, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.625 = fieldNorm(doc=2330)
   

5. Salton, G.: Expert systems and information retrieval (1987) 4.87

   4.8684025 = sum of:
     4.8684025 = weight(author_txt:salton in 2836) [ClassicSimilarity], result of:
       4.8684025 = score(doc=2836,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.12837885 = queryNorm
         4.868403 = fieldWeight in 2836, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.7894444 = idf(docFreq=49, maxDocs=44421)
           0.625 = fieldNorm(doc=2836)
   

Similar documents (content)

1. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.44

   0.4429132 = sum of:
     0.4429132 = product of:
       1.2303144 = sum of:
         0.053164516 = weight(abstract_txt:retrieval in 3307) [ClassicSimilarity], result of:
           0.053164516 = score(doc=3307,freq=4.0), product of:
             0.08156021 = queryWeight, product of:
               1.1675384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020093933 = queryNorm
             0.6518438 = fieldWeight in 3307, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.044351358 = weight(abstract_txt:documents in 3307) [ClassicSimilarity], result of:
           0.044351358 = score(doc=3307,freq=1.0), product of:
             0.11473301 = queryWeight, product of:
               1.3847654 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.020093933 = queryNorm
             0.38656145 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.02347636 = weight(abstract_txt:which in 3307) [ClassicSimilarity], result of:
           0.02347636 = score(doc=3307,freq=1.0), product of:
             0.085941195 = queryWeight, product of:
               1.4678386 = boost
               2.9137893 = idf(docFreq=6552, maxDocs=44421)
               0.020093933 = queryNorm
             0.27316773 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9137893 = idf(docFreq=6552, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.05687117 = weight(abstract_txt:evaluation in 3307) [ClassicSimilarity], result of:
           0.05687117 = score(doc=3307,freq=1.0), product of:
             0.13541867 = queryWeight, product of:
               1.5044276 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020093933 = queryNorm
             0.4199655 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.18563418 = weight(abstract_txt:relevance in 3307) [ClassicSimilarity], result of:
           0.18563418 = score(doc=3307,freq=6.0), product of:
             0.16398545 = queryWeight, product of:
               1.6555208 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.020093933 = queryNorm
             1.1320162 = fieldWeight in 3307, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.083733015 = weight(abstract_txt:effectiveness in 3307) [ClassicSimilarity], result of:
           0.083733015 = score(doc=3307,freq=1.0), product of:
             0.17525952 = queryWeight, product of:
               1.7114838 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.020093933 = queryNorm
             0.4777659 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.32920623 = weight(abstract_txt:variations in 3307) [ClassicSimilarity], result of:
           0.32920623 = score(doc=3307,freq=3.0), product of:
             0.30270672 = queryWeight, product of:
               2.2492774 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.020093933 = queryNorm
             1.0875418 = fieldWeight in 3307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.21322775 = weight(abstract_txt:precision in 3307) [ClassicSimilarity], result of:
           0.21322775 = score(doc=3307,freq=1.0), product of:
             0.41177148 = queryWeight, product of:
               3.7100103 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.020093933 = queryNorm
             0.5178303 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.24064985 = weight(abstract_txt:recall in 3307) [ClassicSimilarity], result of:
           0.24064985 = score(doc=3307,freq=1.0), product of:
             0.44635886 = queryWeight, product of:
               3.862683 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.020093933 = queryNorm
             0.53913987 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
       0.36 = coord(9/25)
   

2. Kekäläinen, J.; Järvelin, K.: Using graded relevance assessments in IR evaluation (2002) 0.43

   0.43412986 = sum of:
     0.43412986 = product of:
       0.9866588 = sum of:
         0.057846215 = weight(abstract_txt:appears in 225) [ClassicSimilarity], result of:
           0.057846215 = score(doc=225,freq=1.0), product of:
             0.14244632 = queryWeight, product of:
               1.0910449 = boost
               6.497461 = idf(docFreq=181, maxDocs=44421)
               0.020093933 = queryNorm
             0.4060913 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.497461 = idf(docFreq=181, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.017721504 = weight(abstract_txt:retrieval in 225) [ClassicSimilarity], result of:
           0.017721504 = score(doc=225,freq=1.0), product of:
             0.08156021 = queryWeight, product of:
               1.1675384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020093933 = queryNorm
             0.21728125 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.008368024 = weight(abstract_txt:that in 225) [ClassicSimilarity], result of:
           0.008368024 = score(doc=225,freq=1.0), product of:
             0.056613974 = queryWeight, product of:
               1.1913502 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020093933 = queryNorm
             0.14780845 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.0661151 = weight(abstract_txt:documents in 225) [ClassicSimilarity], result of:
           0.0661151 = score(doc=225,freq=5.0), product of:
             0.11473301 = queryWeight, product of:
               1.3847654 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.020093933 = queryNorm
             0.5762518 = fieldWeight in 225, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.015650908 = weight(abstract_txt:which in 225) [ClassicSimilarity], result of:
           0.015650908 = score(doc=225,freq=1.0), product of:
             0.085941195 = queryWeight, product of:
               1.4678386 = boost
               2.9137893 = idf(docFreq=6552, maxDocs=44421)
               0.020093933 = queryNorm
             0.18211183 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9137893 = idf(docFreq=6552, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.037914112 = weight(abstract_txt:evaluation in 225) [ClassicSimilarity], result of:
           0.037914112 = score(doc=225,freq=1.0), product of:
             0.13541867 = queryWeight, product of:
               1.5044276 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020093933 = queryNorm
             0.279977 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.041858833 = weight(abstract_txt:relevant in 225) [ClassicSimilarity], result of:
           0.041858833 = score(doc=225,freq=1.0), product of:
             0.14465585 = queryWeight, product of:
               1.5548912 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.020093933 = queryNorm
             0.2893684 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.045330048 = weight(abstract_txt:query in 225) [ClassicSimilarity], result of:
           0.045330048 = score(doc=225,freq=1.0), product of:
             0.15254644 = queryWeight, product of:
               1.5967357 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.020093933 = queryNorm
             0.29715574 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.13367186 = weight(abstract_txt:relevance in 225) [ClassicSimilarity], result of:
           0.13367186 = score(doc=225,freq=7.0), product of:
             0.16398545 = queryWeight, product of:
               1.6555208 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.020093933 = queryNorm
             0.8151447 = fieldWeight in 225, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.28430367 = weight(abstract_txt:precision in 225) [ClassicSimilarity], result of:
           0.28430367 = score(doc=225,freq=4.0), product of:
             0.41177148 = queryWeight, product of:
               3.7100103 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.020093933 = queryNorm
             0.6904404 = fieldWeight in 225, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.2778785 = weight(abstract_txt:recall in 225) [ClassicSimilarity], result of:
           0.2778785 = score(doc=225,freq=3.0), product of:
             0.44635886 = queryWeight, product of:
               3.862683 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.020093933 = queryNorm
             0.62254506 = fieldWeight in 225, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
       0.44 = coord(11/25)
   

3. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.35

   0.34898996 = sum of:
     0.34898996 = product of:
       0.9694165 = sum of:
         0.078489676 = weight(abstract_txt:respectively in 5514) [ClassicSimilarity], result of:
           0.078489676 = score(doc=5514,freq=1.0), product of:
             0.15045373 = queryWeight, product of:
               1.1212914 = boost
               6.677587 = idf(docFreq=151, maxDocs=44421)
               0.020093933 = queryNorm
             0.5216865 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.677587 = idf(docFreq=151, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.04430376 = weight(abstract_txt:retrieval in 5514) [ClassicSimilarity], result of:
           0.04430376 = score(doc=5514,freq=4.0), product of:
             0.08156021 = queryWeight, product of:
               1.1675384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020093933 = queryNorm
             0.5432031 = fieldWeight in 5514, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.010460029 = weight(abstract_txt:that in 5514) [ClassicSimilarity], result of:
           0.010460029 = score(doc=5514,freq=1.0), product of:
             0.056613974 = queryWeight, product of:
               1.1913502 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020093933 = queryNorm
             0.18476056 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.052268572 = weight(abstract_txt:documents in 5514) [ClassicSimilarity], result of:
           0.052268572 = score(doc=5514,freq=2.0), product of:
             0.11473301 = queryWeight, product of:
               1.3847654 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.020093933 = queryNorm
             0.455567 = fieldWeight in 5514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.05232354 = weight(abstract_txt:relevant in 5514) [ClassicSimilarity], result of:
           0.05232354 = score(doc=5514,freq=1.0), product of:
             0.14465585 = queryWeight, product of:
               1.5548912 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.020093933 = queryNorm
             0.3617105 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.06315402 = weight(abstract_txt:relevance in 5514) [ClassicSimilarity], result of:
           0.06315402 = score(doc=5514,freq=1.0), product of:
             0.16398545 = queryWeight, product of:
               1.6555208 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.020093933 = queryNorm
             0.38511968 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.06977751 = weight(abstract_txt:effectiveness in 5514) [ClassicSimilarity], result of:
           0.06977751 = score(doc=5514,freq=1.0), product of:
             0.17525952 = queryWeight, product of:
               1.7114838 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.020093933 = queryNorm
             0.39813823 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.2512913 = weight(abstract_txt:precision in 5514) [ClassicSimilarity], result of:
           0.2512913 = score(doc=5514,freq=2.0), product of:
             0.41177148 = queryWeight, product of:
               3.7100103 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.020093933 = queryNorm
             0.61026883 = fieldWeight in 5514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.34734812 = weight(abstract_txt:recall in 5514) [ClassicSimilarity], result of:
           0.34734812 = score(doc=5514,freq=3.0), product of:
             0.44635886 = queryWeight, product of:
               3.862683 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.020093933 = queryNorm
             0.7781813 = fieldWeight in 5514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
       0.36 = coord(9/25)
   

4. Raghavan, V.V.; Jung, G.S.; Bollmann, P.: ¬A critical investigation of recall and precision as measures of retrieval system performance (1989) 0.35

   0.3466916 = sum of:
     0.3466916 = product of:
       1.0834113 = sum of:
         0.062025268 = weight(abstract_txt:retrieval in 3674) [ClassicSimilarity], result of:
           0.062025268 = score(doc=3674,freq=4.0), product of:
             0.08156021 = queryWeight, product of:
               1.1675384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020093933 = queryNorm
             0.7604844 = fieldWeight in 3674, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=3674)
         0.014644042 = weight(abstract_txt:that in 3674) [ClassicSimilarity], result of:
           0.014644042 = score(doc=3674,freq=1.0), product of:
             0.056613974 = queryWeight, product of:
               1.1913502 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020093933 = queryNorm
             0.2586648 = fieldWeight in 3674, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=3674)
         0.05174325 = weight(abstract_txt:documents in 3674) [ClassicSimilarity], result of:
           0.05174325 = score(doc=3674,freq=1.0), product of:
             0.11473301 = queryWeight, product of:
               1.3847654 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.020093933 = queryNorm
             0.45098835 = fieldWeight in 3674, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.109375 = fieldNorm(doc=3674)
         0.0663497 = weight(abstract_txt:evaluation in 3674) [ClassicSimilarity], result of:
           0.0663497 = score(doc=3674,freq=1.0), product of:
             0.13541867 = queryWeight, product of:
               1.5044276 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.020093933 = queryNorm
             0.48995975 = fieldWeight in 3674, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.109375 = fieldNorm(doc=3674)
         0.07932758 = weight(abstract_txt:query in 3674) [ClassicSimilarity], result of:
           0.07932758 = score(doc=3674,freq=1.0), product of:
             0.15254644 = queryWeight, product of:
               1.5967357 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.020093933 = queryNorm
             0.5200225 = fieldWeight in 3674, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.109375 = fieldNorm(doc=3674)
         0.097688526 = weight(abstract_txt:effectiveness in 3674) [ClassicSimilarity], result of:
           0.097688526 = score(doc=3674,freq=1.0), product of:
             0.17525952 = queryWeight, product of:
               1.7114838 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.020093933 = queryNorm
             0.55739355 = fieldWeight in 3674, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.109375 = fieldNorm(doc=3674)
         0.43087485 = weight(abstract_txt:precision in 3674) [ClassicSimilarity], result of:
           0.43087485 = score(doc=3674,freq=3.0), product of:
             0.41177148 = queryWeight, product of:
               3.7100103 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.020093933 = queryNorm
             1.0463932 = fieldWeight in 3674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.109375 = fieldNorm(doc=3674)
         0.28075814 = weight(abstract_txt:recall in 3674) [ClassicSimilarity], result of:
           0.28075814 = score(doc=3674,freq=1.0), product of:
             0.44635886 = queryWeight, product of:
               3.862683 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.020093933 = queryNorm
             0.6289965 = fieldWeight in 3674, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.109375 = fieldNorm(doc=3674)
       0.32 = coord(8/25)
   

5. Fox, E.; Betrabet, S.; Koushik, M.; Lee, W.: Extended Boolean models (1992) 0.33

   0.33486614 = sum of:
     0.33486614 = product of:
       0.83716536 = sum of:
         0.03132749 = weight(abstract_txt:retrieval in 4512) [ClassicSimilarity], result of:
           0.03132749 = score(doc=4512,freq=2.0), product of:
             0.08156021 = queryWeight, product of:
               1.1675384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.020093933 = queryNorm
             0.3841026 = fieldWeight in 4512, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.010460029 = weight(abstract_txt:that in 4512) [ClassicSimilarity], result of:
           0.010460029 = score(doc=4512,freq=1.0), product of:
             0.056613974 = queryWeight, product of:
               1.1913502 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.020093933 = queryNorm
             0.18476056 = fieldWeight in 4512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.036959466 = weight(abstract_txt:documents in 4512) [ClassicSimilarity], result of:
           0.036959466 = score(doc=4512,freq=1.0), product of:
             0.11473301 = queryWeight, product of:
               1.3847654 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.020093933 = queryNorm
             0.32213452 = fieldWeight in 4512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.019563636 = weight(abstract_txt:which in 4512) [ClassicSimilarity], result of:
           0.019563636 = score(doc=4512,freq=1.0), product of:
             0.085941195 = queryWeight, product of:
               1.4678386 = boost
               2.9137893 = idf(docFreq=6552, maxDocs=44421)
               0.020093933 = queryNorm
             0.2276398 = fieldWeight in 4512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9137893 = idf(docFreq=6552, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.05232354 = weight(abstract_txt:relevant in 4512) [ClassicSimilarity], result of:
           0.05232354 = score(doc=4512,freq=1.0), product of:
             0.14465585 = queryWeight, product of:
               1.5548912 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.020093933 = queryNorm
             0.3617105 = fieldWeight in 4512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.080132954 = weight(abstract_txt:query in 4512) [ClassicSimilarity], result of:
           0.080132954 = score(doc=4512,freq=2.0), product of:
             0.15254644 = queryWeight, product of:
               1.5967357 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.020093933 = queryNorm
             0.52530205 = fieldWeight in 4512, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.06977751 = weight(abstract_txt:effectiveness in 4512) [ClassicSimilarity], result of:
           0.06977751 = score(doc=4512,freq=1.0), product of:
             0.17525952 = queryWeight, product of:
               1.7114838 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.020093933 = queryNorm
             0.39813823 = fieldWeight in 4512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.15838943 = weight(abstract_txt:variations in 4512) [ClassicSimilarity], result of:
           0.15838943 = score(doc=4512,freq=1.0), product of:
             0.30270672 = queryWeight, product of:
               2.2492774 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.020093933 = queryNorm
             0.52324384 = fieldWeight in 4512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.17768979 = weight(abstract_txt:precision in 4512) [ClassicSimilarity], result of:
           0.17768979 = score(doc=4512,freq=1.0), product of:
             0.41177148 = queryWeight, product of:
               3.7100103 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.020093933 = queryNorm
             0.43152526 = fieldWeight in 4512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
         0.20054153 = weight(abstract_txt:recall in 4512) [ClassicSimilarity], result of:
           0.20054153 = score(doc=4512,freq=1.0), product of:
             0.44635886 = queryWeight, product of:
               3.862683 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.020093933 = queryNorm
             0.44928318 = fieldWeight in 4512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=4512)
       0.4 = coord(10/25)