Document (#13221)

Author

Lesk, M.E.
Salton, G.

Title

Relevance assements and retrieval system evaluation

Source

Information storage and retrieval. 4(1969), S.343-359

Year

1969

Abstract

Two widerly used criteria for evaluating the effectiveness of information retrieval systems are, respectively, the recall and the precision. Since the determiniation of these measures is dependent on a distinction between documents which are relevant to a given query and documents which are not relevant to that query, it has sometimes been claimed that an accurate, generally valid evaluation cannot be based on recall and precision measure. A study was made to determine the effect of variations in relevance assesments do not produce significant variations in average recall and precision. It thus appears that properly computed recall and precision data may represent effectiveness indicators which are gemerally valid for many distinct user classes.

Theme

Retrievalstudien

Object

SMART

Similar documents (author)

1. Salton, G.: Another look at automatic text-retrieval systems (1986) 4.87

   4.8655405 = sum of:
     4.8655405 = weight(author_txt:salton in 1356) [ClassicSimilarity], result of:
       4.8655405 = fieldWeight in 1356, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.7848644 = idf(docFreq=49, maxDocs=44218)
         0.625 = fieldNorm(doc=1356)
   

2. Salton, G.: ¬A new comparison between conventional indexing (MEDLARS) and automatic text processing (SMART) (1972) 4.87

   4.8655405 = sum of:
     4.8655405 = weight(author_txt:salton in 2325) [ClassicSimilarity], result of:
       4.8655405 = fieldWeight in 2325, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.7848644 = idf(docFreq=49, maxDocs=44218)
         0.625 = fieldNorm(doc=2325)
   

3. Salton, G.: Future prospects for text-based information retrieval (1990) 4.87

   4.8655405 = sum of:
     4.8655405 = weight(author_txt:salton in 2327) [ClassicSimilarity], result of:
       4.8655405 = fieldWeight in 2327, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.7848644 = idf(docFreq=49, maxDocs=44218)
         0.625 = fieldNorm(doc=2327)
   

4. Salton, G.: Fast document classification in automatic information retrieval (1978) 4.87

   4.8655405 = sum of:
     4.8655405 = weight(author_txt:salton in 2331) [ClassicSimilarity], result of:
       4.8655405 = fieldWeight in 2331, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.7848644 = idf(docFreq=49, maxDocs=44218)
         0.625 = fieldNorm(doc=2331)
   

5. Salton, G.: Expert systems and information retrieval (1987) 4.87

   4.8655405 = sum of:
     4.8655405 = weight(author_txt:salton in 2837) [ClassicSimilarity], result of:
       4.8655405 = fieldWeight in 2837, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.7848644 = idf(docFreq=49, maxDocs=44218)
         0.625 = fieldNorm(doc=2837)
   

Similar documents (content)

1. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.44

   0.44348657 = sum of:
     0.44348657 = product of:
       1.2319071 = sum of:
         0.053048667 = weight(abstract_txt:retrieval in 3308) [ClassicSimilarity], result of:
           0.053048667 = score(doc=3308,freq=4.0), product of:
             0.08141436 = queryWeight, product of:
               1.1648276 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020112548 = queryNorm
             0.6515886 = fieldWeight in 3308, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.044241652 = weight(abstract_txt:documents in 3308) [ClassicSimilarity], result of:
           0.044241652 = score(doc=3308,freq=1.0), product of:
             0.11450529 = queryWeight, product of:
               1.3814143 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.020112548 = queryNorm
             0.38637212 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.023523442 = weight(abstract_txt:which in 3308) [ClassicSimilarity], result of:
           0.023523442 = score(doc=3308,freq=1.0), product of:
             0.086027175 = queryWeight, product of:
               1.4664749 = boost
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.020112548 = queryNorm
             0.273442 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.057059187 = weight(abstract_txt:evaluation in 3308) [ClassicSimilarity], result of:
           0.057059187 = score(doc=3308,freq=1.0), product of:
             0.13567142 = queryWeight, product of:
               1.5036798 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020112548 = queryNorm
             0.42056894 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.1857088 = weight(abstract_txt:relevance in 3308) [ClassicSimilarity], result of:
           0.1857088 = score(doc=3308,freq=6.0), product of:
             0.16397434 = queryWeight, product of:
               1.6531 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.020112548 = queryNorm
             1.132548 = fieldWeight in 3308, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.08375754 = weight(abstract_txt:effectiveness in 3308) [ClassicSimilarity], result of:
           0.08375754 = score(doc=3308,freq=1.0), product of:
             0.1752349 = queryWeight, product of:
               1.708919 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.020112548 = queryNorm
             0.47797295 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.3312019 = weight(abstract_txt:variations in 3308) [ClassicSimilarity], result of:
           0.3312019 = score(doc=3308,freq=3.0), product of:
             0.30382684 = queryWeight, product of:
               2.2502162 = boost
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.020112548 = queryNorm
             1.0901009 = fieldWeight in 3308, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.2132056 = weight(abstract_txt:precision in 3308) [ClassicSimilarity], result of:
           0.2132056 = score(doc=3308,freq=1.0), product of:
             0.41160476 = queryWeight, product of:
               3.7039607 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.020112548 = queryNorm
             0.51798624 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.24016032 = weight(abstract_txt:recall in 3308) [ClassicSimilarity], result of:
           0.24016032 = score(doc=3308,freq=1.0), product of:
             0.44560373 = queryWeight, product of:
               3.8539011 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.020112548 = queryNorm
             0.5389549 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
       0.36 = coord(9/25)
   

2. Kekäläinen, J.; Järvelin, K.: Using graded relevance assessments in IR evaluation (2002) 0.43

   0.43389443 = sum of:
     0.43389443 = product of:
       0.9861237 = sum of:
         0.057812788 = weight(abstract_txt:appears in 5225) [ClassicSimilarity], result of:
           0.057812788 = score(doc=5225,freq=1.0), product of:
             0.14234366 = queryWeight, product of:
               1.0890937 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.020112548 = queryNorm
             0.4061494 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.01768289 = weight(abstract_txt:retrieval in 5225) [ClassicSimilarity], result of:
           0.01768289 = score(doc=5225,freq=1.0), product of:
             0.08141436 = queryWeight, product of:
               1.1648276 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020112548 = queryNorm
             0.21719621 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.008407837 = weight(abstract_txt:that in 5225) [ClassicSimilarity], result of:
           0.008407837 = score(doc=5225,freq=1.0), product of:
             0.05677434 = queryWeight, product of:
               1.1913321 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020112548 = queryNorm
             0.1480922 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.06595156 = weight(abstract_txt:documents in 5225) [ClassicSimilarity], result of:
           0.06595156 = score(doc=5225,freq=5.0), product of:
             0.11450529 = queryWeight, product of:
               1.3814143 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.020112548 = queryNorm
             0.5759696 = fieldWeight in 5225, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.015682295 = weight(abstract_txt:which in 5225) [ClassicSimilarity], result of:
           0.015682295 = score(doc=5225,freq=1.0), product of:
             0.086027175 = queryWeight, product of:
               1.4664749 = boost
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.020112548 = queryNorm
             0.18229467 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.038039457 = weight(abstract_txt:evaluation in 5225) [ClassicSimilarity], result of:
           0.038039457 = score(doc=5225,freq=1.0), product of:
             0.13567142 = queryWeight, product of:
               1.5036798 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020112548 = queryNorm
             0.2803793 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.041970212 = weight(abstract_txt:relevant in 5225) [ClassicSimilarity], result of:
           0.041970212 = score(doc=5225,freq=1.0), product of:
             0.14486371 = queryWeight, product of:
               1.5537852 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.020112548 = queryNorm
             0.28972206 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.04526365 = weight(abstract_txt:query in 5225) [ClassicSimilarity], result of:
           0.04526365 = score(doc=5225,freq=1.0), product of:
             0.1523463 = queryWeight, product of:
               1.5934085 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.020112548 = queryNorm
             0.2971103 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.13372561 = weight(abstract_txt:relevance in 5225) [ClassicSimilarity], result of:
           0.13372561 = score(doc=5225,freq=7.0), product of:
             0.16397434 = queryWeight, product of:
               1.6531 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.020112548 = queryNorm
             0.8155277 = fieldWeight in 5225, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.28427413 = weight(abstract_txt:precision in 5225) [ClassicSimilarity], result of:
           0.28427413 = score(doc=5225,freq=4.0), product of:
             0.41160476 = queryWeight, product of:
               3.7039607 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.020112548 = queryNorm
             0.6906483 = fieldWeight in 5225, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.27731323 = weight(abstract_txt:recall in 5225) [ClassicSimilarity], result of:
           0.27731323 = score(doc=5225,freq=3.0), product of:
             0.44560373 = queryWeight, product of:
               3.8539011 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.020112548 = queryNorm
             0.6223315 = fieldWeight in 5225, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
       0.44 = coord(11/25)
   

3. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.35

   0.34864298 = sum of:
     0.34864298 = product of:
       0.9684527 = sum of:
         0.07824943 = weight(abstract_txt:respectively in 5515) [ClassicSimilarity], result of:
           0.07824943 = score(doc=5515,freq=1.0), product of:
             0.15009618 = queryWeight, product of:
               1.1183584 = boost
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.020112548 = queryNorm
             0.5213286 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.044207223 = weight(abstract_txt:retrieval in 5515) [ClassicSimilarity], result of:
           0.044207223 = score(doc=5515,freq=4.0), product of:
             0.08141436 = queryWeight, product of:
               1.1648276 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020112548 = queryNorm
             0.5429905 = fieldWeight in 5515, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.010509796 = weight(abstract_txt:that in 5515) [ClassicSimilarity], result of:
           0.010509796 = score(doc=5515,freq=1.0), product of:
             0.05677434 = queryWeight, product of:
               1.1913321 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020112548 = queryNorm
             0.18511525 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.052139286 = weight(abstract_txt:documents in 5515) [ClassicSimilarity], result of:
           0.052139286 = score(doc=5515,freq=2.0), product of:
             0.11450529 = queryWeight, product of:
               1.3814143 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.020112548 = queryNorm
             0.4553439 = fieldWeight in 5515, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.052462764 = weight(abstract_txt:relevant in 5515) [ClassicSimilarity], result of:
           0.052462764 = score(doc=5515,freq=1.0), product of:
             0.14486371 = queryWeight, product of:
               1.5537852 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.020112548 = queryNorm
             0.36215258 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.06317942 = weight(abstract_txt:relevance in 5515) [ClassicSimilarity], result of:
           0.06317942 = score(doc=5515,freq=1.0), product of:
             0.16397434 = queryWeight, product of:
               1.6531 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.020112548 = queryNorm
             0.38530064 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.06979795 = weight(abstract_txt:effectiveness in 5515) [ClassicSimilarity], result of:
           0.06979795 = score(doc=5515,freq=1.0), product of:
             0.1752349 = queryWeight, product of:
               1.708919 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.020112548 = queryNorm
             0.39831078 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.25126523 = weight(abstract_txt:precision in 5515) [ClassicSimilarity], result of:
           0.25126523 = score(doc=5515,freq=2.0), product of:
             0.41160476 = queryWeight, product of:
               3.7039607 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.020112548 = queryNorm
             0.61045265 = fieldWeight in 5515, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.34664157 = weight(abstract_txt:recall in 5515) [ClassicSimilarity], result of:
           0.34664157 = score(doc=5515,freq=3.0), product of:
             0.44560373 = queryWeight, product of:
               3.8539011 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.020112548 = queryNorm
             0.7779144 = fieldWeight in 5515, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
       0.36 = coord(9/25)
   

4. Raghavan, V.V.; Jung, G.S.; Bollmann, P.: ¬A critical investigation of recall and precision as measures of retrieval system performance (1989) 0.35

   0.3464748 = sum of:
     0.3464748 = product of:
       1.0827338 = sum of:
         0.061890114 = weight(abstract_txt:retrieval in 3606) [ClassicSimilarity], result of:
           0.061890114 = score(doc=3606,freq=4.0), product of:
             0.08141436 = queryWeight, product of:
               1.1648276 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020112548 = queryNorm
             0.76018673 = fieldWeight in 3606, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.109375 = fieldNorm(doc=3606)
         0.014713715 = weight(abstract_txt:that in 3606) [ClassicSimilarity], result of:
           0.014713715 = score(doc=3606,freq=1.0), product of:
             0.05677434 = queryWeight, product of:
               1.1913321 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020112548 = queryNorm
             0.25916135 = fieldWeight in 3606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.109375 = fieldNorm(doc=3606)
         0.05161526 = weight(abstract_txt:documents in 3606) [ClassicSimilarity], result of:
           0.05161526 = score(doc=3606,freq=1.0), product of:
             0.11450529 = queryWeight, product of:
               1.3814143 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.020112548 = queryNorm
             0.45076746 = fieldWeight in 3606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.109375 = fieldNorm(doc=3606)
         0.06656905 = weight(abstract_txt:evaluation in 3606) [ClassicSimilarity], result of:
           0.06656905 = score(doc=3606,freq=1.0), product of:
             0.13567142 = queryWeight, product of:
               1.5036798 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.020112548 = queryNorm
             0.49066377 = fieldWeight in 3606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.109375 = fieldNorm(doc=3606)
         0.07921139 = weight(abstract_txt:query in 3606) [ClassicSimilarity], result of:
           0.07921139 = score(doc=3606,freq=1.0), product of:
             0.1523463 = queryWeight, product of:
               1.5934085 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.020112548 = queryNorm
             0.519943 = fieldWeight in 3606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.109375 = fieldNorm(doc=3606)
         0.097717136 = weight(abstract_txt:effectiveness in 3606) [ClassicSimilarity], result of:
           0.097717136 = score(doc=3606,freq=1.0), product of:
             0.1752349 = queryWeight, product of:
               1.708919 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.020112548 = queryNorm
             0.5576351 = fieldWeight in 3606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.109375 = fieldNorm(doc=3606)
         0.4308301 = weight(abstract_txt:precision in 3606) [ClassicSimilarity], result of:
           0.4308301 = score(doc=3606,freq=3.0), product of:
             0.41160476 = queryWeight, product of:
               3.7039607 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.020112548 = queryNorm
             1.0467082 = fieldWeight in 3606, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.109375 = fieldNorm(doc=3606)
         0.28018704 = weight(abstract_txt:recall in 3606) [ClassicSimilarity], result of:
           0.28018704 = score(doc=3606,freq=1.0), product of:
             0.44560373 = queryWeight, product of:
               3.8539011 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.020112548 = queryNorm
             0.6287807 = fieldWeight in 3606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.109375 = fieldNorm(doc=3606)
       0.32 = coord(8/25)
   

5. Fox, E.; Betrabet, S.; Koushik, M.; Lee, W.: Extended Boolean models (1992) 0.34

   0.33506832 = sum of:
     0.33506832 = product of:
       0.8376708 = sum of:
         0.031259228 = weight(abstract_txt:retrieval in 3512) [ClassicSimilarity], result of:
           0.031259228 = score(doc=3512,freq=2.0), product of:
             0.08141436 = queryWeight, product of:
               1.1648276 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.020112548 = queryNorm
             0.38395226 = fieldWeight in 3512, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.010509796 = weight(abstract_txt:that in 3512) [ClassicSimilarity], result of:
           0.010509796 = score(doc=3512,freq=1.0), product of:
             0.05677434 = queryWeight, product of:
               1.1913321 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.020112548 = queryNorm
             0.18511525 = fieldWeight in 3512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.036868043 = weight(abstract_txt:documents in 3512) [ClassicSimilarity], result of:
           0.036868043 = score(doc=3512,freq=1.0), product of:
             0.11450529 = queryWeight, product of:
               1.3814143 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.020112548 = queryNorm
             0.32197678 = fieldWeight in 3512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.019602869 = weight(abstract_txt:which in 3512) [ClassicSimilarity], result of:
           0.019602869 = score(doc=3512,freq=1.0), product of:
             0.086027175 = queryWeight, product of:
               1.4664749 = boost
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.020112548 = queryNorm
             0.22786833 = fieldWeight in 3512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.052462764 = weight(abstract_txt:relevant in 3512) [ClassicSimilarity], result of:
           0.052462764 = score(doc=3512,freq=1.0), product of:
             0.14486371 = queryWeight, product of:
               1.5537852 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.020112548 = queryNorm
             0.36215258 = fieldWeight in 3512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.08001559 = weight(abstract_txt:query in 3512) [ClassicSimilarity], result of:
           0.08001559 = score(doc=3512,freq=2.0), product of:
             0.1523463 = queryWeight, product of:
               1.5934085 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.020112548 = queryNorm
             0.52522177 = fieldWeight in 3512, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.06979795 = weight(abstract_txt:effectiveness in 3512) [ClassicSimilarity], result of:
           0.06979795 = score(doc=3512,freq=1.0), product of:
             0.1752349 = queryWeight, product of:
               1.708919 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.020112548 = queryNorm
             0.39831078 = fieldWeight in 3512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.15934959 = weight(abstract_txt:variations in 3512) [ClassicSimilarity], result of:
           0.15934959 = score(doc=3512,freq=1.0), product of:
             0.30382684 = queryWeight, product of:
               2.2502162 = boost
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.020112548 = queryNorm
             0.52447504 = fieldWeight in 3512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.17767133 = weight(abstract_txt:precision in 3512) [ClassicSimilarity], result of:
           0.17767133 = score(doc=3512,freq=1.0), product of:
             0.41160476 = queryWeight, product of:
               3.7039607 = boost
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.020112548 = queryNorm
             0.4316552 = fieldWeight in 3512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5251865 = idf(docFreq=478, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
         0.20013359 = weight(abstract_txt:recall in 3512) [ClassicSimilarity], result of:
           0.20013359 = score(doc=3512,freq=1.0), product of:
             0.44560373 = queryWeight, product of:
               3.8539011 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.020112548 = queryNorm
             0.44912907 = fieldWeight in 3512, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.078125 = fieldNorm(doc=3512)
       0.4 = coord(10/25)