Document (#30226)

Author

Kekäläinen, J.
Järvelin, K.

Title

Using graded relevance assessments in IR evaluation

Source

Journal of the American Society for Information Science and technology. 53(2002) no.13, S.1120-xxxx

Year

2002

Abstract

Kekalainen and Jarvelin use what they term generalized, nonbinary recall and precision measures where recall is the sum of the relevance scores of the retrieved documents divided by the sum of relevance scores of all documents in the data base, and precision is the sum of the relevance scores of the retrieved documents divided by the number of documents where the relevance scores are real numbers between zero and one. Using the In-Query system and a text data base of 53,893 newspaper articles with 30 queries selected from those for which four relevance categories to provide recall measures were available, search results were evaluated by four judges. Searches were done by average key term weight, Boolean expression, and by average term weight where the terms are grouped by a synonym operator, and for each case with and without expansion of the original terms. Use of higher standards of relevance appears to increase the superiority of the best method. Some methods do a better job of getting the highly relevant documents but do not increase retrieval of marginal ones. There is evidence that generalized precision provides more equitable results, while binary precision provides undeserved merit to some methods. Generally graded relevance measures seem to provide additional insight into IR evaluation.

Theme

Retrievalstudien

Similar documents (author)

1. Järvelin, K.: ¬An analysis of two approaches in information retrieval : from frameworks to study designs (2007) 4.99

   4.9924345 = sum of:
     4.9924345 = weight(author_txt:järvelin in 1326) [ClassicSimilarity], result of:
       4.9924345 = fieldWeight in 1326, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.625 = fieldNorm(doc=1326)
   

2. Järvelin, K.: Evaluation (2011) 4.99

   4.9924345 = sum of:
     4.9924345 = weight(author_txt:järvelin in 1548) [ClassicSimilarity], result of:
       4.9924345 = fieldWeight in 1548, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.625 = fieldNorm(doc=1548)
   

3. Järvelin, K.; Vakkari, P.: ¬The evolution of library and information science 1965-1985 : a content analysis of journal titles (1993) 3.99

   3.9939477 = sum of:
     3.9939477 = weight(author_txt:järvelin in 4648) [ClassicSimilarity], result of:
       3.9939477 = fieldWeight in 4648, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.5 = fieldNorm(doc=4648)
   

4. Kristensen, J.; Järvelin, K.: ¬The effectiveness of a searching thesaurus in free-text searching in a full-text database (1990) 3.99

   3.9939477 = sum of:
     3.9939477 = weight(author_txt:järvelin in 2111) [ClassicSimilarity], result of:
       3.9939477 = fieldWeight in 2111, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.5 = fieldNorm(doc=2111)
   

5. Pirkola, A.; Järvelin, K.: Employing the resolution power of search keys (2001) 3.99

   3.9939477 = sum of:
     3.9939477 = weight(author_txt:järvelin in 6907) [ClassicSimilarity], result of:
       3.9939477 = fieldWeight in 6907, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.9878955 = idf(docFreq=40, maxDocs=44421)
         0.5 = fieldNorm(doc=6907)
   

Similar documents (content)

1. Talvensaari, T.; Juhola, M.; Laurikkala, J.; Järvelin, K.: Corpus-based cross-language information retrieval in retrieval of highly relevant documents (2007) 0.49

   0.49268812 = sum of:
     0.49268812 = product of:
       1.1197457 = sum of:
         0.026975503 = weight(abstract_txt:methods in 1139) [ClassicSimilarity], result of:
           0.026975503 = score(doc=1139,freq=2.0), product of:
             0.07365633 = queryWeight, product of:
               1.0062184 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.017666614 = queryNorm
             0.3662347 = fieldWeight in 1139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.04436519 = weight(abstract_txt:were in 1139) [ClassicSimilarity], result of:
           0.04436519 = score(doc=1139,freq=5.0), product of:
             0.08655836 = queryWeight, product of:
               1.3359413 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.017666614 = queryNorm
             0.5125466 = fieldWeight in 1139, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.0497888 = weight(abstract_txt:retrieved in 1139) [ClassicSimilarity], result of:
           0.0497888 = score(doc=1139,freq=1.0), product of:
             0.13963516 = queryWeight, product of:
               1.3854301 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.017666614 = queryNorm
             0.35656348 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.055136785 = weight(abstract_txt:average in 1139) [ClassicSimilarity], result of:
           0.055136785 = score(doc=1139,freq=1.0), product of:
             0.14946333 = queryWeight, product of:
               1.4333576 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.017666614 = queryNorm
             0.36889842 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.09462768 = weight(abstract_txt:generalized in 1139) [ClassicSimilarity], result of:
           0.09462768 = score(doc=1139,freq=1.0), product of:
             0.21424916 = queryWeight, product of:
               1.7161167 = boost
               7.0667386 = idf(docFreq=102, maxDocs=44421)
               0.017666614 = queryNorm
             0.44167116 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0667386 = idf(docFreq=102, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.10854224 = weight(abstract_txt:weight in 1139) [ClassicSimilarity], result of:
           0.10854224 = score(doc=1139,freq=1.0), product of:
             0.23476835 = queryWeight, product of:
               1.7964164 = boost
               7.3974023 = idf(docFreq=73, maxDocs=44421)
               0.017666614 = queryNorm
             0.46233764 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3974023 = idf(docFreq=73, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.07649673 = weight(abstract_txt:recall in 1139) [ClassicSimilarity], result of:
           0.07649673 = score(doc=1139,freq=1.0), product of:
             0.21282993 = queryWeight, product of:
               2.0948322 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017666614 = queryNorm
             0.35942656 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.17396228 = weight(abstract_txt:graded in 1139) [ClassicSimilarity], result of:
           0.17396228 = score(doc=1139,freq=1.0), product of:
             0.3215218 = queryWeight, product of:
               2.1022892 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.017666614 = queryNorm
             0.5410591 = fieldWeight in 1139, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.1050819 = weight(abstract_txt:documents in 1139) [ClassicSimilarity], result of:
           0.1050819 = score(doc=1139,freq=5.0), product of:
             0.18235414 = queryWeight, product of:
               2.5033123 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017666614 = queryNorm
             0.5762518 = fieldWeight in 1139, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.127807 = weight(abstract_txt:precision in 1139) [ClassicSimilarity], result of:
           0.127807 = score(doc=1139,freq=2.0), product of:
             0.26178423 = queryWeight, product of:
               2.6827116 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.017666614 = queryNorm
             0.4882151 = fieldWeight in 1139, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
         0.25696158 = weight(abstract_txt:relevance in 1139) [ClassicSimilarity], result of:
           0.25696158 = score(doc=1139,freq=4.0), product of:
             0.41701576 = queryWeight, product of:
               4.7884336 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017666614 = queryNorm
             0.6161915 = fieldWeight in 1139, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1139)
       0.44 = coord(11/25)
   

2. Huuskonen, S.; Vakkari, P.: Students' search process and outcome in Medline in writing an essay for a class on evidence-based medicine (2008) 0.38

   0.37783587 = sum of:
     0.37783587 = product of:
       0.9445897 = sum of:
         0.017525831 = weight(abstract_txt:provides in 2891) [ClassicSimilarity], result of:
           0.017525831 = score(doc=2891,freq=1.0), product of:
             0.07609464 = queryWeight, product of:
               1.0227377 = boost
               4.211497 = idf(docFreq=1789, maxDocs=44421)
               0.017666614 = queryNorm
             0.23031624 = fieldWeight in 2891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.211497 = idf(docFreq=1789, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.029827107 = weight(abstract_txt:evaluation in 2891) [ClassicSimilarity], result of:
           0.029827107 = score(doc=2891,freq=2.0), product of:
             0.086092584 = queryWeight, product of:
               1.0878527 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017666614 = queryNorm
             0.34645385 = fieldWeight in 2891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.056655895 = weight(abstract_txt:four in 2891) [ClassicSimilarity], result of:
           0.056655895 = score(doc=2891,freq=3.0), product of:
             0.11535187 = queryWeight, product of:
               1.259214 = boost
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.017666614 = queryNorm
             0.49115714 = fieldWeight in 2891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.034721255 = weight(abstract_txt:were in 2891) [ClassicSimilarity], result of:
           0.034721255 = score(doc=2891,freq=4.0), product of:
             0.08655836 = queryWeight, product of:
               1.3359413 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.017666614 = queryNorm
             0.40113115 = fieldWeight in 2891, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.07545714 = weight(abstract_txt:retrieved in 2891) [ClassicSimilarity], result of:
           0.07545714 = score(doc=2891,freq=3.0), product of:
             0.13963516 = queryWeight, product of:
               1.3854301 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.017666614 = queryNorm
             0.5403878 = fieldWeight in 2891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.079457045 = weight(abstract_txt:measures in 2891) [ClassicSimilarity], result of:
           0.079457045 = score(doc=2891,freq=2.0), product of:
             0.18938418 = queryWeight, product of:
               1.9760809 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.017666614 = queryNorm
             0.41955483 = fieldWeight in 2891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.16395572 = weight(abstract_txt:recall in 2891) [ClassicSimilarity], result of:
           0.16395572 = score(doc=2891,freq=6.0), product of:
             0.21282993 = queryWeight, product of:
               2.0948322 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017666614 = queryNorm
             0.77036023 = fieldWeight in 2891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.058152173 = weight(abstract_txt:documents in 2891) [ClassicSimilarity], result of:
           0.058152173 = score(doc=2891,freq=2.0), product of:
             0.18235414 = queryWeight, product of:
               2.5033123 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017666614 = queryNorm
             0.31889692 = fieldWeight in 2891, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.1936972 = weight(abstract_txt:precision in 2891) [ClassicSimilarity], result of:
           0.1936972 = score(doc=2891,freq=6.0), product of:
             0.26178423 = queryWeight, product of:
               2.6827116 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.017666614 = queryNorm
             0.7399117 = fieldWeight in 2891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.23514025 = weight(abstract_txt:scores in 2891) [ClassicSimilarity], result of:
           0.23514025 = score(doc=2891,freq=3.0), product of:
             0.37533802 = queryWeight, product of:
               3.2122808 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.017666614 = queryNorm
             0.626476 = fieldWeight in 2891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
       0.4 = coord(10/25)
   

3. Su, L.T.; Chen, H.L.: Evaluation of Web search engines by undergraduate students (1999) 0.35

   0.3459145 = sum of:
     0.3459145 = product of:
       0.86478627 = sum of:
         0.036530595 = weight(abstract_txt:evaluation in 546) [ClassicSimilarity], result of:
           0.036530595 = score(doc=546,freq=3.0), product of:
             0.086092584 = queryWeight, product of:
               1.0878527 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017666614 = queryNorm
             0.42431757 = fieldWeight in 546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.06542059 = weight(abstract_txt:four in 546) [ClassicSimilarity], result of:
           0.06542059 = score(doc=546,freq=4.0), product of:
             0.11535187 = queryWeight, product of:
               1.259214 = boost
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.017666614 = queryNorm
             0.5671394 = fieldWeight in 546, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.030069487 = weight(abstract_txt:were in 546) [ClassicSimilarity], result of:
           0.030069487 = score(doc=546,freq=3.0), product of:
             0.08655836 = queryWeight, product of:
               1.3359413 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.017666614 = queryNorm
             0.34738976 = fieldWeight in 546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.061610494 = weight(abstract_txt:retrieved in 546) [ClassicSimilarity], result of:
           0.061610494 = score(doc=546,freq=2.0), product of:
             0.13963516 = queryWeight, product of:
               1.3854301 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.017666614 = queryNorm
             0.44122478 = fieldWeight in 546, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.09731461 = weight(abstract_txt:measures in 546) [ClassicSimilarity], result of:
           0.09731461 = score(doc=546,freq=3.0), product of:
             0.18938418 = queryWeight, product of:
               1.9760809 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.017666614 = queryNorm
             0.51384765 = fieldWeight in 546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.06693464 = weight(abstract_txt:recall in 546) [ClassicSimilarity], result of:
           0.06693464 = score(doc=546,freq=1.0), product of:
             0.21282993 = queryWeight, product of:
               2.0948322 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017666614 = queryNorm
             0.31449825 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.041119795 = weight(abstract_txt:documents in 546) [ClassicSimilarity], result of:
           0.041119795 = score(doc=546,freq=1.0), product of:
             0.18235414 = queryWeight, product of:
               2.5033123 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017666614 = queryNorm
             0.22549418 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.07907656 = weight(abstract_txt:precision in 546) [ClassicSimilarity], result of:
           0.07907656 = score(doc=546,freq=1.0), product of:
             0.26178423 = queryWeight, product of:
               2.6827116 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.017666614 = queryNorm
             0.3020677 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.19199121 = weight(abstract_txt:scores in 546) [ClassicSimilarity], result of:
           0.19199121 = score(doc=546,freq=2.0), product of:
             0.37533802 = queryWeight, product of:
               3.2122808 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.017666614 = queryNorm
             0.5115155 = fieldWeight in 546, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.19471833 = weight(abstract_txt:relevance in 546) [ClassicSimilarity], result of:
           0.19471833 = score(doc=546,freq=3.0), product of:
             0.41701576 = queryWeight, product of:
               4.7884336 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017666614 = queryNorm
             0.46693277 = fieldWeight in 546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
       0.4 = coord(10/25)
   

4. Yang, L.; Ji, D.; Leong, M.: Document reranking by term distribution and maximal marginal relevance for chinese information retrieval (2007) 0.34

   0.33562312 = sum of:
     0.33562312 = product of:
       0.9322864 = sum of:
         0.0238432 = weight(abstract_txt:methods in 1907) [ClassicSimilarity], result of:
           0.0238432 = score(doc=1907,freq=1.0), product of:
             0.07365633 = queryWeight, product of:
               1.0062184 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.017666614 = queryNorm
             0.3237088 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.088015 = weight(abstract_txt:retrieved in 1907) [ClassicSimilarity], result of:
           0.088015 = score(doc=1907,freq=2.0), product of:
             0.13963516 = queryWeight, product of:
               1.3854301 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.017666614 = queryNorm
             0.63032115 = fieldWeight in 1907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.06892098 = weight(abstract_txt:average in 1907) [ClassicSimilarity], result of:
           0.06892098 = score(doc=1907,freq=1.0), product of:
             0.14946333 = queryWeight, product of:
               1.4333576 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.017666614 = queryNorm
             0.46112302 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.07837278 = weight(abstract_txt:term in 1907) [ClassicSimilarity], result of:
           0.07837278 = score(doc=1907,freq=2.0), product of:
             0.14794408 = queryWeight, product of:
               1.7465526 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.017666614 = queryNorm
             0.52974594 = fieldWeight in 1907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.1356778 = weight(abstract_txt:weight in 1907) [ClassicSimilarity], result of:
           0.1356778 = score(doc=1907,freq=1.0), product of:
             0.23476835 = queryWeight, product of:
               1.7964164 = boost
               7.3974023 = idf(docFreq=73, maxDocs=44421)
               0.017666614 = queryNorm
             0.57792205 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3974023 = idf(docFreq=73, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.09562091 = weight(abstract_txt:recall in 1907) [ClassicSimilarity], result of:
           0.09562091 = score(doc=1907,freq=1.0), product of:
             0.21282993 = queryWeight, product of:
               2.0948322 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017666614 = queryNorm
             0.44928318 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.10174511 = weight(abstract_txt:documents in 1907) [ClassicSimilarity], result of:
           0.10174511 = score(doc=1907,freq=3.0), product of:
             0.18235414 = queryWeight, product of:
               2.5033123 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017666614 = queryNorm
             0.55795336 = fieldWeight in 1907, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.11296651 = weight(abstract_txt:precision in 1907) [ClassicSimilarity], result of:
           0.11296651 = score(doc=1907,freq=1.0), product of:
             0.26178423 = queryWeight, product of:
               2.6827116 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.017666614 = queryNorm
             0.43152526 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.22712408 = weight(abstract_txt:relevance in 1907) [ClassicSimilarity], result of:
           0.22712408 = score(doc=1907,freq=2.0), product of:
             0.41701576 = queryWeight, product of:
               4.7884336 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017666614 = queryNorm
             0.5446415 = fieldWeight in 1907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
       0.36 = coord(9/25)
   

5. Kim, W.; Wilbur, W.J.: Corpus-based statistical screening for content-bearing terms (2001) 0.32

   0.32303235 = sum of:
     0.32303235 = product of:
       0.7341644 = sum of:
         0.024778582 = weight(abstract_txt:methods in 188) [ClassicSimilarity], result of:
           0.024778582 = score(doc=188,freq=3.0), product of:
             0.07365633 = queryWeight, product of:
               1.0062184 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.017666614 = queryNorm
             0.33640805 = fieldWeight in 188, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.028037397 = weight(abstract_txt:four in 188) [ClassicSimilarity], result of:
           0.028037397 = score(doc=188,freq=1.0), product of:
             0.11535187 = queryWeight, product of:
               1.259214 = boost
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.017666614 = queryNorm
             0.24305975 = fieldWeight in 188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.014880538 = weight(abstract_txt:were in 188) [ClassicSimilarity], result of:
           0.014880538 = score(doc=188,freq=1.0), product of:
             0.08655836 = queryWeight, product of:
               1.3359413 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.017666614 = queryNorm
             0.17191336 = fieldWeight in 188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.08270518 = weight(abstract_txt:average in 188) [ClassicSimilarity], result of:
           0.08270518 = score(doc=188,freq=4.0), product of:
             0.14946333 = queryWeight, product of:
               1.4333576 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.017666614 = queryNorm
             0.55334765 = fieldWeight in 188, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.05759199 = weight(abstract_txt:term in 188) [ClassicSimilarity], result of:
           0.05759199 = score(doc=188,freq=3.0), product of:
             0.14794408 = queryWeight, product of:
               1.7465526 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.017666614 = queryNorm
             0.38928217 = fieldWeight in 188, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.08140668 = weight(abstract_txt:weight in 188) [ClassicSimilarity], result of:
           0.08140668 = score(doc=188,freq=1.0), product of:
             0.23476835 = queryWeight, product of:
               1.7964164 = boost
               7.3974023 = idf(docFreq=73, maxDocs=44421)
               0.017666614 = queryNorm
             0.34675324 = fieldWeight in 188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3974023 = idf(docFreq=73, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.05737255 = weight(abstract_txt:recall in 188) [ClassicSimilarity], result of:
           0.05737255 = score(doc=188,freq=1.0), product of:
             0.21282993 = queryWeight, product of:
               2.0948322 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017666614 = queryNorm
             0.26956993 = fieldWeight in 188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.07881143 = weight(abstract_txt:documents in 188) [ClassicSimilarity], result of:
           0.07881143 = score(doc=188,freq=5.0), product of:
             0.18235414 = queryWeight, product of:
               2.5033123 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017666614 = queryNorm
             0.43218887 = fieldWeight in 188, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.09585526 = weight(abstract_txt:precision in 188) [ClassicSimilarity], result of:
           0.09585526 = score(doc=188,freq=2.0), product of:
             0.26178423 = queryWeight, product of:
               2.6827116 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.017666614 = queryNorm
             0.36616132 = fieldWeight in 188, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.11636425 = weight(abstract_txt:scores in 188) [ClassicSimilarity], result of:
           0.11636425 = score(doc=188,freq=1.0), product of:
             0.37533802 = queryWeight, product of:
               3.2122808 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.017666614 = queryNorm
             0.31002522 = fieldWeight in 188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
         0.09636059 = weight(abstract_txt:relevance in 188) [ClassicSimilarity], result of:
           0.09636059 = score(doc=188,freq=1.0), product of:
             0.41701576 = queryWeight, product of:
               4.7884336 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017666614 = queryNorm
             0.23107181 = fieldWeight in 188, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.046875 = fieldNorm(doc=188)
       0.44 = coord(11/25)