Document (#35654)

Author

Robertson, S.

Title

On the history of evaluation in IR

Source

Information science in transition, Ed.: A. Gilchrist

Imprint

London : Facet Publ.

Year

2009

Pages

S.63-93

Abstract

This paper is a personal take on the history of evaluation experiments in information retrieval. It describes some of the early experiments that were formative in our understanding, and goes on to discuss the current dominance of TREC (the Text REtrieval Conference) and to assess its impact.

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Robertson, M.A.: Windows 3.0 for the online searcher (1991) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 591) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 591, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=591)
   

2. Robertson, S.E.: Some recent theories and models in information retrieval (1980) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 1325) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 1325, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=1325)
   

3. Robertson, S.E.: Theories and models in information retrieval (1977) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 1843) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 1843, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=1843)
   

4. Robertson, S.E.: On term selection for query expansion (1990) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 2649) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 2649, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=2649)
   

5. Robertson, S.E.: On relevance weight estimation and query expansion (1986) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 3874) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 3874, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=3874)
   

Similar documents (content)

1. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.40

   0.39724353 = sum of:
     0.39724353 = product of:
       1.1034542 = sum of:
         0.012445435 = weight(abstract_txt:this in 877) [ClassicSimilarity], result of:
           0.012445435 = score(doc=877,freq=1.0), product of:
             0.033101834 = queryWeight, product of:
               1.0174633 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01352058 = queryNorm
             0.37597418 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.012642984 = weight(abstract_txt:information in 877) [ClassicSimilarity], result of:
           0.012642984 = score(doc=877,freq=1.0), product of:
             0.033451203 = queryWeight, product of:
               1.0228186 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01352058 = queryNorm
             0.37795305 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.058941968 = weight(abstract_txt:text in 877) [ClassicSimilarity], result of:
           0.058941968 = score(doc=877,freq=1.0), product of:
             0.09335303 = queryWeight, product of:
               1.7086651 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.01352058 = queryNorm
             0.6313878 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.085426316 = weight(abstract_txt:impact in 877) [ClassicSimilarity], result of:
           0.085426316 = score(doc=877,freq=1.0), product of:
             0.11955649 = queryWeight, product of:
               1.9336563 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.01352058 = queryNorm
             0.71452683 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.15384972 = weight(abstract_txt:conference in 877) [ClassicSimilarity], result of:
           0.15384972 = score(doc=877,freq=1.0), product of:
             0.17697415 = queryWeight, product of:
               2.3525975 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.01352058 = queryNorm
             0.86933446 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.26918304 = weight(abstract_txt:trec in 877) [ClassicSimilarity], result of:
           0.26918304 = score(doc=877,freq=1.0), product of:
             0.2569669 = queryWeight, product of:
               2.834858 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.01352058 = queryNorm
             1.0475398 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.13002099 = weight(abstract_txt:retrieval in 877) [ClassicSimilarity], result of:
           0.13002099 = score(doc=877,freq=3.0), product of:
             0.13819444 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.01352058 = queryNorm
             0.9408554 = fieldWeight in 877, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.16060278 = weight(abstract_txt:evaluation in 877) [ClassicSimilarity], result of:
           0.16060278 = score(doc=877,freq=1.0), product of:
             0.2294514 = queryWeight, product of:
               3.788376 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.01352058 = queryNorm
             0.69994247 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.220341 = weight(abstract_txt:history in 877) [ClassicSimilarity], result of:
           0.220341 = score(doc=877,freq=1.0), product of:
             0.28330368 = queryWeight, product of:
               4.2095323 = boost
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.01352058 = queryNorm
             0.7777555 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
       0.36 = coord(9/25)
   

2. Voorhees, E.M.; Harman, D.K.: ¬The Text REtrieval Conference (2005) 0.38

   0.38293344 = sum of:
     0.38293344 = product of:
       0.7364105 = sum of:
         0.0059077735 = weight(abstract_txt:that in 82) [ClassicSimilarity], result of:
           0.0059077735 = score(doc=82,freq=4.0), product of:
             0.031975295 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01352058 = queryNorm
             0.18476056 = fieldWeight in 82, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.0062227175 = weight(abstract_txt:this in 82) [ClassicSimilarity], result of:
           0.0062227175 = score(doc=82,freq=4.0), product of:
             0.033101834 = queryWeight, product of:
               1.0174633 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01352058 = queryNorm
             0.18798709 = fieldWeight in 82, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.0070676436 = weight(abstract_txt:information in 82) [ClassicSimilarity], result of:
           0.0070676436 = score(doc=82,freq=5.0), product of:
             0.033451203 = queryWeight, product of:
               1.0228186 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01352058 = queryNorm
             0.2112822 = fieldWeight in 82, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.011116637 = weight(abstract_txt:some in 82) [ClassicSimilarity], result of:
           0.011116637 = score(doc=82,freq=1.0), product of:
             0.07736318 = queryWeight, product of:
               1.5554637 = boost
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.01352058 = queryNorm
             0.14369416 = fieldWeight in 82, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.012525861 = weight(abstract_txt:describes in 82) [ClassicSimilarity], result of:
           0.012525861 = score(doc=82,freq=1.0), product of:
             0.083770365 = queryWeight, product of:
               1.618594 = boost
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.01352058 = queryNorm
             0.14952616 = fieldWeight in 82, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.02552262 = weight(abstract_txt:text in 82) [ClassicSimilarity], result of:
           0.02552262 = score(doc=82,freq=3.0), product of:
             0.09335303 = queryWeight, product of:
               1.7086651 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.01352058 = queryNorm
             0.27339894 = fieldWeight in 82, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.021356579 = weight(abstract_txt:impact in 82) [ClassicSimilarity], result of:
           0.021356579 = score(doc=82,freq=1.0), product of:
             0.11955649 = queryWeight, product of:
               1.9336563 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.01352058 = queryNorm
             0.17863171 = fieldWeight in 82, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.06661888 = weight(abstract_txt:conference in 82) [ClassicSimilarity], result of:
           0.06661888 = score(doc=82,freq=3.0), product of:
             0.17697415 = queryWeight, product of:
               2.3525975 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.01352058 = queryNorm
             0.37643287 = fieldWeight in 82, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.27746755 = weight(abstract_txt:trec in 82) [ClassicSimilarity], result of:
           0.27746755 = score(doc=82,freq=17.0), product of:
             0.2569669 = queryWeight, product of:
               2.834858 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.01352058 = queryNorm
             1.0797794 = fieldWeight in 82, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.07021936 = weight(abstract_txt:retrieval in 82) [ClassicSimilarity], result of:
           0.07021936 = score(doc=82,freq=14.0), product of:
             0.13819444 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.01352058 = queryNorm
             0.50812 = fieldWeight in 82, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.06954305 = weight(abstract_txt:evaluation in 82) [ClassicSimilarity], result of:
           0.06954305 = score(doc=82,freq=3.0), product of:
             0.2294514 = queryWeight, product of:
               3.788376 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.01352058 = queryNorm
             0.303084 = fieldWeight in 82, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.09541045 = weight(abstract_txt:history in 82) [ClassicSimilarity], result of:
           0.09541045 = score(doc=82,freq=3.0), product of:
             0.28330368 = queryWeight, product of:
               4.2095323 = boost
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.01352058 = queryNorm
             0.336778 = fieldWeight in 82, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
         0.0674313 = weight(abstract_txt:experiments in 82) [ClassicSimilarity], result of:
           0.0674313 = score(doc=82,freq=1.0), product of:
             0.32419255 = queryWeight, product of:
               4.5030756 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.01352058 = queryNorm
             0.2079977 = fieldWeight in 82, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.0390625 = fieldNorm(doc=82)
       0.52 = coord(13/25)
   

3. TREC: experiment and evaluation in information retrieval (2005) 0.34

   0.3385243 = sum of:
     0.3385243 = product of:
       0.7693734 = sum of:
         0.004726219 = weight(abstract_txt:that in 761) [ClassicSimilarity], result of:
           0.004726219 = score(doc=761,freq=1.0), product of:
             0.031975295 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01352058 = queryNorm
             0.14780845 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.007040201 = weight(abstract_txt:this in 761) [ClassicSimilarity], result of:
           0.007040201 = score(doc=761,freq=2.0), product of:
             0.033101834 = queryWeight, product of:
               1.0174633 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01352058 = queryNorm
             0.21268311 = fieldWeight in 761, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.007151952 = weight(abstract_txt:information in 761) [ClassicSimilarity], result of:
           0.007151952 = score(doc=761,freq=2.0), product of:
             0.033451203 = queryWeight, product of:
               1.0228186 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01352058 = queryNorm
             0.21380253 = fieldWeight in 761, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.020041378 = weight(abstract_txt:describes in 761) [ClassicSimilarity], result of:
           0.020041378 = score(doc=761,freq=1.0), product of:
             0.083770365 = queryWeight, product of:
               1.618594 = boost
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.01352058 = queryNorm
             0.23924187 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.047153573 = weight(abstract_txt:text in 761) [ClassicSimilarity], result of:
           0.047153573 = score(doc=761,freq=4.0), product of:
             0.09335303 = queryWeight, product of:
               1.7086651 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.01352058 = queryNorm
             0.50511026 = fieldWeight in 761, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.034170527 = weight(abstract_txt:impact in 761) [ClassicSimilarity], result of:
           0.034170527 = score(doc=761,freq=1.0), product of:
             0.11955649 = queryWeight, product of:
               1.9336563 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.01352058 = queryNorm
             0.28581074 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.061539892 = weight(abstract_txt:conference in 761) [ClassicSimilarity], result of:
           0.061539892 = score(doc=761,freq=1.0), product of:
             0.17697415 = queryWeight, product of:
               2.3525975 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.01352058 = queryNorm
             0.3477338 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.30454585 = weight(abstract_txt:trec in 761) [ClassicSimilarity], result of:
           0.30454585 = score(doc=761,freq=8.0), product of:
             0.2569669 = queryWeight, product of:
               2.834858 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.01352058 = queryNorm
             1.185156 = fieldWeight in 761, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.10401679 = weight(abstract_txt:retrieval in 761) [ClassicSimilarity], result of:
           0.10401679 = score(doc=761,freq=12.0), product of:
             0.13819444 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.01352058 = queryNorm
             0.7526843 = fieldWeight in 761, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.09085065 = weight(abstract_txt:evaluation in 761) [ClassicSimilarity], result of:
           0.09085065 = score(doc=761,freq=2.0), product of:
             0.2294514 = queryWeight, product of:
               3.788376 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.01352058 = queryNorm
             0.39594725 = fieldWeight in 761, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.0881364 = weight(abstract_txt:history in 761) [ClassicSimilarity], result of:
           0.0881364 = score(doc=761,freq=1.0), product of:
             0.28330368 = queryWeight, product of:
               4.2095323 = boost
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.01352058 = queryNorm
             0.3111022 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
       0.44 = coord(11/25)
   

4. Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 0.31

   0.30596802 = sum of:
     0.30596802 = product of:
       0.58840007 = sum of:
         0.009247129 = weight(abstract_txt:that in 1835) [ClassicSimilarity], result of:
           0.009247129 = score(doc=1835,freq=5.0), product of:
             0.031975295 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01352058 = queryNorm
             0.28919604 = fieldWeight in 1835, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.0075446437 = weight(abstract_txt:this in 1835) [ClassicSimilarity], result of:
           0.0075446437 = score(doc=1835,freq=3.0), product of:
             0.033101834 = queryWeight, product of:
               1.0174633 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01352058 = queryNorm
             0.22792223 = fieldWeight in 1835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.006257958 = weight(abstract_txt:information in 1835) [ClassicSimilarity], result of:
           0.006257958 = score(doc=1835,freq=2.0), product of:
             0.033451203 = queryWeight, product of:
               1.0228186 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01352058 = queryNorm
             0.18707721 = fieldWeight in 1835, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.012968767 = weight(abstract_txt:paper in 1835) [ClassicSimilarity], result of:
           0.012968767 = score(doc=1835,freq=1.0), product of:
             0.068506606 = queryWeight, product of:
               1.4637232 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.01352058 = queryNorm
             0.18930681 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.026713436 = weight(abstract_txt:were in 1835) [ClassicSimilarity], result of:
           0.026713436 = score(doc=1835,freq=3.0), product of:
             0.07689759 = queryWeight, product of:
               1.550776 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.01352058 = queryNorm
             0.34738976 = fieldWeight in 1835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.02062969 = weight(abstract_txt:text in 1835) [ClassicSimilarity], result of:
           0.02062969 = score(doc=1835,freq=1.0), product of:
             0.09335303 = queryWeight, product of:
               1.7086651 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.01352058 = queryNorm
             0.22098574 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.063845575 = weight(abstract_txt:personal in 1835) [ClassicSimilarity], result of:
           0.063845575 = score(doc=1835,freq=2.0), product of:
             0.15735379 = queryWeight, product of:
               2.2183564 = boost
               5.246269 = idf(docFreq=635, maxDocs=44421)
               0.01352058 = queryNorm
             0.40574542 = fieldWeight in 1835, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.246269 = idf(docFreq=635, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.050924454 = weight(abstract_txt:take in 1835) [ClassicSimilarity], result of:
           0.050924454 = score(doc=1835,freq=1.0), product of:
             0.17051041 = queryWeight, product of:
               2.3092353 = boost
               5.4611917 = idf(docFreq=512, maxDocs=44421)
               0.01352058 = queryNorm
             0.2986589 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4611917 = idf(docFreq=512, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.053847406 = weight(abstract_txt:conference in 1835) [ClassicSimilarity], result of:
           0.053847406 = score(doc=1835,freq=1.0), product of:
             0.17697415 = queryWeight, product of:
               2.3525975 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.01352058 = queryNorm
             0.30426708 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.06550817 = weight(abstract_txt:assess in 1835) [ClassicSimilarity], result of:
           0.06550817 = score(doc=1835,freq=1.0), product of:
             0.20168038 = queryWeight, product of:
               2.51145 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.01352058 = queryNorm
             0.32481185 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.18842815 = weight(abstract_txt:trec in 1835) [ClassicSimilarity], result of:
           0.18842815 = score(doc=1835,freq=4.0), product of:
             0.2569669 = queryWeight, product of:
               2.834858 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.01352058 = queryNorm
             0.7332779 = fieldWeight in 1835, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.026273679 = weight(abstract_txt:retrieval in 1835) [ClassicSimilarity], result of:
           0.026273679 = score(doc=1835,freq=1.0), product of:
             0.13819444 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.01352058 = queryNorm
             0.1901211 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.056210976 = weight(abstract_txt:evaluation in 1835) [ClassicSimilarity], result of:
           0.056210976 = score(doc=1835,freq=1.0), product of:
             0.2294514 = queryWeight, product of:
               3.788376 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.01352058 = queryNorm
             0.24497987 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
       0.52 = coord(13/25)
   

5. Gillman, P.: Text retrieval (1998) 0.28

   0.284576 = sum of:
     0.284576 = product of:
       0.79048884 = sum of:
         0.008270883 = weight(abstract_txt:that in 2502) [ClassicSimilarity], result of:
           0.008270883 = score(doc=2502,freq=1.0), product of:
             0.031975295 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01352058 = queryNorm
             0.2586648 = fieldWeight in 2502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
         0.008850089 = weight(abstract_txt:information in 2502) [ClassicSimilarity], result of:
           0.008850089 = score(doc=2502,freq=1.0), product of:
             0.033451203 = queryWeight, product of:
               1.0228186 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01352058 = queryNorm
             0.26456714 = fieldWeight in 2502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
         0.031126587 = weight(abstract_txt:some in 2502) [ClassicSimilarity], result of:
           0.031126587 = score(doc=2502,freq=1.0), product of:
             0.07736318 = queryWeight, product of:
               1.5554637 = boost
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.01352058 = queryNorm
             0.4023437 = fieldWeight in 2502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
         0.058349576 = weight(abstract_txt:text in 2502) [ClassicSimilarity], result of:
           0.058349576 = score(doc=2502,freq=2.0), product of:
             0.09335303 = queryWeight, product of:
               1.7086651 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.01352058 = queryNorm
             0.6250421 = fieldWeight in 2502, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
         0.10769481 = weight(abstract_txt:conference in 2502) [ClassicSimilarity], result of:
           0.10769481 = score(doc=2502,freq=1.0), product of:
             0.17697415 = queryWeight, product of:
               2.3525975 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.01352058 = queryNorm
             0.60853416 = fieldWeight in 2502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
         0.10794639 = weight(abstract_txt:early in 2502) [ClassicSimilarity], result of:
           0.10794639 = score(doc=2502,freq=1.0), product of:
             0.17724966 = queryWeight, product of:
               2.354428 = boost
               5.5680695 = idf(docFreq=460, maxDocs=44421)
               0.01352058 = queryNorm
             0.6090076 = fieldWeight in 2502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5680695 = idf(docFreq=460, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
         0.18842815 = weight(abstract_txt:trec in 2502) [ClassicSimilarity], result of:
           0.18842815 = score(doc=2502,freq=1.0), product of:
             0.2569669 = queryWeight, product of:
               2.834858 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.01352058 = queryNorm
             0.7332779 = fieldWeight in 2502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
         0.09101469 = weight(abstract_txt:retrieval in 2502) [ClassicSimilarity], result of:
           0.09101469 = score(doc=2502,freq=3.0), product of:
             0.13819444 = queryWeight, product of:
               2.9400384 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.01352058 = queryNorm
             0.6585988 = fieldWeight in 2502, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
         0.18880765 = weight(abstract_txt:experiments in 2502) [ClassicSimilarity], result of:
           0.18880765 = score(doc=2502,freq=1.0), product of:
             0.32419255 = queryWeight, product of:
               4.5030756 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.01352058 = queryNorm
             0.5823935 = fieldWeight in 2502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.109375 = fieldNorm(doc=2502)
       0.36 = coord(9/25)