Document (#11286)

Author

Robertson, S.E.
Walker, S.
Beaulieu, M.

Title

Laboratory experiments with Okapi : participation in the TREC programme

Source

Journal of documentation. 53(1997) no.1, S.20-34

Year

1997

Abstract

Briefly reviews the history of laboratory testing of information retrieval systems, focusing on the idea of a general purpose test collection of documents, queries and relevance judgements. Gives an overview of the methods used in TREC (Text Retrieval Conference) which is concerned with an ideal test collection, and discusses the Okapi team's participation in TREC. Also discusses some of the issues surrounding the difficult problem of interactive evaluation in TREC. The reconciliation of the requirements of the laboratory context with the concerns of interactive retrieval has a long way to go

Content

Vgl. auch unter: http://www.emeraldinsight.com/10.1108/EUM0000000007188.

Footnote

Contribution to a thematic issue on Okapi and information retrieval research

Theme

Retrievalstudien

Object

Okapi

Similar documents (author)

1. Robertson, S.E.; Walker, S.; Beaulieu, M.: Experimentation as a way of life : Okapi at TREC (2000) 4.97

   4.967923 = sum of:
     4.967923 = sum of:
       1.443426 = weight(author_txt:robertson in 6030) [ClassicSimilarity], result of:
         1.443426 = score(doc=6030,freq=1.0), product of:
           0.5262077 = queryWeight, product of:
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.0719368 = queryNorm
           2.7430727 = fieldWeight in 6030, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.375 = fieldNorm(doc=6030)
       1.6650345 = weight(author_txt:walker in 6030) [ClassicSimilarity], result of:
         1.6650345 = score(doc=6030,freq=1.0), product of:
           0.57877487 = queryWeight, product of:
             1.0487603 = boost
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.0719368 = queryNorm
           2.8768258 = fieldWeight in 6030, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.375 = fieldNorm(doc=6030)
       1.8594627 = weight(author_txt:beaulieu in 6030) [ClassicSimilarity], result of:
         1.8594627 = score(doc=6030,freq=1.0), product of:
           0.6229968 = queryWeight, product of:
             1.0880888 = boost
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.0719368 = queryNorm
           2.9847066 = fieldWeight in 6030, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.375 = fieldNorm(doc=6030)
   

2. Robertson, S.E.; Walker, S.; Hancock-Beaulieu, M.M.: Large test collection experiments of an operational, interactive system : OKAPI at TREC (1995) 4.97

   4.967923 = sum of:
     4.967923 = sum of:
       1.443426 = weight(author_txt:robertson in 6964) [ClassicSimilarity], result of:
         1.443426 = score(doc=6964,freq=1.0), product of:
           0.5262077 = queryWeight, product of:
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.0719368 = queryNorm
           2.7430727 = fieldWeight in 6964, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.375 = fieldNorm(doc=6964)
       1.6650345 = weight(author_txt:walker in 6964) [ClassicSimilarity], result of:
         1.6650345 = score(doc=6964,freq=1.0), product of:
           0.57877487 = queryWeight, product of:
             1.0487603 = boost
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.0719368 = queryNorm
           2.8768258 = fieldWeight in 6964, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.375 = fieldNorm(doc=6964)
       1.8594627 = weight(author_txt:beaulieu in 6964) [ClassicSimilarity], result of:
         1.8594627 = score(doc=6964,freq=1.0), product of:
           0.6229968 = queryWeight, product of:
             1.0880888 = boost
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.0719368 = queryNorm
           2.9847066 = fieldWeight in 6964, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.375 = fieldNorm(doc=6964)
   

3. Robertson, S.E.; Walker, S.; Beaulieu, M.M.; Gatford, M.; Payne, A.: Okapi at TREC-4 (1996) 4.14

   4.139936 = sum of:
     4.139936 = sum of:
       1.202855 = weight(author_txt:robertson in 7546) [ClassicSimilarity], result of:
         1.202855 = score(doc=7546,freq=1.0), product of:
           0.5262077 = queryWeight, product of:
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.0719368 = queryNorm
           2.285894 = fieldWeight in 7546, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.3125 = fieldNorm(doc=7546)
       1.3875288 = weight(author_txt:walker in 7546) [ClassicSimilarity], result of:
         1.3875288 = score(doc=7546,freq=1.0), product of:
           0.57877487 = queryWeight, product of:
             1.0487603 = boost
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.0719368 = queryNorm
           2.3973548 = fieldWeight in 7546, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.3125 = fieldNorm(doc=7546)
       1.5495523 = weight(author_txt:beaulieu in 7546) [ClassicSimilarity], result of:
         1.5495523 = score(doc=7546,freq=1.0), product of:
           0.6229968 = queryWeight, product of:
             1.0880888 = boost
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.0719368 = queryNorm
           2.4872556 = fieldWeight in 7546, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.3125 = fieldNorm(doc=7546)
   

4. Jones, S.; Gatford, M.; Robertson, S.; Hancock-Beaulieu, M.; Secker, J.; Walker, S.: Interactive thesaurus navigation : intelligence rules OK? (1995) 3.31

   3.3119488 = sum of:
     3.3119488 = sum of:
       0.96228397 = weight(author_txt:robertson in 180) [ClassicSimilarity], result of:
         0.96228397 = score(doc=180,freq=1.0), product of:
           0.5262077 = queryWeight, product of:
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.0719368 = queryNorm
           1.8287152 = fieldWeight in 180, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.25 = fieldNorm(doc=180)
       1.110023 = weight(author_txt:walker in 180) [ClassicSimilarity], result of:
         1.110023 = score(doc=180,freq=1.0), product of:
           0.57877487 = queryWeight, product of:
             1.0487603 = boost
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.0719368 = queryNorm
           1.9178839 = fieldWeight in 180, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.25 = fieldNorm(doc=180)
       1.2396418 = weight(author_txt:beaulieu in 180) [ClassicSimilarity], result of:
         1.2396418 = score(doc=180,freq=1.0), product of:
           0.6229968 = queryWeight, product of:
             1.0880888 = boost
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.0719368 = queryNorm
           1.9898044 = fieldWeight in 180, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.25 = fieldNorm(doc=180)
   

5. Beaulieu, M.M.; Gatford, M.; Huang, X.; Robertson, S.E.; Walker, S.; Williams, P.: Okapi an TREC-5 (1997) 3.31

   3.3119488 = sum of:
     3.3119488 = sum of:
       0.96228397 = weight(author_txt:robertson in 3097) [ClassicSimilarity], result of:
         0.96228397 = score(doc=3097,freq=1.0), product of:
           0.5262077 = queryWeight, product of:
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.0719368 = queryNorm
           1.8287152 = fieldWeight in 3097, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.314861 = idf(docFreq=79, maxDocs=44218)
             0.25 = fieldNorm(doc=3097)
       1.110023 = weight(author_txt:walker in 3097) [ClassicSimilarity], result of:
         1.110023 = score(doc=3097,freq=1.0), product of:
           0.57877487 = queryWeight, product of:
             1.0487603 = boost
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.0719368 = queryNorm
           1.9178839 = fieldWeight in 3097, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.6715355 = idf(docFreq=55, maxDocs=44218)
             0.25 = fieldNorm(doc=3097)
       1.2396418 = weight(author_txt:beaulieu in 3097) [ClassicSimilarity], result of:
         1.2396418 = score(doc=3097,freq=1.0), product of:
           0.6229968 = queryWeight, product of:
             1.0880888 = boost
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.0719368 = queryNorm
           1.9898044 = fieldWeight in 3097, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.9592175 = idf(docFreq=41, maxDocs=44218)
             0.25 = fieldNorm(doc=3097)
   

Similar documents (content)

1. Beaulieu, M.; Robertson, S.; Rasmussen, E.: Evaluating interactive systems in TREC (1996) 0.42

   0.41500637 = sum of:
     0.41500637 = product of:
       1.4821656 = sum of:
         0.049292207 = weight(abstract_txt:experiments in 2998) [ClassicSimilarity], result of:
           0.049292207 = score(doc=2998,freq=2.0), product of:
             0.08369743 = queryWeight, product of:
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.015701855 = queryNorm
             0.58893335 = fieldWeight in 2998, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.078125 = fieldNorm(doc=2998)
         0.056305557 = weight(abstract_txt:testing in 2998) [ClassicSimilarity], result of:
           0.056305557 = score(doc=2998,freq=1.0), product of:
             0.11523138 = queryWeight, product of:
               1.1733547 = boost
               6.2544694 = idf(docFreq=230, maxDocs=44218)
               0.015701855 = queryNorm
             0.4886304 = fieldWeight in 2998, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2544694 = idf(docFreq=230, maxDocs=44218)
               0.078125 = fieldNorm(doc=2998)
         0.050185513 = weight(abstract_txt:retrieval in 2998) [ClassicSimilarity], result of:
           0.050185513 = score(doc=2998,freq=3.0), product of:
             0.10672238 = queryWeight, product of:
               1.9558355 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015701855 = queryNorm
             0.47024357 = fieldWeight in 2998, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=2998)
         0.13664299 = weight(abstract_txt:interactive in 2998) [ClassicSimilarity], result of:
           0.13664299 = score(doc=2998,freq=3.0), product of:
             0.18178767 = queryWeight, product of:
               2.0842085 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.015701855 = queryNorm
             0.7516626 = fieldWeight in 2998, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.078125 = fieldNorm(doc=2998)
         0.23636506 = weight(abstract_txt:okapi in 2998) [ClassicSimilarity], result of:
           0.23636506 = score(doc=2998,freq=1.0), product of:
             0.37780592 = queryWeight, product of:
               3.004646 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.015701855 = queryNorm
             0.6256256 = fieldWeight in 2998, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.078125 = fieldNorm(doc=2998)
         0.33438075 = weight(abstract_txt:laboratory in 2998) [ClassicSimilarity], result of:
           0.33438075 = score(doc=2998,freq=2.0), product of:
             0.43257475 = queryWeight, product of:
               3.9376323 = boost
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.015701855 = queryNorm
             0.7730011 = fieldWeight in 2998, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.078125 = fieldNorm(doc=2998)
         0.6189935 = weight(abstract_txt:trec in 2998) [ClassicSimilarity], result of:
           0.6189935 = score(doc=2998,freq=5.0), product of:
             0.5288802 = queryWeight, product of:
               5.027506 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.015701855 = queryNorm
             1.1703851 = fieldWeight in 2998, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.078125 = fieldNorm(doc=2998)
       0.28 = coord(7/25)
   

2. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.24

   0.23972052 = sum of:
     0.23972052 = product of:
       0.7491267 = sum of:
         0.049292207 = weight(abstract_txt:experiments in 2884) [ClassicSimilarity], result of:
           0.049292207 = score(doc=2884,freq=2.0), product of:
             0.08369743 = queryWeight, product of:
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.015701855 = queryNorm
             0.58893335 = fieldWeight in 2884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.03962977 = weight(abstract_txt:conference in 2884) [ClassicSimilarity], result of:
           0.03962977 = score(doc=2884,freq=1.0), product of:
             0.091176786 = queryWeight, product of:
               1.043725 = boost
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.015701855 = queryNorm
             0.43464756 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.010784056 = weight(abstract_txt:with in 2884) [ClassicSimilarity], result of:
           0.010784056 = score(doc=2884,freq=1.0), product of:
             0.055220257 = queryWeight, product of:
               1.4068694 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.015701855 = queryNorm
             0.19529167 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.046232626 = weight(abstract_txt:collection in 2884) [ClassicSimilarity], result of:
           0.046232626 = score(doc=2884,freq=1.0), product of:
             0.12730505 = queryWeight, product of:
               1.7441417 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.015701855 = queryNorm
             0.36316413 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.059157323 = weight(abstract_txt:test in 2884) [ClassicSimilarity], result of:
           0.059157323 = score(doc=2884,freq=1.0), product of:
             0.1500441 = queryWeight, product of:
               1.8935134 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.015701855 = queryNorm
             0.39426625 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.040976297 = weight(abstract_txt:retrieval in 2884) [ClassicSimilarity], result of:
           0.040976297 = score(doc=2884,freq=2.0), product of:
             0.10672238 = queryWeight, product of:
               1.9558355 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015701855 = queryNorm
             0.38395226 = fieldWeight in 2884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.11156854 = weight(abstract_txt:interactive in 2884) [ClassicSimilarity], result of:
           0.11156854 = score(doc=2884,freq=2.0), product of:
             0.18178767 = queryWeight, product of:
               2.0842085 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.015701855 = queryNorm
             0.61372995 = fieldWeight in 2884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
         0.39148584 = weight(abstract_txt:trec in 2884) [ClassicSimilarity], result of:
           0.39148584 = score(doc=2884,freq=2.0), product of:
             0.5288802 = queryWeight, product of:
               5.027506 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.015701855 = queryNorm
             0.7402165 = fieldWeight in 2884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.078125 = fieldNorm(doc=2884)
       0.32 = coord(8/25)
   

3. TREC: experiment and evaluation in information retrieval (2005) 0.21

   0.21410128 = sum of:
     0.21410128 = product of:
       0.8920887 = sum of:
         0.031703815 = weight(abstract_txt:conference in 636) [ClassicSimilarity], result of:
           0.031703815 = score(doc=636,freq=1.0), product of:
             0.091176786 = queryWeight, product of:
               1.043725 = boost
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.015701855 = queryNorm
             0.34771806 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.563489 = idf(docFreq=460, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.008627245 = weight(abstract_txt:with in 636) [ClassicSimilarity], result of:
           0.008627245 = score(doc=636,freq=1.0), product of:
             0.055220257 = queryWeight, product of:
               1.4068694 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.015701855 = queryNorm
             0.15623334 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.08197079 = weight(abstract_txt:test in 636) [ClassicSimilarity], result of:
           0.08197079 = score(doc=636,freq=3.0), product of:
             0.1500441 = queryWeight, product of:
               1.8935134 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.015701855 = queryNorm
             0.5463113 = fieldWeight in 636, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.08029682 = weight(abstract_txt:retrieval in 636) [ClassicSimilarity], result of:
           0.08029682 = score(doc=636,freq=12.0), product of:
             0.10672238 = queryWeight, product of:
               1.9558355 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015701855 = queryNorm
             0.7523897 = fieldWeight in 636, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.0631127 = weight(abstract_txt:interactive in 636) [ClassicSimilarity], result of:
           0.0631127 = score(doc=636,freq=1.0), product of:
             0.18178767 = queryWeight, product of:
               2.0842085 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.015701855 = queryNorm
             0.3471781 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.62637734 = weight(abstract_txt:trec in 636) [ClassicSimilarity], result of:
           0.62637734 = score(doc=636,freq=8.0), product of:
             0.5288802 = queryWeight, product of:
               5.027506 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.015701855 = queryNorm
             1.1843464 = fieldWeight in 636, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
       0.24 = coord(6/25)
   

4. Robertson, S.E.: OKAPI at TREC-3 (1995) 0.21

   0.20893376 = sum of:
     0.20893376 = product of:
       1.0446688 = sum of:
         0.04182583 = weight(abstract_txt:experiments in 5694) [ClassicSimilarity], result of:
           0.04182583 = score(doc=5694,freq=1.0), product of:
             0.08369743 = queryWeight, product of:
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.015701855 = queryNorm
             0.49972656 = fieldWeight in 5694, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.09375 = fieldNorm(doc=5694)
         0.049171556 = weight(abstract_txt:retrieval in 5694) [ClassicSimilarity], result of:
           0.049171556 = score(doc=5694,freq=2.0), product of:
             0.10672238 = queryWeight, product of:
               1.9558355 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015701855 = queryNorm
             0.4607427 = fieldWeight in 5694, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=5694)
         0.094669044 = weight(abstract_txt:interactive in 5694) [ClassicSimilarity], result of:
           0.094669044 = score(doc=5694,freq=1.0), product of:
             0.18178767 = queryWeight, product of:
               2.0842085 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.015701855 = queryNorm
             0.52076715 = fieldWeight in 5694, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.09375 = fieldNorm(doc=5694)
         0.2836381 = weight(abstract_txt:okapi in 5694) [ClassicSimilarity], result of:
           0.2836381 = score(doc=5694,freq=1.0), product of:
             0.37780592 = queryWeight, product of:
               3.004646 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.015701855 = queryNorm
             0.7507508 = fieldWeight in 5694, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.09375 = fieldNorm(doc=5694)
         0.5753643 = weight(abstract_txt:trec in 5694) [ClassicSimilarity], result of:
           0.5753643 = score(doc=5694,freq=3.0), product of:
             0.5288802 = queryWeight, product of:
               5.027506 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.015701855 = queryNorm
             1.0878916 = fieldWeight in 5694, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.09375 = fieldNorm(doc=5694)
       0.2 = coord(5/25)
   

5. Robertson, S.E.: OKAPI at TREC-1 (1994) 0.20

   0.19959418 = sum of:
     0.19959418 = product of:
       1.2474637 = sum of:
         0.05576777 = weight(abstract_txt:experiments in 7953) [ClassicSimilarity], result of:
           0.05576777 = score(doc=7953,freq=1.0), product of:
             0.08369743 = queryWeight, product of:
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.015701855 = queryNorm
             0.6663021 = fieldWeight in 7953, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.125 = fieldNorm(doc=7953)
         0.046359394 = weight(abstract_txt:retrieval in 7953) [ClassicSimilarity], result of:
           0.046359394 = score(doc=7953,freq=1.0), product of:
             0.10672238 = queryWeight, product of:
               1.9558355 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015701855 = queryNorm
             0.43439242 = fieldWeight in 7953, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.125 = fieldNorm(doc=7953)
         0.3781841 = weight(abstract_txt:okapi in 7953) [ClassicSimilarity], result of:
           0.3781841 = score(doc=7953,freq=1.0), product of:
             0.37780592 = queryWeight, product of:
               3.004646 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.015701855 = queryNorm
             1.001001 = fieldWeight in 7953, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.125 = fieldNorm(doc=7953)
         0.7671524 = weight(abstract_txt:trec in 7953) [ClassicSimilarity], result of:
           0.7671524 = score(doc=7953,freq=3.0), product of:
             0.5288802 = queryWeight, product of:
               5.027506 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.015701855 = queryNorm
             1.4505222 = fieldWeight in 7953, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.125 = fieldNorm(doc=7953)
       0.16 = coord(4/25)