Document (#30083)

Author

Voorhees, E.M.
Harman, D.K.

Title

¬The Text REtrieval Conference

Source

TREC: experiment and evaluation in information retrieval. Ed.: E.M. Voorhees, u. D.K. Harman

Imprint

Cambridge, MA : MIT Press

Year

2005

Pages

S3-20

Abstract

Text retrieval technology targets a problem that is all too familiar: finding relevant information in large stores of electronic documents. The problem is an old one, with the first research conference devoted to the subject held in 1958 [11]. Since then the problem has continued to grow as more information is created in electronic form and more people gain electronic access. The advent of the World Wide Web, where anyone can publish so everyone must search, is a graphic illustration of the need for effective retrieval technology. The Text REtrieval Conference (TREC) is a workshop series designed to build the infrastructure necessary for the large-scale evaluation of text retrieval technology, thereby accelerating its transfer into the commercial sector. The series is sponsored by the U.S. National Institute of Standards and Technology (NIST) and the U.S. Department of Defense. At the time of this writing, there have been twelve TREC workshops and preparations for the thirteenth workshop are under way. Participants in the workshops have been drawn from the academic, commercial, and government sectors, and have included representatives from more than twenty different countries. These collective efforts have accomplished a great deal: a variety of large test collections have been built for both traditional ad hoc retrieval and related tasks such as cross-language retrieval, speech retrieval, and question answering; retrieval effectiveness has approximately doubled; and many commercial retrieval systems now contain technology first developed in TREC.
This book chronicles the evolution of retrieval systems over the course of TREC. To be sure, there has already been a wealth of information written about TREC. Each conference has produced a proceedings containing general overviews of the various tasks, papers written by the individual participants, and evaluation results.1 Reports on expanded versions of TREC experiments frequently appear in the wider information retrieval literature. There also have been special issues of journals devoted to particular TRECs [3; 13] and particular TREC tasks [6; 4]. No single volume could hope to be a comprehensive record of all TREC-related research. Instead, this book looks to distill the overabundance of detail into a manageable whole that summarizes the main lessons learned from TREC. The book consists of three main parts. The first part contains introductory and descriptive chapters on TREC's history, the major products of TREC (the test collections), and the retrieval evaluation methodology. Part II includes chapters describing the major TREC ''tracks,'' evaluations of special subtopics such as cross-language retrieval and question answering. Part III contains contributions from research groups that have participated in TREC. The epilogue to the book is written by Karen Sparck Jones, who reflects on the impact TREC has had on the information retrieval field. The structure of this introductory chapter is similar to that of the book as a whole. The chapter begins with a short history of TREC; expanded descriptions of specific aspects of the history are included in subsequent chapters to make those chapters self-contained. Section 1.2 describes TREC's track structure, which has been responsible for the growth of TREC and allows TREC to adapt to changing needs. The final section lists both the major accomplishments of TREC and some remaining challenges.

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Harman, D.; Voorhees, E.: Social TREC : an overview (2006) 6.16

   6.163933 = sum of:
     6.163933 = sum of:
       2.9217858 = weight(author_txt:harman in 4457) [ClassicSimilarity], result of:
         2.9217858 = score(doc=4457,freq=1.0), product of:
           0.6821842 = queryWeight, product of:
             8.565973 = idf(docFreq=22, maxDocs=44421)
             0.079638846 = queryNorm
           4.2829866 = fieldWeight in 4457, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.565973 = idf(docFreq=22, maxDocs=44421)
             0.5 = fieldNorm(doc=4457)
       3.2421472 = weight(author_txt:voorhees in 4457) [ClassicSimilarity], result of:
         3.2421472 = score(doc=4457,freq=1.0), product of:
           0.7311804 = queryWeight, product of:
             1.0352886 = boost
             8.868255 = idf(docFreq=16, maxDocs=44421)
             0.079638846 = queryNorm
           4.4341273 = fieldWeight in 4457, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.868255 = idf(docFreq=16, maxDocs=44421)
             0.5 = fieldNorm(doc=4457)
   

2. Voorhees, E.M.; Harman, D.K.: Overview of the fifth Text Retrieval Conference (TREC-5) (1997) 6.16

   6.163933 = sum of:
     6.163933 = sum of:
       2.9217858 = weight(author_txt:harman in 4109) [ClassicSimilarity], result of:
         2.9217858 = score(doc=4109,freq=1.0), product of:
           0.6821842 = queryWeight, product of:
             8.565973 = idf(docFreq=22, maxDocs=44421)
             0.079638846 = queryNorm
           4.2829866 = fieldWeight in 4109, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.565973 = idf(docFreq=22, maxDocs=44421)
             0.5 = fieldNorm(doc=4109)
       3.2421472 = weight(author_txt:voorhees in 4109) [ClassicSimilarity], result of:
         3.2421472 = score(doc=4109,freq=1.0), product of:
           0.7311804 = queryWeight, product of:
             1.0352886 = boost
             8.868255 = idf(docFreq=16, maxDocs=44421)
             0.079638846 = queryNorm
           4.4341273 = fieldWeight in 4109, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.868255 = idf(docFreq=16, maxDocs=44421)
             0.5 = fieldNorm(doc=4109)
   

3. Voorhees, E.M.; Harman, D.: Overview of the Sixth Text REtrieval Conference (TREC-6) (2000) 6.16

   6.163933 = sum of:
     6.163933 = sum of:
       2.9217858 = weight(author_txt:harman in 438) [ClassicSimilarity], result of:
         2.9217858 = score(doc=438,freq=1.0), product of:
           0.6821842 = queryWeight, product of:
             8.565973 = idf(docFreq=22, maxDocs=44421)
             0.079638846 = queryNorm
           4.2829866 = fieldWeight in 438, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.565973 = idf(docFreq=22, maxDocs=44421)
             0.5 = fieldNorm(doc=438)
       3.2421472 = weight(author_txt:voorhees in 438) [ClassicSimilarity], result of:
         3.2421472 = score(doc=438,freq=1.0), product of:
           0.7311804 = queryWeight, product of:
             1.0352886 = boost
             8.868255 = idf(docFreq=16, maxDocs=44421)
             0.079638846 = queryNorm
           4.4341273 = fieldWeight in 438, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.868255 = idf(docFreq=16, maxDocs=44421)
             0.5 = fieldNorm(doc=438)
   

4. Voorhees, E.M.: Implementing agglomerative hierarchic clustering algorithms for use in document retrieval (1986) 2.03

   2.026342 = sum of:
     2.026342 = product of:
       4.052684 = sum of:
         4.052684 = weight(author_txt:voorhees in 401) [ClassicSimilarity], result of:
           4.052684 = score(doc=401,freq=1.0), product of:
             0.7311804 = queryWeight, product of:
               1.0352886 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.079638846 = queryNorm
             5.5426593 = fieldWeight in 401, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.625 = fieldNorm(doc=401)
       0.5 = coord(1/2)
   

5. Voorhees, E.M.: Question answering in TREC (2005) 2.03

   2.026342 = sum of:
     2.026342 = product of:
       4.052684 = sum of:
         4.052684 = weight(author_txt:voorhees in 6486) [ClassicSimilarity], result of:
           4.052684 = score(doc=6486,freq=1.0), product of:
             0.7311804 = queryWeight, product of:
               1.0352886 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.079638846 = queryNorm
             5.5426593 = fieldWeight in 6486, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.625 = fieldNorm(doc=6486)
       0.5 = coord(1/2)
   

Similar documents (content)

1. TREC: experiment and evaluation in information retrieval (2005) 0.90

   0.90126526 = sum of:
     0.90126526 = product of:
       1.6094023 = sum of:
         0.04014548 = weight(abstract_txt:workshop in 761) [ClassicSimilarity], result of:
           0.04014548 = score(doc=761,freq=1.0), product of:
             0.09711826 = queryWeight, product of:
               1.0447085 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.014055621 = queryNorm
             0.41336694 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.031605307 = weight(abstract_txt:large in 761) [ClassicSimilarity], result of:
           0.031605307 = score(doc=761,freq=3.0), product of:
             0.06572135 = queryWeight, product of:
               1.052552 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.014055621 = queryNorm
             0.48089862 = fieldWeight in 761, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.02646078 = weight(abstract_txt:evaluation in 761) [ClassicSimilarity], result of:
           0.02646078 = score(doc=761,freq=2.0), product of:
             0.066829056 = queryWeight, product of:
               1.061385 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.014055621 = queryNorm
             0.39594725 = fieldWeight in 761, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.02829848 = weight(abstract_txt:part in 761) [ClassicSimilarity], result of:
           0.02829848 = score(doc=761,freq=2.0), product of:
             0.06988848 = queryWeight, product of:
               1.0854082 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.014055621 = queryNorm
             0.40490907 = fieldWeight in 761, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.025670238 = weight(abstract_txt:history in 761) [ClassicSimilarity], result of:
           0.025670238 = score(doc=761,freq=1.0), product of:
             0.08251384 = queryWeight, product of:
               1.1793798 = boost
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.014055621 = queryNorm
             0.3111022 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.04028273 = weight(abstract_txt:tasks in 761) [ClassicSimilarity], result of:
           0.04028273 = score(doc=761,freq=2.0), product of:
             0.088438794 = queryWeight, product of:
               1.2209889 = boost
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.014055621 = queryNorm
             0.4554871 = fieldWeight in 761, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1532483 = idf(docFreq=697, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.03662334 = weight(abstract_txt:text in 761) [ClassicSimilarity], result of:
           0.03662334 = score(doc=761,freq=4.0), product of:
             0.07250564 = queryWeight, product of:
               1.2765727 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014055621 = queryNorm
             0.50511026 = fieldWeight in 761, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.040023237 = weight(abstract_txt:commercial in 761) [ClassicSimilarity], result of:
           0.040023237 = score(doc=761,freq=1.0), product of:
             0.110946864 = queryWeight, product of:
               1.3675646 = boost
               5.7718782 = idf(docFreq=375, maxDocs=44421)
               0.014055621 = queryNorm
             0.3607424 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7718782 = idf(docFreq=375, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.027226603 = weight(abstract_txt:technology in 761) [ClassicSimilarity], result of:
           0.027226603 = score(doc=761,freq=1.0), product of:
             0.10174633 = queryWeight, product of:
               1.6907291 = boost
               4.2814875 = idf(docFreq=1668, maxDocs=44421)
               0.014055621 = queryNorm
             0.26759297 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2814875 = idf(docFreq=1668, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.019656876 = weight(abstract_txt:been in 761) [ClassicSimilarity], result of:
           0.019656876 = score(doc=761,freq=1.0), product of:
             0.08701482 = queryWeight, product of:
               1.7127813 = boost
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.014055621 = queryNorm
             0.22590263 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.047796935 = weight(abstract_txt:conference in 761) [ClassicSimilarity], result of:
           0.047796935 = score(doc=761,freq=1.0), product of:
             0.13745266 = queryWeight, product of:
               1.7576656 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.014055621 = queryNorm
             0.3477338 = fieldWeight in 761, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.08885983 = weight(abstract_txt:book in 761) [ClassicSimilarity], result of:
           0.08885983 = score(doc=761,freq=5.0), product of:
             0.13091922 = queryWeight, product of:
               1.9178576 = boost
               4.8566523 = idf(docFreq=938, maxDocs=44421)
               0.014055621 = queryNorm
             0.6787378 = fieldWeight in 761, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.8566523 = idf(docFreq=938, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         0.15147744 = weight(abstract_txt:retrieval in 761) [ClassicSimilarity], result of:
           0.15147744 = score(doc=761,freq=12.0), product of:
             0.20124964 = queryWeight, product of:
               4.118536 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.014055621 = queryNorm
             0.7526843 = fieldWeight in 761, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
         1.005275 = weight(abstract_txt:trec in 761) [ClassicSimilarity], result of:
           1.005275 = score(doc=761,freq=8.0), product of:
             0.84822166 = queryWeight, product of:
               9.001374 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.014055621 = queryNorm
             1.185156 = fieldWeight in 761, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=761)
       0.56 = coord(14/25)
   

2. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 0.56

   0.5645394 = sum of:
     0.5645394 = product of:
       1.5681648 = sum of:
         0.100363694 = weight(abstract_txt:workshop in 877) [ClassicSimilarity], result of:
           0.100363694 = score(doc=877,freq=1.0), product of:
             0.09711826 = queryWeight, product of:
               1.0447085 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.014055621 = queryNorm
             1.0334173 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.045618333 = weight(abstract_txt:large in 877) [ClassicSimilarity], result of:
           0.045618333 = score(doc=877,freq=1.0), product of:
             0.06572135 = queryWeight, product of:
               1.052552 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.014055621 = queryNorm
             0.6941174 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.046776496 = weight(abstract_txt:evaluation in 877) [ClassicSimilarity], result of:
           0.046776496 = score(doc=877,freq=1.0), product of:
             0.066829056 = queryWeight, product of:
               1.061385 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.014055621 = queryNorm
             0.69994247 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.06417559 = weight(abstract_txt:history in 877) [ClassicSimilarity], result of:
           0.06417559 = score(doc=877,freq=1.0), product of:
             0.08251384 = queryWeight, product of:
               1.1793798 = boost
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.014055621 = queryNorm
             0.7777555 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.045779176 = weight(abstract_txt:text in 877) [ClassicSimilarity], result of:
           0.045779176 = score(doc=877,freq=1.0), product of:
             0.07250564 = queryWeight, product of:
               1.2765727 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014055621 = queryNorm
             0.6313878 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.0680665 = weight(abstract_txt:technology in 877) [ClassicSimilarity], result of:
           0.0680665 = score(doc=877,freq=1.0), product of:
             0.10174633 = queryWeight, product of:
               1.6907291 = boost
               4.2814875 = idf(docFreq=1668, maxDocs=44421)
               0.014055621 = queryNorm
             0.6689824 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2814875 = idf(docFreq=1668, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.11949234 = weight(abstract_txt:conference in 877) [ClassicSimilarity], result of:
           0.11949234 = score(doc=877,freq=1.0), product of:
             0.13745266 = queryWeight, product of:
               1.7576656 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.014055621 = queryNorm
             0.86933446 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.1893468 = weight(abstract_txt:retrieval in 877) [ClassicSimilarity], result of:
           0.1893468 = score(doc=877,freq=3.0), product of:
             0.20124964 = queryWeight, product of:
               4.118536 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.014055621 = queryNorm
             0.9408554 = fieldWeight in 877, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
         0.888546 = weight(abstract_txt:trec in 877) [ClassicSimilarity], result of:
           0.888546 = score(doc=877,freq=1.0), product of:
             0.84822166 = queryWeight, product of:
               9.001374 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.014055621 = queryNorm
             1.0475398 = fieldWeight in 877, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.15625 = fieldNorm(doc=877)
       0.36 = coord(9/25)
   

3. Harman, D.: ¬The Text REtrieval Conferences (TRECs) : providing a test-bed for information retrieval systems (1998) 0.51

   0.50836325 = sum of:
     0.50836325 = product of:
       1.4121201 = sum of:
         0.06021822 = weight(abstract_txt:workshop in 2314) [ClassicSimilarity], result of:
           0.06021822 = score(doc=2314,freq=1.0), product of:
             0.09711826 = queryWeight, product of:
               1.0447085 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.014055621 = queryNorm
             0.62005043 = fieldWeight in 2314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
         0.03870844 = weight(abstract_txt:large in 2314) [ClassicSimilarity], result of:
           0.03870844 = score(doc=2314,freq=2.0), product of:
             0.06572135 = queryWeight, product of:
               1.052552 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.014055621 = queryNorm
             0.5889782 = fieldWeight in 2314, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
         0.03154223 = weight(abstract_txt:major in 2314) [ClassicSimilarity], result of:
           0.03154223 = score(doc=2314,freq=1.0), product of:
             0.07223943 = queryWeight, product of:
               1.103513 = boost
               4.657435 = idf(docFreq=1145, maxDocs=44421)
               0.014055621 = queryNorm
             0.43663454 = fieldWeight in 2314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.657435 = idf(docFreq=1145, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
         0.03884492 = weight(abstract_txt:text in 2314) [ClassicSimilarity], result of:
           0.03884492 = score(doc=2314,freq=2.0), product of:
             0.07250564 = queryWeight, product of:
               1.2765727 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014055621 = queryNorm
             0.5357503 = fieldWeight in 2314, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
         0.057756342 = weight(abstract_txt:technology in 2314) [ClassicSimilarity], result of:
           0.057756342 = score(doc=2314,freq=2.0), product of:
             0.10174633 = queryWeight, product of:
               1.6907291 = boost
               4.2814875 = idf(docFreq=1668, maxDocs=44421)
               0.014055621 = queryNorm
             0.5676504 = fieldWeight in 2314, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2814875 = idf(docFreq=1668, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
         0.124180086 = weight(abstract_txt:conference in 2314) [ClassicSimilarity], result of:
           0.124180086 = score(doc=2314,freq=3.0), product of:
             0.13745266 = queryWeight, product of:
               1.7576656 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.014055621 = queryNorm
             0.9034389 = fieldWeight in 2314, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
         0.023857748 = weight(abstract_txt:have in 2314) [ClassicSimilarity], result of:
           0.023857748 = score(doc=2314,freq=1.0), product of:
             0.07954104 = queryWeight, product of:
               1.768782 = boost
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.014055621 = queryNorm
             0.2999426 = fieldWeight in 2314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
         0.113608085 = weight(abstract_txt:retrieval in 2314) [ClassicSimilarity], result of:
           0.113608085 = score(doc=2314,freq=3.0), product of:
             0.20124964 = queryWeight, product of:
               4.118536 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.014055621 = queryNorm
             0.5645132 = fieldWeight in 2314, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
         0.92340404 = weight(abstract_txt:trec in 2314) [ClassicSimilarity], result of:
           0.92340404 = score(doc=2314,freq=3.0), product of:
             0.84822166 = queryWeight, product of:
               9.001374 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.014055621 = queryNorm
             1.0886353 = fieldWeight in 2314, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.09375 = fieldNorm(doc=2314)
       0.36 = coord(9/25)
   

4. Harman, D.K.: ¬The first text retrieval conference : TREC-1, 1992 (1993) 0.35

   0.3531325 = sum of:
     0.3531325 = product of:
       1.2611874 = sum of:
         0.055504303 = weight(abstract_txt:text in 2317) [ClassicSimilarity], result of:
           0.055504303 = score(doc=2317,freq=3.0), product of:
             0.07250564 = queryWeight, product of:
               1.2765727 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014055621 = queryNorm
             0.76551706 = fieldWeight in 2317, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.109375 = fieldNorm(doc=2317)
         0.047646556 = weight(abstract_txt:technology in 2317) [ClassicSimilarity], result of:
           0.047646556 = score(doc=2317,freq=1.0), product of:
             0.10174633 = queryWeight, product of:
               1.6907291 = boost
               4.2814875 = idf(docFreq=1668, maxDocs=44421)
               0.014055621 = queryNorm
             0.4682877 = fieldWeight in 2317, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2814875 = idf(docFreq=1668, maxDocs=44421)
               0.109375 = fieldNorm(doc=2317)
         0.03439953 = weight(abstract_txt:been in 2317) [ClassicSimilarity], result of:
           0.03439953 = score(doc=2317,freq=1.0), product of:
             0.08701482 = queryWeight, product of:
               1.7127813 = boost
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.014055621 = queryNorm
             0.3953296 = fieldWeight in 2317, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.109375 = fieldNorm(doc=2317)
         0.08364464 = weight(abstract_txt:conference in 2317) [ClassicSimilarity], result of:
           0.08364464 = score(doc=2317,freq=1.0), product of:
             0.13745266 = queryWeight, product of:
               1.7576656 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.014055621 = queryNorm
             0.60853416 = fieldWeight in 2317, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.109375 = fieldNorm(doc=2317)
         0.027834041 = weight(abstract_txt:have in 2317) [ClassicSimilarity], result of:
           0.027834041 = score(doc=2317,freq=1.0), product of:
             0.07954104 = queryWeight, product of:
               1.768782 = boost
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.014055621 = queryNorm
             0.34993306 = fieldWeight in 2317, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.199388 = idf(docFreq=4924, maxDocs=44421)
               0.109375 = fieldNorm(doc=2317)
         0.13254277 = weight(abstract_txt:retrieval in 2317) [ClassicSimilarity], result of:
           0.13254277 = score(doc=2317,freq=3.0), product of:
             0.20124964 = queryWeight, product of:
               4.118536 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.014055621 = queryNorm
             0.6585988 = fieldWeight in 2317, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=2317)
         0.8796156 = weight(abstract_txt:trec in 2317) [ClassicSimilarity], result of:
           0.8796156 = score(doc=2317,freq=2.0), product of:
             0.84822166 = queryWeight, product of:
               9.001374 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.014055621 = queryNorm
             1.0370115 = fieldWeight in 2317, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.109375 = fieldNorm(doc=2317)
       0.28 = coord(7/25)
   

5. Robertson, S.E.; Walker, S.; Beaulieu, M.: Laboratory experiments with Okapi : participation in the TREC programme (1997) 0.34

   0.34452134 = sum of:
     0.34452134 = product of:
       1.2304333 = sum of:
         0.02768707 = weight(abstract_txt:problem in 2284) [ClassicSimilarity], result of:
           0.02768707 = score(doc=2284,freq=1.0), product of:
             0.06622633 = queryWeight, product of:
               1.0565879 = boost
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.014055621 = queryNorm
             0.4180674 = fieldWeight in 2284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.09375 = fieldNorm(doc=2284)
         0.028065898 = weight(abstract_txt:evaluation in 2284) [ClassicSimilarity], result of:
           0.028065898 = score(doc=2284,freq=1.0), product of:
             0.066829056 = queryWeight, product of:
               1.061385 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.014055621 = queryNorm
             0.4199655 = fieldWeight in 2284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=2284)
         0.038505357 = weight(abstract_txt:history in 2284) [ClassicSimilarity], result of:
           0.038505357 = score(doc=2284,freq=1.0), product of:
             0.08251384 = queryWeight, product of:
               1.1793798 = boost
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.014055621 = queryNorm
             0.46665332 = fieldWeight in 2284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9776354 = idf(docFreq=831, maxDocs=44421)
               0.09375 = fieldNorm(doc=2284)
         0.027467506 = weight(abstract_txt:text in 2284) [ClassicSimilarity], result of:
           0.027467506 = score(doc=2284,freq=1.0), product of:
             0.07250564 = queryWeight, product of:
               1.2765727 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014055621 = queryNorm
             0.3788327 = fieldWeight in 2284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.09375 = fieldNorm(doc=2284)
         0.07169541 = weight(abstract_txt:conference in 2284) [ClassicSimilarity], result of:
           0.07169541 = score(doc=2284,freq=1.0), product of:
             0.13745266 = queryWeight, product of:
               1.7576656 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.014055621 = queryNorm
             0.5216007 = fieldWeight in 2284, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.09375 = fieldNorm(doc=2284)
         0.113608085 = weight(abstract_txt:retrieval in 2284) [ClassicSimilarity], result of:
           0.113608085 = score(doc=2284,freq=3.0), product of:
             0.20124964 = queryWeight, product of:
               4.118536 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.014055621 = queryNorm
             0.5645132 = fieldWeight in 2284, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=2284)
         0.92340404 = weight(abstract_txt:trec in 2284) [ClassicSimilarity], result of:
           0.92340404 = score(doc=2284,freq=3.0), product of:
             0.84822166 = queryWeight, product of:
               9.001374 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.014055621 = queryNorm
             1.0886353 = fieldWeight in 2284, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.09375 = fieldNorm(doc=2284)
       0.28 = coord(7/25)