Document (#21763)

Author

Dunlop, M.D.
Johnson, C.W.
Reid, J.

Title

Exploring the layers of information retrieval evaluation

Source

Interacting with computers. 10(1998) no.3, S.225-236

Year

1998

Abstract

Presents current work on modelling interactive information retrieval systems and users' interactions with them. Analyzes the papers in this special issue in the context of evaluation in information retrieval (IR) by examining the different layers at which IR use could be evaluated. IR poses the double evaluation problem of evaluating both the underlying system effectiveness and the overall ability of the system to aid users. The papers look at different issues in combining human-computer interaction (HCI) research with IR research and provide insights into the problem of evaluating the information seeking process

Footnote

Contribution to a special section of articles related to human-computer interaction and information retrieval

Theme

Retrievalstudien

Similar documents (author)

1. Johnson, C.; Dunlop, M.D.: Subjectivity and notions of time and value in interactive information retrieval (1998) 3.08

   3.0830343 = sum of:
     3.0830343 = product of:
       4.6245513 = sum of:
         1.4449222 = weight(author_txt:johnson in 4611) [ClassicSimilarity], result of:
           1.4449222 = score(doc=4611,freq=1.0), product of:
             0.3954889 = queryWeight, product of:
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.054124523 = queryNorm
             3.6535091 = fieldWeight in 4611, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.5 = fieldNorm(doc=4611)
         3.179629 = weight(author_txt:dunlop in 4611) [ClassicSimilarity], result of:
           3.179629 = score(doc=4611,freq=1.0), product of:
             0.66909677 = queryWeight, product of:
               1.3007005 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.054124523 = queryNorm
             4.7521214 = fieldWeight in 4611, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.5 = fieldNorm(doc=4611)
       0.6666667 = coord(2/3)
   

2. Dunlop, P.: Main entry : the argument against the irrelevance of the main entry concept (1996) 1.32

   1.3248454 = sum of:
     1.3248454 = product of:
       3.9745362 = sum of:
         3.9745362 = weight(author_txt:dunlop in 263) [ClassicSimilarity], result of:
           3.9745362 = score(doc=263,freq=1.0), product of:
             0.66909677 = queryWeight, product of:
               1.3007005 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.054124523 = queryNorm
             5.9401517 = fieldWeight in 263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.625 = fieldNorm(doc=263)
       0.33333334 = coord(1/3)
   

3. Dunlop, P.: Serials : a climate for change (1999) 1.32

   1.3248454 = sum of:
     1.3248454 = product of:
       3.9745362 = sum of:
         3.9745362 = weight(author_txt:dunlop in 276) [ClassicSimilarity], result of:
           3.9745362 = score(doc=276,freq=1.0), product of:
             0.66909677 = queryWeight, product of:
               1.3007005 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.054124523 = queryNorm
             5.9401517 = fieldWeight in 276, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.625 = fieldNorm(doc=276)
       0.33333334 = coord(1/3)
   

4. Reid, H.T.: CD-ROM as a library equivalent (1992) 1.21

   1.2081459 = sum of:
     1.2081459 = product of:
       3.6244376 = sum of:
         3.6244376 = weight(author_txt:reid in 3751) [ClassicSimilarity], result of:
           3.6244376 = score(doc=3751,freq=1.0), product of:
             0.62920433 = queryWeight, product of:
               1.26133 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.054124523 = queryNorm
             5.7603507 = fieldWeight in 3751, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.625 = fieldNorm(doc=3751)
       0.33333334 = coord(1/3)
   

5. Reid, H.T.: Continued power with full-text CDROM (1994) 1.21

   1.2081459 = sum of:
     1.2081459 = product of:
       3.6244376 = sum of:
         3.6244376 = weight(author_txt:reid in 336) [ClassicSimilarity], result of:
           3.6244376 = score(doc=336,freq=1.0), product of:
             0.62920433 = queryWeight, product of:
               1.26133 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.054124523 = queryNorm
             5.7603507 = fieldWeight in 336, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.625 = fieldNorm(doc=336)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.27

   0.2711823 = sum of:
     0.2711823 = product of:
       0.6163234 = sum of:
         0.05930758 = weight(abstract_txt:interactive in 3019) [ClassicSimilarity], result of:
           0.05930758 = score(doc=3019,freq=3.0), product of:
             0.13144554 = queryWeight, product of:
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.023652848 = queryNorm
             0.45119506 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.042972445 = weight(abstract_txt:interactions in 3019) [ClassicSimilarity], result of:
           0.042972445 = score(doc=3019,freq=1.0), product of:
             0.15293476 = queryWeight, product of:
               1.078649 = boost
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.023652848 = queryNorm
             0.28098547 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.017799022 = weight(abstract_txt:research in 3019) [ClassicSimilarity], result of:
           0.017799022 = score(doc=3019,freq=2.0), product of:
             0.08497873 = queryWeight, product of:
               1.1370962 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.023652848 = queryNorm
             0.20945267 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.021650573 = weight(abstract_txt:system in 3019) [ClassicSimilarity], result of:
           0.021650573 = score(doc=3019,freq=2.0), product of:
             0.09683353 = queryWeight, product of:
               1.2138218 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.023652848 = queryNorm
             0.2235855 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.025616737 = weight(abstract_txt:users in 3019) [ClassicSimilarity], result of:
           0.025616737 = score(doc=3019,freq=2.0), product of:
             0.108325 = queryWeight, product of:
               1.2838267 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.023652848 = queryNorm
             0.23648039 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.01955872 = weight(abstract_txt:different in 3019) [ClassicSimilarity], result of:
           0.01955872 = score(doc=3019,freq=1.0), product of:
             0.114011794 = queryWeight, product of:
               1.3170946 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.023652848 = queryNorm
             0.17154998 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.011294728 = weight(abstract_txt:information in 3019) [ClassicSimilarity], result of:
           0.011294728 = score(doc=3019,freq=1.0), product of:
             0.09961315 = queryWeight, product of:
               1.7410666 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023652848 = queryNorm
             0.113385916 = fieldWeight in 3019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.043558292 = weight(abstract_txt:retrieval in 3019) [ClassicSimilarity], result of:
           0.043558292 = score(doc=3019,freq=3.0), product of:
             0.15432161 = queryWeight, product of:
               1.8767269 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.023652848 = queryNorm
             0.2822566 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.100885004 = weight(abstract_txt:papers in 3019) [ClassicSimilarity], result of:
           0.100885004 = score(doc=3019,freq=3.0), product of:
             0.23599356 = queryWeight, product of:
               1.8949255 = boost
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.023652848 = queryNorm
             0.42749047 = fieldWeight in 3019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.11226982 = weight(abstract_txt:evaluating in 3019) [ClassicSimilarity], result of:
           0.11226982 = score(doc=3019,freq=2.0), product of:
             0.29010475 = queryWeight, product of:
               2.1009681 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.023652848 = queryNorm
             0.38699752 = fieldWeight in 3019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
         0.16141051 = weight(abstract_txt:evaluation in 3019) [ClassicSimilarity], result of:
           0.16141051 = score(doc=3019,freq=9.0), product of:
             0.2562282 = queryWeight, product of:
               2.4182498 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.023652848 = queryNorm
             0.62994826 = fieldWeight in 3019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=3019)
       0.44 = coord(11/25)
   

2. Park, T.K.: ¬The nature of relevance in information retrieval : an empirical study (1993) 0.23

   0.22502533 = sum of:
     0.22502533 = product of:
       0.70320415 = sum of:
         0.020976348 = weight(abstract_txt:research in 5335) [ClassicSimilarity], result of:
           0.020976348 = score(doc=5335,freq=1.0), product of:
             0.08497873 = queryWeight, product of:
               1.1370962 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.023652848 = queryNorm
             0.24684234 = fieldWeight in 5335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.078125 = fieldNorm(doc=5335)
         0.025515446 = weight(abstract_txt:system in 5335) [ClassicSimilarity], result of:
           0.025515446 = score(doc=5335,freq=1.0), product of:
             0.09683353 = queryWeight, product of:
               1.2138218 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.023652848 = queryNorm
             0.26349807 = fieldWeight in 5335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=5335)
         0.052289944 = weight(abstract_txt:users in 5335) [ClassicSimilarity], result of:
           0.052289944 = score(doc=5335,freq=3.0), product of:
             0.108325 = queryWeight, product of:
               1.2838267 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.023652848 = queryNorm
             0.48271355 = fieldWeight in 5335, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=5335)
         0.05897474 = weight(abstract_txt:problem in 5335) [ClassicSimilarity], result of:
           0.05897474 = score(doc=5335,freq=1.0), product of:
             0.16927819 = queryWeight, product of:
               1.60488 = boost
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.023652848 = queryNorm
             0.34838948 = fieldWeight in 5335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.078125 = fieldNorm(doc=5335)
         0.02662193 = weight(abstract_txt:information in 5335) [ClassicSimilarity], result of:
           0.02662193 = score(doc=5335,freq=2.0), product of:
             0.09961315 = queryWeight, product of:
               1.7410666 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023652848 = queryNorm
             0.26725316 = fieldWeight in 5335, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=5335)
         0.059275333 = weight(abstract_txt:retrieval in 5335) [ClassicSimilarity], result of:
           0.059275333 = score(doc=5335,freq=2.0), product of:
             0.15432161 = queryWeight, product of:
               1.8767269 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.023652848 = queryNorm
             0.3841026 = fieldWeight in 5335, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=5335)
         0.13231125 = weight(abstract_txt:evaluating in 5335) [ClassicSimilarity], result of:
           0.13231125 = score(doc=5335,freq=1.0), product of:
             0.29010475 = queryWeight, product of:
               2.1009681 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.023652848 = queryNorm
             0.45608097 = fieldWeight in 5335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.078125 = fieldNorm(doc=5335)
         0.32723913 = weight(abstract_txt:layers in 5335) [ClassicSimilarity], result of:
           0.32723913 = score(doc=5335,freq=1.0), product of:
             0.5305591 = queryWeight, product of:
               2.8412468 = boost
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.023652848 = queryNorm
             0.61678165 = fieldWeight in 5335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.078125 = fieldNorm(doc=5335)
       0.32 = coord(8/25)
   

3. Tague-Sutcliffe, J.M.: Some perspectives on the evaluation of information retrieval systems (1996) 0.22

   0.21809085 = sum of:
     0.21809085 = product of:
       0.77889585 = sum of:
         0.068482496 = weight(abstract_txt:interactive in 4231) [ClassicSimilarity], result of:
           0.068482496 = score(doc=4231,freq=1.0), product of:
             0.13144554 = queryWeight, product of:
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.023652848 = queryNorm
             0.5209952 = fieldWeight in 4231, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.09375 = fieldNorm(doc=4231)
         0.036227535 = weight(abstract_txt:users in 4231) [ClassicSimilarity], result of:
           0.036227535 = score(doc=4231,freq=1.0), product of:
             0.108325 = queryWeight, product of:
               1.2838267 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.023652848 = queryNorm
             0.33443376 = fieldWeight in 4231, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.09375 = fieldNorm(doc=4231)
         0.031946316 = weight(abstract_txt:information in 4231) [ClassicSimilarity], result of:
           0.031946316 = score(doc=4231,freq=2.0), product of:
             0.09961315 = queryWeight, product of:
               1.7410666 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023652848 = queryNorm
             0.3207038 = fieldWeight in 4231, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=4231)
         0.10059358 = weight(abstract_txt:retrieval in 4231) [ClassicSimilarity], result of:
           0.10059358 = score(doc=4231,freq=4.0), product of:
             0.15432161 = queryWeight, product of:
               1.8767269 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.023652848 = queryNorm
             0.6518438 = fieldWeight in 4231, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=4231)
         0.116491966 = weight(abstract_txt:papers in 4231) [ClassicSimilarity], result of:
           0.116491966 = score(doc=4231,freq=1.0), product of:
             0.23599356 = queryWeight, product of:
               1.8949255 = boost
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.023652848 = queryNorm
             0.4936235 = fieldWeight in 4231, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.09375 = fieldNorm(doc=4231)
         0.317547 = weight(abstract_txt:evaluating in 4231) [ClassicSimilarity], result of:
           0.317547 = score(doc=4231,freq=4.0), product of:
             0.29010475 = queryWeight, product of:
               2.1009681 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.023652848 = queryNorm
             1.0945942 = fieldWeight in 4231, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.09375 = fieldNorm(doc=4231)
         0.10760701 = weight(abstract_txt:evaluation in 4231) [ClassicSimilarity], result of:
           0.10760701 = score(doc=4231,freq=1.0), product of:
             0.2562282 = queryWeight, product of:
               2.4182498 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.023652848 = queryNorm
             0.4199655 = fieldWeight in 4231, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=4231)
       0.28 = coord(7/25)
   

4. Wang, B.; Liu, J.: Understanding users' dynamic perceptions of search gain and cost in sessions : an expectation confirmation model (2024) 0.21

   0.21147142 = sum of:
     0.21147142 = product of:
       0.52867854 = sum of:
         0.045654997 = weight(abstract_txt:interactive in 2339) [ClassicSimilarity], result of:
           0.045654997 = score(doc=2339,freq=1.0), product of:
             0.13144554 = queryWeight, product of:
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.023652848 = queryNorm
             0.34733012 = fieldWeight in 2339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.056455914 = weight(abstract_txt:insights in 2339) [ClassicSimilarity], result of:
           0.056455914 = score(doc=2339,freq=1.0), product of:
             0.15143512 = queryWeight, product of:
               1.0733476 = boost
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.023652848 = queryNorm
             0.37280595 = fieldWeight in 2339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.057296596 = weight(abstract_txt:interactions in 2339) [ClassicSimilarity], result of:
           0.057296596 = score(doc=2339,freq=1.0), product of:
             0.15293476 = queryWeight, product of:
               1.078649 = boost
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.023652848 = queryNorm
             0.37464732 = fieldWeight in 2339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.060914874 = weight(abstract_txt:examining in 2339) [ClassicSimilarity], result of:
           0.060914874 = score(doc=2339,freq=1.0), product of:
             0.15930738 = queryWeight, product of:
               1.1008928 = boost
               6.1179714 = idf(docFreq=265, maxDocs=44421)
               0.023652848 = queryNorm
             0.3823732 = fieldWeight in 2339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1179714 = idf(docFreq=265, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.016781079 = weight(abstract_txt:research in 2339) [ClassicSimilarity], result of:
           0.016781079 = score(doc=2339,freq=1.0), product of:
             0.08497873 = queryWeight, product of:
               1.1370962 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.023652848 = queryNorm
             0.19747387 = fieldWeight in 2339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.059159316 = weight(abstract_txt:users in 2339) [ClassicSimilarity], result of:
           0.059159316 = score(doc=2339,freq=6.0), product of:
             0.108325 = queryWeight, product of:
               1.2838267 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.023652848 = queryNorm
             0.54612803 = fieldWeight in 2339, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.021297544 = weight(abstract_txt:information in 2339) [ClassicSimilarity], result of:
           0.021297544 = score(doc=2339,freq=2.0), product of:
             0.09961315 = queryWeight, product of:
               1.7410666 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023652848 = queryNorm
             0.21380253 = fieldWeight in 2339, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.033531193 = weight(abstract_txt:retrieval in 2339) [ClassicSimilarity], result of:
           0.033531193 = score(doc=2339,freq=1.0), product of:
             0.15432161 = queryWeight, product of:
               1.8767269 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.023652848 = queryNorm
             0.21728125 = fieldWeight in 2339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.105849 = weight(abstract_txt:evaluating in 2339) [ClassicSimilarity], result of:
           0.105849 = score(doc=2339,freq=1.0), product of:
             0.29010475 = queryWeight, product of:
               2.1009681 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.023652848 = queryNorm
             0.36486477 = fieldWeight in 2339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
         0.071738005 = weight(abstract_txt:evaluation in 2339) [ClassicSimilarity], result of:
           0.071738005 = score(doc=2339,freq=1.0), product of:
             0.2562282 = queryWeight, product of:
               2.4182498 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.023652848 = queryNorm
             0.279977 = fieldWeight in 2339, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=2339)
       0.4 = coord(10/25)
   

5. Wacholder, N.; Kelly, D.; Kantor, P.; Rittman, R.; Sun, Y.; Bai, B.; Small, S.; Yamrom, B.; Strzalkowski, T.: ¬A model for quantitative evaluation of an end-to-end question-answering system (2007) 0.20

   0.19973552 = sum of:
     0.19973552 = product of:
       0.6241735 = sum of:
         0.114137486 = weight(abstract_txt:interactive in 1435) [ClassicSimilarity], result of:
           0.114137486 = score(doc=1435,freq=4.0), product of:
             0.13144554 = queryWeight, product of:
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.023652848 = queryNorm
             0.8683253 = fieldWeight in 1435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.05907118 = weight(abstract_txt:underlying in 1435) [ClassicSimilarity], result of:
           0.05907118 = score(doc=1435,freq=1.0), product of:
             0.13450262 = queryWeight, product of:
               1.0115619 = boost
               5.6215343 = idf(docFreq=436, maxDocs=44421)
               0.023652848 = queryNorm
             0.43918237 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6215343 = idf(docFreq=436, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.04419405 = weight(abstract_txt:system in 1435) [ClassicSimilarity], result of:
           0.04419405 = score(doc=1435,freq=3.0), product of:
             0.09683353 = queryWeight, product of:
               1.2138218 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.023652848 = queryNorm
             0.45639202 = fieldWeight in 1435, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.030189615 = weight(abstract_txt:users in 1435) [ClassicSimilarity], result of:
           0.030189615 = score(doc=1435,freq=1.0), product of:
             0.108325 = queryWeight, product of:
               1.2838267 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.023652848 = queryNorm
             0.2786948 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.04610035 = weight(abstract_txt:different in 1435) [ClassicSimilarity], result of:
           0.04610035 = score(doc=1435,freq=2.0), product of:
             0.114011794 = queryWeight, product of:
               1.3170946 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.023652848 = queryNorm
             0.40434718 = fieldWeight in 1435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.018824548 = weight(abstract_txt:information in 1435) [ClassicSimilarity], result of:
           0.018824548 = score(doc=1435,freq=1.0), product of:
             0.09961315 = queryWeight, product of:
               1.7410666 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023652848 = queryNorm
             0.18897653 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.13231125 = weight(abstract_txt:evaluating in 1435) [ClassicSimilarity], result of:
           0.13231125 = score(doc=1435,freq=1.0), product of:
             0.29010475 = queryWeight, product of:
               2.1009681 = boost
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.023652848 = queryNorm
             0.45608097 = fieldWeight in 1435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8378363 = idf(docFreq=351, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
         0.17934501 = weight(abstract_txt:evaluation in 1435) [ClassicSimilarity], result of:
           0.17934501 = score(doc=1435,freq=4.0), product of:
             0.2562282 = queryWeight, product of:
               2.4182498 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.023652848 = queryNorm
             0.69994247 = fieldWeight in 1435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=1435)
       0.32 = coord(8/25)