Document (#16505)

Author

Drabenstott, K.M.
Weller, M.S.

Title

¬A comparative approach to system evaluation : delegating control of retrieval tests to an experimental online system

Source

Global complexity: information, chaos and control. Proceedings of the 59th Annual Meeting of the American Society for Information Science, ASIS'96, Baltimore, Maryland, 21-24 Oct 1996. Ed.: S. Hardin

Imprint

Medford, NJ : Learned Information

Year

1996

Pages

S.34-40

Abstract

Describes the comparative approach to system evaluation used in this research project which delegated the administartion of an online retrieval test to an experimental online catalogue to produce data for evaluating the effectiveness of a new subject access design. Describes the methods enlisted to sort out problem test administration, e.g. to identify out-of-scope queries, incomplete system administration, and suspect post-search questionnaire responses. Covers how w the researchers handled problem search administrations and what actions they would use to reduce or eliminate the occurrence of such administrations in future online retrieval tests that delegate control of retrieval tests to online systems

Theme

Retrievalstudien

Similar documents (author)

1. Drabenstott, K.M.; Weller, M.S.: Testing a new design for subject searching in online catalogs (1994) 5.91

   5.9143763 = sum of:
     5.9143763 = sum of:
       2.7884655 = weight(author_txt:drabenstott in 7715) [ClassicSimilarity], result of:
         2.7884655 = score(doc=7715,freq=1.0), product of:
           0.6797024 = queryWeight, product of:
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.08284043 = queryNorm
           4.10248 = fieldWeight in 7715, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.5 = fieldNorm(doc=7715)
       3.125911 = weight(author_txt:weller in 7715) [ClassicSimilarity], result of:
         3.125911 = score(doc=7715,freq=1.0), product of:
           0.733488 = queryWeight, product of:
             1.0388124 = boost
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.08284043 = queryNorm
           4.261707 = fieldWeight in 7715, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.5 = fieldNorm(doc=7715)
   

2. Drabenstott, K.M.; Weller, M.S.: Failure analysis of subject searches in a test of a new design for subject access to online catalogs (1996) 5.91

   5.9143763 = sum of:
     5.9143763 = sum of:
       2.7884655 = weight(author_txt:drabenstott in 4450) [ClassicSimilarity], result of:
         2.7884655 = score(doc=4450,freq=1.0), product of:
           0.6797024 = queryWeight, product of:
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.08284043 = queryNorm
           4.10248 = fieldWeight in 4450, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.5 = fieldNorm(doc=4450)
       3.125911 = weight(author_txt:weller in 4450) [ClassicSimilarity], result of:
         3.125911 = score(doc=4450,freq=1.0), product of:
           0.733488 = queryWeight, product of:
             1.0388124 = boost
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.08284043 = queryNorm
           4.261707 = fieldWeight in 4450, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.5 = fieldNorm(doc=4450)
   

3. Drabenstott, K.M.; Weller, M.S.: Improving personal-name searching in online catalogs (1996) 5.91

   5.9143763 = sum of:
     5.9143763 = sum of:
       2.7884655 = weight(author_txt:drabenstott in 6810) [ClassicSimilarity], result of:
         2.7884655 = score(doc=6810,freq=1.0), product of:
           0.6797024 = queryWeight, product of:
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.08284043 = queryNorm
           4.10248 = fieldWeight in 6810, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.5 = fieldNorm(doc=6810)
       3.125911 = weight(author_txt:weller in 6810) [ClassicSimilarity], result of:
         3.125911 = score(doc=6810,freq=1.0), product of:
           0.733488 = queryWeight, product of:
             1.0388124 = boost
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.08284043 = queryNorm
           4.261707 = fieldWeight in 6810, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.5 = fieldNorm(doc=6810)
   

4. Drabenstott, K.M.; Weller, M.S.: ¬The exact-display approach for online catalog subject searching (1996) 5.91

   5.9143763 = sum of:
     5.9143763 = sum of:
       2.7884655 = weight(author_txt:drabenstott in 6999) [ClassicSimilarity], result of:
         2.7884655 = score(doc=6999,freq=1.0), product of:
           0.6797024 = queryWeight, product of:
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.08284043 = queryNorm
           4.10248 = fieldWeight in 6999, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.5 = fieldNorm(doc=6999)
       3.125911 = weight(author_txt:weller in 6999) [ClassicSimilarity], result of:
         3.125911 = score(doc=6999,freq=1.0), product of:
           0.733488 = queryWeight, product of:
             1.0388124 = boost
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.08284043 = queryNorm
           4.261707 = fieldWeight in 6999, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.5 = fieldNorm(doc=6999)
   

5. Drabenstott, K.M.; Weller, M.S.: Testing a new design for subject access to online catalogs (1995) 5.91

   5.9143763 = sum of:
     5.9143763 = sum of:
       2.7884655 = weight(author_txt:drabenstott in 385) [ClassicSimilarity], result of:
         2.7884655 = score(doc=385,freq=1.0), product of:
           0.6797024 = queryWeight, product of:
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.08284043 = queryNorm
           4.10248 = fieldWeight in 385, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.20496 = idf(docFreq=32, maxDocs=44421)
             0.5 = fieldNorm(doc=385)
       3.125911 = weight(author_txt:weller in 385) [ClassicSimilarity], result of:
         3.125911 = score(doc=385,freq=1.0), product of:
           0.733488 = queryWeight, product of:
             1.0388124 = boost
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.08284043 = queryNorm
           4.261707 = fieldWeight in 385, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.523414 = idf(docFreq=23, maxDocs=44421)
             0.5 = fieldNorm(doc=385)
   

Similar documents (content)

1. Fieldhouse, M.; Hancock-Beaulieu, M.: ¬The changing face of OKAPI (1994) 0.22

   0.21673463 = sum of:
     0.21673463 = product of:
       0.67729574 = sum of:
         0.030205673 = weight(abstract_txt:describes in 1561) [ClassicSimilarity], result of:
           0.030205673 = score(doc=1561,freq=1.0), product of:
             0.10100464 = queryWeight, product of:
               1.2443519 = boost
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.021205131 = queryNorm
             0.29905233 = fieldWeight in 1561, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.078125 = fieldNorm(doc=1561)
         0.06846348 = weight(abstract_txt:evaluation in 1561) [ClassicSimilarity], result of:
           0.06846348 = score(doc=1561,freq=2.0), product of:
             0.1383285 = queryWeight, product of:
               1.4562246 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021205131 = queryNorm
             0.49493405 = fieldWeight in 1561, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=1561)
         0.08466011 = weight(abstract_txt:experimental in 1561) [ClassicSimilarity], result of:
           0.08466011 = score(doc=1561,freq=1.0), product of:
             0.20078667 = queryWeight, product of:
               1.7544459 = boost
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.021205131 = queryNorm
             0.4216421 = fieldWeight in 1561, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.078125 = fieldNorm(doc=1561)
         0.14105318 = weight(abstract_txt:comparative in 1561) [ClassicSimilarity], result of:
           0.14105318 = score(doc=1561,freq=1.0), product of:
             0.28218737 = queryWeight, product of:
               2.0798945 = boost
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.021205131 = queryNorm
             0.49985647 = fieldWeight in 1561, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.078125 = fieldNorm(doc=1561)
         0.04132465 = weight(abstract_txt:system in 1561) [ClassicSimilarity], result of:
           0.04132465 = score(doc=1561,freq=1.0), product of:
             0.15683094 = queryWeight, product of:
               2.1928222 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.021205131 = queryNorm
             0.26349807 = fieldWeight in 1561, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=1561)
         0.06400129 = weight(abstract_txt:retrieval in 1561) [ClassicSimilarity], result of:
           0.06400129 = score(doc=1561,freq=2.0), product of:
             0.1666255 = queryWeight, product of:
               2.2602594 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021205131 = queryNorm
             0.3841026 = fieldWeight in 1561, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=1561)
         0.18133119 = weight(abstract_txt:tests in 1561) [ClassicSimilarity], result of:
           0.18133119 = score(doc=1561,freq=1.0), product of:
             0.38191003 = queryWeight, product of:
               2.9634576 = boost
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.021205131 = queryNorm
             0.4748008 = fieldWeight in 1561, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.078125 = fieldNorm(doc=1561)
         0.06625617 = weight(abstract_txt:online in 1561) [ClassicSimilarity], result of:
           0.06625617 = score(doc=1561,freq=1.0), product of:
             0.23142657 = queryWeight, product of:
               2.9781675 = boost
               3.6645708 = idf(docFreq=3092, maxDocs=44421)
               0.021205131 = queryNorm
             0.28629458 = fieldWeight in 1561, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6645708 = idf(docFreq=3092, maxDocs=44421)
               0.078125 = fieldNorm(doc=1561)
       0.32 = coord(8/25)
   

2. Larson, R.R.: Evaluation of advanced retrieval techniques in an experimental online catalog (1992) 0.18

   0.17828554 = sum of:
     0.17828554 = product of:
       0.63673407 = sum of:
         0.045529876 = weight(abstract_txt:search in 480) [ClassicSimilarity], result of:
           0.045529876 = score(doc=480,freq=3.0), product of:
             0.09206747 = queryWeight, product of:
               1.1880252 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.021205131 = queryNorm
             0.49452728 = fieldWeight in 480, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=480)
         0.030205673 = weight(abstract_txt:describes in 480) [ClassicSimilarity], result of:
           0.030205673 = score(doc=480,freq=1.0), product of:
             0.10100464 = queryWeight, product of:
               1.2443519 = boost
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.021205131 = queryNorm
             0.29905233 = fieldWeight in 480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.82787 = idf(docFreq=2626, maxDocs=44421)
               0.078125 = fieldNorm(doc=480)
         0.08466011 = weight(abstract_txt:experimental in 480) [ClassicSimilarity], result of:
           0.08466011 = score(doc=480,freq=1.0), product of:
             0.20078667 = queryWeight, product of:
               1.7544459 = boost
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.021205131 = queryNorm
             0.4216421 = fieldWeight in 480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.078125 = fieldNorm(doc=480)
         0.04132465 = weight(abstract_txt:system in 480) [ClassicSimilarity], result of:
           0.04132465 = score(doc=480,freq=1.0), product of:
             0.15683094 = queryWeight, product of:
               2.1928222 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.021205131 = queryNorm
             0.26349807 = fieldWeight in 480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=480)
         0.07838525 = weight(abstract_txt:retrieval in 480) [ClassicSimilarity], result of:
           0.07838525 = score(doc=480,freq=3.0), product of:
             0.1666255 = queryWeight, product of:
               2.2602594 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021205131 = queryNorm
             0.4704277 = fieldWeight in 480, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=480)
         0.18133119 = weight(abstract_txt:tests in 480) [ClassicSimilarity], result of:
           0.18133119 = score(doc=480,freq=1.0), product of:
             0.38191003 = queryWeight, product of:
               2.9634576 = boost
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.021205131 = queryNorm
             0.4748008 = fieldWeight in 480, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.078125 = fieldNorm(doc=480)
         0.17529735 = weight(abstract_txt:online in 480) [ClassicSimilarity], result of:
           0.17529735 = score(doc=480,freq=7.0), product of:
             0.23142657 = queryWeight, product of:
               2.9781675 = boost
               3.6645708 = idf(docFreq=3092, maxDocs=44421)
               0.021205131 = queryNorm
             0.75746423 = fieldWeight in 480, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6645708 = idf(docFreq=3092, maxDocs=44421)
               0.078125 = fieldNorm(doc=480)
       0.28 = coord(7/25)
   

3. Jacucci, G.; Barral, O.; Daee, P.; Wenzel, M.; Serim, B.; Ruotsalo, T.; Pluchino, P.; Freeman, J.; Gamberini, L.; Kaski, S.; Blankertz, B.: Integrating neurophysiologic relevance feedback in intent modeling for information retrieval (2019) 0.17

   0.17310688 = sum of:
     0.17310688 = product of:
       0.48085243 = sum of:
         0.058352854 = weight(abstract_txt:responses in 356) [ClassicSimilarity], result of:
           0.058352854 = score(doc=356,freq=1.0), product of:
             0.14429581 = queryWeight, product of:
               1.0516819 = boost
               6.470359 = idf(docFreq=186, maxDocs=44421)
               0.021205131 = queryNorm
             0.40439743 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.470359 = idf(docFreq=186, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.029739993 = weight(abstract_txt:search in 356) [ClassicSimilarity], result of:
           0.029739993 = score(doc=356,freq=2.0), product of:
             0.09206747 = queryWeight, product of:
               1.1880252 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.021205131 = queryNorm
             0.3230239 = fieldWeight in 356, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.02255902 = weight(abstract_txt:approach in 356) [ClassicSimilarity], result of:
           0.02255902 = score(doc=356,freq=1.0), product of:
             0.09647967 = queryWeight, product of:
               1.2161592 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.021205131 = queryNorm
             0.2338215 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.09301545 = weight(abstract_txt:incomplete in 356) [ClassicSimilarity], result of:
           0.09301545 = score(doc=356,freq=1.0), product of:
             0.19690152 = queryWeight, product of:
               1.2285196 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.021205131 = queryNorm
             0.4723958 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.038728796 = weight(abstract_txt:evaluation in 356) [ClassicSimilarity], result of:
           0.038728796 = score(doc=356,freq=1.0), product of:
             0.1383285 = queryWeight, product of:
               1.4562246 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021205131 = queryNorm
             0.279977 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.06772809 = weight(abstract_txt:experimental in 356) [ClassicSimilarity], result of:
           0.06772809 = score(doc=356,freq=1.0), product of:
             0.20078667 = queryWeight, product of:
               1.7544459 = boost
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.021205131 = queryNorm
             0.33731368 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397019 = idf(docFreq=546, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.033059716 = weight(abstract_txt:system in 356) [ClassicSimilarity], result of:
           0.033059716 = score(doc=356,freq=1.0), product of:
             0.15683094 = queryWeight, product of:
               2.1928222 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.021205131 = queryNorm
             0.21079844 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.0627082 = weight(abstract_txt:retrieval in 356) [ClassicSimilarity], result of:
           0.0627082 = score(doc=356,freq=3.0), product of:
             0.1666255 = queryWeight, product of:
               2.2602594 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021205131 = queryNorm
             0.37634215 = fieldWeight in 356, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.07496031 = weight(abstract_txt:online in 356) [ClassicSimilarity], result of:
           0.07496031 = score(doc=356,freq=2.0), product of:
             0.23142657 = queryWeight, product of:
               2.9781675 = boost
               3.6645708 = idf(docFreq=3092, maxDocs=44421)
               0.021205131 = queryNorm
             0.32390535 = fieldWeight in 356, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6645708 = idf(docFreq=3092, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
       0.36 = coord(9/25)
   

4. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.17

   0.17189553 = sum of:
     0.17189553 = product of:
       0.53717357 = sum of:
         0.0420587 = weight(abstract_txt:search in 4700) [ClassicSimilarity], result of:
           0.0420587 = score(doc=4700,freq=4.0), product of:
             0.09206747 = queryWeight, product of:
               1.1880252 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.021205131 = queryNorm
             0.45682475 = fieldWeight in 4700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.02255902 = weight(abstract_txt:approach in 4700) [ClassicSimilarity], result of:
           0.02255902 = score(doc=4700,freq=1.0), product of:
             0.09647967 = queryWeight, product of:
               1.2161592 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.021205131 = queryNorm
             0.2338215 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.07745759 = weight(abstract_txt:evaluation in 4700) [ClassicSimilarity], result of:
           0.07745759 = score(doc=4700,freq=4.0), product of:
             0.1383285 = queryWeight, product of:
               1.4562246 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021205131 = queryNorm
             0.559954 = fieldWeight in 4700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.055354867 = weight(abstract_txt:test in 4700) [ClassicSimilarity], result of:
           0.055354867 = score(doc=4700,freq=1.0), product of:
             0.17551984 = queryWeight, product of:
               1.6403466 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.021205131 = queryNorm
             0.3153767 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.033059716 = weight(abstract_txt:system in 4700) [ClassicSimilarity], result of:
           0.033059716 = score(doc=4700,freq=1.0), product of:
             0.15683094 = queryWeight, product of:
               2.1928222 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.021205131 = queryNorm
             0.21079844 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.1086138 = weight(abstract_txt:retrieval in 4700) [ClassicSimilarity], result of:
           0.1086138 = score(doc=4700,freq=9.0), product of:
             0.1666255 = queryWeight, product of:
               2.2602594 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021205131 = queryNorm
             0.6518438 = fieldWeight in 4700, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.14506495 = weight(abstract_txt:tests in 4700) [ClassicSimilarity], result of:
           0.14506495 = score(doc=4700,freq=1.0), product of:
             0.38191003 = queryWeight, product of:
               2.9634576 = boost
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.021205131 = queryNorm
             0.37984064 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
         0.05300494 = weight(abstract_txt:online in 4700) [ClassicSimilarity], result of:
           0.05300494 = score(doc=4700,freq=1.0), product of:
             0.23142657 = queryWeight, product of:
               2.9781675 = boost
               3.6645708 = idf(docFreq=3092, maxDocs=44421)
               0.021205131 = queryNorm
             0.22903568 = fieldWeight in 4700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6645708 = idf(docFreq=3092, maxDocs=44421)
               0.0625 = fieldNorm(doc=4700)
       0.32 = coord(8/25)
   

5. Parapar, J.; Losada, D.E.; Presedo-Quindimil, M.A.; Barreiro, A.: Using score distributions to compare statistical significance tests for information retrieval evaluation (2020) 0.17

   0.16685176 = sum of:
     0.16685176 = product of:
       0.6952157 = sum of:
         0.036423903 = weight(abstract_txt:search in 506) [ClassicSimilarity], result of:
           0.036423903 = score(doc=506,freq=3.0), product of:
             0.09206747 = queryWeight, product of:
               1.1880252 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.021205131 = queryNorm
             0.39562184 = fieldWeight in 506, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=506)
         0.02255902 = weight(abstract_txt:approach in 506) [ClassicSimilarity], result of:
           0.02255902 = score(doc=506,freq=1.0), product of:
             0.09647967 = queryWeight, product of:
               1.2161592 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.021205131 = queryNorm
             0.2338215 = fieldWeight in 506, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=506)
         0.054770786 = weight(abstract_txt:evaluation in 506) [ClassicSimilarity], result of:
           0.054770786 = score(doc=506,freq=2.0), product of:
             0.1383285 = queryWeight, product of:
               1.4562246 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.021205131 = queryNorm
             0.39594725 = fieldWeight in 506, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=506)
         0.14645521 = weight(abstract_txt:test in 506) [ClassicSimilarity], result of:
           0.14645521 = score(doc=506,freq=7.0), product of:
             0.17551984 = queryWeight, product of:
               1.6403466 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.021205131 = queryNorm
             0.8344083 = fieldWeight in 506, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0625 = fieldNorm(doc=506)
         0.05120103 = weight(abstract_txt:retrieval in 506) [ClassicSimilarity], result of:
           0.05120103 = score(doc=506,freq=2.0), product of:
             0.1666255 = queryWeight, product of:
               2.2602594 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.021205131 = queryNorm
             0.3072821 = fieldWeight in 506, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=506)
         0.38380578 = weight(abstract_txt:tests in 506) [ClassicSimilarity], result of:
           0.38380578 = score(doc=506,freq=7.0), product of:
             0.38191003 = queryWeight, product of:
               2.9634576 = boost
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.021205131 = queryNorm
             1.0049639 = fieldWeight in 506, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.0625 = fieldNorm(doc=506)
       0.24 = coord(6/25)