Document (#12070)

Author

Hersh, W.
Pentecost, J.
Hickam, D.

Title

¬A task-oriented approach to information retrieval evaluation : overview and design for empirical testing

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.50-56

Year

1996

Abstract

As retrieval system become more oriented towards end-users, there is an increasing need for improved methods to evaluate their effectiveness. We performed a task-oriented assessment of 2 MEDLINE searching systems, one which promotes traditional Boolean searching on human-indexed thesaurus terms and the other natural language searching on words in the title, abstracts and indexing terms. Medical students were randomized to one of the 2 systems and given clinical questions to answer. The students were able to use each system successfully, with no significant differences in questions correctly answered, time taken, relevant articles retrieved, or user satisfaction between the systems. This approach to evaluation was successful in measuring effectiveness of system use and demonstrates that both types of systems can be used equally well with minimal training

Theme

Retrievalstudien

Similar documents (author)

1. Hersh, W.: Relevance and retrieval evaluation : perspectives from medicine (1994) 5.87

   5.874302 = sum of:
     5.874302 = weight(author_txt:hersh in 6931) [ClassicSimilarity], result of:
       5.874302 = fieldWeight in 6931, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.398883 = idf(docFreq=9, maxDocs=44421)
         0.625 = fieldNorm(doc=6931)
   

2. Hersh, R.: Reply to Martin Gardner (2001) 5.87

   5.874302 = sum of:
     5.874302 = weight(author_txt:hersh in 4571) [ClassicSimilarity], result of:
       5.874302 = fieldWeight in 4571, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.398883 = idf(docFreq=9, maxDocs=44421)
         0.625 = fieldNorm(doc=4571)
   

3. Hersh, W.R.; Hickam, D.H.: ¬A comparison of two methods for indexing and retrieval from a full-text medical database (1992) 4.70

   4.6994414 = sum of:
     4.6994414 = weight(author_txt:hersh in 4525) [ClassicSimilarity], result of:
       4.6994414 = fieldWeight in 4525, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.398883 = idf(docFreq=9, maxDocs=44421)
         0.5 = fieldNorm(doc=4525)
   

4. Hersh, W.R.; Over, P.: Interactivity at the Text Retrieval Conference (TREC) (2001) 4.70

   4.6994414 = sum of:
     4.6994414 = weight(author_txt:hersh in 5485) [ClassicSimilarity], result of:
       4.6994414 = fieldWeight in 5485, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.398883 = idf(docFreq=9, maxDocs=44421)
         0.5 = fieldNorm(doc=5485)
   

5. Hersh, W.R.; Hickam, D.H.: ¬An evaluation of interactive Boolean and natural language searching with an online medical textbook (1995) 4.70

   4.6994414 = sum of:
     4.6994414 = weight(author_txt:hersh in 2719) [ClassicSimilarity], result of:
       4.6994414 = fieldWeight in 2719, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.398883 = idf(docFreq=9, maxDocs=44421)
         0.5 = fieldNorm(doc=2719)
   

Similar documents (content)

1. Hersh, W.R.; Pentecost, J.; Hickam, D.H.: ¬A task-oriented approach to retrieval system evaluation (1995) 2.12

   2.1154585 = sum of:
     2.1154585 = product of:
       2.2036026 = sum of:
         0.07436868 = weight(abstract_txt:boolean in 3935) [ClassicSimilarity], result of:
           0.07436868 = score(doc=3935,freq=1.0), product of:
             0.15219186 = queryWeight, product of:
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.024332283 = queryNorm
             0.4886508 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.08016573 = weight(abstract_txt:satisfaction in 3935) [ClassicSimilarity], result of:
           0.08016573 = score(doc=3935,freq=1.0), product of:
             0.16000144 = queryWeight, product of:
               1.025336 = boost
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.024332283 = queryNorm
             0.5010313 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.08672207 = weight(abstract_txt:measuring in 3935) [ClassicSimilarity], result of:
           0.08672207 = score(doc=3935,freq=1.0), product of:
             0.16861044 = queryWeight, product of:
               1.0525591 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.024332283 = queryNorm
             0.5143339 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.090763286 = weight(abstract_txt:successfully in 3935) [ClassicSimilarity], result of:
           0.090763286 = score(doc=3935,freq=1.0), product of:
             0.17380871 = queryWeight, product of:
               1.0686612 = boost
               6.684188 = idf(docFreq=150, maxDocs=44421)
               0.024332283 = queryNorm
             0.5222022 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.684188 = idf(docFreq=150, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.09571631 = weight(abstract_txt:medline in 3935) [ClassicSimilarity], result of:
           0.09571631 = score(doc=3935,freq=1.0), product of:
             0.18007581 = queryWeight, product of:
               1.0877572 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.024332283 = queryNorm
             0.5315334 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.025540005 = weight(abstract_txt:retrieval in 3935) [ClassicSimilarity], result of:
           0.025540005 = score(doc=3935,freq=1.0), product of:
             0.09403483 = queryWeight, product of:
               1.1116387 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.024332283 = queryNorm
             0.27160156 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.105954014 = weight(abstract_txt:minimal in 3935) [ClassicSimilarity], result of:
           0.105954014 = score(doc=3935,freq=1.0), product of:
             0.19269761 = queryWeight, product of:
               1.1252329 = boost
               7.0380287 = idf(docFreq=105, maxDocs=44421)
               0.024332283 = queryNorm
             0.549846 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0380287 = idf(docFreq=105, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.11248105 = weight(abstract_txt:equally in 3935) [ClassicSimilarity], result of:
           0.11248105 = score(doc=3935,freq=1.0), product of:
             0.20053229 = queryWeight, product of:
               1.1478798 = boost
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.024332283 = queryNorm
             0.56091243 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.11624164 = weight(abstract_txt:clinical in 3935) [ClassicSimilarity], result of:
           0.11624164 = score(doc=3935,freq=1.0), product of:
             0.20497735 = queryWeight, product of:
               1.1605322 = boost
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.024332283 = queryNorm
             0.56709504 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.029984668 = weight(abstract_txt:were in 3935) [ClassicSimilarity], result of:
           0.029984668 = score(doc=3935,freq=1.0), product of:
             0.1046504 = queryWeight, product of:
               1.1727076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.024332283 = queryNorm
             0.28652224 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.031827867 = weight(abstract_txt:approach in 3935) [ClassicSimilarity], result of:
           0.031827867 = score(doc=3935,freq=1.0), product of:
             0.10889629 = queryWeight, product of:
               1.1962607 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.024332283 = queryNorm
             0.29227686 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.13123278 = weight(abstract_txt:answered in 3935) [ClassicSimilarity], result of:
           0.13123278 = score(doc=3935,freq=1.0), product of:
             0.22224209 = queryWeight, product of:
               1.2084187 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.024332283 = queryNorm
             0.59049475 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.13942705 = weight(abstract_txt:correctly in 3935) [ClassicSimilarity], result of:
           0.13942705 = score(doc=3935,freq=1.0), product of:
             0.2313997 = queryWeight, product of:
               1.2330642 = boost
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.024332283 = queryNorm
             0.60253775 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.15350588 = weight(abstract_txt:promotes in 3935) [ClassicSimilarity], result of:
           0.15350588 = score(doc=3935,freq=1.0), product of:
             0.2467259 = queryWeight, product of:
               1.273244 = boost
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.024332283 = queryNorm
             0.6221717 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.056839462 = weight(abstract_txt:terms in 3935) [ClassicSimilarity], result of:
           0.056839462 = score(doc=3935,freq=2.0), product of:
             0.12722273 = queryWeight, product of:
               1.2930093 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.024332283 = queryNorm
             0.44677126 = fieldWeight in 3935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.05464133 = weight(abstract_txt:evaluation in 3935) [ClassicSimilarity], result of:
           0.05464133 = score(doc=3935,freq=1.0), product of:
             0.15613091 = queryWeight, product of:
               1.4323981 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024332283 = queryNorm
             0.34997123 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.10005704 = weight(abstract_txt:questions in 3935) [ClassicSimilarity], result of:
           0.10005704 = score(doc=3935,freq=2.0), product of:
             0.18547976 = queryWeight, product of:
               1.5612323 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.024332283 = queryNorm
             0.53944993 = fieldWeight in 3935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.07176516 = weight(abstract_txt:task in 3935) [ClassicSimilarity], result of:
           0.07176516 = score(doc=3935,freq=1.0), product of:
             0.187248 = queryWeight, product of:
               1.5686566 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.024332283 = queryNorm
             0.38326263 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.10355169 = weight(abstract_txt:students in 3935) [ClassicSimilarity], result of:
           0.10355169 = score(doc=3935,freq=2.0), product of:
             0.18977378 = queryWeight, product of:
               1.5792009 = boost
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.024332283 = queryNorm
             0.5456586 = fieldWeight in 3935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.049472373 = weight(abstract_txt:system in 3935) [ClassicSimilarity], result of:
           0.049472373 = score(doc=3935,freq=2.0), product of:
             0.13276094 = queryWeight, product of:
               1.6177077 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.024332283 = queryNorm
             0.37264252 = fieldWeight in 3935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.113773435 = weight(abstract_txt:effectiveness in 3935) [ClassicSimilarity], result of:
           0.113773435 = score(doc=3935,freq=2.0), product of:
             0.20206542 = queryWeight, product of:
               1.6295409 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.024332283 = queryNorm
             0.5630525 = fieldWeight in 3935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.12436312 = weight(abstract_txt:searching in 3935) [ClassicSimilarity], result of:
           0.12436312 = score(doc=3935,freq=3.0), product of:
             0.21441695 = queryWeight, product of:
               2.0558643 = boost
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.024332283 = queryNorm
             0.580006 = fieldWeight in 3935, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.09650867 = weight(abstract_txt:systems in 3935) [ClassicSimilarity], result of:
           0.09650867 = score(doc=3935,freq=4.0), product of:
             0.18106824 = queryWeight, product of:
               2.181501 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024332283 = queryNorm
             0.5329961 = fieldWeight in 3935, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.15869923 = weight(abstract_txt:oriented in 3935) [ClassicSimilarity], result of:
           0.15869923 = score(doc=3935,freq=1.0), product of:
             0.3638215 = queryWeight, product of:
               2.677991 = boost
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.024332283 = queryNorm
             0.4362008 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
       0.96 = coord(24/25)
   

2. Hersh, W.R.; Hickam, D.H.: ¬An evaluation of interactive Boolean and natural language searching with an online medical textbook (1995) 0.45

   0.44761005 = sum of:
     0.44761005 = product of:
       1.1190251 = sum of:
         0.12620781 = weight(abstract_txt:boolean in 2719) [ClassicSimilarity], result of:
           0.12620781 = score(doc=2719,freq=2.0), product of:
             0.15219186 = queryWeight, product of:
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.024332283 = queryNorm
             0.82926786 = fieldWeight in 2719, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.053083904 = weight(abstract_txt:retrieval in 2719) [ClassicSimilarity], result of:
           0.053083904 = score(doc=2719,freq=3.0), product of:
             0.09403483 = queryWeight, product of:
               1.1116387 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.024332283 = queryNorm
             0.5645132 = fieldWeight in 2719, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.13948996 = weight(abstract_txt:clinical in 2719) [ClassicSimilarity], result of:
           0.13948996 = score(doc=2719,freq=1.0), product of:
             0.20497735 = queryWeight, product of:
               1.1605322 = boost
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.024332283 = queryNorm
             0.68051404 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.035981603 = weight(abstract_txt:were in 2719) [ClassicSimilarity], result of:
           0.035981603 = score(doc=2719,freq=1.0), product of:
             0.1046504 = queryWeight, product of:
               1.1727076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.024332283 = queryNorm
             0.3438267 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.065569595 = weight(abstract_txt:evaluation in 2719) [ClassicSimilarity], result of:
           0.065569595 = score(doc=2719,freq=1.0), product of:
             0.15613091 = queryWeight, product of:
               1.4323981 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024332283 = queryNorm
             0.4199655 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.3248966 = weight(abstract_txt:randomized in 2719) [ClassicSimilarity], result of:
           0.3248966 = score(doc=2719,freq=1.0), product of:
             0.36016986 = queryWeight, product of:
               1.53836 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.024332283 = queryNorm
             0.902065 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.08786653 = weight(abstract_txt:students in 2719) [ClassicSimilarity], result of:
           0.08786653 = score(doc=2719,freq=1.0), product of:
             0.18977378 = queryWeight, product of:
               1.5792009 = boost
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.024332283 = queryNorm
             0.46300668 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.0839574 = weight(abstract_txt:system in 2719) [ClassicSimilarity], result of:
           0.0839574 = score(doc=2719,freq=4.0), product of:
             0.13276094 = queryWeight, product of:
               1.6177077 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.024332283 = queryNorm
             0.6323953 = fieldWeight in 2719, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.086161286 = weight(abstract_txt:searching in 2719) [ClassicSimilarity], result of:
           0.086161286 = score(doc=2719,freq=1.0), product of:
             0.21441695 = queryWeight, product of:
               2.0558643 = boost
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.024332283 = queryNorm
             0.4018399 = fieldWeight in 2719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
         0.1158104 = weight(abstract_txt:systems in 2719) [ClassicSimilarity], result of:
           0.1158104 = score(doc=2719,freq=4.0), product of:
             0.18106824 = queryWeight, product of:
               2.181501 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024332283 = queryNorm
             0.6395953 = fieldWeight in 2719, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.09375 = fieldNorm(doc=2719)
       0.4 = coord(10/25)
   

3. Vegt, A. van der; Zuccon, G.; Koopman, B.: Do better search engines really equate to better clinical decisions? : If not, why not? (2021) 0.34

   0.34017625 = sum of:
     0.34017625 = product of:
       0.8504406 = sum of:
         0.020432005 = weight(abstract_txt:retrieval in 1151) [ClassicSimilarity], result of:
           0.020432005 = score(doc=1151,freq=1.0), product of:
             0.09403483 = queryWeight, product of:
               1.1116387 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.024332283 = queryNorm
             0.21728125 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.16106912 = weight(abstract_txt:clinical in 1151) [ClassicSimilarity], result of:
           0.16106912 = score(doc=1151,freq=3.0), product of:
             0.20497735 = queryWeight, product of:
               1.1605322 = boost
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.024332283 = queryNorm
             0.7857899 = fieldWeight in 1151, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.03392378 = weight(abstract_txt:were in 1151) [ClassicSimilarity], result of:
           0.03392378 = score(doc=1151,freq=2.0), product of:
             0.1046504 = queryWeight, product of:
               1.1727076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.024332283 = queryNorm
             0.3241629 = fieldWeight in 1151, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.025462294 = weight(abstract_txt:approach in 1151) [ClassicSimilarity], result of:
           0.025462294 = score(doc=1151,freq=1.0), product of:
             0.10889629 = queryWeight, product of:
               1.1962607 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.024332283 = queryNorm
             0.2338215 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.14847295 = weight(abstract_txt:answered in 1151) [ClassicSimilarity], result of:
           0.14847295 = score(doc=1151,freq=2.0), product of:
             0.22224209 = queryWeight, product of:
               1.2084187 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.024332283 = queryNorm
             0.6680685 = fieldWeight in 1151, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.111541644 = weight(abstract_txt:correctly in 1151) [ClassicSimilarity], result of:
           0.111541644 = score(doc=1151,freq=1.0), product of:
             0.2313997 = queryWeight, product of:
               1.2330642 = boost
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.024332283 = queryNorm
             0.4820302 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.08004563 = weight(abstract_txt:questions in 1151) [ClassicSimilarity], result of:
           0.08004563 = score(doc=1151,freq=2.0), product of:
             0.18547976 = queryWeight, product of:
               1.5612323 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.024332283 = queryNorm
             0.43155995 = fieldWeight in 1151, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.09944072 = weight(abstract_txt:task in 1151) [ClassicSimilarity], result of:
           0.09944072 = score(doc=1151,freq=3.0), product of:
             0.187248 = queryWeight, product of:
               1.5686566 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.024332283 = queryNorm
             0.5310643 = fieldWeight in 1151, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.058577687 = weight(abstract_txt:students in 1151) [ClassicSimilarity], result of:
           0.058577687 = score(doc=1151,freq=1.0), product of:
             0.18977378 = queryWeight, product of:
               1.5792009 = boost
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.024332283 = queryNorm
             0.30867112 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.111474745 = weight(abstract_txt:effectiveness in 1151) [ClassicSimilarity], result of:
           0.111474745 = score(doc=1151,freq=3.0), product of:
             0.20206542 = queryWeight, product of:
               1.6295409 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.024332283 = queryNorm
             0.5516765 = fieldWeight in 1151, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
       0.4 = coord(10/25)
   

4. Vakkari, P.; Huuskonen, S.: Search effort degrades search output but improves task outcome (2012) 0.29

   0.28825387 = sum of:
     0.28825387 = product of:
       0.72063464 = sum of:
         0.10829065 = weight(abstract_txt:medline in 1046) [ClassicSimilarity], result of:
           0.10829065 = score(doc=1046,freq=2.0), product of:
             0.18007581 = queryWeight, product of:
               1.0877572 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.024332283 = queryNorm
             0.60136145 = fieldWeight in 1046, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.028895218 = weight(abstract_txt:retrieval in 1046) [ClassicSimilarity], result of:
           0.028895218 = score(doc=1046,freq=2.0), product of:
             0.09403483 = queryWeight, product of:
               1.1116387 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.024332283 = queryNorm
             0.3072821 = fieldWeight in 1046, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.03392378 = weight(abstract_txt:were in 1046) [ClassicSimilarity], result of:
           0.03392378 = score(doc=1046,freq=2.0), product of:
             0.1046504 = queryWeight, product of:
               1.1727076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.024332283 = queryNorm
             0.3241629 = fieldWeight in 1046, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.032153256 = weight(abstract_txt:terms in 1046) [ClassicSimilarity], result of:
           0.032153256 = score(doc=1046,freq=1.0), product of:
             0.12722273 = queryWeight, product of:
               1.2930093 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.024332283 = queryNorm
             0.252732 = fieldWeight in 1046, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.061819606 = weight(abstract_txt:evaluation in 1046) [ClassicSimilarity], result of:
           0.061819606 = score(doc=1046,freq=2.0), product of:
             0.15613091 = queryWeight, product of:
               1.4323981 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024332283 = queryNorm
             0.39594725 = fieldWeight in 1046, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.056600813 = weight(abstract_txt:questions in 1046) [ClassicSimilarity], result of:
           0.056600813 = score(doc=1046,freq=1.0), product of:
             0.18547976 = queryWeight, product of:
               1.5612323 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.024332283 = queryNorm
             0.30515897 = fieldWeight in 1046, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.15189822 = weight(abstract_txt:task in 1046) [ClassicSimilarity], result of:
           0.15189822 = score(doc=1046,freq=7.0), product of:
             0.187248 = queryWeight, product of:
               1.5686566 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.024332283 = queryNorm
             0.8112141 = fieldWeight in 1046, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.101459526 = weight(abstract_txt:students in 1046) [ClassicSimilarity], result of:
           0.101459526 = score(doc=1046,freq=3.0), product of:
             0.18977378 = queryWeight, product of:
               1.5792009 = boost
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.024332283 = queryNorm
             0.53463405 = fieldWeight in 1046, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.06435998 = weight(abstract_txt:effectiveness in 1046) [ClassicSimilarity], result of:
           0.06435998 = score(doc=1046,freq=1.0), product of:
             0.20206542 = queryWeight, product of:
               1.6295409 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.024332283 = queryNorm
             0.3185106 = fieldWeight in 1046, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
         0.08123364 = weight(abstract_txt:searching in 1046) [ClassicSimilarity], result of:
           0.08123364 = score(doc=1046,freq=2.0), product of:
             0.21441695 = queryWeight, product of:
               2.0558643 = boost
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.024332283 = queryNorm
             0.3788583 = fieldWeight in 1046, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.0625 = fieldNorm(doc=1046)
       0.4 = coord(10/25)
   

5. Dani, A.; Chatzopoulou, C.; Siatri, R.; Mystakopoulos, F.; Antonopoulou, S.; Katrinaki, E.; Garoufallou, E.: Digital libraries evaluation : measuring Europeana's usability (2015) 0.26

   0.2645796 = sum of:
     0.2645796 = product of:
       0.66144896 = sum of:
         0.111080885 = weight(abstract_txt:satisfaction in 3395) [ClassicSimilarity], result of:
           0.111080885 = score(doc=3395,freq=3.0), product of:
             0.16000144 = queryWeight, product of:
               1.025336 = boost
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.024332283 = queryNorm
             0.6942493 = fieldWeight in 3395, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.4132004 = idf(docFreq=197, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.069377646 = weight(abstract_txt:measuring in 3395) [ClassicSimilarity], result of:
           0.069377646 = score(doc=3395,freq=1.0), product of:
             0.16861044 = queryWeight, product of:
               1.0525591 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.024332283 = queryNorm
             0.4114671 = fieldWeight in 3395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.03392378 = weight(abstract_txt:were in 3395) [ClassicSimilarity], result of:
           0.03392378 = score(doc=3395,freq=2.0), product of:
             0.1046504 = queryWeight, product of:
               1.1727076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.024332283 = queryNorm
             0.3241629 = fieldWeight in 3395, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.043713063 = weight(abstract_txt:evaluation in 3395) [ClassicSimilarity], result of:
           0.043713063 = score(doc=3395,freq=1.0), product of:
             0.15613091 = queryWeight, product of:
               1.4323981 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.024332283 = queryNorm
             0.279977 = fieldWeight in 3395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.057412133 = weight(abstract_txt:task in 3395) [ClassicSimilarity], result of:
           0.057412133 = score(doc=3395,freq=1.0), product of:
             0.187248 = queryWeight, product of:
               1.5686566 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.024332283 = queryNorm
             0.3066101 = fieldWeight in 3395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.058577687 = weight(abstract_txt:students in 3395) [ClassicSimilarity], result of:
           0.058577687 = score(doc=3395,freq=1.0), product of:
             0.18977378 = queryWeight, product of:
               1.5792009 = boost
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.024332283 = queryNorm
             0.30867112 = fieldWeight in 3395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.938738 = idf(docFreq=864, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.06435998 = weight(abstract_txt:effectiveness in 3395) [ClassicSimilarity], result of:
           0.06435998 = score(doc=3395,freq=1.0), product of:
             0.20206542 = queryWeight, product of:
               1.6295409 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.024332283 = queryNorm
             0.3185106 = fieldWeight in 3395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.057440862 = weight(abstract_txt:searching in 3395) [ClassicSimilarity], result of:
           0.057440862 = score(doc=3395,freq=1.0), product of:
             0.21441695 = queryWeight, product of:
               2.0558643 = boost
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.024332283 = queryNorm
             0.26789328 = fieldWeight in 3395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2862926 = idf(docFreq=1660, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.038603466 = weight(abstract_txt:systems in 3395) [ClassicSimilarity], result of:
           0.038603466 = score(doc=3395,freq=1.0), product of:
             0.18106824 = queryWeight, product of:
               2.181501 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.024332283 = queryNorm
             0.21319844 = fieldWeight in 3395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
         0.12695938 = weight(abstract_txt:oriented in 3395) [ClassicSimilarity], result of:
           0.12695938 = score(doc=3395,freq=1.0), product of:
             0.3638215 = queryWeight, product of:
               2.677991 = boost
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.024332283 = queryNorm
             0.34896064 = fieldWeight in 3395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.58337 = idf(docFreq=453, maxDocs=44421)
               0.0625 = fieldNorm(doc=3395)
       0.4 = coord(10/25)