Document (#43152)

Author

Vegt, A. van der
Zuccon, G.
Koopman, B.

Title

Do better search engines really equate to better clinical decisions? : If not, why not?

Source

Journal of the Association for Information Science and Technology. 72(2021) no.2, S.141-155

Year

2021

Abstract

Previous research has found that improved search engine effectiveness-evaluated using a batch-style approach-does not always translate to significant improvements in user task performance; however, these prior studies focused on simple recall and precision-based search tasks. We investigated the same relationship, but for realistic, complex search tasks required in clinical decision making. One hundred and nine clinicians and final year medical students answered 16 clinical questions. Although the search engine did improve answer accuracy by 20 percentage points, there was no significant difference when participants used a more effective, state-of-the-art search engine. We also found that the search engine effectiveness difference, identified in the lab, was diminished by around 70% when the search engines were used with real users. Despite the aid of the search engine, half of the clinical questions were answered incorrectly. We further identified the relative contribution of search engine effectiveness to the overall end task success. We found that the ability to interpret documents correctly was a much more important factor impacting task success. If these findings are representative, information retrieval research may need to reorient its emphasis towards helping users to better understand information, rather than just finding it for them.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24398.

Theme

Suchmaschinen
Retrievalstudien

Field

Medizin

Similar documents (author)

1. Koopman, B.; Zuccon, G.; Bruza, P.; Sitbon, L.; Lawley, M.: Information retrieval as semantic inference : a graph Inference model applied to medical search (2016) 4.27

   4.266645 = sum of:
     4.266645 = sum of:
       1.9643213 = weight(author_txt:koopman in 4260) [ClassicSimilarity], result of:
         1.9643213 = score(doc=4260,freq=1.0), product of:
           0.66878456 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07115575 = queryNorm
           2.937151 = fieldWeight in 4260, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.3125 = fieldNorm(doc=4260)
       2.3023236 = weight(author_txt:zuccon in 4260) [ClassicSimilarity], result of:
         2.3023236 = score(doc=4260,freq=1.0), product of:
           0.74345636 = queryWeight, product of:
             1.0543495 = boost
             9.909708 = idf(docFreq=5, maxDocs=44421)
             0.07115575 = queryNorm
           3.0967836 = fieldWeight in 4260, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.909708 = idf(docFreq=5, maxDocs=44421)
             0.3125 = fieldNorm(doc=4260)
   

2. Koopman, B.; Zuccon, G.; Bruza, P.; Nguyen, A.: What makes an effective clinical query and querier? (2017) 4.27

   4.266645 = sum of:
     4.266645 = sum of:
       1.9643213 = weight(author_txt:koopman in 4922) [ClassicSimilarity], result of:
         1.9643213 = score(doc=4922,freq=1.0), product of:
           0.66878456 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07115575 = queryNorm
           2.937151 = fieldWeight in 4922, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.3125 = fieldNorm(doc=4922)
       2.3023236 = weight(author_txt:zuccon in 4922) [ClassicSimilarity], result of:
         2.3023236 = score(doc=4922,freq=1.0), product of:
           0.74345636 = queryWeight, product of:
             1.0543495 = boost
             9.909708 = idf(docFreq=5, maxDocs=44421)
             0.07115575 = queryNorm
           3.0967836 = fieldWeight in 4922, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.909708 = idf(docFreq=5, maxDocs=44421)
             0.3125 = fieldNorm(doc=4922)
   

3. Symonds, M.; Bruza, P.; Zuccon, G.; Koopman, B.; Sitbon, L.; Turner, I.: Automatic query expansion : a structural linguistic perspective (2014) 3.41

   3.4133158 = sum of:
     3.4133158 = sum of:
       1.5714569 = weight(author_txt:koopman in 2338) [ClassicSimilarity], result of:
         1.5714569 = score(doc=2338,freq=1.0), product of:
           0.66878456 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07115575 = queryNorm
           2.3497207 = fieldWeight in 2338, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.25 = fieldNorm(doc=2338)
       1.8418589 = weight(author_txt:zuccon in 2338) [ClassicSimilarity], result of:
         1.8418589 = score(doc=2338,freq=1.0), product of:
           0.74345636 = queryWeight, product of:
             1.0543495 = boost
             9.909708 = idf(docFreq=5, maxDocs=44421)
             0.07115575 = queryNorm
           2.477427 = fieldWeight in 2338, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.909708 = idf(docFreq=5, maxDocs=44421)
             0.25 = fieldNorm(doc=2338)
   

4. Koopman, R.: ¬The Pica Micro OPC (1995) 1.96

   1.9643213 = sum of:
     1.9643213 = product of:
       3.9286425 = sum of:
         3.9286425 = weight(author_txt:koopman in 4173) [ClassicSimilarity], result of:
           3.9286425 = score(doc=4173,freq=1.0), product of:
             0.66878456 = queryWeight, product of:
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.07115575 = queryNorm
             5.874302 = fieldWeight in 4173, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.625 = fieldNorm(doc=4173)
       0.5 = coord(1/2)
   

5. Koopman, R.: ¬Ein OPAC mit Gewichtungsalgorithmen : Der PICA Micro OPC (1996) 1.96

   1.9643213 = sum of:
     1.9643213 = product of:
       3.9286425 = sum of:
         3.9286425 = weight(author_txt:koopman in 4182) [ClassicSimilarity], result of:
           3.9286425 = score(doc=4182,freq=1.0), product of:
             0.66878456 = queryWeight, product of:
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.07115575 = queryNorm
             5.874302 = fieldWeight in 4182, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.625 = fieldNorm(doc=4182)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Lewandowski, D.: ¬The retrieval effectiveness of search engines on navigational queries (2011) 0.28

   0.28157324 = sum of:
     0.28157324 = product of:
       0.7821479 = sum of:
         0.06267696 = weight(abstract_txt:correctly in 537) [ClassicSimilarity], result of:
           0.06267696 = score(doc=537,freq=1.0), product of:
             0.13002704 = queryWeight, product of:
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.016859297 = queryNorm
             0.4820302 = fieldWeight in 537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
         0.019474667 = weight(abstract_txt:when in 537) [ClassicSimilarity], result of:
           0.019474667 = score(doc=537,freq=1.0), product of:
             0.07515394 = queryWeight, product of:
               1.0751623 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.016859297 = queryNorm
             0.25913036 = fieldWeight in 537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
         0.114388116 = weight(abstract_txt:engines in 537) [ClassicSimilarity], result of:
           0.114388116 = score(doc=537,freq=8.0), product of:
             0.122328885 = queryWeight, product of:
               1.3717111 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.016859297 = queryNorm
             0.9350867 = fieldWeight in 537, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
         0.050737113 = weight(abstract_txt:success in 537) [ClassicSimilarity], result of:
           0.050737113 = score(doc=537,freq=1.0), product of:
             0.14229475 = queryWeight, product of:
               1.4794238 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.016859297 = queryNorm
             0.35656348 = fieldWeight in 537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
         0.036647446 = weight(abstract_txt:found in 537) [ClassicSimilarity], result of:
           0.036647446 = score(doc=537,freq=1.0), product of:
             0.13112876 = queryWeight, product of:
               1.7393731 = boost
               4.4716287 = idf(docFreq=1379, maxDocs=44421)
               0.016859297 = queryNorm
             0.2794768 = fieldWeight in 537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4716287 = idf(docFreq=1379, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
         0.11798676 = weight(abstract_txt:answered in 537) [ClassicSimilarity], result of:
           0.11798676 = score(doc=537,freq=1.0), product of:
             0.2497625 = queryWeight, product of:
               1.9600257 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.016859297 = queryNorm
             0.4723958 = fieldWeight in 537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
         0.054247297 = weight(abstract_txt:effectiveness in 537) [ClassicSimilarity], result of:
           0.054247297 = score(doc=537,freq=1.0), product of:
             0.17031552 = queryWeight, product of:
               1.9823068 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.016859297 = queryNorm
             0.3185106 = fieldWeight in 537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
         0.13736896 = weight(abstract_txt:engine in 537) [ClassicSimilarity], result of:
           0.13736896 = score(doc=537,freq=1.0), product of:
             0.39866173 = queryWeight, product of:
               4.2890496 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.016859297 = queryNorm
             0.34457523 = fieldWeight in 537, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
         0.18862057 = weight(abstract_txt:search in 537) [ClassicSimilarity], result of:
           0.18862057 = score(doc=537,freq=8.0), product of:
             0.29196072 = queryWeight, product of:
               4.7385488 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016859297 = queryNorm
             0.6460478 = fieldWeight in 537, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=537)
       0.36 = coord(9/25)
   

2. Radev, D.R.; Libner, K.; Fan, W.: Getting answers to natural language questions on the Web (2002) 0.25

   0.2537745 = sum of:
     0.2537745 = product of:
       0.79304534 = sum of:
         0.050927863 = weight(abstract_txt:significant in 204) [ClassicSimilarity], result of:
           0.050927863 = score(doc=204,freq=3.0), product of:
             0.098908804 = queryWeight, product of:
               1.2334331 = boost
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.016859297 = queryNorm
             0.51489717 = fieldWeight in 204, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.0625 = fieldNorm(doc=204)
         0.03180487 = weight(abstract_txt:questions in 204) [ClassicSimilarity], result of:
           0.03180487 = score(doc=204,freq=1.0), product of:
             0.10422394 = queryWeight, product of:
               1.2661405 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.016859297 = queryNorm
             0.30515897 = fieldWeight in 204, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.0625 = fieldNorm(doc=204)
         0.032349315 = weight(abstract_txt:identified in 204) [ClassicSimilarity], result of:
           0.032349315 = score(doc=204,freq=1.0), product of:
             0.105409995 = queryWeight, product of:
               1.2733244 = boost
               4.9102464 = idf(docFreq=889, maxDocs=44421)
               0.016859297 = queryNorm
             0.3068904 = fieldWeight in 204, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9102464 = idf(docFreq=889, maxDocs=44421)
               0.0625 = fieldNorm(doc=204)
         0.057194058 = weight(abstract_txt:engines in 204) [ClassicSimilarity], result of:
           0.057194058 = score(doc=204,freq=2.0), product of:
             0.122328885 = queryWeight, product of:
               1.3717111 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.016859297 = queryNorm
             0.46754336 = fieldWeight in 204, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=204)
         0.036647446 = weight(abstract_txt:found in 204) [ClassicSimilarity], result of:
           0.036647446 = score(doc=204,freq=1.0), product of:
             0.13112876 = queryWeight, product of:
               1.7393731 = boost
               4.4716287 = idf(docFreq=1379, maxDocs=44421)
               0.016859297 = queryNorm
             0.2794768 = fieldWeight in 204, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4716287 = idf(docFreq=1379, maxDocs=44421)
               0.0625 = fieldNorm(doc=204)
         0.044239286 = weight(abstract_txt:better in 204) [ClassicSimilarity], result of:
           0.044239286 = score(doc=204,freq=1.0), product of:
             0.1486646 = queryWeight, product of:
               1.852028 = boost
               4.7612453 = idf(docFreq=1032, maxDocs=44421)
               0.016859297 = queryNorm
             0.29757783 = fieldWeight in 204, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7612453 = idf(docFreq=1032, maxDocs=44421)
               0.0625 = fieldNorm(doc=204)
         0.3634441 = weight(abstract_txt:engine in 204) [ClassicSimilarity], result of:
           0.3634441 = score(doc=204,freq=7.0), product of:
             0.39866173 = queryWeight, product of:
               4.2890496 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.016859297 = queryNorm
             0.9116603 = fieldWeight in 204, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0625 = fieldNorm(doc=204)
         0.17643838 = weight(abstract_txt:search in 204) [ClassicSimilarity], result of:
           0.17643838 = score(doc=204,freq=7.0), product of:
             0.29196072 = queryWeight, product of:
               4.7385488 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016859297 = queryNorm
             0.6043223 = fieldWeight in 204, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=204)
       0.32 = coord(8/25)
   

3. Hersh, W.; Pentecost, J.; Hickam, D.: ¬A task-oriented approach to information retrieval evaluation : overview and design for empirical testing (1996) 0.21

   0.20621009 = sum of:
     0.20621009 = product of:
       0.7364646 = sum of:
         0.0783462 = weight(abstract_txt:correctly in 3069) [ClassicSimilarity], result of:
           0.0783462 = score(doc=3069,freq=1.0), product of:
             0.13002704 = queryWeight, product of:
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.016859297 = queryNorm
             0.60253775 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.078125 = fieldNorm(doc=3069)
         0.03675402 = weight(abstract_txt:significant in 3069) [ClassicSimilarity], result of:
           0.03675402 = score(doc=3069,freq=1.0), product of:
             0.098908804 = queryWeight, product of:
               1.2334331 = boost
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.016859297 = queryNorm
             0.37159503 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.078125 = fieldNorm(doc=3069)
         0.056223594 = weight(abstract_txt:questions in 3069) [ClassicSimilarity], result of:
           0.056223594 = score(doc=3069,freq=2.0), product of:
             0.10422394 = queryWeight, product of:
               1.2661405 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.016859297 = queryNorm
             0.53944993 = fieldWeight in 3069, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.078125 = fieldNorm(doc=3069)
         0.060488924 = weight(abstract_txt:task in 3069) [ClassicSimilarity], result of:
           0.060488924 = score(doc=3069,freq=1.0), product of:
             0.1578263 = queryWeight, product of:
               1.9082421 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.016859297 = queryNorm
             0.38326263 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.078125 = fieldNorm(doc=3069)
         0.14748345 = weight(abstract_txt:answered in 3069) [ClassicSimilarity], result of:
           0.14748345 = score(doc=3069,freq=1.0), product of:
             0.2497625 = queryWeight, product of:
               1.9600257 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.016859297 = queryNorm
             0.59049475 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.078125 = fieldNorm(doc=3069)
         0.09589657 = weight(abstract_txt:effectiveness in 3069) [ClassicSimilarity], result of:
           0.09589657 = score(doc=3069,freq=2.0), product of:
             0.17031552 = queryWeight, product of:
               1.9823068 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.016859297 = queryNorm
             0.5630525 = fieldWeight in 3069, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=3069)
         0.26127186 = weight(abstract_txt:clinical in 3069) [ClassicSimilarity], result of:
           0.26127186 = score(doc=3069,freq=1.0), product of:
             0.4607197 = queryWeight, product of:
               3.7647102 = boost
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.016859297 = queryNorm
             0.56709504 = fieldWeight in 3069, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.078125 = fieldNorm(doc=3069)
       0.28 = coord(7/25)
   

4. Hersh, W.R.; Pentecost, J.; Hickam, D.H.: ¬A task-oriented approach to retrieval system evaluation (1995) 0.21

   0.20621009 = sum of:
     0.20621009 = product of:
       0.7364646 = sum of:
         0.0783462 = weight(abstract_txt:correctly in 3935) [ClassicSimilarity], result of:
           0.0783462 = score(doc=3935,freq=1.0), product of:
             0.13002704 = queryWeight, product of:
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.016859297 = queryNorm
             0.60253775 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7124834 = idf(docFreq=53, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.03675402 = weight(abstract_txt:significant in 3935) [ClassicSimilarity], result of:
           0.03675402 = score(doc=3935,freq=1.0), product of:
             0.098908804 = queryWeight, product of:
               1.2334331 = boost
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.016859297 = queryNorm
             0.37159503 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.056223594 = weight(abstract_txt:questions in 3935) [ClassicSimilarity], result of:
           0.056223594 = score(doc=3935,freq=2.0), product of:
             0.10422394 = queryWeight, product of:
               1.2661405 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.016859297 = queryNorm
             0.53944993 = fieldWeight in 3935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.060488924 = weight(abstract_txt:task in 3935) [ClassicSimilarity], result of:
           0.060488924 = score(doc=3935,freq=1.0), product of:
             0.1578263 = queryWeight, product of:
               1.9082421 = boost
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.016859297 = queryNorm
             0.38326263 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9057617 = idf(docFreq=893, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.14748345 = weight(abstract_txt:answered in 3935) [ClassicSimilarity], result of:
           0.14748345 = score(doc=3935,freq=1.0), product of:
             0.2497625 = queryWeight, product of:
               1.9600257 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.016859297 = queryNorm
             0.59049475 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.09589657 = weight(abstract_txt:effectiveness in 3935) [ClassicSimilarity], result of:
           0.09589657 = score(doc=3935,freq=2.0), product of:
             0.17031552 = queryWeight, product of:
               1.9823068 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.016859297 = queryNorm
             0.5630525 = fieldWeight in 3935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
         0.26127186 = weight(abstract_txt:clinical in 3935) [ClassicSimilarity], result of:
           0.26127186 = score(doc=3935,freq=1.0), product of:
             0.4607197 = queryWeight, product of:
               3.7647102 = boost
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.016859297 = queryNorm
             0.56709504 = fieldWeight in 3935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.078125 = fieldNorm(doc=3935)
       0.28 = coord(7/25)
   

5. Lewandowski, D.: Evaluating the retrieval effectiveness of web search engines using a representative query sample (2015) 0.18

   0.18025368 = sum of:
     0.18025368 = product of:
       0.751057 = sum of:
         0.050552886 = weight(abstract_txt:engines in 3157) [ClassicSimilarity], result of:
           0.050552886 = score(doc=3157,freq=1.0), product of:
             0.122328885 = queryWeight, product of:
               1.3717111 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.016859297 = queryNorm
             0.41325387 = fieldWeight in 3157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.078125 = fieldNorm(doc=3157)
         0.076945275 = weight(abstract_txt:difference in 3157) [ClassicSimilarity], result of:
           0.076945275 = score(doc=3157,freq=1.0), product of:
             0.16186503 = queryWeight, product of:
               1.5778825 = boost
               6.0846963 = idf(docFreq=274, maxDocs=44421)
               0.016859297 = queryNorm
             0.4753669 = fieldWeight in 3157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0846963 = idf(docFreq=274, maxDocs=44421)
               0.078125 = fieldNorm(doc=3157)
         0.09161861 = weight(abstract_txt:found in 3157) [ClassicSimilarity], result of:
           0.09161861 = score(doc=3157,freq=4.0), product of:
             0.13112876 = queryWeight, product of:
               1.7393731 = boost
               4.4716287 = idf(docFreq=1379, maxDocs=44421)
               0.016859297 = queryNorm
             0.69869196 = fieldWeight in 3157, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4716287 = idf(docFreq=1379, maxDocs=44421)
               0.078125 = fieldNorm(doc=3157)
         0.06780912 = weight(abstract_txt:effectiveness in 3157) [ClassicSimilarity], result of:
           0.06780912 = score(doc=3157,freq=1.0), product of:
             0.17031552 = queryWeight, product of:
               1.9823068 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.016859297 = queryNorm
             0.39813823 = fieldWeight in 3157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.078125 = fieldNorm(doc=3157)
         0.2974125 = weight(abstract_txt:engine in 3157) [ClassicSimilarity], result of:
           0.2974125 = score(doc=3157,freq=3.0), product of:
             0.39866173 = queryWeight, product of:
               4.2890496 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.016859297 = queryNorm
             0.74602723 = fieldWeight in 3157, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.078125 = fieldNorm(doc=3157)
         0.1667186 = weight(abstract_txt:search in 3157) [ClassicSimilarity], result of:
           0.1667186 = score(doc=3157,freq=4.0), product of:
             0.29196072 = queryWeight, product of:
               4.7385488 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016859297 = queryNorm
             0.5710309 = fieldWeight in 3157, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=3157)
       0.24 = coord(6/25)