Document (#40923)

Author

Koopman, B.
Zuccon, G.
Bruza, P.
Nguyen, A.

Title

What makes an effective clinical query and querier?

Source

Journal of the Association for Information Science and Technology. 68(2017) no.11, S.2557-2571

Year

2017

Abstract

In this paper, we perform an in-depth study into how clinicians represent their information needs and the influence this has on information retrieval (IR) effectiveness. While much research in IR has considered the effectiveness of IR systems, there is still a significant gap in the understanding of how users contribute to the effectiveness of these systems. The paper aims to contribute to this by studying how clinicians search for information. Multiple representations of an information need-from verbose patient case descriptions to ad-hoc queries-were considered in order to understand their effect on retrieval. Four clinicians provided queries and performed relevance assessment to form a test collection used in this study. The different query formulation strategies of each clinician, and their effectiveness, were investigated. The results show that query formulation had more impact on retrieval effectiveness than the particular retrieval systems used. The most effective queries were short, ad-hoc keyword queries. Different clinicians were observed to consistently adopt specific query formulation strategies. The most effective queriers were those who, given their information need, inferred novel keywords most likely to appear in relevant documents. This study reveals aspects of how people search within the clinical domain. This can help inform the development of new models and methods that specifically focus on the query formulation process to improve retrieval effectiveness.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23959/full.

Footnote

Beitrag in einem Special issue on biomedical information retrieval.

Field

Medizin

Similar documents (author)

1. Koopman, B.; Zuccon, G.; Bruza, P.; Sitbon, L.; Lawley, M.: Information retrieval as semantic inference : a graph Inference model applied to medical search (2016) 3.40

   3.3950553 = sum of:
     3.3950553 = product of:
       4.5267406 = sum of:
         1.3702693 = weight(author_txt:bruza in 4260) [ClassicSimilarity], result of:
           1.3702693 = score(doc=4260,freq=1.0), product of:
             0.47575897 = queryWeight, product of:
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.051620007 = queryNorm
             2.8801754 = fieldWeight in 4260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.3125 = fieldNorm(doc=4260)
         1.4532083 = weight(author_txt:koopman in 4260) [ClassicSimilarity], result of:
           1.4532083 = score(doc=4260,freq=1.0), product of:
             0.49476802 = queryWeight, product of:
               1.019782 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.051620007 = queryNorm
             2.937151 = fieldWeight in 4260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.3125 = fieldNorm(doc=4260)
         1.7032629 = weight(author_txt:zuccon in 4260) [ClassicSimilarity], result of:
           1.7032629 = score(doc=4260,freq=1.0), product of:
             0.5500103 = queryWeight, product of:
               1.0752066 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.051620007 = queryNorm
             3.0967836 = fieldWeight in 4260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.3125 = fieldNorm(doc=4260)
       0.75 = coord(3/4)
   

2. Symonds, M.; Bruza, P.; Zuccon, G.; Koopman, B.; Sitbon, L.; Turner, I.: Automatic query expansion : a structural linguistic perspective (2014) 2.72

   2.7160444 = sum of:
     2.7160444 = product of:
       3.6213927 = sum of:
         1.0962155 = weight(author_txt:bruza in 2338) [ClassicSimilarity], result of:
           1.0962155 = score(doc=2338,freq=1.0), product of:
             0.47575897 = queryWeight, product of:
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.051620007 = queryNorm
             2.3041403 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.25 = fieldNorm(doc=2338)
         1.1625667 = weight(author_txt:koopman in 2338) [ClassicSimilarity], result of:
           1.1625667 = score(doc=2338,freq=1.0), product of:
             0.49476802 = queryWeight, product of:
               1.019782 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.051620007 = queryNorm
             2.3497207 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.25 = fieldNorm(doc=2338)
         1.3626105 = weight(author_txt:zuccon in 2338) [ClassicSimilarity], result of:
           1.3626105 = score(doc=2338,freq=1.0), product of:
             0.5500103 = queryWeight, product of:
               1.0752066 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.051620007 = queryNorm
             2.477427 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.25 = fieldNorm(doc=2338)
       0.75 = coord(3/4)
   

3. Vegt, A. van der; Zuccon, G.; Koopman, B.: Do better search engines really equate to better clinical decisions? : If not, why not? (2021) 1.58

   1.5782356 = sum of:
     1.5782356 = product of:
       3.1564713 = sum of:
         1.4532083 = weight(author_txt:koopman in 1151) [ClassicSimilarity], result of:
           1.4532083 = score(doc=1151,freq=1.0), product of:
             0.49476802 = queryWeight, product of:
               1.019782 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.051620007 = queryNorm
             2.937151 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.3125 = fieldNorm(doc=1151)
         1.7032629 = weight(author_txt:zuccon in 1151) [ClassicSimilarity], result of:
           1.7032629 = score(doc=1151,freq=1.0), product of:
             0.5500103 = queryWeight, product of:
               1.0752066 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.051620007 = queryNorm
             3.0967836 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.3125 = fieldNorm(doc=1151)
       0.5 = coord(2/4)
   

4. Kholghi, M.; Vine, L.D.; Sitbon, L.; Zuccon, G.; Nguyen, A.: Clinical information extraction using small data : an active learning approach based on sequence representations and word embeddings (2017) 1.54

   1.536766 = sum of:
     1.536766 = product of:
       3.073532 = sum of:
         1.3702693 = weight(author_txt:nguyen in 4920) [ClassicSimilarity], result of:
           1.3702693 = score(doc=4920,freq=1.0), product of:
             0.47575897 = queryWeight, product of:
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.051620007 = queryNorm
             2.8801754 = fieldWeight in 4920, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.3125 = fieldNorm(doc=4920)
         1.7032629 = weight(author_txt:zuccon in 4920) [ClassicSimilarity], result of:
           1.7032629 = score(doc=4920,freq=1.0), product of:
             0.5500103 = queryWeight, product of:
               1.0752066 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.051620007 = queryNorm
             3.0967836 = fieldWeight in 4920, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.3125 = fieldNorm(doc=4920)
       0.5 = coord(2/4)
   

5. Koopman, R.: ¬The Pica Micro OPC (1995) 0.73

   0.72660416 = sum of:
     0.72660416 = product of:
       2.9064167 = sum of:
         2.9064167 = weight(author_txt:koopman in 4173) [ClassicSimilarity], result of:
           2.9064167 = score(doc=4173,freq=1.0), product of:
             0.49476802 = queryWeight, product of:
               1.019782 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.051620007 = queryNorm
             5.874302 = fieldWeight in 4173, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.625 = fieldNorm(doc=4173)
       0.25 = coord(1/4)
   

Similar documents (content)

1. Sahib, N.G.; Tombros, A.; Stockman, T.: ¬A comparative analysis of the information-seeking behavior of visually impaired and sighted searchers (2012) 0.36

   0.36483383 = sum of:
     0.36483383 = product of:
       0.70160353 = sum of:
         0.04106767 = weight(abstract_txt:search in 989) [ClassicSimilarity], result of:
           0.04106767 = score(doc=989,freq=11.0), product of:
             0.054210585 = queryWeight, product of:
               1.0300014 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014401465 = queryNorm
             0.75755817 = fieldWeight in 989, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.012434634 = weight(abstract_txt:different in 989) [ClassicSimilarity], result of:
           0.012434634 = score(doc=989,freq=1.0), product of:
             0.054363027 = queryWeight, product of:
               1.0314486 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.014401465 = queryNorm
             0.2287333 = fieldWeight in 989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.03392705 = weight(abstract_txt:strategies in 989) [ClassicSimilarity], result of:
           0.03392705 = score(doc=989,freq=1.0), product of:
             0.10614813 = queryWeight, product of:
               1.4412919 = boost
               5.113918 = idf(docFreq=725, maxDocs=44421)
               0.014401465 = queryNorm
             0.31961986 = fieldWeight in 989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.113918 = idf(docFreq=725, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.015103867 = weight(abstract_txt:systems in 989) [ClassicSimilarity], result of:
           0.015103867 = score(doc=989,freq=1.0), product of:
             0.07084417 = queryWeight, product of:
               1.4420936 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.014401465 = queryNorm
             0.21319844 = fieldWeight in 989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.021435756 = weight(abstract_txt:study in 989) [ClassicSimilarity], result of:
           0.021435756 = score(doc=989,freq=2.0), product of:
             0.07101137 = queryWeight, product of:
               1.4437944 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.014401465 = queryNorm
             0.3018637 = fieldWeight in 989, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.017951816 = weight(abstract_txt:information in 989) [ClassicSimilarity], result of:
           0.017951816 = score(doc=989,freq=4.0), product of:
             0.059371844 = queryWeight, product of:
               1.7043393 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.014401465 = queryNorm
             0.30236244 = fieldWeight in 989, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.014994608 = weight(abstract_txt:this in 989) [ClassicSimilarity], result of:
           0.014994608 = score(doc=989,freq=2.0), product of:
             0.07050211 = queryWeight, product of:
               2.034499 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014401465 = queryNorm
             0.21268311 = fieldWeight in 989, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.043080755 = weight(abstract_txt:effective in 989) [ClassicSimilarity], result of:
           0.043080755 = score(doc=989,freq=1.0), product of:
             0.14248449 = queryWeight, product of:
               2.04515 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.014401465 = queryNorm
             0.302354 = fieldWeight in 989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.026647199 = weight(abstract_txt:retrieval in 989) [ClassicSimilarity], result of:
           0.026647199 = score(doc=989,freq=1.0), product of:
             0.1226392 = queryWeight, product of:
               2.4495168 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.014401465 = queryNorm
             0.21728125 = fieldWeight in 989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.031284545 = weight(abstract_txt:were in 989) [ClassicSimilarity], result of:
           0.031284545 = score(doc=989,freq=1.0), product of:
             0.13648392 = queryWeight, product of:
               2.5840833 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.014401465 = queryNorm
             0.2292178 = fieldWeight in 989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.06736486 = weight(abstract_txt:queries in 989) [ClassicSimilarity], result of:
           0.06736486 = score(doc=989,freq=1.0), product of:
             0.21127455 = queryWeight, product of:
               2.875639 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.014401465 = queryNorm
             0.31884983 = fieldWeight in 989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.16696016 = weight(abstract_txt:query in 989) [ClassicSimilarity], result of:
           0.16696016 = score(doc=989,freq=6.0), product of:
             0.22937872 = queryWeight, product of:
               3.3499808 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.014401465 = queryNorm
             0.72787994 = fieldWeight in 989, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
         0.20935056 = weight(abstract_txt:formulation in 989) [ClassicSimilarity], result of:
           0.20935056 = score(doc=989,freq=2.0), product of:
             0.35710645 = queryWeight, product of:
               3.7386053 = boost
               6.6325636 = idf(docFreq=158, maxDocs=44421)
               0.014401465 = queryNorm
             0.5862413 = fieldWeight in 989, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6325636 = idf(docFreq=158, maxDocs=44421)
               0.0625 = fieldNorm(doc=989)
       0.52 = coord(13/25)
   

2. Pluye, P.; Grad, R.; Repchinsky, C.; Jovaisas, B.; Johnson-Lafleur, J.; Carrier, M.-E.; Granikov, V.; Farrell, B.; Rodriguez, C.; Bartlett, G.; Loiselle, C.; Légaré, F.: Four levels of outcomes of information-seeking : a mixed methods study in primary health care (2013) 0.35

   0.34771323 = sum of:
     0.34771323 = product of:
       0.8692831 = sum of:
         0.017511314 = weight(abstract_txt:search in 1534) [ClassicSimilarity], result of:
           0.017511314 = score(doc=1534,freq=2.0), product of:
             0.054210585 = queryWeight, product of:
               1.0300014 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014401465 = queryNorm
             0.3230239 = fieldWeight in 1534, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.12021928 = weight(abstract_txt:patient in 1534) [ClassicSimilarity], result of:
           0.12021928 = score(doc=1534,freq=5.0), product of:
             0.11451552 = queryWeight, product of:
               1.0585538 = boost
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.014401465 = queryNorm
             1.0498078 = fieldWeight in 1534, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.5118127 = idf(docFreq=65, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.018493433 = weight(abstract_txt:need in 1534) [ClassicSimilarity], result of:
           0.018493433 = score(doc=1534,freq=1.0), product of:
             0.07083153 = queryWeight, product of:
               1.1773595 = boost
               4.1774464 = idf(docFreq=1851, maxDocs=44421)
               0.014401465 = queryNorm
             0.2610904 = fieldWeight in 1534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1774464 = idf(docFreq=1851, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.026253333 = weight(abstract_txt:study in 1534) [ClassicSimilarity], result of:
           0.026253333 = score(doc=1534,freq=3.0), product of:
             0.07101137 = queryWeight, product of:
               1.4437944 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.014401465 = queryNorm
             0.36970603 = fieldWeight in 1534, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.026927724 = weight(abstract_txt:information in 1534) [ClassicSimilarity], result of:
           0.026927724 = score(doc=1534,freq=9.0), product of:
             0.059371844 = queryWeight, product of:
               1.7043393 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.014401465 = queryNorm
             0.45354366 = fieldWeight in 1534, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.01589403 = weight(abstract_txt:their in 1534) [ClassicSimilarity], result of:
           0.01589403 = score(doc=1534,freq=1.0), product of:
             0.08067041 = queryWeight, product of:
               1.7769201 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.014401465 = queryNorm
             0.19702427 = fieldWeight in 1534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.010602789 = weight(abstract_txt:this in 1534) [ClassicSimilarity], result of:
           0.010602789 = score(doc=1534,freq=1.0), product of:
             0.07050211 = queryWeight, product of:
               2.034499 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014401465 = queryNorm
             0.15038967 = fieldWeight in 1534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.2169538 = weight(abstract_txt:clinical in 1534) [ClassicSimilarity], result of:
           0.2169538 = score(doc=1534,freq=5.0), product of:
             0.21386339 = queryWeight, product of:
               2.0458038 = boost
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.014401465 = queryNorm
             1.0144504 = fieldWeight in 1534, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.06256909 = weight(abstract_txt:were in 1534) [ClassicSimilarity], result of:
           0.06256909 = score(doc=1534,freq=4.0), product of:
             0.13648392 = queryWeight, product of:
               2.5840833 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.014401465 = queryNorm
             0.4584356 = fieldWeight in 1534, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
         0.35385826 = weight(abstract_txt:clinicians in 1534) [ClassicSimilarity], result of:
           0.35385826 = score(doc=1534,freq=1.0), product of:
             0.6384269 = queryWeight, product of:
               4.998807 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.014401465 = queryNorm
             0.5542659 = fieldWeight in 1534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.0625 = fieldNorm(doc=1534)
       0.4 = coord(10/25)
   

3. Symonds, M.; Bruza, P.; Zuccon, G.; Koopman, B.; Sitbon, L.; Turner, I.: Automatic query expansion : a structural linguistic perspective (2014) 0.35

   0.34685066 = sum of:
     0.34685066 = product of:
       0.78829694 = sum of:
         0.012382369 = weight(abstract_txt:search in 2338) [ClassicSimilarity], result of:
           0.012382369 = score(doc=2338,freq=1.0), product of:
             0.054210585 = queryWeight, product of:
               1.0300014 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014401465 = queryNorm
             0.22841237 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.018493433 = weight(abstract_txt:need in 2338) [ClassicSimilarity], result of:
           0.018493433 = score(doc=2338,freq=1.0), product of:
             0.07083153 = queryWeight, product of:
               1.1773595 = boost
               4.1774464 = idf(docFreq=1851, maxDocs=44421)
               0.014401465 = queryNorm
             0.2610904 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1774464 = idf(docFreq=1851, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.032055642 = weight(abstract_txt:considered in 2338) [ClassicSimilarity], result of:
           0.032055642 = score(doc=2338,freq=1.0), product of:
             0.10220793 = queryWeight, product of:
               1.4142886 = boost
               5.0181065 = idf(docFreq=798, maxDocs=44421)
               0.014401465 = queryNorm
             0.31363165 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0181065 = idf(docFreq=798, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.017951816 = weight(abstract_txt:information in 2338) [ClassicSimilarity], result of:
           0.017951816 = score(doc=2338,freq=4.0), product of:
             0.059371844 = queryWeight, product of:
               1.7043393 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.014401465 = queryNorm
             0.30236244 = fieldWeight in 2338, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.01589403 = weight(abstract_txt:their in 2338) [ClassicSimilarity], result of:
           0.01589403 = score(doc=2338,freq=1.0), product of:
             0.08067041 = queryWeight, product of:
               1.7769201 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.014401465 = queryNorm
             0.19702427 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.010602789 = weight(abstract_txt:this in 2338) [ClassicSimilarity], result of:
           0.010602789 = score(doc=2338,freq=1.0), product of:
             0.07050211 = queryWeight, product of:
               2.034499 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014401465 = queryNorm
             0.15038967 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.059584953 = weight(abstract_txt:retrieval in 2338) [ClassicSimilarity], result of:
           0.059584953 = score(doc=2338,freq=5.0), product of:
             0.1226392 = queryWeight, product of:
               2.4495168 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.014401465 = queryNorm
             0.48585567 = fieldWeight in 2338, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.06736486 = weight(abstract_txt:queries in 2338) [ClassicSimilarity], result of:
           0.06736486 = score(doc=2338,freq=1.0), product of:
             0.21127455 = queryWeight, product of:
               2.875639 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.014401465 = queryNorm
             0.31884983 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.2044836 = weight(abstract_txt:query in 2338) [ClassicSimilarity], result of:
           0.2044836 = score(doc=2338,freq=9.0), product of:
             0.22937872 = queryWeight, product of:
               3.3499808 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.014401465 = queryNorm
             0.8914672 = fieldWeight in 2338, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.1480332 = weight(abstract_txt:formulation in 2338) [ClassicSimilarity], result of:
           0.1480332 = score(doc=2338,freq=1.0), product of:
             0.35710645 = queryWeight, product of:
               3.7386053 = boost
               6.6325636 = idf(docFreq=158, maxDocs=44421)
               0.014401465 = queryNorm
             0.41453522 = fieldWeight in 2338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6325636 = idf(docFreq=158, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
         0.20145021 = weight(abstract_txt:effectiveness in 2338) [ClassicSimilarity], result of:
           0.20145021 = score(doc=2338,freq=4.0), product of:
             0.31623787 = queryWeight, product of:
               4.3088694 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.014401465 = queryNorm
             0.6370212 = fieldWeight in 2338, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=2338)
       0.44 = coord(11/25)
   

4. Friman, J.; Kangaspunta, J.; Leppäniemi, S.; Rasi, P.; Virrankoski, A.: Query performance analyser : a tool for teaching information retrieval skills through an educational game (2005) 0.35

   0.34542945 = sum of:
     0.34542945 = product of:
       0.7196447 = sum of:
         0.012382369 = weight(abstract_txt:search in 4010) [ClassicSimilarity], result of:
           0.012382369 = score(doc=4010,freq=1.0), product of:
             0.054210585 = queryWeight, product of:
               1.0300014 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014401465 = queryNorm
             0.22841237 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.01758523 = weight(abstract_txt:different in 4010) [ClassicSimilarity], result of:
           0.01758523 = score(doc=4010,freq=2.0), product of:
             0.054363027 = queryWeight, product of:
               1.0314486 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.014401465 = queryNorm
             0.32347775 = fieldWeight in 4010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.018493433 = weight(abstract_txt:need in 4010) [ClassicSimilarity], result of:
           0.018493433 = score(doc=4010,freq=1.0), product of:
             0.07083153 = queryWeight, product of:
               1.1773595 = boost
               4.1774464 = idf(docFreq=1851, maxDocs=44421)
               0.014401465 = queryNorm
             0.2610904 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1774464 = idf(docFreq=1851, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.047980096 = weight(abstract_txt:strategies in 4010) [ClassicSimilarity], result of:
           0.047980096 = score(doc=4010,freq=2.0), product of:
             0.10614813 = queryWeight, product of:
               1.4412919 = boost
               5.113918 = idf(docFreq=725, maxDocs=44421)
               0.014401465 = queryNorm
             0.45201075 = fieldWeight in 4010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.113918 = idf(docFreq=725, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.015103867 = weight(abstract_txt:systems in 4010) [ClassicSimilarity], result of:
           0.015103867 = score(doc=4010,freq=1.0), product of:
             0.07084417 = queryWeight, product of:
               1.4420936 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.014401465 = queryNorm
             0.21319844 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.020070741 = weight(abstract_txt:information in 4010) [ClassicSimilarity], result of:
           0.020070741 = score(doc=4010,freq=5.0), product of:
             0.059371844 = queryWeight, product of:
               1.7043393 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.014401465 = queryNorm
             0.3380515 = fieldWeight in 4010, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.01589403 = weight(abstract_txt:their in 4010) [ClassicSimilarity], result of:
           0.01589403 = score(doc=4010,freq=1.0), product of:
             0.08067041 = queryWeight, product of:
               1.7769201 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.014401465 = queryNorm
             0.19702427 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.010602789 = weight(abstract_txt:this in 4010) [ClassicSimilarity], result of:
           0.010602789 = score(doc=4010,freq=1.0), product of:
             0.07050211 = queryWeight, product of:
               2.034499 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014401465 = queryNorm
             0.15038967 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.13472971 = weight(abstract_txt:queries in 4010) [ClassicSimilarity], result of:
           0.13472971 = score(doc=4010,freq=4.0), product of:
             0.21127455 = queryWeight, product of:
               2.875639 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.014401465 = queryNorm
             0.63769966 = fieldWeight in 4010, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.13632241 = weight(abstract_txt:query in 4010) [ClassicSimilarity], result of:
           0.13632241 = score(doc=4010,freq=4.0), product of:
             0.22937872 = queryWeight, product of:
               3.3499808 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.014401465 = queryNorm
             0.5943115 = fieldWeight in 4010, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.1480332 = weight(abstract_txt:formulation in 4010) [ClassicSimilarity], result of:
           0.1480332 = score(doc=4010,freq=1.0), product of:
             0.35710645 = queryWeight, product of:
               3.7386053 = boost
               6.6325636 = idf(docFreq=158, maxDocs=44421)
               0.014401465 = queryNorm
             0.41453522 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6325636 = idf(docFreq=158, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.14244682 = weight(abstract_txt:effectiveness in 4010) [ClassicSimilarity], result of:
           0.14244682 = score(doc=4010,freq=2.0), product of:
             0.31623787 = queryWeight, product of:
               4.3088694 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.014401465 = queryNorm
             0.450442 = fieldWeight in 4010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
       0.48 = coord(12/25)
   

5. Vegt, A. van der; Zuccon, G.; Koopman, B.: Do better search engines really equate to better clinical decisions? : If not, why not? (2021) 0.32

   0.3163235 = sum of:
     0.3163235 = product of:
       0.8786763 = sum of:
         0.037147105 = weight(abstract_txt:search in 1151) [ClassicSimilarity], result of:
           0.037147105 = score(doc=1151,freq=9.0), product of:
             0.054210585 = queryWeight, product of:
               1.0300014 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014401465 = queryNorm
             0.6852371 = fieldWeight in 1151, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.018493433 = weight(abstract_txt:need in 1151) [ClassicSimilarity], result of:
           0.018493433 = score(doc=1151,freq=1.0), product of:
             0.07083153 = queryWeight, product of:
               1.1773595 = boost
               4.1774464 = idf(docFreq=1851, maxDocs=44421)
               0.014401465 = queryNorm
             0.2610904 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1774464 = idf(docFreq=1851, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.01269385 = weight(abstract_txt:information in 1151) [ClassicSimilarity], result of:
           0.01269385 = score(doc=1151,freq=2.0), product of:
             0.059371844 = queryWeight, product of:
               1.7043393 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.014401465 = queryNorm
             0.21380253 = fieldWeight in 1151, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.043080755 = weight(abstract_txt:effective in 1151) [ClassicSimilarity], result of:
           0.043080755 = score(doc=1151,freq=1.0), product of:
             0.14248449 = queryWeight, product of:
               2.04515 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.014401465 = queryNorm
             0.302354 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.16805169 = weight(abstract_txt:clinical in 1151) [ClassicSimilarity], result of:
           0.16805169 = score(doc=1151,freq=3.0), product of:
             0.21386339 = queryWeight, product of:
               2.0458038 = boost
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.014401465 = queryNorm
             0.7857899 = fieldWeight in 1151, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.2588162 = idf(docFreq=84, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.026647199 = weight(abstract_txt:retrieval in 1151) [ClassicSimilarity], result of:
           0.026647199 = score(doc=1151,freq=1.0), product of:
             0.1226392 = queryWeight, product of:
               2.4495168 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.014401465 = queryNorm
             0.21728125 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.044243023 = weight(abstract_txt:were in 1151) [ClassicSimilarity], result of:
           0.044243023 = score(doc=1151,freq=2.0), product of:
             0.13648392 = queryWeight, product of:
               2.5840833 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.014401465 = queryNorm
             0.3241629 = fieldWeight in 1151, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.174461 = weight(abstract_txt:effectiveness in 1151) [ClassicSimilarity], result of:
           0.174461 = score(doc=1151,freq=3.0), product of:
             0.31623787 = queryWeight, product of:
               4.3088694 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.014401465 = queryNorm
             0.5516765 = fieldWeight in 1151, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
         0.35385826 = weight(abstract_txt:clinicians in 1151) [ClassicSimilarity], result of:
           0.35385826 = score(doc=1151,freq=1.0), product of:
             0.6384269 = queryWeight, product of:
               4.998807 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.014401465 = queryNorm
             0.5542659 = fieldWeight in 1151, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.0625 = fieldNorm(doc=1151)
       0.36 = coord(9/25)