Document (#27885)

Author

Vakkari, P.
Sormunen, E.

Title

¬The influence of relevance levels an the effectiveness of interactive information retrieval

Source

Journal of the American Society for Information Science and Technology. 55(2004) no.11, S.963-969

Year

2004

Abstract

In this paper, we focus an the effect of graded relevance an the results of interactive information retrieval (IR) experiments based an assigned search tasks in a test collection. A group of 26 subjects searched for four Text REtrieval Conference (TREC) topics using automatic and interactive query expansion based an relevance feedback. The TREC- and user-suggested pools of relevant documents were reassessed an a four-level relevance scale. The results show that the users could identify nearly all highly relevant documents and about half of the marginal ones. Users also selected a fair number of irrelevant documents for query expansion. The findings suggest that the effectiveness of query expansion is closely related to the searchers' success in retrieving and identifying highly relevant documents for feedback. The implications of the results an interpreting the findings of past experiments with liberal relevance thresholds are also discussed.

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 3.88

   3.882875 = sum of:
     3.882875 = sum of:
       1.6011534 = weight(author_txt:vakkari in 5435) [ClassicSimilarity], result of:
         1.6011534 = score(doc=5435,freq=1.0), product of:
           0.6197403 = queryWeight, product of:
             8.267481 = idf(docFreq=30, maxDocs=44421)
             0.0749612 = queryNorm
           2.5835876 = fieldWeight in 5435, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.267481 = idf(docFreq=30, maxDocs=44421)
             0.3125 = fieldNorm(doc=5435)
       2.2817216 = weight(author_txt:sormunen in 5435) [ClassicSimilarity], result of:
         2.2817216 = score(doc=5435,freq=1.0), product of:
           0.78480697 = queryWeight, product of:
             1.1253214 = boost
             9.303573 = idf(docFreq=10, maxDocs=44421)
             0.0749612 = queryNorm
           2.9073665 = fieldWeight in 5435, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.303573 = idf(docFreq=10, maxDocs=44421)
             0.3125 = fieldNorm(doc=5435)
   

2. Sormunen, E.: Free-text searching in full-text databases : probing system limits (1993) 2.28

   2.2817216 = sum of:
     2.2817216 = product of:
       4.563443 = sum of:
         4.563443 = weight(author_txt:sormunen in 7119) [ClassicSimilarity], result of:
           4.563443 = score(doc=7119,freq=1.0), product of:
             0.78480697 = queryWeight, product of:
               1.1253214 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0749612 = queryNorm
             5.814733 = fieldWeight in 7119, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=7119)
       0.5 = coord(1/2)
   

3. Halttunen, K.; Sormunen, E.: Learning information retrieval through an educational game : is gaming sufficient for learning? (2000) 1.83

   1.8253771 = sum of:
     1.8253771 = product of:
       3.6507542 = sum of:
         3.6507542 = weight(author_txt:sormunen in 4865) [ClassicSimilarity], result of:
           3.6507542 = score(doc=4865,freq=1.0), product of:
             0.78480697 = queryWeight, product of:
               1.1253214 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0749612 = queryNorm
             4.6517863 = fieldWeight in 4865, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.5 = fieldNorm(doc=4865)
       0.5 = coord(1/2)
   

4. Alkula, R.; Sormunen, E.: Problems and guidelines for database descriptions (1989) 1.83

   1.8253771 = sum of:
     1.8253771 = product of:
       3.6507542 = sum of:
         3.6507542 = weight(author_txt:sormunen in 3397) [ClassicSimilarity], result of:
           3.6507542 = score(doc=3397,freq=1.0), product of:
             0.78480697 = queryWeight, product of:
               1.1253214 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0749612 = queryNorm
             4.6517863 = fieldWeight in 3397, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.5 = fieldNorm(doc=3397)
       0.5 = coord(1/2)
   

5. Vakkari, P.: Information seeking in context : a challenging metatheory (1997) 1.60

   1.6011534 = sum of:
     1.6011534 = product of:
       3.2023067 = sum of:
         3.2023067 = weight(author_txt:vakkari in 1302) [ClassicSimilarity], result of:
           3.2023067 = score(doc=1302,freq=1.0), product of:
             0.6197403 = queryWeight, product of:
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.0749612 = queryNorm
             5.1671753 = fieldWeight in 1302, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.267481 = idf(docFreq=30, maxDocs=44421)
               0.625 = fieldNorm(doc=1302)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 0.71

   0.70627034 = sum of:
     0.70627034 = product of:
       1.3582122 = sum of:
         0.036555775 = weight(abstract_txt:users in 5435) [ClassicSimilarity], result of:
           0.036555775 = score(doc=5435,freq=5.0), product of:
             0.07332501 = queryWeight, product of:
               1.0507506 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.019562017 = queryNorm
             0.49854442 = fieldWeight in 5435, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.123172656 = weight(abstract_txt:liberal in 5435) [ClassicSimilarity], result of:
           0.123172656 = score(doc=5435,freq=1.0), product of:
             0.22366825 = queryWeight, product of:
               1.2976595 = boost
               8.811096 = idf(docFreq=17, maxDocs=44421)
               0.019562017 = queryNorm
             0.5506935 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.811096 = idf(docFreq=17, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.050207634 = weight(abstract_txt:four in 5435) [ClassicSimilarity], result of:
           0.050207634 = score(doc=5435,freq=1.0), product of:
             0.15492374 = queryWeight, product of:
               1.5273288 = boost
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.019562017 = queryNorm
             0.32407966 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.022739258 = weight(abstract_txt:results in 5435) [ClassicSimilarity], result of:
           0.022739258 = score(doc=5435,freq=1.0), product of:
             0.104589015 = queryWeight, product of:
               1.5369589 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.019562017 = queryNorm
             0.21741535 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.058282696 = weight(abstract_txt:highly in 5435) [ClassicSimilarity], result of:
           0.058282696 = score(doc=5435,freq=1.0), product of:
             0.17111887 = queryWeight, product of:
               1.6051755 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.019562017 = queryNorm
             0.34059772 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.07545461 = weight(abstract_txt:feedback in 5435) [ClassicSimilarity], result of:
           0.07545461 = score(doc=5435,freq=1.0), product of:
             0.20326471 = queryWeight, product of:
               1.7494622 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.019562017 = queryNorm
             0.37121353 = fieldWeight in 5435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.15346913 = weight(abstract_txt:trec in 5435) [ClassicSimilarity], result of:
           0.15346913 = score(doc=5435,freq=2.0), product of:
             0.25898555 = queryWeight, product of:
               1.9747465 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.019562017 = queryNorm
             0.592578 = fieldWeight in 5435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.10722324 = weight(abstract_txt:relevant in 5435) [ClassicSimilarity], result of:
           0.10722324 = score(doc=5435,freq=4.0), product of:
             0.18527117 = queryWeight, product of:
               2.0456114 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.019562017 = queryNorm
             0.5787368 = fieldWeight in 5435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.100558475 = weight(abstract_txt:query in 5435) [ClassicSimilarity], result of:
           0.100558475 = score(doc=5435,freq=3.0), product of:
             0.19537722 = queryWeight, product of:
               2.100662 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.019562017 = queryNorm
             0.51468885 = fieldWeight in 5435, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.07140707 = weight(abstract_txt:documents in 5435) [ClassicSimilarity], result of:
           0.07140707 = score(doc=5435,freq=2.0), product of:
             0.19592911 = queryWeight, product of:
               2.429059 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019562017 = queryNorm
             0.3644536 = fieldWeight in 5435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.16058081 = weight(abstract_txt:interactive in 5435) [ClassicSimilarity], result of:
           0.16058081 = score(doc=5435,freq=3.0), product of:
             0.2669258 = queryWeight, product of:
               2.4553561 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.019562017 = queryNorm
             0.60159343 = fieldWeight in 5435, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.24604098 = weight(abstract_txt:expansion in 5435) [ClassicSimilarity], result of:
           0.24604098 = score(doc=5435,freq=4.0), product of:
             0.32231972 = queryWeight, product of:
               2.6981287 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.019562017 = queryNorm
             0.7633445 = fieldWeight in 5435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
         0.1525199 = weight(abstract_txt:relevance in 5435) [ClassicSimilarity], result of:
           0.1525199 = score(doc=5435,freq=2.0), product of:
             0.35004658 = queryWeight, product of:
               3.629999 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.019562017 = queryNorm
             0.43571317 = fieldWeight in 5435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=5435)
       0.52 = coord(13/25)
   

2. Efthimiadis, E.N.: Interactive query expansion : a user-based evaluation in a relevance feedback environment (2000) 0.66

   0.65559727 = sum of:
     0.65559727 = product of:
       1.3658277 = sum of:
         0.028609417 = weight(abstract_txt:users in 6701) [ClassicSimilarity], result of:
           0.028609417 = score(doc=6701,freq=4.0), product of:
             0.07332501 = queryWeight, product of:
               1.0507506 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.019562017 = queryNorm
             0.39017272 = fieldWeight in 6701, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.058980584 = weight(abstract_txt:effectiveness in 6701) [ClassicSimilarity], result of:
           0.058980584 = score(doc=6701,freq=2.0), product of:
             0.14964499 = queryWeight, product of:
               1.5010829 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.019562017 = queryNorm
             0.39413673 = fieldWeight in 6701, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.03439863 = weight(abstract_txt:retrieval in 6701) [ClassicSimilarity], result of:
           0.03439863 = score(doc=6701,freq=3.0), product of:
             0.104460046 = queryWeight, product of:
               1.536011 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019562017 = queryNorm
             0.3292994 = fieldWeight in 6701, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.034462355 = weight(abstract_txt:results in 6701) [ClassicSimilarity], result of:
           0.034462355 = score(doc=6701,freq=3.0), product of:
             0.104589015 = queryWeight, product of:
               1.5369589 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.019562017 = queryNorm
             0.3295026 = fieldWeight in 6701, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.07212116 = weight(abstract_txt:highly in 6701) [ClassicSimilarity], result of:
           0.07212116 = score(doc=6701,freq=2.0), product of:
             0.17111887 = queryWeight, product of:
               1.6051755 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.019562017 = queryNorm
             0.42146817 = fieldWeight in 6701, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.06602278 = weight(abstract_txt:feedback in 6701) [ClassicSimilarity], result of:
           0.06602278 = score(doc=6701,freq=1.0), product of:
             0.20326471 = queryWeight, product of:
               1.7494622 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.019562017 = queryNorm
             0.32481185 = fieldWeight in 6701, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.06634099 = weight(abstract_txt:relevant in 6701) [ClassicSimilarity], result of:
           0.06634099 = score(doc=6701,freq=2.0), product of:
             0.18527117 = queryWeight, product of:
               2.0456114 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.019562017 = queryNorm
             0.35807508 = fieldWeight in 6701, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.20945491 = weight(abstract_txt:query in 6701) [ClassicSimilarity], result of:
           0.20945491 = score(doc=6701,freq=17.0), product of:
             0.19537722 = queryWeight, product of:
               2.100662 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.019562017 = queryNorm
             1.0720539 = fieldWeight in 6701, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.06248119 = weight(abstract_txt:documents in 6701) [ClassicSimilarity], result of:
           0.06248119 = score(doc=6701,freq=2.0), product of:
             0.19592911 = queryWeight, product of:
               2.429059 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019562017 = queryNorm
             0.31889692 = fieldWeight in 6701, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.18139532 = weight(abstract_txt:interactive in 6701) [ClassicSimilarity], result of:
           0.18139532 = score(doc=6701,freq=5.0), product of:
             0.2669258 = queryWeight, product of:
               2.4553561 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.019562017 = queryNorm
             0.67957205 = fieldWeight in 6701, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.38811213 = weight(abstract_txt:expansion in 6701) [ClassicSimilarity], result of:
           0.38811213 = score(doc=6701,freq=13.0), product of:
             0.32231972 = queryWeight, product of:
               2.6981287 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.019562017 = queryNorm
             1.2041216 = fieldWeight in 6701, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
         0.16344821 = weight(abstract_txt:relevance in 6701) [ClassicSimilarity], result of:
           0.16344821 = score(doc=6701,freq=3.0), product of:
             0.35004658 = queryWeight, product of:
               3.629999 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.019562017 = queryNorm
             0.46693277 = fieldWeight in 6701, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=6701)
       0.48 = coord(12/25)
   

3. Ruthven, T.; Lalmas, M.; Rijsbergen, K.van: Incorporating user research behavior into relevance feedback (2003) 0.54

   0.54031545 = sum of:
     0.54031545 = product of:
       1.2279897 = sum of:
         0.067406386 = weight(abstract_txt:effectiveness in 169) [ClassicSimilarity], result of:
           0.067406386 = score(doc=169,freq=2.0), product of:
             0.14964499 = queryWeight, product of:
               1.5010829 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.019562017 = queryNorm
             0.450442 = fieldWeight in 169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.02269721 = weight(abstract_txt:retrieval in 169) [ClassicSimilarity], result of:
           0.02269721 = score(doc=169,freq=1.0), product of:
             0.104460046 = queryWeight, product of:
               1.536011 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019562017 = queryNorm
             0.21728125 = fieldWeight in 169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.07688912 = weight(abstract_txt:experiments in 169) [ClassicSimilarity], result of:
           0.07688912 = score(doc=169,freq=2.0), product of:
             0.16336966 = queryWeight, product of:
               1.5684088 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.019562017 = queryNorm
             0.47064504 = fieldWeight in 169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.10670893 = weight(abstract_txt:feedback in 169) [ClassicSimilarity], result of:
           0.10670893 = score(doc=169,freq=2.0), product of:
             0.20326471 = queryWeight, product of:
               1.7494622 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.019562017 = queryNorm
             0.5249752 = fieldWeight in 169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.15346913 = weight(abstract_txt:trec in 169) [ClassicSimilarity], result of:
           0.15346913 = score(doc=169,freq=2.0), product of:
             0.25898555 = queryWeight, product of:
               1.9747465 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.019562017 = queryNorm
             0.592578 = fieldWeight in 169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.09285805 = weight(abstract_txt:relevant in 169) [ClassicSimilarity], result of:
           0.09285805 = score(doc=169,freq=3.0), product of:
             0.18527117 = queryWeight, product of:
               2.0456114 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.019562017 = queryNorm
             0.50120074 = fieldWeight in 169, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.082105644 = weight(abstract_txt:query in 169) [ClassicSimilarity], result of:
           0.082105644 = score(doc=169,freq=2.0), product of:
             0.19537722 = queryWeight, product of:
               2.100662 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.019562017 = queryNorm
             0.42024165 = fieldWeight in 169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.07140707 = weight(abstract_txt:documents in 169) [ClassicSimilarity], result of:
           0.07140707 = score(doc=169,freq=2.0), product of:
             0.19592911 = queryWeight, product of:
               2.429059 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019562017 = queryNorm
             0.3644536 = fieldWeight in 169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.092711374 = weight(abstract_txt:interactive in 169) [ClassicSimilarity], result of:
           0.092711374 = score(doc=169,freq=1.0), product of:
             0.2669258 = queryWeight, product of:
               2.4553561 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.019562017 = queryNorm
             0.34733012 = fieldWeight in 169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.24604098 = weight(abstract_txt:expansion in 169) [ClassicSimilarity], result of:
           0.24604098 = score(doc=169,freq=4.0), product of:
             0.32231972 = queryWeight, product of:
               2.6981287 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.019562017 = queryNorm
             0.7633445 = fieldWeight in 169, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
         0.21569572 = weight(abstract_txt:relevance in 169) [ClassicSimilarity], result of:
           0.21569572 = score(doc=169,freq=4.0), product of:
             0.35004658 = queryWeight, product of:
               3.629999 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.019562017 = queryNorm
             0.6161915 = fieldWeight in 169, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=169)
       0.44 = coord(11/25)
   

4. He, D.; Wu, D.: Enhancing query translation with relevance feedback in translingual information retrieval : a study of the medication process (2011) 0.47

   0.4745728 = sum of:
     0.4745728 = product of:
       1.0785745 = sum of:
         0.014091982 = weight(abstract_txt:also in 244) [ClassicSimilarity], result of:
           0.014091982 = score(doc=244,freq=1.0), product of:
             0.06641296 = queryWeight, product of:
               3.3949955 = idf(docFreq=4049, maxDocs=44421)
               0.019562017 = queryNorm
             0.21218722 = fieldWeight in 244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3949955 = idf(docFreq=4049, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.047663514 = weight(abstract_txt:effectiveness in 244) [ClassicSimilarity], result of:
           0.047663514 = score(doc=244,freq=1.0), product of:
             0.14964499 = queryWeight, product of:
               1.5010829 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.019562017 = queryNorm
             0.3185106 = fieldWeight in 244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.0320987 = weight(abstract_txt:retrieval in 244) [ClassicSimilarity], result of:
           0.0320987 = score(doc=244,freq=2.0), product of:
             0.104460046 = queryWeight, product of:
               1.536011 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019562017 = queryNorm
             0.3072821 = fieldWeight in 244, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.022739258 = weight(abstract_txt:results in 244) [ClassicSimilarity], result of:
           0.022739258 = score(doc=244,freq=1.0), product of:
             0.104589015 = queryWeight, product of:
               1.5369589 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.019562017 = queryNorm
             0.21741535 = fieldWeight in 244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.16872165 = weight(abstract_txt:feedback in 244) [ClassicSimilarity], result of:
           0.16872165 = score(doc=244,freq=5.0), product of:
             0.20326471 = queryWeight, product of:
               1.7494622 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.019562017 = queryNorm
             0.8300587 = fieldWeight in 244, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.05361162 = weight(abstract_txt:relevant in 244) [ClassicSimilarity], result of:
           0.05361162 = score(doc=244,freq=1.0), product of:
             0.18527117 = queryWeight, product of:
               2.0456114 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.019562017 = queryNorm
             0.2893684 = fieldWeight in 244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.14221115 = weight(abstract_txt:query in 244) [ClassicSimilarity], result of:
           0.14221115 = score(doc=244,freq=6.0), product of:
             0.19537722 = queryWeight, product of:
               2.100662 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.019562017 = queryNorm
             0.72787994 = fieldWeight in 244, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.050492425 = weight(abstract_txt:documents in 244) [ClassicSimilarity], result of:
           0.050492425 = score(doc=244,freq=1.0), product of:
             0.19592911 = queryWeight, product of:
               2.429059 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019562017 = queryNorm
             0.25770763 = fieldWeight in 244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.092711374 = weight(abstract_txt:interactive in 244) [ClassicSimilarity], result of:
           0.092711374 = score(doc=244,freq=1.0), product of:
             0.2669258 = queryWeight, product of:
               2.4553561 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.019562017 = queryNorm
             0.34733012 = fieldWeight in 244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.21307774 = weight(abstract_txt:expansion in 244) [ClassicSimilarity], result of:
           0.21307774 = score(doc=244,freq=3.0), product of:
             0.32231972 = queryWeight, product of:
               2.6981287 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.019562017 = queryNorm
             0.6610757 = fieldWeight in 244, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
         0.24115516 = weight(abstract_txt:relevance in 244) [ClassicSimilarity], result of:
           0.24115516 = score(doc=244,freq=5.0), product of:
             0.35004658 = queryWeight, product of:
               3.629999 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.019562017 = queryNorm
             0.68892306 = fieldWeight in 244, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=244)
       0.44 = coord(11/25)
   

5. Kekäläinen, J.; Järvelin, K.: Using graded relevance assessments in IR evaluation (2002) 0.45

   0.45467693 = sum of:
     0.45467693 = product of:
       1.0333567 = sum of:
         0.09946122 = weight(abstract_txt:marginal in 225) [ClassicSimilarity], result of:
           0.09946122 = score(doc=225,freq=1.0), product of:
             0.19395337 = queryWeight, product of:
               1.2083904 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.019562017 = queryNorm
             0.51281 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.11682034 = weight(abstract_txt:graded in 225) [ClassicSimilarity], result of:
           0.11682034 = score(doc=225,freq=1.0), product of:
             0.21591051 = queryWeight, product of:
               1.2749568 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.019562017 = queryNorm
             0.5410591 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.071004316 = weight(abstract_txt:four in 225) [ClassicSimilarity], result of:
           0.071004316 = score(doc=225,freq=2.0), product of:
             0.15492374 = queryWeight, product of:
               1.5273288 = boost
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.019562017 = queryNorm
             0.45831785 = fieldWeight in 225, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1852746 = idf(docFreq=675, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.02269721 = weight(abstract_txt:retrieval in 225) [ClassicSimilarity], result of:
           0.02269721 = score(doc=225,freq=1.0), product of:
             0.104460046 = queryWeight, product of:
               1.536011 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.019562017 = queryNorm
             0.21728125 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.032158166 = weight(abstract_txt:results in 225) [ClassicSimilarity], result of:
           0.032158166 = score(doc=225,freq=2.0), product of:
             0.104589015 = queryWeight, product of:
               1.5369589 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.019562017 = queryNorm
             0.30747172 = fieldWeight in 225, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.058282696 = weight(abstract_txt:highly in 225) [ClassicSimilarity], result of:
           0.058282696 = score(doc=225,freq=1.0), product of:
             0.17111887 = queryWeight, product of:
               1.6051755 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.019562017 = queryNorm
             0.34059772 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.05361162 = weight(abstract_txt:relevant in 225) [ClassicSimilarity], result of:
           0.05361162 = score(doc=225,freq=1.0), product of:
             0.18527117 = queryWeight, product of:
               2.0456114 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.019562017 = queryNorm
             0.2893684 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.05805746 = weight(abstract_txt:query in 225) [ClassicSimilarity], result of:
           0.05805746 = score(doc=225,freq=1.0), product of:
             0.19537722 = queryWeight, product of:
               2.100662 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.019562017 = queryNorm
             0.29715574 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.112904504 = weight(abstract_txt:documents in 225) [ClassicSimilarity], result of:
           0.112904504 = score(doc=225,freq=5.0), product of:
             0.19592911 = queryWeight, product of:
               2.429059 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019562017 = queryNorm
             0.5762518 = fieldWeight in 225, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.12302049 = weight(abstract_txt:expansion in 225) [ClassicSimilarity], result of:
           0.12302049 = score(doc=225,freq=1.0), product of:
             0.32231972 = queryWeight, product of:
               2.6981287 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.019562017 = queryNorm
             0.38167226 = fieldWeight in 225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
         0.2853386 = weight(abstract_txt:relevance in 225) [ClassicSimilarity], result of:
           0.2853386 = score(doc=225,freq=7.0), product of:
             0.35004658 = queryWeight, product of:
               3.629999 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.019562017 = queryNorm
             0.8151447 = fieldWeight in 225, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=225)
       0.44 = coord(11/25)