Document (#38786)

Author

Ruthven, I.

Title

Relevance behaviour in TREC

Source

Journal of documentation. 70(2014) no.6, S.1098-1117

Year

2014

Abstract

Purpose - The purpose of this paper is to examine how various types of TREC data can be used to better understand relevance and serve as test-bed for exploring relevance. The author proposes that there are many interesting studies that can be performed on the TREC data collections that are not directly related to evaluating systems but to learning more about human judgements of information and relevance and that these studies can provide useful research questions for other types of investigation. Design/methodology/approach - Through several case studies the author shows how existing data from TREC can be used to learn more about the factors that may affect relevance judgements and interactive search decisions and answer new research questions for exploring relevance. Findings - The paper uncovers factors, such as familiarity, interest and strictness of relevance criteria, that affect the nature of relevance assessments within TREC, contrasting these against findings from user studies of relevance. Research limitations/implications - The research only considers certain uses of TREC data and assessment given by professional relevance assessors but motivates further exploration of the TREC data so that the research community can further exploit the effort involved in the construction of TREC test collections. Originality/value - The paper presents an original viewpoint on relevance investigations and TREC itself by motivating TREC as a source of inspiration on understanding relevance rather than purely as a source of evaluation material.

Content

Beitrag in einem Special Issue: Festschrift in honour of Nigel Ford

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Ruthven, R.: Interactive information retrieval (2008) 5.09

   5.0913243 = sum of:
     5.0913243 = weight(author_txt:ruthven in 2838) [ClassicSimilarity], result of:
       5.0913243 = fieldWeight in 2838, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.146119 = idf(docFreq=34, maxDocs=44421)
         0.625 = fieldNorm(doc=2838)
   

2. Ruthven, I.: Integrating approaches to relevance (2005) 5.09

   5.0913243 = sum of:
     5.0913243 = weight(author_txt:ruthven in 763) [ClassicSimilarity], result of:
       5.0913243 = fieldWeight in 763, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.146119 = idf(docFreq=34, maxDocs=44421)
         0.625 = fieldNorm(doc=763)
   

3. Ruthven, I.: ¬The language of information need : differentiating conscious and formalized information needs (2019) 5.09

   5.0913243 = sum of:
     5.0913243 = weight(author_txt:ruthven in 35) [ClassicSimilarity], result of:
       5.0913243 = fieldWeight in 35, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.146119 = idf(docFreq=34, maxDocs=44421)
         0.625 = fieldNorm(doc=35)
   

4. Ruthven, I.: Resonance and the experience of relevance (2021) 5.09

   5.0913243 = sum of:
     5.0913243 = weight(author_txt:ruthven in 1212) [ClassicSimilarity], result of:
       5.0913243 = fieldWeight in 1212, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.146119 = idf(docFreq=34, maxDocs=44421)
         0.625 = fieldNorm(doc=1212)
   

5. Ruthven, I.: ¬An information behavior theory of transitions (2022) 5.09

   5.0913243 = sum of:
     5.0913243 = weight(author_txt:ruthven in 1531) [ClassicSimilarity], result of:
       5.0913243 = fieldWeight in 1531, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.146119 = idf(docFreq=34, maxDocs=44421)
         0.625 = fieldNorm(doc=1531)
   

Similar documents (content)

1. Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011) 0.60

   0.60131305 = sum of:
     0.60131305 = product of:
       1.3666205 = sum of:
         0.014511077 = weight(abstract_txt:findings in 540) [ClassicSimilarity], result of:
           0.014511077 = score(doc=540,freq=1.0), product of:
             0.056097902 = queryWeight, product of:
               1.0196631 = boost
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.013292814 = queryNorm
             0.25867414 = fieldWeight in 540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.11695738 = weight(abstract_txt:assessors in 540) [ClassicSimilarity], result of:
           0.11695738 = score(doc=540,freq=3.0), product of:
             0.12410279 = queryWeight, product of:
               1.0724058 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.013292814 = queryNorm
             0.94242346 = fieldWeight in 540, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.018203817 = weight(abstract_txt:purpose in 540) [ClassicSimilarity], result of:
           0.018203817 = score(doc=540,freq=1.0), product of:
             0.0652512 = queryWeight, product of:
               1.0997087 = boost
               4.4636893 = idf(docFreq=1390, maxDocs=44421)
               0.013292814 = queryNorm
             0.27898058 = fieldWeight in 540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4636893 = idf(docFreq=1390, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.04976768 = weight(abstract_txt:factors in 540) [ClassicSimilarity], result of:
           0.04976768 = score(doc=540,freq=4.0), product of:
             0.0803696 = queryWeight, product of:
               1.2204762 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.013292814 = queryNorm
             0.61923516 = fieldWeight in 540, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.04215322 = weight(abstract_txt:affect in 540) [ClassicSimilarity], result of:
           0.04215322 = score(doc=540,freq=1.0), product of:
             0.1142091 = queryWeight, product of:
               1.454902 = boost
               5.90541 = idf(docFreq=328, maxDocs=44421)
               0.013292814 = queryNorm
             0.3690881 = fieldWeight in 540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90541 = idf(docFreq=328, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.036090635 = weight(abstract_txt:research in 540) [ClassicSimilarity], result of:
           0.036090635 = score(doc=540,freq=5.0), product of:
             0.08173346 = queryWeight, product of:
               1.9460471 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.013292814 = queryNorm
             0.441565 = fieldWeight in 540, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.016412208 = weight(abstract_txt:that in 540) [ClassicSimilarity], result of:
           0.016412208 = score(doc=540,freq=3.0), product of:
             0.064107254 = queryWeight, product of:
               2.0392525 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013292814 = queryNorm
             0.25601172 = fieldWeight in 540, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.018899119 = weight(abstract_txt:data in 540) [ClassicSimilarity], result of:
           0.018899119 = score(doc=540,freq=1.0), product of:
             0.09080043 = queryWeight, product of:
               2.0511496 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.013292814 = queryNorm
             0.20813909 = fieldWeight in 540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.031559553 = weight(abstract_txt:studies in 540) [ClassicSimilarity], result of:
           0.031559553 = score(doc=540,freq=1.0), product of:
             0.11864354 = queryWeight, product of:
               2.0971062 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.013292814 = queryNorm
             0.26600313 = fieldWeight in 540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.48791635 = weight(abstract_txt:relevance in 540) [ClassicSimilarity], result of:
           0.48791635 = score(doc=540,freq=11.0), product of:
             0.4774889 = queryWeight, product of:
               7.286864 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013292814 = queryNorm
             1.0218381 = fieldWeight in 540, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
         0.5341495 = weight(abstract_txt:trec in 540) [ClassicSimilarity], result of:
           0.5341495 = score(doc=540,freq=3.0), product of:
             0.73598963 = queryWeight, product of:
               8.258558 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.013292814 = queryNorm
             0.7257569 = fieldWeight in 540, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=540)
       0.44 = coord(11/25)
   

2. Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 0.55

   0.5487242 = sum of:
     0.5487242 = product of:
       1.1431754 = sum of:
         0.012697192 = weight(abstract_txt:findings in 1835) [ClassicSimilarity], result of:
           0.012697192 = score(doc=1835,freq=1.0), product of:
             0.056097902 = queryWeight, product of:
               1.0196631 = boost
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.013292814 = queryNorm
             0.22633988 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.10233771 = weight(abstract_txt:assessors in 1835) [ClassicSimilarity], result of:
           0.10233771 = score(doc=1835,freq=3.0), product of:
             0.12410279 = queryWeight, product of:
               1.0724058 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.013292814 = queryNorm
             0.82462054 = fieldWeight in 1835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.022526074 = weight(abstract_txt:purpose in 1835) [ClassicSimilarity], result of:
           0.022526074 = score(doc=1835,freq=2.0), product of:
             0.0652512 = queryWeight, product of:
               1.0997087 = boost
               4.4636893 = idf(docFreq=1390, maxDocs=44421)
               0.013292814 = queryNorm
             0.34522083 = fieldWeight in 1835, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4636893 = idf(docFreq=1390, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.020846207 = weight(abstract_txt:questions in 1835) [ClassicSimilarity], result of:
           0.020846207 = score(doc=1835,freq=1.0), product of:
             0.078071564 = queryWeight, product of:
               1.2029009 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.013292814 = queryNorm
             0.2670141 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.030792182 = weight(abstract_txt:factors in 1835) [ClassicSimilarity], result of:
           0.030792182 = score(doc=1835,freq=2.0), product of:
             0.0803696 = queryWeight, product of:
               1.2204762 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.013292814 = queryNorm
             0.38313222 = fieldWeight in 1835, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.0111433165 = weight(abstract_txt:paper in 1835) [ClassicSimilarity], result of:
           0.0111433165 = score(doc=1835,freq=1.0), product of:
             0.058863793 = queryWeight, product of:
               1.2792432 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.013292814 = queryNorm
             0.18930681 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.06388508 = weight(abstract_txt:affect in 1835) [ClassicSimilarity], result of:
           0.06388508 = score(doc=1835,freq=3.0), product of:
             0.1142091 = queryWeight, product of:
               1.454902 = boost
               5.90541 = idf(docFreq=328, maxDocs=44421)
               0.013292814 = queryNorm
             0.55936944 = fieldWeight in 1835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.90541 = idf(docFreq=328, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.07330663 = weight(abstract_txt:judgements in 1835) [ClassicSimilarity], result of:
           0.07330663 = score(doc=1835,freq=1.0), product of:
             0.1805387 = queryWeight, product of:
               1.8292309 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.013292814 = queryNorm
             0.40604383 = fieldWeight in 1835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.024461223 = weight(abstract_txt:research in 1835) [ClassicSimilarity], result of:
           0.024461223 = score(doc=1835,freq=3.0), product of:
             0.08173346 = queryWeight, product of:
               1.9460471 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.013292814 = queryNorm
             0.2992804 = fieldWeight in 1835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.018539565 = weight(abstract_txt:that in 1835) [ClassicSimilarity], result of:
           0.018539565 = score(doc=1835,freq=5.0), product of:
             0.064107254 = queryWeight, product of:
               2.0392525 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013292814 = queryNorm
             0.28919604 = fieldWeight in 1835, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.22295521 = weight(abstract_txt:relevance in 1835) [ClassicSimilarity], result of:
           0.22295521 = score(doc=1835,freq=3.0), product of:
             0.4774889 = queryWeight, product of:
               7.286864 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013292814 = queryNorm
             0.46693277 = fieldWeight in 1835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
         0.53968495 = weight(abstract_txt:trec in 1835) [ClassicSimilarity], result of:
           0.53968495 = score(doc=1835,freq=4.0), product of:
             0.73598963 = queryWeight, product of:
               8.258558 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.013292814 = queryNorm
             0.7332779 = fieldWeight in 1835, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1835)
       0.48 = coord(12/25)
   

3. Ravana, S.D.; Rajagopal, P.; Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments (2015) 0.43

   0.43062901 = sum of:
     0.43062901 = product of:
       1.0765725 = sum of:
         0.014511077 = weight(abstract_txt:findings in 3591) [ClassicSimilarity], result of:
           0.014511077 = score(doc=3591,freq=1.0), product of:
             0.056097902 = queryWeight, product of:
               1.0196631 = boost
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.013292814 = queryNorm
             0.25867414 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.11695738 = weight(abstract_txt:assessors in 3591) [ClassicSimilarity], result of:
           0.11695738 = score(doc=3591,freq=3.0), product of:
             0.12410279 = queryWeight, product of:
               1.0724058 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.013292814 = queryNorm
             0.94242346 = fieldWeight in 3591, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.018203817 = weight(abstract_txt:purpose in 3591) [ClassicSimilarity], result of:
           0.018203817 = score(doc=3591,freq=1.0), product of:
             0.0652512 = queryWeight, product of:
               1.0997087 = boost
               4.4636893 = idf(docFreq=1390, maxDocs=44421)
               0.013292814 = queryNorm
             0.27898058 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4636893 = idf(docFreq=1390, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.021216769 = weight(abstract_txt:collections in 3591) [ClassicSimilarity], result of:
           0.021216769 = score(doc=3591,freq=1.0), product of:
             0.07226583 = queryWeight, product of:
               1.1573105 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.013292814 = queryNorm
             0.29359335 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.02488384 = weight(abstract_txt:factors in 3591) [ClassicSimilarity], result of:
           0.02488384 = score(doc=3591,freq=1.0), product of:
             0.0803696 = queryWeight, product of:
               1.2204762 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.013292814 = queryNorm
             0.30961758 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.026298404 = weight(abstract_txt:test in 3591) [ClassicSimilarity], result of:
           0.026298404 = score(doc=3591,freq=1.0), product of:
             0.08338728 = queryWeight, product of:
               1.2431779 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.013292814 = queryNorm
             0.3153767 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.01273522 = weight(abstract_txt:paper in 3591) [ClassicSimilarity], result of:
           0.01273522 = score(doc=3591,freq=1.0), product of:
             0.058863793 = queryWeight, product of:
               1.2792432 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.013292814 = queryNorm
             0.21635064 = fieldWeight in 3591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.016412208 = weight(abstract_txt:that in 3591) [ClassicSimilarity], result of:
           0.016412208 = score(doc=3591,freq=3.0), product of:
             0.064107254 = queryWeight, product of:
               2.0392525 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013292814 = queryNorm
             0.25601172 = fieldWeight in 3591, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.38922256 = weight(abstract_txt:relevance in 3591) [ClassicSimilarity], result of:
           0.38922256 = score(doc=3591,freq=7.0), product of:
             0.4774889 = queryWeight, product of:
               7.286864 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013292814 = queryNorm
             0.8151447 = fieldWeight in 3591, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
         0.43613127 = weight(abstract_txt:trec in 3591) [ClassicSimilarity], result of:
           0.43613127 = score(doc=3591,freq=2.0), product of:
             0.73598963 = queryWeight, product of:
               8.258558 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.013292814 = queryNorm
             0.592578 = fieldWeight in 3591, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=3591)
       0.4 = coord(10/25)
   

4. Sparck Jones, K.: Reflections on TREC (1997) 0.28

   0.27867758 = sum of:
     0.27867758 = product of:
       0.8708675 = sum of:
         0.021766616 = weight(abstract_txt:findings in 1580) [ClassicSimilarity], result of:
           0.021766616 = score(doc=1580,freq=1.0), product of:
             0.056097902 = queryWeight, product of:
               1.0196631 = boost
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.013292814 = queryNorm
             0.38801122 = fieldWeight in 1580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.09375 = fieldNorm(doc=1580)
         0.037325762 = weight(abstract_txt:factors in 1580) [ClassicSimilarity], result of:
           0.037325762 = score(doc=1580,freq=1.0), product of:
             0.0803696 = queryWeight, product of:
               1.2204762 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.013292814 = queryNorm
             0.46442637 = fieldWeight in 1580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.09375 = fieldNorm(doc=1580)
         0.05578734 = weight(abstract_txt:test in 1580) [ClassicSimilarity], result of:
           0.05578734 = score(doc=1580,freq=2.0), product of:
             0.08338728 = queryWeight, product of:
               1.2431779 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.013292814 = queryNorm
             0.669015 = fieldWeight in 1580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.09375 = fieldNorm(doc=1580)
         0.019102829 = weight(abstract_txt:paper in 1580) [ClassicSimilarity], result of:
           0.019102829 = score(doc=1580,freq=1.0), product of:
             0.058863793 = queryWeight, product of:
               1.2792432 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.013292814 = queryNorm
             0.32452595 = fieldWeight in 1580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.09375 = fieldNorm(doc=1580)
         0.034238584 = weight(abstract_txt:research in 1580) [ClassicSimilarity], result of:
           0.034238584 = score(doc=1580,freq=2.0), product of:
             0.08173346 = queryWeight, product of:
               1.9460471 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.013292814 = queryNorm
             0.41890535 = fieldWeight in 1580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.09375 = fieldNorm(doc=1580)
         0.02010077 = weight(abstract_txt:that in 1580) [ClassicSimilarity], result of:
           0.02010077 = score(doc=1580,freq=2.0), product of:
             0.064107254 = queryWeight, product of:
               2.0392525 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013292814 = queryNorm
             0.31354907 = fieldWeight in 1580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=1580)
         0.028348679 = weight(abstract_txt:data in 1580) [ClassicSimilarity], result of:
           0.028348679 = score(doc=1580,freq=1.0), product of:
             0.09080043 = queryWeight, product of:
               2.0511496 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.013292814 = queryNorm
             0.31220865 = fieldWeight in 1580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.09375 = fieldNorm(doc=1580)
         0.6541969 = weight(abstract_txt:trec in 1580) [ClassicSimilarity], result of:
           0.6541969 = score(doc=1580,freq=2.0), product of:
             0.73598963 = queryWeight, product of:
               8.258558 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.013292814 = queryNorm
             0.888867 = fieldWeight in 1580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.09375 = fieldNorm(doc=1580)
       0.32 = coord(8/25)
   

5. Wong, W.S.; Luk, R.W.P.; Leong, H.V.; Ho, K.S.; Lee, D.L.: Re-examining the effects of adding relevance information in a relevance feedback environment (2008) 0.25

   0.24809223 = sum of:
     0.24809223 = product of:
       0.88604367 = sum of:
         0.02052176 = weight(abstract_txt:findings in 3084) [ClassicSimilarity], result of:
           0.02052176 = score(doc=3084,freq=2.0), product of:
             0.056097902 = queryWeight, product of:
               1.0196631 = boost
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.013292814 = queryNorm
             0.36582047 = fieldWeight in 3084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1387863 = idf(docFreq=1924, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.03719156 = weight(abstract_txt:test in 3084) [ClassicSimilarity], result of:
           0.03719156 = score(doc=3084,freq=2.0), product of:
             0.08338728 = queryWeight, product of:
               1.2431779 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.013292814 = queryNorm
             0.44601 = fieldWeight in 3084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.01273522 = weight(abstract_txt:paper in 3084) [ClassicSimilarity], result of:
           0.01273522 = score(doc=3084,freq=1.0), product of:
             0.058863793 = queryWeight, product of:
               1.2792432 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.013292814 = queryNorm
             0.21635064 = fieldWeight in 3084, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.018951187 = weight(abstract_txt:that in 3084) [ClassicSimilarity], result of:
           0.018951187 = score(doc=3084,freq=4.0), product of:
             0.064107254 = queryWeight, product of:
               2.0392525 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013292814 = queryNorm
             0.2956169 = fieldWeight in 3084, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.031559553 = weight(abstract_txt:studies in 3084) [ClassicSimilarity], result of:
           0.031559553 = score(doc=3084,freq=1.0), product of:
             0.11864354 = queryWeight, product of:
               2.0971062 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.013292814 = queryNorm
             0.26600313 = fieldWeight in 3084, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.32895312 = weight(abstract_txt:relevance in 3084) [ClassicSimilarity], result of:
           0.32895312 = score(doc=3084,freq=5.0), product of:
             0.4774889 = queryWeight, product of:
               7.286864 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.013292814 = queryNorm
             0.68892306 = fieldWeight in 3084, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.43613127 = weight(abstract_txt:trec in 3084) [ClassicSimilarity], result of:
           0.43613127 = score(doc=3084,freq=2.0), product of:
             0.73598963 = queryWeight, product of:
               8.258558 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.013292814 = queryNorm
             0.592578 = fieldWeight in 3084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
       0.28 = coord(7/25)