Document (#31771)

Author

Kelly, D.

Title

Implicit feedback : using behavior to infer relevance

Source

New directions in cognitive information retrieval. Eds.: A. Spink, C. Cole

Imprint

Dordrecht : Springer Netherland

Year

2005

Pages

S.169-186

Series

The information retrieval series, vol. 19

Abstract

The concept of relevance has a rich history in information retrieval (IR) that dates back well over 40 years (Borlund, 2003) and is necessarily a part of any theory of informationseeking and retrieval. Relevance feedback also has a long history in IR (Salton, 1971) and is considered an important part of interactive IR (Spink and Losee, 1996). Relevance feedback techniques often require users to explicitly provide feedback to the system, by, for instance, specifying keywords, selecting, evaluating and marking documents, or answering questions about their interests. The feedback that users provide during these interactions has been used for a variety of IR techniques and applications including query expansion, term disambiguation, user profiling, filtering and personalization. Empirical studies have led to the general finding that users of interactive IR systems desire explicit relevance feedback features and, in particular, term suggestion features (Beaulieu, 1997; Belkin et al., 2001; Koenemann and Belkin, 1996). However, much of the evidence from laboratory studies has indicated that relevance feedback features are not used. While users often report a desire for relevance feedback and term suggestion, they do not actually use these features during their searching activities. Several reasons can be given for why this disparately exists. Users may not have additional cognitive resources available to operate the relevance feedback feature. While the extra effort required to operate the feature may seem trivial, the user is already potentially involved in a complex and cognitively burdensome task. Increased effort would be required for both learning the new system and operating its features. When features require more effort and additional cognitive processing than they appear to be worth, they may be abandoned all together. Furthermore, if relevance feedback features are not implemented as part of the routine search activity, they may be forgotten, no matter how helpful they are. This research, in part, has lead to the general belief that users are unwilling to engage in explicit relevance feedback. Recently (Anick, 2003) demonstrated in a web-based study, that users made use of a term suggestion feature to expand and refine their queries, thus things may be changing. These results suggest the potential of term suggestion features in some types of information-seeking environments, especially for single session interactions. Hence it may just be the case that traditional relevance feedback interfaces have not effectively elicited feedback from users or optimally integrated relevance feedback features into current information interaction models.

Similar documents (author)

1. Kelly, B.: ¬The XHTML interview (2000) 5.33

   5.3271337 = sum of:
     5.3271337 = weight(author_txt:kelly in 4182) [ClassicSimilarity], result of:
       5.3271337 = fieldWeight in 4182, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.523414 = idf(docFreq=23, maxDocs=44421)
         0.625 = fieldNorm(doc=4182)
   

2. Kelly, J.: Downloading information using bibliographic management software (1994) 5.33

   5.3271337 = sum of:
     5.3271337 = weight(author_txt:kelly in 8355) [ClassicSimilarity], result of:
       5.3271337 = fieldWeight in 8355, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.523414 = idf(docFreq=23, maxDocs=44421)
         0.625 = fieldNorm(doc=8355)
   

3. Kelly, J.A.: Downloading information using bibliographic management software (1997) 5.33

   5.3271337 = sum of:
     5.3271337 = weight(author_txt:kelly in 3322) [ClassicSimilarity], result of:
       5.3271337 = fieldWeight in 3322, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.523414 = idf(docFreq=23, maxDocs=44421)
         0.625 = fieldNorm(doc=3322)
   

4. Kelly, R.A.: Digital archiving the physics literature : Author to archive and beyond. The American Physical Society (1997) 5.33

   5.3271337 = sum of:
     5.3271337 = weight(author_txt:kelly in 804) [ClassicSimilarity], result of:
       5.3271337 = fieldWeight in 804, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.523414 = idf(docFreq=23, maxDocs=44421)
         0.625 = fieldNorm(doc=804)
   

5. Kelly, D.: Measuring online information seeking context : Part 1: background and method (2006) 5.33

   5.3271337 = sum of:
     5.3271337 = weight(author_txt:kelly in 331) [ClassicSimilarity], result of:
       5.3271337 = fieldWeight in 331, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.523414 = idf(docFreq=23, maxDocs=44421)
         0.625 = fieldNorm(doc=331)
   

Similar documents (content)

1. Kelley, D.: Relevance feedback : getting to know your user (2008) 0.43

   0.43195534 = sum of:
     0.43195534 = product of:
       1.0798883 = sum of:
         0.02649926 = weight(abstract_txt:required in 2924) [ClassicSimilarity], result of:
           0.02649926 = score(doc=2924,freq=1.0), product of:
             0.07774714 = queryWeight, product of:
               1.1006228 = boost
               5.453425 = idf(docFreq=516, maxDocs=44421)
               0.012953185 = queryNorm
             0.34083906 = fieldWeight in 2924, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.453425 = idf(docFreq=516, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.028042259 = weight(abstract_txt:interactive in 2924) [ClassicSimilarity], result of:
           0.028042259 = score(doc=2924,freq=1.0), product of:
             0.080736615 = queryWeight, product of:
               1.1215833 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.012953185 = queryNorm
             0.34733012 = fieldWeight in 2924, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.035192776 = weight(abstract_txt:interactions in 2924) [ClassicSimilarity], result of:
           0.035192776 = score(doc=2924,freq=1.0), product of:
             0.09393575 = queryWeight, product of:
               1.2097949 = boost
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.012953185 = queryNorm
             0.37464732 = fieldWeight in 2924, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.03941347 = weight(abstract_txt:explicit in 2924) [ClassicSimilarity], result of:
           0.03941347 = score(doc=2924,freq=1.0), product of:
             0.10130363 = queryWeight, product of:
               1.2563447 = boost
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.012953185 = queryNorm
             0.38906276 = fieldWeight in 2924, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.010697111 = weight(abstract_txt:that in 2924) [ClassicSimilarity], result of:
           0.010697111 = score(doc=2924,freq=2.0), product of:
             0.05117434 = queryWeight, product of:
               1.6705383 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012953185 = queryNorm
             0.20903271 = fieldWeight in 2924, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.037243865 = weight(abstract_txt:they in 2924) [ClassicSimilarity], result of:
           0.037243865 = score(doc=2924,freq=3.0), product of:
             0.091799006 = queryWeight, product of:
               1.8909729 = boost
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.012953185 = queryNorm
             0.405711 = fieldWeight in 2924, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.045024984 = weight(abstract_txt:term in 2924) [ClassicSimilarity], result of:
           0.045024984 = score(doc=2924,freq=1.0), product of:
             0.15024877 = queryWeight, product of:
               2.4192 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.012953185 = queryNorm
             0.29966956 = fieldWeight in 2924, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.059337903 = weight(abstract_txt:users in 2924) [ClassicSimilarity], result of:
           0.059337903 = score(doc=2924,freq=4.0), product of:
             0.13307098 = queryWeight, product of:
               2.8798373 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012953185 = queryNorm
             0.44591168 = fieldWeight in 2924, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.26259056 = weight(abstract_txt:relevance in 2924) [ClassicSimilarity], result of:
           0.26259056 = score(doc=2924,freq=5.0), product of:
             0.3811609 = queryWeight, product of:
               5.969337 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012953185 = queryNorm
             0.68892306 = fieldWeight in 2924, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
         0.5358461 = weight(abstract_txt:feedback in 2924) [ClassicSimilarity], result of:
           0.5358461 = score(doc=2924,freq=5.0), product of:
             0.6455521 = queryWeight, product of:
               8.390946 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012953185 = queryNorm
             0.8300587 = fieldWeight in 2924, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=2924)
       0.4 = coord(10/25)
   

2. Tseng, Y.-H.: Solving vocabulary problems with interactive query expansion (1998) 0.31

   0.30738714 = sum of:
     0.30738714 = product of:
       1.0978112 = sum of:
         0.028042259 = weight(abstract_txt:interactive in 6159) [ClassicSimilarity], result of:
           0.028042259 = score(doc=6159,freq=1.0), product of:
             0.080736615 = queryWeight, product of:
               1.1215833 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.012953185 = queryNorm
             0.34733012 = fieldWeight in 6159, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0625 = fieldNorm(doc=6159)
         0.01310123 = weight(abstract_txt:that in 6159) [ClassicSimilarity], result of:
           0.01310123 = score(doc=6159,freq=3.0), product of:
             0.05117434 = queryWeight, product of:
               1.6705383 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012953185 = queryNorm
             0.25601172 = fieldWeight in 6159, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=6159)
         0.10067892 = weight(abstract_txt:term in 6159) [ClassicSimilarity], result of:
           0.10067892 = score(doc=6159,freq=5.0), product of:
             0.15024877 = queryWeight, product of:
               2.4192 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.012953185 = queryNorm
             0.6700815 = fieldWeight in 6159, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0625 = fieldNorm(doc=6159)
         0.04195823 = weight(abstract_txt:users in 6159) [ClassicSimilarity], result of:
           0.04195823 = score(doc=6159,freq=2.0), product of:
             0.13307098 = queryWeight, product of:
               2.8798373 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012953185 = queryNorm
             0.31530717 = fieldWeight in 6159, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=6159)
         0.2313535 = weight(abstract_txt:suggestion in 6159) [ClassicSimilarity], result of:
           0.2313535 = score(doc=6159,freq=2.0), product of:
             0.3296446 = queryWeight, product of:
               3.205046 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.012953185 = queryNorm
             0.7018271 = fieldWeight in 6159, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.0625 = fieldNorm(doc=6159)
         0.20340174 = weight(abstract_txt:relevance in 6159) [ClassicSimilarity], result of:
           0.20340174 = score(doc=6159,freq=3.0), product of:
             0.3811609 = queryWeight, product of:
               5.969337 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012953185 = queryNorm
             0.53363746 = fieldWeight in 6159, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=6159)
         0.47927535 = weight(abstract_txt:feedback in 6159) [ClassicSimilarity], result of:
           0.47927535 = score(doc=6159,freq=4.0), product of:
             0.6455521 = queryWeight, product of:
               8.390946 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012953185 = queryNorm
             0.74242705 = fieldWeight in 6159, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=6159)
       0.28 = coord(7/25)
   

3. Spink, A.: Towards a theoretical framework for information retrieval in an information seeking context (1999) 0.29

   0.29234296 = sum of:
     0.29234296 = product of:
       0.9135718 = sum of:
         0.0627044 = weight(abstract_txt:interactive in 1300) [ClassicSimilarity], result of:
           0.0627044 = score(doc=1300,freq=5.0), product of:
             0.080736615 = queryWeight, product of:
               1.1215833 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.012953185 = queryNorm
             0.77665377 = fieldWeight in 1300, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0625 = fieldNorm(doc=1300)
         0.0497701 = weight(abstract_txt:interactions in 1300) [ClassicSimilarity], result of:
           0.0497701 = score(doc=1300,freq=2.0), product of:
             0.09393575 = queryWeight, product of:
               1.2097949 = boost
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.012953185 = queryNorm
             0.5298313 = fieldWeight in 1300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.0625 = fieldNorm(doc=1300)
         0.052622616 = weight(abstract_txt:1996 in 1300) [ClassicSimilarity], result of:
           0.052622616 = score(doc=1300,freq=2.0), product of:
             0.097491525 = queryWeight, product of:
               1.2324796 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.012953185 = queryNorm
             0.5397661 = fieldWeight in 1300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.0625 = fieldNorm(doc=1300)
         0.0075639994 = weight(abstract_txt:that in 1300) [ClassicSimilarity], result of:
           0.0075639994 = score(doc=1300,freq=1.0), product of:
             0.05117434 = queryWeight, product of:
               1.6705383 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012953185 = queryNorm
             0.14780845 = fieldWeight in 1300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1300)
         0.10780578 = weight(abstract_txt:belkin in 1300) [ClassicSimilarity], result of:
           0.10780578 = score(doc=1300,freq=1.0), product of:
             0.19813289 = queryWeight, product of:
               1.7570114 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.012953185 = queryNorm
             0.54410845 = fieldWeight in 1300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=1300)
         0.059337903 = weight(abstract_txt:users in 1300) [ClassicSimilarity], result of:
           0.059337903 = score(doc=1300,freq=4.0), product of:
             0.13307098 = queryWeight, product of:
               2.8798373 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012953185 = queryNorm
             0.44591168 = fieldWeight in 1300, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=1300)
         0.23486812 = weight(abstract_txt:relevance in 1300) [ClassicSimilarity], result of:
           0.23486812 = score(doc=1300,freq=4.0), product of:
             0.3811609 = queryWeight, product of:
               5.969337 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012953185 = queryNorm
             0.6161915 = fieldWeight in 1300, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1300)
         0.33889884 = weight(abstract_txt:feedback in 1300) [ClassicSimilarity], result of:
           0.33889884 = score(doc=1300,freq=2.0), product of:
             0.6455521 = queryWeight, product of:
               8.390946 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012953185 = queryNorm
             0.5249752 = fieldWeight in 1300, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=1300)
       0.32 = coord(8/25)
   

4. Kuhlthau, C.C.: Investigating patterns in information seeking : concepts in context (1999) 0.29

   0.29234296 = sum of:
     0.29234296 = product of:
       0.9135718 = sum of:
         0.0627044 = weight(abstract_txt:interactive in 1301) [ClassicSimilarity], result of:
           0.0627044 = score(doc=1301,freq=5.0), product of:
             0.080736615 = queryWeight, product of:
               1.1215833 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.012953185 = queryNorm
             0.77665377 = fieldWeight in 1301, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.0625 = fieldNorm(doc=1301)
         0.0497701 = weight(abstract_txt:interactions in 1301) [ClassicSimilarity], result of:
           0.0497701 = score(doc=1301,freq=2.0), product of:
             0.09393575 = queryWeight, product of:
               1.2097949 = boost
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.012953185 = queryNorm
             0.5298313 = fieldWeight in 1301, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.0625 = fieldNorm(doc=1301)
         0.052622616 = weight(abstract_txt:1996 in 1301) [ClassicSimilarity], result of:
           0.052622616 = score(doc=1301,freq=2.0), product of:
             0.097491525 = queryWeight, product of:
               1.2324796 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.012953185 = queryNorm
             0.5397661 = fieldWeight in 1301, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.0625 = fieldNorm(doc=1301)
         0.0075639994 = weight(abstract_txt:that in 1301) [ClassicSimilarity], result of:
           0.0075639994 = score(doc=1301,freq=1.0), product of:
             0.05117434 = queryWeight, product of:
               1.6705383 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012953185 = queryNorm
             0.14780845 = fieldWeight in 1301, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1301)
         0.10780578 = weight(abstract_txt:belkin in 1301) [ClassicSimilarity], result of:
           0.10780578 = score(doc=1301,freq=1.0), product of:
             0.19813289 = queryWeight, product of:
               1.7570114 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.012953185 = queryNorm
             0.54410845 = fieldWeight in 1301, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=1301)
         0.059337903 = weight(abstract_txt:users in 1301) [ClassicSimilarity], result of:
           0.059337903 = score(doc=1301,freq=4.0), product of:
             0.13307098 = queryWeight, product of:
               2.8798373 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012953185 = queryNorm
             0.44591168 = fieldWeight in 1301, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=1301)
         0.23486812 = weight(abstract_txt:relevance in 1301) [ClassicSimilarity], result of:
           0.23486812 = score(doc=1301,freq=4.0), product of:
             0.3811609 = queryWeight, product of:
               5.969337 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012953185 = queryNorm
             0.6161915 = fieldWeight in 1301, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1301)
         0.33889884 = weight(abstract_txt:feedback in 1301) [ClassicSimilarity], result of:
           0.33889884 = score(doc=1301,freq=2.0), product of:
             0.6455521 = queryWeight, product of:
               8.390946 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012953185 = queryNorm
             0.5249752 = fieldWeight in 1301, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=1301)
       0.32 = coord(8/25)
   

5. Spink, A.: Term relevance feedback and mediated database searching : implications for information retrieval practice and systems design (1995) 0.28

   0.27956882 = sum of:
     0.27956882 = product of:
       0.99846005 = sum of:
         0.033124074 = weight(abstract_txt:required in 1824) [ClassicSimilarity], result of:
           0.033124074 = score(doc=1824,freq=1.0), product of:
             0.07774714 = queryWeight, product of:
               1.1006228 = boost
               5.453425 = idf(docFreq=516, maxDocs=44421)
               0.012953185 = queryNorm
             0.42604882 = fieldWeight in 1824, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.453425 = idf(docFreq=516, maxDocs=44421)
               0.078125 = fieldNorm(doc=1824)
         0.03505282 = weight(abstract_txt:interactive in 1824) [ClassicSimilarity], result of:
           0.03505282 = score(doc=1824,freq=1.0), product of:
             0.080736615 = queryWeight, product of:
               1.1215833 = boost
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.012953185 = queryNorm
             0.43416265 = fieldWeight in 1824, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.557282 = idf(docFreq=465, maxDocs=44421)
               0.078125 = fieldNorm(doc=1824)
         0.013371389 = weight(abstract_txt:that in 1824) [ClassicSimilarity], result of:
           0.013371389 = score(doc=1824,freq=2.0), product of:
             0.05117434 = queryWeight, product of:
               1.6705383 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012953185 = queryNorm
             0.2612909 = fieldWeight in 1824, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=1824)
         0.07959367 = weight(abstract_txt:term in 1824) [ClassicSimilarity], result of:
           0.07959367 = score(doc=1824,freq=2.0), product of:
             0.15024877 = queryWeight, product of:
               2.4192 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.012953185 = queryNorm
             0.52974594 = fieldWeight in 1824, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.078125 = fieldNorm(doc=1824)
         0.064235166 = weight(abstract_txt:users in 1824) [ClassicSimilarity], result of:
           0.064235166 = score(doc=1824,freq=3.0), product of:
             0.13307098 = queryWeight, product of:
               2.8798373 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012953185 = queryNorm
             0.48271355 = fieldWeight in 1824, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=1824)
         0.2542522 = weight(abstract_txt:relevance in 1824) [ClassicSimilarity], result of:
           0.2542522 = score(doc=1824,freq=3.0), product of:
             0.3811609 = queryWeight, product of:
               5.969337 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012953185 = queryNorm
             0.66704684 = fieldWeight in 1824, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=1824)
         0.5188307 = weight(abstract_txt:feedback in 1824) [ClassicSimilarity], result of:
           0.5188307 = score(doc=1824,freq=3.0), product of:
             0.6455521 = queryWeight, product of:
               8.390946 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012953185 = queryNorm
             0.8037008 = fieldWeight in 1824, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.078125 = fieldNorm(doc=1824)
       0.28 = coord(7/25)