Document (#32913)

Author

Jung, S.
Herlocker, J.L.
Webster, J.

Title

Click data as implicit relevance feedback in web search

Source

Information processing and management. 43(2007) no.3, S.791-807

Year

2007

Abstract

Search sessions consist of a person presenting a query to a search engine, followed by that person examining the search results, selecting some of those search results for further review, possibly following some series of hyperlinks, and perhaps backtracking to previously viewed pages in the session. The series of pages selected for viewing in a search session, sometimes called the click data, is intuitively a source of relevance feedback information to the search engine. We are interested in how that relevance feedback can be used to improve the search results quality for all users, not just the current user. For example, the search engine could learn which documents are frequently visited when certain search queries are given. In this article, we address three issues related to using click data as implicit relevance feedback: (1) How click data beyond the search results page might be more reliable than just the clicks from the search results page; (2) Whether we can further subselect from this click data to get even more reliable relevance feedback; and (3) How the reliability of click data for relevance feedback changes when the goal becomes finding one document for the user that completely meets their information needs (if possible). We refer to these documents as the ones that are strictly relevant to the query. Our conclusions are based on empirical data from a live website with manual assessment of relevance. We found that considering all of the click data in a search session as relevance feedback has the potential to increase both precision and recall of the feedback data. We further found that, when the goal is identifying strictly relevant documents, that it could be useful to focus on last visited documents rather than all documents visited in a search session.

Footnote

Beitrag in: Special issue on Heterogeneous and Distributed IR

Similar documents (author)

1. Jung, S.; Herlocker, J.L.; Webster, J.; Mellinger, M.; Frumkin, J.: LibraryFind : system design and usability testing of academic metasearch system (2008) 4.06

   4.0583477 = sum of:
     4.0583477 = sum of:
       1.9492757 = weight(author_txt:jung in 2366) [ClassicSimilarity], result of:
         1.9492757 = score(doc=2366,freq=1.0), product of:
           0.6883028 = queryWeight, product of:
             9.06241 = idf(docFreq=13, maxDocs=44421)
             0.075951405 = queryNorm
           2.832003 = fieldWeight in 2366, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.06241 = idf(docFreq=13, maxDocs=44421)
             0.3125 = fieldNorm(doc=2366)
       2.109072 = weight(author_txt:webster in 2366) [ClassicSimilarity], result of:
         2.109072 = score(doc=2366,freq=1.0), product of:
           0.7254235 = queryWeight, product of:
             1.0266113 = boost
             9.303573 = idf(docFreq=10, maxDocs=44421)
             0.075951405 = queryNorm
           2.9073665 = fieldWeight in 2366, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.303573 = idf(docFreq=10, maxDocs=44421)
             0.3125 = fieldNorm(doc=2366)
   

2. Webster, S.: ¬An annotated bibliography for object-oriented analysis and design (1994) 2.11

   2.109072 = sum of:
     2.109072 = product of:
       4.218144 = sum of:
         4.218144 = weight(author_txt:webster in 1639) [ClassicSimilarity], result of:
           4.218144 = score(doc=1639,freq=1.0), product of:
             0.7254235 = queryWeight, product of:
               1.0266113 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.075951405 = queryNorm
             5.814733 = fieldWeight in 1639, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=1639)
       0.5 = coord(1/2)
   

3. Webster, F.: ¬The information society : conceptions and critique (1996) 2.11

   2.109072 = sum of:
     2.109072 = product of:
       4.218144 = sum of:
         4.218144 = weight(author_txt:webster in 6038) [ClassicSimilarity], result of:
           4.218144 = score(doc=6038,freq=1.0), product of:
             0.7254235 = queryWeight, product of:
               1.0266113 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.075951405 = queryNorm
             5.814733 = fieldWeight in 6038, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=6038)
       0.5 = coord(1/2)
   

4. Webster, F.: Theories of the information society (1995) 2.11

   2.109072 = sum of:
     2.109072 = product of:
       4.218144 = sum of:
         4.218144 = weight(author_txt:webster in 1836) [ClassicSimilarity], result of:
           4.218144 = score(doc=1836,freq=1.0), product of:
             0.7254235 = queryWeight, product of:
               1.0266113 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.075951405 = queryNorm
             5.814733 = fieldWeight in 1836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=1836)
       0.5 = coord(1/2)
   

5. Webster, N.: Webster's third new international dictionary of the English language unabridged : utilizing all the experience and resources of more than one hundred years of Merriam-Webster dictionaries (1993) 2.11

   2.109072 = sum of:
     2.109072 = product of:
       4.218144 = sum of:
         4.218144 = weight(author_txt:webster in 3415) [ClassicSimilarity], result of:
           4.218144 = score(doc=3415,freq=1.0), product of:
             0.7254235 = queryWeight, product of:
               1.0266113 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.075951405 = queryNorm
             5.814733 = fieldWeight in 3415, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=3415)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Smith, G.; Brien, C.; Ashman, H.: Evaluating implicit judgments from image search clickthrough data (2012) 0.46

   0.45583266 = sum of:
     0.45583266 = product of:
       1.0359833 = sum of:
         0.031890787 = weight(abstract_txt:page in 1518) [ClassicSimilarity], result of:
           0.031890787 = score(doc=1518,freq=1.0), product of:
             0.09739006 = queryWeight, product of:
               1.2593849 = boost
               5.987735 = idf(docFreq=302, maxDocs=44421)
               0.012914976 = queryNorm
             0.32745424 = fieldWeight in 1518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.987735 = idf(docFreq=302, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.015881212 = weight(abstract_txt:when in 1518) [ClassicSimilarity], result of:
           0.015881212 = score(doc=1518,freq=1.0), product of:
             0.0700418 = queryWeight, product of:
               1.3080533 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.012914976 = queryNorm
             0.22673906 = fieldWeight in 1518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.04462928 = weight(abstract_txt:implicit in 1518) [ClassicSimilarity], result of:
           0.04462928 = score(doc=1518,freq=1.0), product of:
             0.1218478 = queryWeight, product of:
               1.4086723 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.012914976 = queryNorm
             0.3662707 = fieldWeight in 1518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.04517549 = weight(abstract_txt:reliable in 1518) [ClassicSimilarity], result of:
           0.04517549 = score(doc=1518,freq=1.0), product of:
             0.12283997 = queryWeight, product of:
               1.4143959 = boost
               6.724734 = idf(docFreq=144, maxDocs=44421)
               0.012914976 = queryNorm
             0.36775887 = fieldWeight in 1518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.724734 = idf(docFreq=144, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.015377593 = weight(abstract_txt:that in 1518) [ClassicSimilarity], result of:
           0.015377593 = score(doc=1518,freq=5.0), product of:
             0.053173594 = queryWeight, product of:
               1.7409375 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012914976 = queryNorm
             0.28919604 = fieldWeight in 1518, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.04421739 = weight(abstract_txt:results in 1518) [ClassicSimilarity], result of:
           0.04421739 = score(doc=1518,freq=8.0), product of:
             0.082176924 = queryWeight, product of:
               1.8291365 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.012914976 = queryNorm
             0.5380755 = fieldWeight in 1518, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.07807482 = weight(abstract_txt:data in 1518) [ClassicSimilarity], result of:
           0.07807482 = score(doc=1518,freq=10.0), product of:
             0.13556553 = queryWeight, product of:
               3.1519697 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.012914976 = queryNorm
             0.5759194 = fieldWeight in 1518, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.1591621 = weight(abstract_txt:relevance in 1518) [ClassicSimilarity], result of:
           0.1591621 = score(doc=1518,freq=5.0), product of:
             0.26403463 = queryWeight, product of:
               4.147263 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012914976 = queryNorm
             0.6028077 = fieldWeight in 1518, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.17606938 = weight(abstract_txt:feedback in 1518) [ClassicSimilarity], result of:
           0.17606938 = score(doc=1518,freq=2.0), product of:
             0.38329843 = queryWeight, product of:
               4.9968886 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012914976 = queryNorm
             0.45935327 = fieldWeight in 1518, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.16050717 = weight(abstract_txt:search in 1518) [ClassicSimilarity], result of:
           0.16050717 = score(doc=1518,freq=10.0), product of:
             0.25396085 = queryWeight, product of:
               5.3806353 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012914976 = queryNorm
             0.6320154 = fieldWeight in 1518, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
         0.26499808 = weight(abstract_txt:click in 1518) [ClassicSimilarity], result of:
           0.26499808 = score(doc=1518,freq=1.0), product of:
             0.60662776 = queryWeight, product of:
               5.880257 = boost
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.012914976 = queryNorm
             0.43683803 = fieldWeight in 1518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1518)
       0.44 = coord(11/25)
   

2. Kelly, D.: Implicit feedback : using behavior to infer relevance (2005) 0.33

   0.32591107 = sum of:
     0.32591107 = product of:
       0.8147777 = sum of:
         0.013684946 = weight(abstract_txt:query in 770) [ClassicSimilarity], result of:
           0.013684946 = score(doc=770,freq=1.0), product of:
             0.061404146 = queryWeight, product of:
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.012914976 = queryNorm
             0.2228668 = fieldWeight in 770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.026636254 = weight(abstract_txt:just in 770) [ClassicSimilarity], result of:
           0.026636254 = score(doc=770,freq=1.0), product of:
             0.095723316 = queryWeight, product of:
               1.2485617 = boost
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.012914976 = queryNorm
             0.27826297 = fieldWeight in 770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.013612467 = weight(abstract_txt:when in 770) [ClassicSimilarity], result of:
           0.013612467 = score(doc=770,freq=1.0), product of:
             0.0700418 = queryWeight, product of:
               1.3080533 = boost
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.012914976 = queryNorm
             0.19434777 = fieldWeight in 770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1460857 = idf(docFreq=1910, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.015595724 = weight(abstract_txt:that in 770) [ClassicSimilarity], result of:
           0.015595724 = score(doc=770,freq=7.0), product of:
             0.053173594 = queryWeight, product of:
               1.7409375 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012914976 = queryNorm
             0.29329827 = fieldWeight in 770, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.013399893 = weight(abstract_txt:results in 770) [ClassicSimilarity], result of:
           0.013399893 = score(doc=770,freq=1.0), product of:
             0.082176924 = queryWeight, product of:
               1.8291365 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.012914976 = queryNorm
             0.16306151 = fieldWeight in 770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.022315806 = weight(abstract_txt:documents in 770) [ClassicSimilarity], result of:
           0.022315806 = score(doc=770,freq=1.0), product of:
             0.115458 = queryWeight, product of:
               2.1681192 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.012914976 = queryNorm
             0.19328073 = fieldWeight in 770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.07891291 = weight(abstract_txt:session in 770) [ClassicSimilarity], result of:
           0.07891291 = score(doc=770,freq=1.0), product of:
             0.24877745 = queryWeight, product of:
               2.8465686 = boost
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.012914976 = queryNorm
             0.3172028 = fieldWeight in 770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.20235047 = weight(abstract_txt:relevance in 770) [ClassicSimilarity], result of:
           0.20235047 = score(doc=770,freq=11.0), product of:
             0.26403463 = queryWeight, product of:
               4.147263 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012914976 = queryNorm
             0.7663785 = fieldWeight in 770, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.3847634 = weight(abstract_txt:feedback in 770) [ClassicSimilarity], result of:
           0.3847634 = score(doc=770,freq=13.0), product of:
             0.38329843 = queryWeight, product of:
               4.9968886 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012914976 = queryNorm
             1.003822 = fieldWeight in 770, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
         0.04350585 = weight(abstract_txt:search in 770) [ClassicSimilarity], result of:
           0.04350585 = score(doc=770,freq=1.0), product of:
             0.25396085 = queryWeight, product of:
               5.3806353 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012914976 = queryNorm
             0.17130928 = fieldWeight in 770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.046875 = fieldNorm(doc=770)
       0.4 = coord(10/25)
   

3. Jiang, J.-D.; Jiang, J.-Y.; Cheng, P.-J.: Cocluster hypothesis and ranking consistency for relevance ranking in web search (2019) 0.30

   0.30050534 = sum of:
     0.30050534 = product of:
       0.7512633 = sum of:
         0.018246595 = weight(abstract_txt:query in 247) [ClassicSimilarity], result of:
           0.018246595 = score(doc=247,freq=1.0), product of:
             0.061404146 = queryWeight, product of:
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.012914976 = queryNorm
             0.29715574 = fieldWeight in 247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.029941238 = weight(abstract_txt:goal in 247) [ClassicSimilarity], result of:
           0.029941238 = score(doc=247,freq=1.0), product of:
             0.08542592 = queryWeight, product of:
               1.1794946 = boost
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.012914976 = queryNorm
             0.3504936 = fieldWeight in 247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.02575667 = weight(abstract_txt:further in 247) [ClassicSimilarity], result of:
           0.02575667 = score(doc=247,freq=1.0), product of:
             0.088450454 = queryWeight, product of:
               1.4699305 = boost
               4.6591816 = idf(docFreq=1143, maxDocs=44421)
               0.012914976 = queryNorm
             0.29119885 = fieldWeight in 247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6591816 = idf(docFreq=1143, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.06035148 = weight(abstract_txt:engine in 247) [ClassicSimilarity], result of:
           0.06035148 = score(doc=247,freq=2.0), product of:
             0.12384796 = queryWeight, product of:
               1.739367 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.012914976 = queryNorm
             0.48730296 = fieldWeight in 247, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.011115021 = weight(abstract_txt:that in 247) [ClassicSimilarity], result of:
           0.011115021 = score(doc=247,freq=2.0), product of:
             0.053173594 = queryWeight, product of:
               1.7409375 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012914976 = queryNorm
             0.20903271 = fieldWeight in 247, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.017866524 = weight(abstract_txt:results in 247) [ClassicSimilarity], result of:
           0.017866524 = score(doc=247,freq=1.0), product of:
             0.082176924 = queryWeight, product of:
               1.8291365 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.012914976 = queryNorm
             0.21741535 = fieldWeight in 247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.028216487 = weight(abstract_txt:data in 247) [ClassicSimilarity], result of:
           0.028216487 = score(doc=247,freq=1.0), product of:
             0.13556553 = queryWeight, product of:
               3.1519697 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.012914976 = queryNorm
             0.20813909 = fieldWeight in 247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.14089876 = weight(abstract_txt:relevance in 247) [ClassicSimilarity], result of:
           0.14089876 = score(doc=247,freq=3.0), product of:
             0.26403463 = queryWeight, product of:
               4.147263 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012914976 = queryNorm
             0.53363746 = fieldWeight in 247, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.1160156 = weight(abstract_txt:search in 247) [ClassicSimilarity], result of:
           0.1160156 = score(doc=247,freq=4.0), product of:
             0.25396085 = queryWeight, product of:
               5.3806353 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012914976 = queryNorm
             0.45682475 = fieldWeight in 247, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
         0.30285496 = weight(abstract_txt:click in 247) [ClassicSimilarity], result of:
           0.30285496 = score(doc=247,freq=1.0), product of:
             0.60662776 = queryWeight, product of:
               5.880257 = boost
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.012914976 = queryNorm
             0.49924347 = fieldWeight in 247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.0625 = fieldNorm(doc=247)
       0.4 = coord(10/25)
   

4. Quiroga, L.M.; Mostafa, J.: ¬An experiment in building profiles in information filtering : the role of context of user relevance feedback (2002) 0.26

   0.25890943 = sum of:
     0.25890943 = product of:
       0.809092 = sum of:
         0.018425679 = weight(abstract_txt:could in 3579) [ClassicSimilarity], result of:
           0.018425679 = score(doc=3579,freq=1.0), product of:
             0.061805267 = queryWeight, product of:
               1.0032609 = boost
               4.7699957 = idf(docFreq=1023, maxDocs=44421)
               0.012914976 = queryNorm
             0.29812473 = fieldWeight in 3579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7699957 = idf(docFreq=1023, maxDocs=44421)
               0.0625 = fieldNorm(doc=3579)
         0.088343054 = weight(abstract_txt:implicit in 3579) [ClassicSimilarity], result of:
           0.088343054 = score(doc=3579,freq=3.0), product of:
             0.1218478 = queryWeight, product of:
               1.4086723 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.012914976 = queryNorm
             0.7250279 = fieldWeight in 3579, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.0625 = fieldNorm(doc=3579)
         0.015719013 = weight(abstract_txt:that in 3579) [ClassicSimilarity], result of:
           0.015719013 = score(doc=3579,freq=4.0), product of:
             0.053173594 = queryWeight, product of:
               1.7409375 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012914976 = queryNorm
             0.2956169 = fieldWeight in 3579, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3579)
         0.02526708 = weight(abstract_txt:results in 3579) [ClassicSimilarity], result of:
           0.02526708 = score(doc=3579,freq=2.0), product of:
             0.082176924 = queryWeight, product of:
               1.8291365 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.012914976 = queryNorm
             0.30747172 = fieldWeight in 3579, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=3579)
         0.029754406 = weight(abstract_txt:documents in 3579) [ClassicSimilarity], result of:
           0.029754406 = score(doc=3579,freq=1.0), product of:
             0.115458 = queryWeight, product of:
               2.1681192 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.012914976 = queryNorm
             0.25770763 = fieldWeight in 3579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=3579)
         0.03990414 = weight(abstract_txt:data in 3579) [ClassicSimilarity], result of:
           0.03990414 = score(doc=3579,freq=2.0), product of:
             0.13556553 = queryWeight, product of:
               3.1519697 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.012914976 = queryNorm
             0.29435313 = fieldWeight in 3579, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=3579)
         0.21522643 = weight(abstract_txt:relevance in 3579) [ClassicSimilarity], result of:
           0.21522643 = score(doc=3579,freq=7.0), product of:
             0.26403463 = queryWeight, product of:
               4.147263 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012914976 = queryNorm
             0.8151447 = fieldWeight in 3579, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3579)
         0.3764522 = weight(abstract_txt:feedback in 3579) [ClassicSimilarity], result of:
           0.3764522 = score(doc=3579,freq=7.0), product of:
             0.38329843 = queryWeight, product of:
               4.9968886 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012914976 = queryNorm
             0.98213863 = fieldWeight in 3579, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=3579)
       0.32 = coord(8/25)
   

5. Jacucci, G.; Barral, O.; Daee, P.; Wenzel, M.; Serim, B.; Ruotsalo, T.; Pluchino, P.; Freeman, J.; Gamberini, L.; Kaski, S.; Blankertz, B.: Integrating neurophysiologic relevance feedback in intent modeling for information retrieval (2019) 0.26

   0.25680077 = sum of:
     0.25680077 = product of:
       0.8025024 = sum of:
         0.018425679 = weight(abstract_txt:could in 356) [ClassicSimilarity], result of:
           0.018425679 = score(doc=356,freq=1.0), product of:
             0.061805267 = queryWeight, product of:
               1.0032609 = boost
               4.7699957 = idf(docFreq=1023, maxDocs=44421)
               0.012914976 = queryNorm
             0.29812473 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7699957 = idf(docFreq=1023, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.088343054 = weight(abstract_txt:implicit in 356) [ClassicSimilarity], result of:
           0.088343054 = score(doc=356,freq=3.0), product of:
             0.1218478 = queryWeight, product of:
               1.4086723 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.012914976 = queryNorm
             0.7250279 = fieldWeight in 356, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.013613064 = weight(abstract_txt:that in 356) [ClassicSimilarity], result of:
           0.013613064 = score(doc=356,freq=3.0), product of:
             0.053173594 = queryWeight, product of:
               1.7409375 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012914976 = queryNorm
             0.25601172 = fieldWeight in 356, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.029754406 = weight(abstract_txt:documents in 356) [ClassicSimilarity], result of:
           0.029754406 = score(doc=356,freq=1.0), product of:
             0.115458 = queryWeight, product of:
               2.1681192 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.012914976 = queryNorm
             0.25770763 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.03990414 = weight(abstract_txt:data in 356) [ClassicSimilarity], result of:
           0.03990414 = score(doc=356,freq=2.0), product of:
             0.13556553 = queryWeight, product of:
               3.1519697 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.012914976 = queryNorm
             0.29435313 = fieldWeight in 356, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.18189955 = weight(abstract_txt:relevance in 356) [ClassicSimilarity], result of:
           0.18189955 = score(doc=356,freq=5.0), product of:
             0.26403463 = queryWeight, product of:
               4.147263 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012914976 = queryNorm
             0.68892306 = fieldWeight in 356, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.34852704 = weight(abstract_txt:feedback in 356) [ClassicSimilarity], result of:
           0.34852704 = score(doc=356,freq=6.0), product of:
             0.38329843 = queryWeight, product of:
               4.9968886 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.012914976 = queryNorm
             0.90928376 = fieldWeight in 356, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
         0.08203542 = weight(abstract_txt:search in 356) [ClassicSimilarity], result of:
           0.08203542 = score(doc=356,freq=2.0), product of:
             0.25396085 = queryWeight, product of:
               5.3806353 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012914976 = queryNorm
             0.3230239 = fieldWeight in 356, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=356)
       0.32 = coord(8/25)