Document (#32913)

Author

Jung, S.
Herlocker, J.L.
Webster, J.

Title

Click data as implicit relevance feedback in web search

Source

Information processing and management. 43(2007) no.3, S.791-807

Year

2007

Abstract

Search sessions consist of a person presenting a query to a search engine, followed by that person examining the search results, selecting some of those search results for further review, possibly following some series of hyperlinks, and perhaps backtracking to previously viewed pages in the session. The series of pages selected for viewing in a search session, sometimes called the click data, is intuitively a source of relevance feedback information to the search engine. We are interested in how that relevance feedback can be used to improve the search results quality for all users, not just the current user. For example, the search engine could learn which documents are frequently visited when certain search queries are given. In this article, we address three issues related to using click data as implicit relevance feedback: (1) How click data beyond the search results page might be more reliable than just the clicks from the search results page; (2) Whether we can further subselect from this click data to get even more reliable relevance feedback; and (3) How the reliability of click data for relevance feedback changes when the goal becomes finding one document for the user that completely meets their information needs (if possible). We refer to these documents as the ones that are strictly relevant to the query. Our conclusions are based on empirical data from a live website with manual assessment of relevance. We found that considering all of the click data in a search session as relevance feedback has the potential to increase both precision and recall of the feedback data. We further found that, when the goal is identifying strictly relevant documents, that it could be useful to focus on last visited documents rather than all documents visited in a search session.

Footnote

Beitrag in: Special issue on Heterogeneous and Distributed IR

Similar documents (author)

1. Jung, S.; Herlocker, J.L.; Webster, J.; Mellinger, M.; Frumkin, J.: LibraryFind : system design and usability testing of academic metasearch system (2008) 4.06

   4.0563235 = sum of:
     4.0563235 = sum of:
       1.9482638 = weight(author_txt:jung in 1366) [ClassicSimilarity], result of:
         1.9482638 = score(doc=1366,freq=1.0), product of:
           0.68829334 = queryWeight, product of:
             9.05783 = idf(docFreq=13, maxDocs=44218)
             0.07598877 = queryNorm
           2.830572 = fieldWeight in 1366, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.05783 = idf(docFreq=13, maxDocs=44218)
             0.3125 = fieldNorm(doc=1366)
       2.1080596 = weight(author_txt:webster in 1366) [ClassicSimilarity], result of:
         2.1080596 = score(doc=1366,freq=1.0), product of:
           0.72543246 = queryWeight, product of:
             1.0266247 = boost
             9.298992 = idf(docFreq=10, maxDocs=44218)
             0.07598877 = queryNorm
           2.905935 = fieldWeight in 1366, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.298992 = idf(docFreq=10, maxDocs=44218)
             0.3125 = fieldNorm(doc=1366)
   

2. Webster, S.: ¬An annotated bibliography for object-oriented analysis and design (1994) 2.11

   2.1080596 = sum of:
     2.1080596 = product of:
       4.2161193 = sum of:
         4.2161193 = weight(author_txt:webster in 1571) [ClassicSimilarity], result of:
           4.2161193 = score(doc=1571,freq=1.0), product of:
             0.72543246 = queryWeight, product of:
               1.0266247 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07598877 = queryNorm
             5.81187 = fieldWeight in 1571, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=1571)
       0.5 = coord(1/2)
   

3. Webster, F.: ¬The information society : conceptions and critique (1996) 2.11

   2.1080596 = sum of:
     2.1080596 = product of:
       4.2161193 = sum of:
         4.2161193 = weight(author_txt:webster in 5038) [ClassicSimilarity], result of:
           4.2161193 = score(doc=5038,freq=1.0), product of:
             0.72543246 = queryWeight, product of:
               1.0266247 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07598877 = queryNorm
             5.81187 = fieldWeight in 5038, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=5038)
       0.5 = coord(1/2)
   

4. Webster, F.: Theories of the information society (1995) 2.11

   2.1080596 = sum of:
     2.1080596 = product of:
       4.2161193 = sum of:
         4.2161193 = weight(author_txt:webster in 836) [ClassicSimilarity], result of:
           4.2161193 = score(doc=836,freq=1.0), product of:
             0.72543246 = queryWeight, product of:
               1.0266247 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07598877 = queryNorm
             5.81187 = fieldWeight in 836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=836)
       0.5 = coord(1/2)
   

5. Webster, N.: Webster's third new international dictionary of the English language unabridged : utilizing all the experience and resources of more than one hundred years of Merriam-Webster dictionaries (1993) 2.11

   2.1080596 = sum of:
     2.1080596 = product of:
       4.2161193 = sum of:
         4.2161193 = weight(author_txt:webster in 2415) [ClassicSimilarity], result of:
           4.2161193 = score(doc=2415,freq=1.0), product of:
             0.72543246 = queryWeight, product of:
               1.0266247 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07598877 = queryNorm
             5.81187 = fieldWeight in 2415, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=2415)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Smith, G.; Brien, C.; Ashman, H.: Evaluating implicit judgments from image search clickthrough data (2012) 0.46

   0.45653152 = sum of:
     0.45653152 = product of:
       1.0375717 = sum of:
         0.03195047 = weight(abstract_txt:page in 518) [ClassicSimilarity], result of:
           0.03195047 = score(doc=518,freq=1.0), product of:
             0.09743061 = queryWeight, product of:
               1.2614095 = boost
               5.9964437 = idf(docFreq=298, maxDocs=44218)
               0.01288088 = queryNorm
             0.3279305 = fieldWeight in 518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9964437 = idf(docFreq=298, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.015867462 = weight(abstract_txt:when in 518) [ClassicSimilarity], result of:
           0.015867462 = score(doc=518,freq=1.0), product of:
             0.06994328 = queryWeight, product of:
               1.308962 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.01288088 = queryNorm
             0.22686186 = fieldWeight in 518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.04483326 = weight(abstract_txt:implicit in 518) [ClassicSimilarity], result of:
           0.04483326 = score(doc=518,freq=1.0), product of:
             0.12211737 = queryWeight, product of:
               1.412203 = boost
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.01288088 = queryNorm
             0.36713254 = fieldWeight in 518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.044971097 = weight(abstract_txt:reliable in 518) [ClassicSimilarity], result of:
           0.044971097 = score(doc=518,freq=1.0), product of:
             0.12236754 = queryWeight, product of:
               1.4136487 = boost
               6.7201533 = idf(docFreq=144, maxDocs=44218)
               0.01288088 = queryNorm
             0.36750838 = fieldWeight in 518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7201533 = idf(docFreq=144, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.015427851 = weight(abstract_txt:that in 518) [ClassicSimilarity], result of:
           0.015427851 = score(doc=518,freq=5.0), product of:
             0.053245172 = queryWeight, product of:
               1.7445464 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01288088 = queryNorm
             0.28975117 = fieldWeight in 518, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.04425122 = weight(abstract_txt:results in 518) [ClassicSimilarity], result of:
           0.04425122 = score(doc=518,freq=8.0), product of:
             0.0821506 = queryWeight, product of:
               1.8314023 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01288088 = queryNorm
             0.5386597 = fieldWeight in 518, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.07831093 = weight(abstract_txt:data in 518) [ClassicSimilarity], result of:
           0.07831093 = score(doc=518,freq=10.0), product of:
             0.13572599 = queryWeight, product of:
               3.1582475 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01288088 = queryNorm
             0.57697815 = fieldWeight in 518, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.15899007 = weight(abstract_txt:relevance in 518) [ClassicSimilarity], result of:
           0.15899007 = score(doc=518,freq=5.0), product of:
             0.26362538 = queryWeight, product of:
               4.149846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01288088 = queryNorm
             0.6030909 = fieldWeight in 518, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.17606631 = weight(abstract_txt:feedback in 518) [ClassicSimilarity], result of:
           0.17606631 = score(doc=518,freq=2.0), product of:
             0.38297588 = queryWeight, product of:
               5.0017743 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.01288088 = queryNorm
             0.45973212 = fieldWeight in 518, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.16056238 = weight(abstract_txt:search in 518) [ClassicSimilarity], result of:
           0.16056238 = score(doc=518,freq=10.0), product of:
             0.2538083 = queryWeight, product of:
               5.386545 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01288088 = queryNorm
             0.6326128 = fieldWeight in 518, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
         0.26634067 = weight(abstract_txt:click in 518) [ClassicSimilarity], result of:
           0.26634067 = score(doc=518,freq=1.0), product of:
             0.6081699 = queryWeight, product of:
               5.8959646 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.01288088 = queryNorm
             0.43793795 = fieldWeight in 518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.0546875 = fieldNorm(doc=518)
       0.44 = coord(11/25)
   

2. Kelly, D.: Implicit feedback : using behavior to infer relevance (2005) 0.33

   0.32573628 = sum of:
     0.32573628 = product of:
       0.8143407 = sum of:
         0.013644643 = weight(abstract_txt:query in 645) [ClassicSimilarity], result of:
           0.013644643 = score(doc=645,freq=1.0), product of:
             0.061232675 = queryWeight, product of:
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.01288088 = queryNorm
             0.22283271 = fieldWeight in 645, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.026592953 = weight(abstract_txt:just in 645) [ClassicSimilarity], result of:
           0.026592953 = score(doc=645,freq=1.0), product of:
             0.095540196 = queryWeight, product of:
               1.2491122 = boost
               5.9379854 = idf(docFreq=316, maxDocs=44218)
               0.01288088 = queryNorm
             0.27834308 = fieldWeight in 645, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9379854 = idf(docFreq=316, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.013600683 = weight(abstract_txt:when in 645) [ClassicSimilarity], result of:
           0.013600683 = score(doc=645,freq=1.0), product of:
             0.06994328 = queryWeight, product of:
               1.308962 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.01288088 = queryNorm
             0.19445303 = fieldWeight in 645, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.015646696 = weight(abstract_txt:that in 645) [ClassicSimilarity], result of:
           0.015646696 = score(doc=645,freq=7.0), product of:
             0.053245172 = queryWeight, product of:
               1.7445464 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01288088 = queryNorm
             0.29386133 = fieldWeight in 645, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.0134101445 = weight(abstract_txt:results in 645) [ClassicSimilarity], result of:
           0.0134101445 = score(doc=645,freq=1.0), product of:
             0.0821506 = queryWeight, product of:
               1.8314023 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01288088 = queryNorm
             0.16323854 = fieldWeight in 645, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.022227606 = weight(abstract_txt:documents in 645) [ClassicSimilarity], result of:
           0.022227606 = score(doc=645,freq=1.0), product of:
             0.11505802 = queryWeight, product of:
               2.167389 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.01288088 = queryNorm
             0.19318606 = fieldWeight in 645, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.078808784 = weight(abstract_txt:session in 645) [ClassicSimilarity], result of:
           0.078808784 = score(doc=645,freq=1.0), product of:
             0.2483523 = queryWeight, product of:
               2.8481147 = boost
               6.769634 = idf(docFreq=137, maxDocs=44218)
               0.01288088 = queryNorm
             0.31732658 = fieldWeight in 645, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.769634 = idf(docFreq=137, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.20213176 = weight(abstract_txt:relevance in 645) [ClassicSimilarity], result of:
           0.20213176 = score(doc=645,freq=11.0), product of:
             0.26362538 = queryWeight, product of:
               4.149846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01288088 = queryNorm
             0.7667386 = fieldWeight in 645, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.38475665 = weight(abstract_txt:feedback in 645) [ClassicSimilarity], result of:
           0.38475665 = score(doc=645,freq=13.0), product of:
             0.38297588 = queryWeight, product of:
               5.0017743 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.01288088 = queryNorm
             1.0046499 = fieldWeight in 645, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
         0.043520816 = weight(abstract_txt:search in 645) [ClassicSimilarity], result of:
           0.043520816 = score(doc=645,freq=1.0), product of:
             0.2538083 = queryWeight, product of:
               5.386545 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01288088 = queryNorm
             0.17147121 = fieldWeight in 645, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.046875 = fieldNorm(doc=645)
       0.4 = coord(10/25)
   

3. Jiang, J.-D.; Jiang, J.-Y.; Cheng, P.-J.: Cocluster hypothesis and ranking consistency for relevance ranking in web search (2019) 0.30

   0.30125654 = sum of:
     0.30125654 = product of:
       0.75314134 = sum of:
         0.018192858 = weight(abstract_txt:query in 5247) [ClassicSimilarity], result of:
           0.018192858 = score(doc=5247,freq=1.0), product of:
             0.061232675 = queryWeight, product of:
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.01288088 = queryNorm
             0.2971103 = fieldWeight in 5247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.029865878 = weight(abstract_txt:goal in 5247) [ClassicSimilarity], result of:
           0.029865878 = score(doc=5247,freq=1.0), product of:
             0.08521175 = queryWeight, product of:
               1.1796634 = boost
               5.6078424 = idf(docFreq=440, maxDocs=44218)
               0.01288088 = queryNorm
             0.35049015 = fieldWeight in 5247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6078424 = idf(docFreq=440, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.025894416 = weight(abstract_txt:further in 5247) [ClassicSimilarity], result of:
           0.025894416 = score(doc=5247,freq=1.0), product of:
             0.08869187 = queryWeight, product of:
               1.4739947 = boost
               4.671349 = idf(docFreq=1124, maxDocs=44218)
               0.01288088 = queryNorm
             0.29195932 = fieldWeight in 5247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.671349 = idf(docFreq=1124, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.06066353 = weight(abstract_txt:engine in 5247) [ClassicSimilarity], result of:
           0.06066353 = score(doc=5247,freq=2.0), product of:
             0.12417137 = queryWeight, product of:
               1.7440734 = boost
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.01288088 = queryNorm
             0.48854682 = fieldWeight in 5247, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5272765 = idf(docFreq=477, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.011151348 = weight(abstract_txt:that in 5247) [ClassicSimilarity], result of:
           0.011151348 = score(doc=5247,freq=2.0), product of:
             0.053245172 = queryWeight, product of:
               1.7445464 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01288088 = queryNorm
             0.20943399 = fieldWeight in 5247, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.017880192 = weight(abstract_txt:results in 5247) [ClassicSimilarity], result of:
           0.017880192 = score(doc=5247,freq=1.0), product of:
             0.0821506 = queryWeight, product of:
               1.8314023 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01288088 = queryNorm
             0.21765138 = fieldWeight in 5247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.02830182 = weight(abstract_txt:data in 5247) [ClassicSimilarity], result of:
           0.02830182 = score(doc=5247,freq=1.0), product of:
             0.13572599 = queryWeight, product of:
               3.1582475 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01288088 = queryNorm
             0.20852174 = fieldWeight in 5247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.14074649 = weight(abstract_txt:relevance in 5247) [ClassicSimilarity], result of:
           0.14074649 = score(doc=5247,freq=3.0), product of:
             0.26362538 = queryWeight, product of:
               4.149846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01288088 = queryNorm
             0.5338882 = fieldWeight in 5247, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.1160555 = weight(abstract_txt:search in 5247) [ClassicSimilarity], result of:
           0.1160555 = score(doc=5247,freq=4.0), product of:
             0.2538083 = queryWeight, product of:
               5.386545 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01288088 = queryNorm
             0.45725656 = fieldWeight in 5247, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
         0.30438936 = weight(abstract_txt:click in 5247) [ClassicSimilarity], result of:
           0.30438936 = score(doc=5247,freq=1.0), product of:
             0.6081699 = queryWeight, product of:
               5.8959646 = boost
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.01288088 = queryNorm
             0.5005005 = fieldWeight in 5247, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.008008 = idf(docFreq=39, maxDocs=44218)
               0.0625 = fieldNorm(doc=5247)
       0.4 = coord(10/25)
   

4. Quiroga, L.M.; Mostafa, J.: ¬An experiment in building profiles in information filtering : the role of context of user relevance feedback (2002) 0.26

   0.25897947 = sum of:
     0.25897947 = product of:
       0.80931085 = sum of:
         0.018406205 = weight(abstract_txt:could in 2579) [ClassicSimilarity], result of:
           0.018406205 = score(doc=2579,freq=1.0), product of:
             0.06171046 = queryWeight, product of:
               1.0038939 = boost
               4.772275 = idf(docFreq=1016, maxDocs=44218)
               0.01288088 = queryNorm
             0.2982672 = fieldWeight in 2579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.772275 = idf(docFreq=1016, maxDocs=44218)
               0.0625 = fieldNorm(doc=2579)
         0.08874684 = weight(abstract_txt:implicit in 2579) [ClassicSimilarity], result of:
           0.08874684 = score(doc=2579,freq=3.0), product of:
             0.12211737 = queryWeight, product of:
               1.412203 = boost
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.01288088 = queryNorm
             0.7267339 = fieldWeight in 2579, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.0625 = fieldNorm(doc=2579)
         0.015770389 = weight(abstract_txt:that in 2579) [ClassicSimilarity], result of:
           0.015770389 = score(doc=2579,freq=4.0), product of:
             0.053245172 = queryWeight, product of:
               1.7445464 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01288088 = queryNorm
             0.2961844 = fieldWeight in 2579, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2579)
         0.02528641 = weight(abstract_txt:results in 2579) [ClassicSimilarity], result of:
           0.02528641 = score(doc=2579,freq=2.0), product of:
             0.0821506 = queryWeight, product of:
               1.8314023 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.01288088 = queryNorm
             0.30780554 = fieldWeight in 2579, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=2579)
         0.029636808 = weight(abstract_txt:documents in 2579) [ClassicSimilarity], result of:
           0.029636808 = score(doc=2579,freq=1.0), product of:
             0.11505802 = queryWeight, product of:
               2.167389 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.01288088 = queryNorm
             0.2575814 = fieldWeight in 2579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=2579)
         0.040024817 = weight(abstract_txt:data in 2579) [ClassicSimilarity], result of:
           0.040024817 = score(doc=2579,freq=2.0), product of:
             0.13572599 = queryWeight, product of:
               3.1582475 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01288088 = queryNorm
             0.29489428 = fieldWeight in 2579, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=2579)
         0.21499379 = weight(abstract_txt:relevance in 2579) [ClassicSimilarity], result of:
           0.21499379 = score(doc=2579,freq=7.0), product of:
             0.26362538 = queryWeight, product of:
               4.149846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01288088 = queryNorm
             0.8155277 = fieldWeight in 2579, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=2579)
         0.3764456 = weight(abstract_txt:feedback in 2579) [ClassicSimilarity], result of:
           0.3764456 = score(doc=2579,freq=7.0), product of:
             0.38297588 = queryWeight, product of:
               5.0017743 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.01288088 = queryNorm
             0.9829486 = fieldWeight in 2579, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=2579)
       0.32 = coord(8/25)
   

5. Jacucci, G.; Barral, O.; Daee, P.; Wenzel, M.; Serim, B.; Ruotsalo, T.; Pluchino, P.; Freeman, J.; Gamberini, L.; Kaski, S.; Blankertz, B.: Integrating neurophysiologic relevance feedback in intent modeling for information retrieval (2019) 0.26

   0.2568831 = sum of:
     0.2568831 = product of:
       0.8027597 = sum of:
         0.018406205 = weight(abstract_txt:could in 5356) [ClassicSimilarity], result of:
           0.018406205 = score(doc=5356,freq=1.0), product of:
             0.06171046 = queryWeight, product of:
               1.0038939 = boost
               4.772275 = idf(docFreq=1016, maxDocs=44218)
               0.01288088 = queryNorm
             0.2982672 = fieldWeight in 5356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.772275 = idf(docFreq=1016, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.08874684 = weight(abstract_txt:implicit in 5356) [ClassicSimilarity], result of:
           0.08874684 = score(doc=5356,freq=3.0), product of:
             0.12211737 = queryWeight, product of:
               1.412203 = boost
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.01288088 = queryNorm
             0.7267339 = fieldWeight in 5356, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.013657557 = weight(abstract_txt:that in 5356) [ClassicSimilarity], result of:
           0.013657557 = score(doc=5356,freq=3.0), product of:
             0.053245172 = queryWeight, product of:
               1.7445464 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01288088 = queryNorm
             0.2565032 = fieldWeight in 5356, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.029636808 = weight(abstract_txt:documents in 5356) [ClassicSimilarity], result of:
           0.029636808 = score(doc=5356,freq=1.0), product of:
             0.11505802 = queryWeight, product of:
               2.167389 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.01288088 = queryNorm
             0.2575814 = fieldWeight in 5356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.040024817 = weight(abstract_txt:data in 5356) [ClassicSimilarity], result of:
           0.040024817 = score(doc=5356,freq=2.0), product of:
             0.13572599 = queryWeight, product of:
               3.1582475 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01288088 = queryNorm
             0.29489428 = fieldWeight in 5356, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.18170293 = weight(abstract_txt:relevance in 5356) [ClassicSimilarity], result of:
           0.18170293 = score(doc=5356,freq=5.0), product of:
             0.26362538 = queryWeight, product of:
               4.149846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.01288088 = queryNorm
             0.6892467 = fieldWeight in 5356, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.34852093 = weight(abstract_txt:feedback in 5356) [ClassicSimilarity], result of:
           0.34852093 = score(doc=5356,freq=6.0), product of:
             0.38297588 = queryWeight, product of:
               5.0017743 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.01288088 = queryNorm
             0.91003364 = fieldWeight in 5356, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.08206363 = weight(abstract_txt:search in 5356) [ClassicSimilarity], result of:
           0.08206363 = score(doc=5356,freq=2.0), product of:
             0.2538083 = queryWeight, product of:
               5.386545 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.01288088 = queryNorm
             0.3233292 = fieldWeight in 5356, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
       0.32 = coord(8/25)