Document (#40528)

Author

Cai, F.
Wang, S.
Rijke, M.de

Title

Behavior-based personalization in web search

Source

Journal of the Association for Information Science and Technology. 68(2017) no.4, S.855-868

Year

2017

Abstract

Personalized search approaches tailor search results to users' current interests, so as to help improve the likelihood of a user finding relevant documents for their query. Previous work on personalized search focuses on using the content of the user's query and of the documents clicked to model the user's preference. In this paper we focus on a different type of signal: We investigate the use of behavioral information for the purpose of search personalization. That is, we consider clicks and dwell time for reranking an initially retrieved list of documents. In particular, we (i) investigate the impact of distributions of users and queries on document reranking; (ii) estimate the relevance of a document for a query at 2 levels, at the query-level and at the word-level, to alleviate the problem of sparseness; and (iii) perform an experimental evaluation both for users seen during the training period and for users not seen during training. For the latter, we explore the use of information from similar users who have been seen during the training period. We use the dwell time on clicked documents to estimate a document's relevance to a query, and perform Bayesian probabilistic matrix factorization to generate a relevance distribution of a document over queries. Our experiments show that: (i) for personalized ranking, behavioral information helps to improve retrieval effectiveness; and (ii) given a query, merging information inferred from behavior of a particular user and from behaviors of other users with a user-dependent adaptive weight outperforms any combination with a fixed weight.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23735/full.

Footnote

A preliminary version of this paper was published in the proceedings of SIGIR '14. In this extension, we (i) extend the behavioral personalization search model introduced there to deal with queries issued by new users for whom long-term search logs are unavailable; (ii) examine the impact of sparseness on the performance of our model by considering both word-level and query-level modeling, as we find that the word-document relevance matrix is less sparse than the query-document relevance matrix; (iii) investigate the effectiveness of our behavior-based reranking model with and without assuming a uniform distribution of users as users may behave differently; (iv) include more related work and provide a detailed discussion of the experimental results.

Similar documents (author)

1. De Rijke, M. -> Rijke, M. de: 1.99

   1.9941707 = sum of:
     1.9941707 = product of:
       3.9883413 = sum of:
         3.9883413 = weight(author_txt:rijke in 5116) [ClassicSimilarity], result of:
           3.9883413 = score(doc=5116,freq=2.0), product of:
             0.8687231 = queryWeight, product of:
               1.324364 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.07577211 = queryNorm
             4.5910387 = fieldWeight in 5116, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.375 = fieldNorm(doc=5116)
       0.5 = coord(1/2)
   

2. Li, X.; Rijke, M.de: Characterizing and predicting downloads in academic search (2019) 1.88

   1.8801221 = sum of:
     1.8801221 = product of:
       3.7602441 = sum of:
         3.7602441 = weight(author_txt:rijke in 103) [ClassicSimilarity], result of:
           3.7602441 = score(doc=103,freq=1.0), product of:
             0.8687231 = queryWeight, product of:
               1.324364 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.07577211 = queryNorm
             4.3284726 = fieldWeight in 103, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.5 = fieldNorm(doc=103)
       0.5 = coord(1/2)
   

3. DeRijke, M. -> Rijke, M. de: 1.65

   1.6451068 = sum of:
     1.6451068 = product of:
       3.2902136 = sum of:
         3.2902136 = weight(author_txt:rijke in 117) [ClassicSimilarity], result of:
           3.2902136 = score(doc=117,freq=1.0), product of:
             0.8687231 = queryWeight, product of:
               1.324364 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.07577211 = queryNorm
             3.7874136 = fieldWeight in 117, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.4375 = fieldNorm(doc=117)
       0.5 = coord(1/2)
   

4. Meij, E.; Rijke, M. de: Thesaurus-based feedback to support mixed search and browsing environments (2007) 1.65

   1.6451068 = sum of:
     1.6451068 = product of:
       3.2902136 = sum of:
         3.2902136 = weight(author_txt:rijke in 3432) [ClassicSimilarity], result of:
           3.2902136 = score(doc=3432,freq=1.0), product of:
             0.8687231 = queryWeight, product of:
               1.324364 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.07577211 = queryNorm
             3.7874136 = fieldWeight in 3432, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.4375 = fieldNorm(doc=3432)
       0.5 = coord(1/2)
   

5. Cai, F.; Rijke, M. de: Learning from homologous queries and semantically related terms for query auto completion (2016) 1.65

   1.6451068 = sum of:
     1.6451068 = product of:
       3.2902136 = sum of:
         3.2902136 = weight(author_txt:rijke in 3971) [ClassicSimilarity], result of:
           3.2902136 = score(doc=3971,freq=1.0), product of:
             0.8687231 = queryWeight, product of:
               1.324364 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.07577211 = queryNorm
             3.7874136 = fieldWeight in 3971, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.4375 = fieldNorm(doc=3971)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Liu, J.; Belkin, N.J.: Personalizing information retrieval for multi-session tasks : examining the roles of task stage, task type, and topic knowledge on the interpretation of dwell time as an indicator of document usefulness (2015) 0.26

   0.25969225 = sum of:
     0.25969225 = product of:
       0.8115383 = sum of:
         0.034961563 = weight(abstract_txt:behavior in 2608) [ClassicSimilarity], result of:
           0.034961563 = score(doc=2608,freq=1.0), product of:
             0.10753928 = queryWeight, product of:
               1.0492742 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.019703096 = queryNorm
             0.32510504 = fieldWeight in 2608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.0625 = fieldNorm(doc=2608)
         0.018582406 = weight(abstract_txt:user in 2608) [ClassicSimilarity], result of:
           0.018582406 = score(doc=2608,freq=1.0), product of:
             0.08077401 = queryWeight, product of:
               1.1137478 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.019703096 = queryNorm
             0.23005427 = fieldWeight in 2608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=2608)
         0.05110263 = weight(abstract_txt:document in 2608) [ClassicSimilarity], result of:
           0.05110263 = score(doc=2608,freq=3.0), product of:
             0.109932326 = queryWeight, product of:
               1.299313 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.019703096 = queryNorm
             0.46485534 = fieldWeight in 2608, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.0625 = fieldNorm(doc=2608)
         0.16603293 = weight(abstract_txt:personalization in 2608) [ClassicSimilarity], result of:
           0.16603293 = score(doc=2608,freq=2.0), product of:
             0.24115303 = queryWeight, product of:
               1.5712734 = boost
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.019703096 = queryNorm
             0.6884961 = fieldWeight in 2608, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.0625 = fieldNorm(doc=2608)
         0.034828242 = weight(abstract_txt:documents in 2608) [ClassicSimilarity], result of:
           0.034828242 = score(doc=2608,freq=1.0), product of:
             0.13514633 = queryWeight, product of:
               1.663499 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019703096 = queryNorm
             0.25770763 = fieldWeight in 2608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=2608)
         0.030312281 = weight(abstract_txt:search in 2608) [ClassicSimilarity], result of:
           0.030312281 = score(doc=2608,freq=1.0), product of:
             0.13270858 = queryWeight, product of:
               1.8429981 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.019703096 = queryNorm
             0.22841237 = fieldWeight in 2608, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=2608)
         0.40007284 = weight(abstract_txt:dwell in 2608) [ClassicSimilarity], result of:
           0.40007284 = score(doc=2608,freq=4.0), product of:
             0.34401652 = queryWeight, product of:
               1.8767009 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.019703096 = queryNorm
             1.1629466 = fieldWeight in 2608, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0625 = fieldNorm(doc=2608)
         0.0756454 = weight(abstract_txt:users in 2608) [ClassicSimilarity], result of:
           0.0756454 = score(doc=2608,freq=5.0), product of:
             0.15173252 = queryWeight, product of:
               2.158765 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.019703096 = queryNorm
             0.49854442 = fieldWeight in 2608, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=2608)
       0.32 = coord(8/25)
   

2. Díaz, A.; Gervás, P.: User-model based personalized summarization (2007) 0.25

   0.2501358 = sum of:
     0.2501358 = product of:
       0.7816744 = sum of:
         0.04916442 = weight(abstract_txt:user in 1952) [ClassicSimilarity], result of:
           0.04916442 = score(doc=1952,freq=7.0), product of:
             0.08077401 = queryWeight, product of:
               1.1137478 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.019703096 = queryNorm
             0.60866636 = fieldWeight in 1952, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=1952)
         0.057093717 = weight(abstract_txt:perform in 1952) [ClassicSimilarity], result of:
           0.057093717 = score(doc=1952,freq=1.0), product of:
             0.14913015 = queryWeight, product of:
               1.2356292 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.019703096 = queryNorm
             0.3828449 = fieldWeight in 1952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.0625 = fieldNorm(doc=1952)
         0.041725125 = weight(abstract_txt:document in 1952) [ClassicSimilarity], result of:
           0.041725125 = score(doc=1952,freq=2.0), product of:
             0.109932326 = queryWeight, product of:
               1.299313 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.019703096 = queryNorm
             0.3795528 = fieldWeight in 1952, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.0625 = fieldNorm(doc=1952)
         0.042405 = weight(abstract_txt:during in 1952) [ClassicSimilarity], result of:
           0.042405 = score(doc=1952,freq=1.0), product of:
             0.14000656 = queryWeight, product of:
               1.4663081 = boost
               4.846059 = idf(docFreq=948, maxDocs=44421)
               0.019703096 = queryNorm
             0.30287868 = fieldWeight in 1952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.846059 = idf(docFreq=948, maxDocs=44421)
               0.0625 = fieldNorm(doc=1952)
         0.07730877 = weight(abstract_txt:relevance in 1952) [ClassicSimilarity], result of:
           0.07730877 = score(doc=1952,freq=3.0), product of:
             0.14487132 = queryWeight, product of:
               1.4915652 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.019703096 = queryNorm
             0.53363746 = fieldWeight in 1952, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1952)
         0.20334798 = weight(abstract_txt:personalization in 1952) [ClassicSimilarity], result of:
           0.20334798 = score(doc=1952,freq=3.0), product of:
             0.24115303 = queryWeight, product of:
               1.5712734 = boost
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.019703096 = queryNorm
             0.8432321 = fieldWeight in 1952, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.0625 = fieldNorm(doc=1952)
         0.034828242 = weight(abstract_txt:documents in 1952) [ClassicSimilarity], result of:
           0.034828242 = score(doc=1952,freq=1.0), product of:
             0.13514633 = queryWeight, product of:
               1.663499 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019703096 = queryNorm
             0.25770763 = fieldWeight in 1952, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=1952)
         0.27580115 = weight(abstract_txt:personalized in 1952) [ClassicSimilarity], result of:
           0.27580115 = score(doc=1952,freq=4.0), product of:
             0.30731308 = queryWeight, product of:
               2.1724088 = boost
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.019703096 = queryNorm
             0.89745986 = fieldWeight in 1952, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.0625 = fieldNorm(doc=1952)
       0.32 = coord(8/25)
   

3. Sah, M.; Wade, V.: Personalized concept-based search on the Linked Open Data (2015) 0.24

   0.23928624 = sum of:
     0.23928624 = product of:
       0.74776953 = sum of:
         0.028162463 = weight(abstract_txt:user in 3511) [ClassicSimilarity], result of:
           0.028162463 = score(doc=3511,freq=3.0), product of:
             0.08077401 = queryWeight, product of:
               1.1137478 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.019703096 = queryNorm
             0.3486575 = fieldWeight in 3511, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3511)
         0.042931095 = weight(abstract_txt:user's in 3511) [ClassicSimilarity], result of:
           0.042931095 = score(doc=3511,freq=1.0), product of:
             0.1347977 = queryWeight, product of:
               1.1747533 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.019703096 = queryNorm
             0.31848535 = fieldWeight in 3511, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3511)
         0.049957003 = weight(abstract_txt:perform in 3511) [ClassicSimilarity], result of:
           0.049957003 = score(doc=3511,freq=1.0), product of:
             0.14913015 = queryWeight, product of:
               1.2356292 = boost
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.019703096 = queryNorm
             0.33498928 = fieldWeight in 3511, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1255183 = idf(docFreq=263, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3511)
         0.22970599 = weight(abstract_txt:personalization in 3511) [ClassicSimilarity], result of:
           0.22970599 = score(doc=3511,freq=5.0), product of:
             0.24115303 = queryWeight, product of:
               1.5712734 = boost
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.019703096 = queryNorm
             0.95253205 = fieldWeight in 3511, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3511)
         0.05930778 = weight(abstract_txt:search in 3511) [ClassicSimilarity], result of:
           0.05930778 = score(doc=3511,freq=5.0), product of:
             0.13270858 = queryWeight, product of:
               1.8429981 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.019703096 = queryNorm
             0.4469024 = fieldWeight in 3511, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3511)
         0.029600944 = weight(abstract_txt:users in 3511) [ClassicSimilarity], result of:
           0.029600944 = score(doc=3511,freq=1.0), product of:
             0.15173252 = queryWeight, product of:
               2.158765 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.019703096 = queryNorm
             0.19508636 = fieldWeight in 3511, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3511)
         0.20899446 = weight(abstract_txt:personalized in 3511) [ClassicSimilarity], result of:
           0.20899446 = score(doc=3511,freq=3.0), product of:
             0.30731308 = queryWeight, product of:
               2.1724088 = boost
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.019703096 = queryNorm
             0.68007016 = fieldWeight in 3511, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3511)
         0.09910975 = weight(abstract_txt:query in 3511) [ClassicSimilarity], result of:
           0.09910975 = score(doc=3511,freq=2.0), product of:
             0.2695313 = queryWeight, product of:
               2.877204 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.019703096 = queryNorm
             0.36771145 = fieldWeight in 3511, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3511)
       0.32 = coord(8/25)
   

4. Naderi, H.; Rumpler, B.: PERCIRS: a system to combine personalized and collaborative information retrieval (2010) 0.24

   0.23907562 = sum of:
     0.23907562 = product of:
       0.6640989 = sum of:
         0.02648085 = weight(abstract_txt:improve in 947) [ClassicSimilarity], result of:
           0.02648085 = score(doc=947,freq=1.0), product of:
             0.09767629 = queryWeight, product of:
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.019703096 = queryNorm
             0.27110827 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
         0.028162463 = weight(abstract_txt:user in 947) [ClassicSimilarity], result of:
           0.028162463 = score(doc=947,freq=3.0), product of:
             0.08077401 = queryWeight, product of:
               1.1137478 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.019703096 = queryNorm
             0.3486575 = fieldWeight in 947, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
         0.042931095 = weight(abstract_txt:user's in 947) [ClassicSimilarity], result of:
           0.042931095 = score(doc=947,freq=1.0), product of:
             0.1347977 = queryWeight, product of:
               1.1747533 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.019703096 = queryNorm
             0.31848535 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
         0.025816103 = weight(abstract_txt:document in 947) [ClassicSimilarity], result of:
           0.025816103 = score(doc=947,freq=1.0), product of:
             0.109932326 = queryWeight, product of:
               1.299313 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.019703096 = queryNorm
             0.23483633 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
         0.10272764 = weight(abstract_txt:personalization in 947) [ClassicSimilarity], result of:
           0.10272764 = score(doc=947,freq=1.0), product of:
             0.24115303 = queryWeight, product of:
               1.5712734 = boost
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.019703096 = queryNorm
             0.42598525 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
         0.030474711 = weight(abstract_txt:documents in 947) [ClassicSimilarity], result of:
           0.030474711 = score(doc=947,freq=1.0), product of:
             0.13514633 = queryWeight, product of:
               1.663499 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019703096 = queryNorm
             0.22549418 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
         0.04186206 = weight(abstract_txt:users in 947) [ClassicSimilarity], result of:
           0.04186206 = score(doc=947,freq=2.0), product of:
             0.15173252 = queryWeight, product of:
               2.158765 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.019703096 = queryNorm
             0.27589378 = fieldWeight in 947, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
         0.2955628 = weight(abstract_txt:personalized in 947) [ClassicSimilarity], result of:
           0.2955628 = score(doc=947,freq=6.0), product of:
             0.30731308 = queryWeight, product of:
               2.1724088 = boost
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.019703096 = queryNorm
             0.96176445 = fieldWeight in 947, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
         0.070081174 = weight(abstract_txt:query in 947) [ClassicSimilarity], result of:
           0.070081174 = score(doc=947,freq=1.0), product of:
             0.2695313 = queryWeight, product of:
               2.877204 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.019703096 = queryNorm
             0.26001126 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0546875 = fieldNorm(doc=947)
       0.36 = coord(9/25)
   

5. Dennis, S.; Bruza, P.; McArthur, R.: Web searching : a process-oriented experimental study of three interactive search paradigms (2002) 0.23

   0.22574225 = sum of:
     0.22574225 = product of:
       0.6270618 = sum of:
         0.03026383 = weight(abstract_txt:improve in 1200) [ClassicSimilarity], result of:
           0.03026383 = score(doc=1200,freq=1.0), product of:
             0.09767629 = queryWeight, product of:
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.019703096 = queryNorm
             0.30983803 = fieldWeight in 1200, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9574084 = idf(docFreq=848, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
         0.0329821 = weight(abstract_txt:queries in 1200) [ClassicSimilarity], result of:
           0.0329821 = score(doc=1200,freq=1.0), product of:
             0.10344086 = queryWeight, product of:
               1.0290855 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.019703096 = queryNorm
             0.31884983 = fieldWeight in 1200, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
         0.03218567 = weight(abstract_txt:user in 1200) [ClassicSimilarity], result of:
           0.03218567 = score(doc=1200,freq=3.0), product of:
             0.08077401 = queryWeight, product of:
               1.1137478 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.019703096 = queryNorm
             0.3984657 = fieldWeight in 1200, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
         0.029504118 = weight(abstract_txt:document in 1200) [ClassicSimilarity], result of:
           0.029504118 = score(doc=1200,freq=1.0), product of:
             0.109932326 = queryWeight, product of:
               1.299313 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.019703096 = queryNorm
             0.26838437 = fieldWeight in 1200, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
         0.042405 = weight(abstract_txt:during in 1200) [ClassicSimilarity], result of:
           0.042405 = score(doc=1200,freq=1.0), product of:
             0.14000656 = queryWeight, product of:
               1.4663081 = boost
               4.846059 = idf(docFreq=948, maxDocs=44421)
               0.019703096 = queryNorm
             0.30287868 = fieldWeight in 1200, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.846059 = idf(docFreq=948, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
         0.08926848 = weight(abstract_txt:relevance in 1200) [ClassicSimilarity], result of:
           0.08926848 = score(doc=1200,freq=4.0), product of:
             0.14487132 = queryWeight, product of:
               1.4915652 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.019703096 = queryNorm
             0.6161915 = fieldWeight in 1200, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
         0.04925457 = weight(abstract_txt:documents in 1200) [ClassicSimilarity], result of:
           0.04925457 = score(doc=1200,freq=2.0), product of:
             0.13514633 = queryWeight, product of:
               1.663499 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.019703096 = queryNorm
             0.3644536 = fieldWeight in 1200, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
         0.10929249 = weight(abstract_txt:search in 1200) [ClassicSimilarity], result of:
           0.10929249 = score(doc=1200,freq=13.0), product of:
             0.13270858 = queryWeight, product of:
               1.8429981 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.019703096 = queryNorm
             0.82355255 = fieldWeight in 1200, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
         0.21190555 = weight(abstract_txt:query in 1200) [ClassicSimilarity], result of:
           0.21190555 = score(doc=1200,freq=7.0), product of:
             0.2695313 = queryWeight, product of:
               2.877204 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.019703096 = queryNorm
             0.78620017 = fieldWeight in 1200, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=1200)
       0.36 = coord(9/25)