Document (#38857)

Author

Ozdemiray, A.M.
Altingovde, I.S.

Title

Explicit search result diversification using score and rank aggregation methods

Source

Journal of the Association for Information Science and Technology. 66(2015) no.6, S.1212-1228

Year

2015

Abstract

Search result diversification is one of the key techniques to cope with the ambiguous and underspecified information needs of web users. In the last few years, strategies that are based on the explicit knowledge of query aspects emerged as highly effective ways of diversifying search results. Our contributions in this article are two-fold. First, we extensively evaluate the performance of a state-of-the-art explicit diversification strategy and pin-point its potential weaknesses. We propose basic yet novel optimizations to remedy these weaknesses and boost the performance of this algorithm. As a second contribution, inspired by the success of the current diversification strategies that exploit the relevance of the candidate documents to individual query aspects, we cast the diversification problem into the problem of ranking aggregation. To this end, we propose to materialize the re-rankings of the candidate documents for each query aspect and then merge these rankings by adapting the score(-based) and rank(-based) aggregation methods. Our extensive experimental evaluations show that certain ranking aggregation methods are superior to existing explicit diversification strategies in terms of diversification effectiveness. Furthermore, these ranking aggregation methods have lower computational complexity than the state-of-the-art diversification strategies.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23259/abstract.

Theme

Retrievalalgorithmen

Similar documents (author)

1. Sengor Altingovde, I. => Altingovde, I.S.: 5.95

   5.9533253 = sum of:
     5.9533253 = weight(author_txt:altingovde in 1155) [ClassicSimilarity], result of:
       5.9533253 = fieldWeight in 1155, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.4375 = fieldNorm(doc=1155)
   

2. Altingovde, I. Sengor => Sengor Altingovde, I.: 5.10

   5.10285 = sum of:
     5.10285 = weight(author_txt:altingovde in 135) [ClassicSimilarity], result of:
       5.10285 = fieldWeight in 135, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.375 = fieldNorm(doc=135)
   

3. Ozcan, R.; Altingovde, I.S.; Ulusoy, O.: Exploiting navigational queries for result presentation and caching in Web search engines (2011) 3.61

   3.60826 = sum of:
     3.60826 = weight(author_txt:altingovde in 364) [ClassicSimilarity], result of:
       3.60826 = fieldWeight in 364, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.375 = fieldNorm(doc=364)
   

4. Yilmaz, T.; Ozcan, R.; Altingovde, I.S.; Ulusoy, Ö.: Improving educational web search for question-like queries through subject classification (2019) 3.01

   3.0068831 = sum of:
     3.0068831 = weight(author_txt:altingovde in 41) [ClassicSimilarity], result of:
       3.0068831 = fieldWeight in 41, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.3125 = fieldNorm(doc=41)
   

5. Sarigil, E.; Sengor Altingovde, I.; Blanco, R.; Barla Cambazoglu, B.; Ozcan, R.; Ulusoy, Ö.: Characterizing, predicting, and handling web search queries that match very few or no results (2018) 2.41

   2.4055066 = sum of:
     2.4055066 = weight(author_txt:altingovde in 39) [ClassicSimilarity], result of:
       2.4055066 = fieldWeight in 39, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.25 = fieldNorm(doc=39)
   

Similar documents (content)

1. He, J.; Meij, E.; Rijke, M. de: Result diversification based on query-specific cluster ranking (2011) 0.55

   0.5530201 = sum of:
     0.5530201 = product of:
       1.5361669 = sum of:
         0.02825793 = weight(abstract_txt:performance in 355) [ClassicSimilarity], result of:
           0.02825793 = score(doc=355,freq=3.0), product of:
             0.056504153 = queryWeight, product of:
               1.0840162 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.011283018 = queryNorm
             0.5001036 = fieldWeight in 355, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
         0.011318448 = weight(abstract_txt:these in 355) [ClassicSimilarity], result of:
           0.011318448 = score(doc=355,freq=2.0), product of:
             0.040232055 = queryWeight, product of:
               1.1202819 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.011283018 = queryNorm
             0.2813291 = fieldWeight in 355, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
         0.011320579 = weight(abstract_txt:based in 355) [ClassicSimilarity], result of:
           0.011320579 = score(doc=355,freq=2.0), product of:
             0.040237106 = queryWeight, product of:
               1.1203523 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.011283018 = queryNorm
             0.28134674 = fieldWeight in 355, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
         0.037902538 = weight(abstract_txt:result in 355) [ClassicSimilarity], result of:
           0.037902538 = score(doc=355,freq=3.0), product of:
             0.06872251 = queryWeight, product of:
               1.1954876 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.011283018 = queryNorm
             0.5515302 = fieldWeight in 355, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
         0.022494717 = weight(abstract_txt:propose in 355) [ClassicSimilarity], result of:
           0.022494717 = score(doc=355,freq=1.0), product of:
             0.069997236 = queryWeight, product of:
               1.2065241 = boost
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.011283018 = queryNorm
             0.32136577 = fieldWeight in 355, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
         0.037725955 = weight(abstract_txt:query in 355) [ClassicSimilarity], result of:
           0.037725955 = score(doc=355,freq=2.0), product of:
             0.08977205 = queryWeight, product of:
               1.6734463 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.011283018 = queryNorm
             0.42024165 = fieldWeight in 355, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
         0.023542097 = weight(abstract_txt:methods in 355) [ClassicSimilarity], result of:
           0.023542097 = score(doc=355,freq=1.0), product of:
             0.09090769 = queryWeight, product of:
               1.9445132 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.011283018 = queryNorm
             0.25896704 = fieldWeight in 355, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
         0.07536397 = weight(abstract_txt:ranking in 355) [ClassicSimilarity], result of:
           0.07536397 = score(doc=355,freq=3.0), product of:
             0.124392174 = queryWeight, product of:
               1.9698708 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.011283018 = queryNorm
             0.6058578 = fieldWeight in 355, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
         1.2882407 = weight(abstract_txt:diversification in 355) [ClassicSimilarity], result of:
           1.2882407 = score(doc=355,freq=9.0), product of:
             0.7936537 = queryWeight, product of:
               8.125332 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.011283018 = queryNorm
             1.6231773 = fieldWeight in 355, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=355)
       0.36 = coord(9/25)
   

2. Yanovsky, S.; Hoernle, N.; Lev, O.; Gal, K.: One size does not fit all : a study of badge behavior in stack overflow (2021) 0.33

   0.32751408 = sum of:
     0.32751408 = product of:
       1.0234815 = sum of:
         0.014673939 = weight(abstract_txt:problem in 1152) [ClassicSimilarity], result of:
           0.014673939 = score(doc=1152,freq=1.0), product of:
             0.05264919 = queryWeight, product of:
               1.0463848 = boost
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.011283018 = queryNorm
             0.2787116 = fieldWeight in 1152, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.0625 = fieldNorm(doc=1152)
         0.025044324 = weight(abstract_txt:aspects in 1152) [ClassicSimilarity], result of:
           0.025044324 = score(doc=1152,freq=2.0), product of:
             0.05967926 = queryWeight, product of:
               1.1140567 = boost
               4.747783 = idf(docFreq=1046, maxDocs=44421)
               0.011283018 = queryNorm
             0.4196487 = fieldWeight in 1152, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.747783 = idf(docFreq=1046, maxDocs=44421)
               0.0625 = fieldNorm(doc=1152)
         0.011320579 = weight(abstract_txt:based in 1152) [ClassicSimilarity], result of:
           0.011320579 = score(doc=1152,freq=2.0), product of:
             0.040237106 = queryWeight, product of:
               1.1203523 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.011283018 = queryNorm
             0.28134674 = fieldWeight in 1152, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=1152)
         0.037902538 = weight(abstract_txt:result in 1152) [ClassicSimilarity], result of:
           0.037902538 = score(doc=1152,freq=3.0), product of:
             0.06872251 = queryWeight, product of:
               1.1954876 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.011283018 = queryNorm
             0.5515302 = fieldWeight in 1152, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.0625 = fieldNorm(doc=1152)
         0.022494717 = weight(abstract_txt:propose in 1152) [ClassicSimilarity], result of:
           0.022494717 = score(doc=1152,freq=1.0), product of:
             0.069997236 = queryWeight, product of:
               1.2065241 = boost
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.011283018 = queryNorm
             0.32136577 = fieldWeight in 1152, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.0625 = fieldNorm(doc=1152)
         0.029676141 = weight(abstract_txt:search in 1152) [ClassicSimilarity], result of:
           0.029676141 = score(doc=1152,freq=6.0), product of:
             0.053041056 = queryWeight, product of:
               1.2863148 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.011283018 = queryNorm
             0.5594938 = fieldWeight in 1152, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1152)
         0.023542097 = weight(abstract_txt:methods in 1152) [ClassicSimilarity], result of:
           0.023542097 = score(doc=1152,freq=1.0), product of:
             0.09090769 = queryWeight, product of:
               1.9445132 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.011283018 = queryNorm
             0.25896704 = fieldWeight in 1152, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=1152)
         0.8588271 = weight(abstract_txt:diversification in 1152) [ClassicSimilarity], result of:
           0.8588271 = score(doc=1152,freq=4.0), product of:
             0.7936537 = queryWeight, product of:
               8.125332 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.011283018 = queryNorm
             1.0821182 = fieldWeight in 1152, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=1152)
       0.32 = coord(8/25)
   

3. Yigit-Sert, S.; Altingovde, I.S.; Macdonald, C.; Ounis, I.; Ulusoy, Ö,: Explicit diversification of search results across multiple dimensions for educational search (2021) 0.33

   0.32751408 = sum of:
     0.32751408 = product of:
       1.0234815 = sum of:
         0.014673939 = weight(abstract_txt:problem in 1157) [ClassicSimilarity], result of:
           0.014673939 = score(doc=1157,freq=1.0), product of:
             0.05264919 = queryWeight, product of:
               1.0463848 = boost
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.011283018 = queryNorm
             0.2787116 = fieldWeight in 1157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.0625 = fieldNorm(doc=1157)
         0.025044324 = weight(abstract_txt:aspects in 1157) [ClassicSimilarity], result of:
           0.025044324 = score(doc=1157,freq=2.0), product of:
             0.05967926 = queryWeight, product of:
               1.1140567 = boost
               4.747783 = idf(docFreq=1046, maxDocs=44421)
               0.011283018 = queryNorm
             0.4196487 = fieldWeight in 1157, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.747783 = idf(docFreq=1046, maxDocs=44421)
               0.0625 = fieldNorm(doc=1157)
         0.011320579 = weight(abstract_txt:based in 1157) [ClassicSimilarity], result of:
           0.011320579 = score(doc=1157,freq=2.0), product of:
             0.040237106 = queryWeight, product of:
               1.1203523 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.011283018 = queryNorm
             0.28134674 = fieldWeight in 1157, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=1157)
         0.037902538 = weight(abstract_txt:result in 1157) [ClassicSimilarity], result of:
           0.037902538 = score(doc=1157,freq=3.0), product of:
             0.06872251 = queryWeight, product of:
               1.1954876 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.011283018 = queryNorm
             0.5515302 = fieldWeight in 1157, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.0625 = fieldNorm(doc=1157)
         0.022494717 = weight(abstract_txt:propose in 1157) [ClassicSimilarity], result of:
           0.022494717 = score(doc=1157,freq=1.0), product of:
             0.069997236 = queryWeight, product of:
               1.2065241 = boost
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.011283018 = queryNorm
             0.32136577 = fieldWeight in 1157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.0625 = fieldNorm(doc=1157)
         0.029676141 = weight(abstract_txt:search in 1157) [ClassicSimilarity], result of:
           0.029676141 = score(doc=1157,freq=6.0), product of:
             0.053041056 = queryWeight, product of:
               1.2863148 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.011283018 = queryNorm
             0.5594938 = fieldWeight in 1157, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1157)
         0.023542097 = weight(abstract_txt:methods in 1157) [ClassicSimilarity], result of:
           0.023542097 = score(doc=1157,freq=1.0), product of:
             0.09090769 = queryWeight, product of:
               1.9445132 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.011283018 = queryNorm
             0.25896704 = fieldWeight in 1157, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=1157)
         0.8588271 = weight(abstract_txt:diversification in 1157) [ClassicSimilarity], result of:
           0.8588271 = score(doc=1157,freq=4.0), product of:
             0.7936537 = queryWeight, product of:
               8.125332 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.011283018 = queryNorm
             1.0821182 = fieldWeight in 1157, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=1157)
       0.32 = coord(8/25)
   

4. Wei, F.; Li, W.; Liu, S.: iRANK: a rank-learn-combine framework for unsupervised ensemble ranking (2010) 0.29

   0.28644222 = sum of:
     0.28644222 = product of:
       0.651005 = sum of:
         0.051230952 = weight(abstract_txt:boost in 459) [ClassicSimilarity], result of:
           0.051230952 = score(doc=459,freq=1.0), product of:
             0.09616983 = queryWeight, product of:
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.011283018 = queryNorm
             0.53271335 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.020752084 = weight(abstract_txt:problem in 459) [ClassicSimilarity], result of:
           0.020752084 = score(doc=459,freq=2.0), product of:
             0.05264919 = queryWeight, product of:
               1.0463848 = boost
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.011283018 = queryNorm
             0.3941577 = fieldWeight in 459, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.023072502 = weight(abstract_txt:performance in 459) [ClassicSimilarity], result of:
           0.023072502 = score(doc=459,freq=2.0), product of:
             0.056504153 = queryWeight, product of:
               1.0840162 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.011283018 = queryNorm
             0.40833285 = fieldWeight in 459, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.008004858 = weight(abstract_txt:based in 459) [ClassicSimilarity], result of:
           0.008004858 = score(doc=459,freq=1.0), product of:
             0.040237106 = queryWeight, product of:
               1.1203523 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.011283018 = queryNorm
             0.1989422 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.022494717 = weight(abstract_txt:propose in 459) [ClassicSimilarity], result of:
           0.022494717 = score(doc=459,freq=1.0), product of:
             0.069997236 = queryWeight, product of:
               1.2065241 = boost
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.011283018 = queryNorm
             0.32136577 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.08749927 = weight(abstract_txt:rank in 459) [ClassicSimilarity], result of:
           0.08749927 = score(doc=459,freq=4.0), product of:
             0.10906285 = queryWeight, product of:
               1.5060313 = boost
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.011283018 = queryNorm
             0.802283 = fieldWeight in 459, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.055705838 = weight(abstract_txt:score in 459) [ClassicSimilarity], result of:
           0.055705838 = score(doc=459,freq=1.0), product of:
             0.12812318 = queryWeight, product of:
               1.6323355 = boost
               6.9565353 = idf(docFreq=114, maxDocs=44421)
               0.011283018 = queryNorm
             0.43478346 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9565353 = idf(docFreq=114, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.02667628 = weight(abstract_txt:query in 459) [ClassicSimilarity], result of:
           0.02667628 = score(doc=459,freq=1.0), product of:
             0.08977205 = queryWeight, product of:
               1.6734463 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.011283018 = queryNorm
             0.29715574 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.15072794 = weight(abstract_txt:ranking in 459) [ClassicSimilarity], result of:
           0.15072794 = score(doc=459,freq=12.0), product of:
             0.124392174 = queryWeight, product of:
               1.9698708 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.011283018 = queryNorm
             1.2117156 = fieldWeight in 459, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.044260155 = weight(abstract_txt:strategies in 459) [ClassicSimilarity], result of:
           0.044260155 = score(doc=459,freq=1.0), product of:
             0.13847749 = queryWeight, product of:
               2.3999388 = boost
               5.113918 = idf(docFreq=725, maxDocs=44421)
               0.011283018 = queryNorm
             0.31961986 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.113918 = idf(docFreq=725, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
         0.16058043 = weight(abstract_txt:aggregation in 459) [ClassicSimilarity], result of:
           0.16058043 = score(doc=459,freq=1.0), product of:
             0.3522105 = queryWeight, product of:
               4.2792406 = boost
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.011283018 = queryNorm
             0.45592177 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.2947483 = idf(docFreq=81, maxDocs=44421)
               0.0625 = fieldNorm(doc=459)
       0.44 = coord(11/25)
   

5. Xu, B.; Lin, H.; Lin, Y.: Assessment of learning to rank methods for query expansion (2016) 0.16

   0.1558489 = sum of:
     0.1558489 = product of:
       0.4329136 = sum of:
         0.02825793 = weight(abstract_txt:performance in 3929) [ClassicSimilarity], result of:
           0.02825793 = score(doc=3929,freq=3.0), product of:
             0.056504153 = queryWeight, product of:
               1.0840162 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.011283018 = queryNorm
             0.5001036 = fieldWeight in 3929, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
         0.018601468 = weight(abstract_txt:state in 3929) [ClassicSimilarity], result of:
           0.018601468 = score(doc=3929,freq=1.0), product of:
             0.061667833 = queryWeight, product of:
               1.1324654 = boost
               4.8262353 = idf(docFreq=967, maxDocs=44421)
               0.011283018 = queryNorm
             0.3016397 = fieldWeight in 3929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8262353 = idf(docFreq=967, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
         0.022494717 = weight(abstract_txt:propose in 3929) [ClassicSimilarity], result of:
           0.022494717 = score(doc=3929,freq=1.0), product of:
             0.069997236 = queryWeight, product of:
               1.2065241 = boost
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.011283018 = queryNorm
             0.32136577 = fieldWeight in 3929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1418524 = idf(docFreq=705, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
         0.08749927 = weight(abstract_txt:rank in 3929) [ClassicSimilarity], result of:
           0.08749927 = score(doc=3929,freq=4.0), product of:
             0.10906285 = queryWeight, product of:
               1.5060313 = boost
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.011283018 = queryNorm
             0.802283 = fieldWeight in 3929, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
         0.037725955 = weight(abstract_txt:query in 3929) [ClassicSimilarity], result of:
           0.037725955 = score(doc=3929,freq=2.0), product of:
             0.08977205 = queryWeight, product of:
               1.6734463 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.011283018 = queryNorm
             0.42024165 = fieldWeight in 3929, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
         0.0917636 = weight(abstract_txt:candidate in 3929) [ClassicSimilarity], result of:
           0.0917636 = score(doc=3929,freq=2.0), product of:
             0.14183961 = queryWeight, product of:
               1.7174904 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.011283018 = queryNorm
             0.6469533 = fieldWeight in 3929, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
         0.040776104 = weight(abstract_txt:methods in 3929) [ClassicSimilarity], result of:
           0.040776104 = score(doc=3929,freq=3.0), product of:
             0.09090769 = queryWeight, product of:
               1.9445132 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.011283018 = queryNorm
             0.44854406 = fieldWeight in 3929, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
         0.06153442 = weight(abstract_txt:ranking in 3929) [ClassicSimilarity], result of:
           0.06153442 = score(doc=3929,freq=2.0), product of:
             0.124392174 = queryWeight, product of:
               1.9698708 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.011283018 = queryNorm
             0.4946808 = fieldWeight in 3929, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
         0.044260155 = weight(abstract_txt:strategies in 3929) [ClassicSimilarity], result of:
           0.044260155 = score(doc=3929,freq=1.0), product of:
             0.13847749 = queryWeight, product of:
               2.3999388 = boost
               5.113918 = idf(docFreq=725, maxDocs=44421)
               0.011283018 = queryNorm
             0.31961986 = fieldWeight in 3929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.113918 = idf(docFreq=725, maxDocs=44421)
               0.0625 = fieldNorm(doc=3929)
       0.36 = coord(9/25)