Document (#40145)

Author

Schaer, P.
Mayr, P.
Sünkler, S.
Lewandowski, D.

Title

How relevant is the long tail? : a relevance assessment study on million short

Source

https://arxiv.org/abs/1606.06081

Year

2016

Abstract

Users of web search engines are known to mostly focus on the top ranked results of the search engine result page. While many studies support this well known information seeking pattern only few studies concentrate on the question what users are missing by neglecting lower ranked results. To learn more about the relevance distributions in the so-called long tail we conducted a relevance assessment study with the Million Short long-tail web search engine. While we see a clear difference in the content between the head and the tail of the search engine result list we see no statistical significant differences in the binary relevance judgments and weak significant differences when using graded relevance. The tail contains different but still valuable results. We argue that the long tail can be a rich source for the diversification of web search engine result lists but it needs more evaluation to clearly describe the differences.

Content

Die Studie wurde auf der diesjährigen CLEF-Konferenz mit dem Best Poster Award ausgezeichnet.

Footnote

To appear in Experimental IR Meets Multilinguality, Multimodality, and Interaction. 7th International Conference of the CLEF Association, CLEF 2016, \'Evora, Portugal, September 5-8, 2016.

Theme

Suchmaschinen
Retrievalstudien

Similar documents (author)

1. Lewandowski, D.; Sünkler, S.: ¬Das Relevance Assessment Tool : eine modulare Software zur Unterstützung bei der Durchführung vielfältiger Studien mit Suchmaschinen (2019) 2.08

   2.084402 = sum of:
     2.084402 = product of:
       4.168804 = sum of:
         1.5131068 = weight(author_txt:lewandowski in 26) [ClassicSimilarity], result of:
           1.5131068 = score(doc=26,freq=1.0), product of:
             0.39953533 = queryWeight, product of:
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.05274858 = queryNorm
             3.7871666 = fieldWeight in 26, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.5 = fieldNorm(doc=26)
         2.655697 = weight(author_txt:sünkler in 26) [ClassicSimilarity], result of:
           2.655697 = score(doc=26,freq=1.0), product of:
             0.5813368 = queryWeight, product of:
               1.2062472 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.05274858 = queryNorm
             4.5682592 = fieldWeight in 26, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.5 = fieldNorm(doc=26)
       0.5 = coord(2/4)
   

2. Lewandowski, D.; Sünkler, S.: What does Google recommend when you want to compare insurance offerings? (2019) 2.08

   2.084402 = sum of:
     2.084402 = product of:
       4.168804 = sum of:
         1.5131068 = weight(author_txt:lewandowski in 288) [ClassicSimilarity], result of:
           1.5131068 = score(doc=288,freq=1.0), product of:
             0.39953533 = queryWeight, product of:
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.05274858 = queryNorm
             3.7871666 = fieldWeight in 288, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.5 = fieldNorm(doc=288)
         2.655697 = weight(author_txt:sünkler in 288) [ClassicSimilarity], result of:
           2.655697 = score(doc=288,freq=1.0), product of:
             0.5813368 = queryWeight, product of:
               1.2062472 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.05274858 = queryNorm
             4.5682592 = fieldWeight in 288, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.5 = fieldNorm(doc=288)
       0.5 = coord(2/4)
   

3. Lewandowski, D.; Mayr, P.: Exploring the academic invisible Web (2006) 1.66

   1.6606922 = sum of:
     1.6606922 = product of:
       3.3213844 = sum of:
         1.5131068 = weight(author_txt:lewandowski in 4752) [ClassicSimilarity], result of:
           1.5131068 = score(doc=4752,freq=1.0), product of:
             0.39953533 = queryWeight, product of:
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.05274858 = queryNorm
             3.7871666 = fieldWeight in 4752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.5 = fieldNorm(doc=4752)
         1.8082777 = weight(author_txt:mayr in 4752) [ClassicSimilarity], result of:
           1.8082777 = score(doc=4752,freq=1.0), product of:
             0.44993752 = queryWeight, product of:
               1.0612031 = boost
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.05274858 = queryNorm
             4.018953 = fieldWeight in 4752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.5 = fieldNorm(doc=4752)
       0.5 = coord(2/4)
   

4. Lewandowski, D.; Mayr, P.: Exploring the academic invisible Web (2006) 1.66

   1.6606922 = sum of:
     1.6606922 = product of:
       3.3213844 = sum of:
         1.5131068 = weight(author_txt:lewandowski in 3580) [ClassicSimilarity], result of:
           1.5131068 = score(doc=3580,freq=1.0), product of:
             0.39953533 = queryWeight, product of:
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.05274858 = queryNorm
             3.7871666 = fieldWeight in 3580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.5 = fieldNorm(doc=3580)
         1.8082777 = weight(author_txt:mayr in 3580) [ClassicSimilarity], result of:
           1.8082777 = score(doc=3580,freq=1.0), product of:
             0.44993752 = queryWeight, product of:
               1.0612031 = boost
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.05274858 = queryNorm
             4.018953 = fieldWeight in 3580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.5 = fieldNorm(doc=3580)
       0.5 = coord(2/4)
   

5. Mayr, P.; Schaer, P.; Mutschke, P.: ¬A science model driven retrieval prototype (2011) 1.59

   1.5888183 = sum of:
     1.5888183 = product of:
       3.1776366 = sum of:
         1.3562082 = weight(author_txt:mayr in 1649) [ClassicSimilarity], result of:
           1.3562082 = score(doc=1649,freq=1.0), product of:
             0.44993752 = queryWeight, product of:
               1.0612031 = boost
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.05274858 = queryNorm
             3.0142145 = fieldWeight in 1649, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.375 = fieldNorm(doc=1649)
         1.8214283 = weight(author_txt:schaer in 1649) [ClassicSimilarity], result of:
           1.8214283 = score(doc=1649,freq=1.0), product of:
             0.5476999 = queryWeight, product of:
               1.1708298 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.05274858 = queryNorm
             3.3255954 = fieldWeight in 1649, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.375 = fieldNorm(doc=1649)
       0.5 = coord(2/4)
   

Similar documents (content)

1. Li, X.; Schijvenaars, B.J.A.; Rijke, M.de: Investigating queries and search failures in academic search (2017) 0.22

   0.2185847 = sum of:
     0.2185847 = product of:
       0.6830772 = sum of:
         0.012283649 = weight(abstract_txt:users in 33) [ClassicSimilarity], result of:
           0.012283649 = score(doc=33,freq=2.0), product of:
             0.044523112 = queryWeight, product of:
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012480923 = queryNorm
             0.27589378 = fieldWeight in 33, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0546875 = fieldNorm(doc=33)
         0.020589015 = weight(abstract_txt:significant in 33) [ClassicSimilarity], result of:
           0.020589015 = score(doc=33,freq=1.0), product of:
             0.079153046 = queryWeight, product of:
               1.3333404 = boost
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.012480923 = queryNorm
             0.26011652 = fieldWeight in 33, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.0546875 = fieldNorm(doc=33)
         0.02690609 = weight(abstract_txt:known in 33) [ClassicSimilarity], result of:
           0.02690609 = score(doc=33,freq=1.0), product of:
             0.094611585 = queryWeight, product of:
               1.4577377 = boost
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.012480923 = queryNorm
             0.28438473 = fieldWeight in 33, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.0546875 = fieldNorm(doc=33)
         0.034891848 = weight(abstract_txt:differences in 33) [ClassicSimilarity], result of:
           0.034891848 = score(doc=33,freq=1.0), product of:
             0.12879242 = queryWeight, product of:
               2.083042 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.012480923 = queryNorm
             0.2709154 = fieldWeight in 33, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.0546875 = fieldNorm(doc=33)
         0.03795536 = weight(abstract_txt:result in 33) [ClassicSimilarity], result of:
           0.03795536 = score(doc=33,freq=1.0), product of:
             0.13622487 = queryWeight, product of:
               2.1423037 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.012480923 = queryNorm
             0.27862284 = fieldWeight in 33, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.0546875 = fieldNorm(doc=33)
         0.08736125 = weight(abstract_txt:search in 33) [ClassicSimilarity], result of:
           0.08736125 = score(doc=33,freq=14.0), product of:
             0.11682266 = queryWeight, product of:
               2.561184 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012480923 = queryNorm
             0.7478108 = fieldWeight in 33, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=33)
         0.09068866 = weight(abstract_txt:engine in 33) [ClassicSimilarity], result of:
           0.09068866 = score(doc=33,freq=2.0), product of:
             0.21268943 = queryWeight, product of:
               3.090973 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.012480923 = queryNorm
             0.42639008 = fieldWeight in 33, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0546875 = fieldNorm(doc=33)
         0.37240133 = weight(abstract_txt:tail in 33) [ClassicSimilarity], result of:
           0.37240133 = score(doc=33,freq=1.0), product of:
             0.7866082 = queryWeight, product of:
               7.280264 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.012480923 = queryNorm
             0.4734267 = fieldWeight in 33, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0546875 = fieldNorm(doc=33)
       0.32 = coord(8/25)
   

2. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.19

   0.19219317 = sum of:
     0.19219317 = product of:
       0.80080485 = sum of:
         0.031390943 = weight(abstract_txt:users in 909) [ClassicSimilarity], result of:
           0.031390943 = score(doc=909,freq=10.0), product of:
             0.044523112 = queryWeight, product of:
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012480923 = queryNorm
             0.70504826 = fieldWeight in 909, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.046217594 = weight(abstract_txt:search in 909) [ClassicSimilarity], result of:
           0.046217594 = score(doc=909,freq=3.0), product of:
             0.11682266 = queryWeight, product of:
               2.561184 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012480923 = queryNorm
             0.39562184 = fieldWeight in 909, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.062979676 = weight(abstract_txt:long in 909) [ClassicSimilarity], result of:
           0.062979676 = score(doc=909,freq=1.0), product of:
             0.19224699 = queryWeight, product of:
               2.938678 = boost
               5.2415633 = idf(docFreq=638, maxDocs=44421)
               0.012480923 = queryNorm
             0.3275977 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2415633 = idf(docFreq=638, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.103644185 = weight(abstract_txt:engine in 909) [ClassicSimilarity], result of:
           0.103644185 = score(doc=909,freq=2.0), product of:
             0.21268943 = queryWeight, product of:
               3.090973 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.012480923 = queryNorm
             0.48730296 = fieldWeight in 909, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.13097095 = weight(abstract_txt:relevance in 909) [ClassicSimilarity], result of:
           0.13097095 = score(doc=909,freq=4.0), product of:
             0.2125491 = queryWeight, product of:
               3.4546723 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012480923 = queryNorm
             0.6161915 = fieldWeight in 909, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.4256015 = weight(abstract_txt:tail in 909) [ClassicSimilarity], result of:
           0.4256015 = score(doc=909,freq=1.0), product of:
             0.7866082 = queryWeight, product of:
               7.280264 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.012480923 = queryNorm
             0.5410591 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
       0.24 = coord(6/25)
   

3. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 0.17

   0.16922289 = sum of:
     0.16922289 = product of:
       0.42305723 = sum of:
         0.015044336 = weight(abstract_txt:users in 4071) [ClassicSimilarity], result of:
           0.015044336 = score(doc=4071,freq=3.0), product of:
             0.044523112 = queryWeight, product of:
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012480923 = queryNorm
             0.33789948 = fieldWeight in 4071, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.014750819 = weight(abstract_txt:studies in 4071) [ClassicSimilarity], result of:
           0.014750819 = score(doc=4071,freq=1.0), product of:
             0.06337549 = queryWeight, product of:
               1.1930754 = boost
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.012480923 = queryNorm
             0.23275274 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.25605 = idf(docFreq=1711, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.038050957 = weight(abstract_txt:known in 4071) [ClassicSimilarity], result of:
           0.038050957 = score(doc=4071,freq=2.0), product of:
             0.094611585 = queryWeight, product of:
               1.4577377 = boost
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.012480923 = queryNorm
             0.40218073 = fieldWeight in 4071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.02092562 = weight(abstract_txt:results in 4071) [ClassicSimilarity], result of:
           0.02092562 = score(doc=4071,freq=3.0), product of:
             0.06350669 = queryWeight, product of:
               1.4627248 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.012480923 = queryNorm
             0.3295026 = fieldWeight in 4071, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.036291838 = weight(abstract_txt:assessment in 4071) [ClassicSimilarity], result of:
           0.036291838 = score(doc=4071,freq=1.0), product of:
             0.11550032 = queryWeight, product of:
               1.6106414 = boost
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.012480923 = queryNorm
             0.31421417 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.034891848 = weight(abstract_txt:differences in 4071) [ClassicSimilarity], result of:
           0.034891848 = score(doc=4071,freq=1.0), product of:
             0.12879242 = queryWeight, product of:
               2.083042 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.012480923 = queryNorm
             0.2709154 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.03795536 = weight(abstract_txt:result in 4071) [ClassicSimilarity], result of:
           0.03795536 = score(doc=4071,freq=1.0), product of:
             0.13622487 = queryWeight, product of:
               2.1423037 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.012480923 = queryNorm
             0.27862284 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.06177372 = weight(abstract_txt:search in 4071) [ClassicSimilarity], result of:
           0.06177372 = score(doc=4071,freq=7.0), product of:
             0.11682266 = queryWeight, product of:
               2.561184 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012480923 = queryNorm
             0.528782 = fieldWeight in 4071, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.06412657 = weight(abstract_txt:engine in 4071) [ClassicSimilarity], result of:
           0.06412657 = score(doc=4071,freq=1.0), product of:
             0.21268943 = queryWeight, product of:
               3.090973 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.012480923 = queryNorm
             0.30150333 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.099246144 = weight(abstract_txt:relevance in 4071) [ClassicSimilarity], result of:
           0.099246144 = score(doc=4071,freq=3.0), product of:
             0.2125491 = queryWeight, product of:
               3.4546723 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012480923 = queryNorm
             0.46693277 = fieldWeight in 4071, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
       0.4 = coord(10/25)
   

4. Peters, I.; Stock, W.G.: Power tags in information retrieval (2010) 0.15

   0.14682646 = sum of:
     0.14682646 = product of:
       0.61177695 = sum of:
         0.018971993 = weight(abstract_txt:while in 1865) [ClassicSimilarity], result of:
           0.018971993 = score(doc=1865,freq=1.0), product of:
             0.06856849 = queryWeight, product of:
               1.2409935 = boost
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.012480923 = queryNorm
             0.27668676 = fieldWeight in 1865, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.0625 = fieldNorm(doc=1865)
         0.030749818 = weight(abstract_txt:known in 1865) [ClassicSimilarity], result of:
           0.030749818 = score(doc=1865,freq=1.0), product of:
             0.094611585 = queryWeight, product of:
               1.4577377 = boost
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.012480923 = queryNorm
             0.32501113 = fieldWeight in 1865, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.0625 = fieldNorm(doc=1865)
         0.013807329 = weight(abstract_txt:results in 1865) [ClassicSimilarity], result of:
           0.013807329 = score(doc=1865,freq=1.0), product of:
             0.06350669 = queryWeight, product of:
               1.4627248 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.012480923 = queryNorm
             0.21741535 = fieldWeight in 1865, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=1865)
         0.059666656 = weight(abstract_txt:search in 1865) [ClassicSimilarity], result of:
           0.059666656 = score(doc=1865,freq=5.0), product of:
             0.11682266 = queryWeight, product of:
               2.561184 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012480923 = queryNorm
             0.5107456 = fieldWeight in 1865, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1865)
         0.062979676 = weight(abstract_txt:long in 1865) [ClassicSimilarity], result of:
           0.062979676 = score(doc=1865,freq=1.0), product of:
             0.19224699 = queryWeight, product of:
               2.938678 = boost
               5.2415633 = idf(docFreq=638, maxDocs=44421)
               0.012480923 = queryNorm
             0.3275977 = fieldWeight in 1865, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2415633 = idf(docFreq=638, maxDocs=44421)
               0.0625 = fieldNorm(doc=1865)
         0.4256015 = weight(abstract_txt:tail in 1865) [ClassicSimilarity], result of:
           0.4256015 = score(doc=1865,freq=1.0), product of:
             0.7866082 = queryWeight, product of:
               7.280264 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.012480923 = queryNorm
             0.5410591 = fieldWeight in 1865, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=1865)
       0.24 = coord(6/25)
   

5. Can, F.; Nuray, R.; Sevdik, A.B.: Automatic performance evaluation of Web search engines (2004) 0.15

   0.14506242 = sum of:
     0.14506242 = product of:
       0.45332006 = sum of:
         0.01240836 = weight(abstract_txt:users in 3570) [ClassicSimilarity], result of:
           0.01240836 = score(doc=3570,freq=1.0), product of:
             0.044523112 = queryWeight, product of:
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.012480923 = queryNorm
             0.2786948 = fieldWeight in 3570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=3570)
         0.053319793 = weight(abstract_txt:binary in 3570) [ClassicSimilarity], result of:
           0.053319793 = score(doc=3570,freq=1.0), product of:
             0.093402445 = queryWeight, product of:
               1.0241684 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.012480923 = queryNorm
             0.5708608 = fieldWeight in 3570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.078125 = fieldNorm(doc=3570)
         0.029412879 = weight(abstract_txt:significant in 3570) [ClassicSimilarity], result of:
           0.029412879 = score(doc=3570,freq=1.0), product of:
             0.079153046 = queryWeight, product of:
               1.3333404 = boost
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.012480923 = queryNorm
             0.37159503 = fieldWeight in 3570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.078125 = fieldNorm(doc=3570)
         0.017259162 = weight(abstract_txt:results in 3570) [ClassicSimilarity], result of:
           0.017259162 = score(doc=3570,freq=1.0), product of:
             0.06350669 = queryWeight, product of:
               1.4627248 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.012480923 = queryNorm
             0.2717692 = fieldWeight in 3570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=3570)
         0.05184548 = weight(abstract_txt:assessment in 3570) [ClassicSimilarity], result of:
           0.05184548 = score(doc=3570,freq=1.0), product of:
             0.11550032 = queryWeight, product of:
               1.6106414 = boost
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.012480923 = queryNorm
             0.44887736 = fieldWeight in 3570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7456303 = idf(docFreq=385, maxDocs=44421)
               0.078125 = fieldNorm(doc=3570)
         0.08170194 = weight(abstract_txt:search in 3570) [ClassicSimilarity], result of:
           0.08170194 = score(doc=3570,freq=6.0), product of:
             0.11682266 = queryWeight, product of:
               2.561184 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.012480923 = queryNorm
             0.6993672 = fieldWeight in 3570, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=3570)
         0.09160938 = weight(abstract_txt:engine in 3570) [ClassicSimilarity], result of:
           0.09160938 = score(doc=3570,freq=1.0), product of:
             0.21268943 = queryWeight, product of:
               3.090973 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.012480923 = queryNorm
             0.43071902 = fieldWeight in 3570, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.078125 = fieldNorm(doc=3570)
         0.11576306 = weight(abstract_txt:relevance in 3570) [ClassicSimilarity], result of:
           0.11576306 = score(doc=3570,freq=2.0), product of:
             0.2125491 = queryWeight, product of:
               3.4546723 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.012480923 = queryNorm
             0.5446415 = fieldWeight in 3570, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=3570)
       0.32 = coord(8/25)