Document (#33069)

Author

Bar-Ilan, J.

Title

Comparing rankings of search results on the Web

Source

Information processing and management. 41(2005) no.6, S.1511-1519

Year

2005

Abstract

The Web has become an information source for professional data gathering. Because of the vast amounts of information on almost all topics, one cannot systematically go over the whole set of results, and therefore must rely on the ordering of the results by the search engine. It is well known that search engines on the Web have low overlap in terms of coverage. In this study we measure how similar are the rankings of search engines on the overlapping results. We compare rankings of results for identical queries retrieved from several search engines. The method is based only on the set of URLs that appear in the answer sets of the engines being compared. For comparing the similarity of rankings of two search engines, the Spearman correlation coefficient is computed. When comparing more than two sets Kendall's W is used. These are well-known measures and the statistical significance of the results can be computed. The methods are demonstrated on a set of 15 queries that were submitted to four large Web search engines. The findings indicate that the large public search engines on the Web employ considerably different ranking algorithms.

Footnote

Beitrag in einem "Special Issue on Infometrics"

Theme

Suchmaschinen

Similar documents (author)

1. Ilan, J. Bar- => Bar-Ilan, J.: 4.29

   4.290662 = sum of:
     4.290662 = weight(author_txt:ilan in 4392) [ClassicSimilarity], result of:
       4.290662 = fieldWeight in 4392, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         8.090549 = idf(docFreq=36, maxDocs=44421)
         0.375 = fieldNorm(doc=4392)
   

2. Ilan, E. Bar- => Bar-Ilan, E.: 4.29

   4.290662 = sum of:
     4.290662 = weight(author_txt:ilan in 4393) [ClassicSimilarity], result of:
       4.290662 = fieldWeight in 4393, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         8.090549 = idf(docFreq=36, maxDocs=44421)
         0.375 = fieldNorm(doc=4393)
   

3. Bar-Ilan, J.: Information hub blogs (2005) 4.05

   4.0452747 = sum of:
     4.0452747 = weight(author_txt:ilan in 193) [ClassicSimilarity], result of:
       4.0452747 = fieldWeight in 193, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.090549 = idf(docFreq=36, maxDocs=44421)
         0.5 = fieldNorm(doc=193)
   

4. Bar-Ilan, J.: Evaluating the stability of the search tools Hotbot and Snap : a case study (2000) 4.05

   4.0452747 = sum of:
     4.0452747 = weight(author_txt:ilan in 2180) [ClassicSimilarity], result of:
       4.0452747 = fieldWeight in 2180, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.090549 = idf(docFreq=36, maxDocs=44421)
         0.5 = fieldNorm(doc=2180)
   

5. Bar-Ilan, J.: On the overlap, the precision and estimated recall of search engines : a case study of the query 'Erdös' (1998) 4.05

   4.0452747 = sum of:
     4.0452747 = weight(author_txt:ilan in 4753) [ClassicSimilarity], result of:
       4.0452747 = fieldWeight in 4753, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.090549 = idf(docFreq=36, maxDocs=44421)
         0.5 = fieldNorm(doc=4753)
   

Similar documents (content)

1. Bar-Ilan, J.; Levene, M.; Mat-Hassan, M.: Methods for evaluating dynamic changes in search engine rankings : a case study (2006) 0.60

   0.5984301 = sum of:
     0.5984301 = product of:
       1.4960753 = sum of:
         0.06360577 = weight(abstract_txt:overlap in 741) [ClassicSimilarity], result of:
           0.06360577 = score(doc=741,freq=2.0), product of:
             0.118369915 = queryWeight, product of:
               1.012045 = boost
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.016834078 = queryNorm
             0.53734744 = fieldWeight in 741, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.054888282 = weight(abstract_txt:identical in 741) [ClassicSimilarity], result of:
           0.054888282 = score(doc=741,freq=1.0), product of:
             0.13517822 = queryWeight, product of:
               1.081515 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016834078 = queryNorm
             0.40604383 = fieldWeight in 741, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.012288628 = weight(abstract_txt:that in 741) [ClassicSimilarity], result of:
           0.012288628 = score(doc=741,freq=3.0), product of:
             0.054857437 = queryWeight, product of:
               1.3779293 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.016834078 = queryNorm
             0.22401026 = fieldWeight in 741, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.050360333 = weight(abstract_txt:queries in 741) [ClassicSimilarity], result of:
           0.050360333 = score(doc=741,freq=2.0), product of:
             0.12763782 = queryWeight, product of:
               1.4862226 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.016834078 = queryNorm
             0.39455652 = fieldWeight in 741, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.11884798 = weight(abstract_txt:computed in 741) [ClassicSimilarity], result of:
           0.11884798 = score(doc=741,freq=1.0), product of:
             0.2850525 = queryWeight, product of:
               2.2210412 = boost
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.016834078 = queryNorm
             0.41693366 = fieldWeight in 741, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.089196816 = weight(abstract_txt:comparing in 741) [ClassicSimilarity], result of:
           0.089196816 = score(doc=741,freq=1.0), product of:
             0.26948026 = queryWeight, product of:
               2.6448636 = boost
               6.0524936 = idf(docFreq=283, maxDocs=44421)
               0.016834078 = queryNorm
             0.33099574 = fieldWeight in 741, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0524936 = idf(docFreq=283, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.089609884 = weight(abstract_txt:results in 741) [ClassicSimilarity], result of:
           0.089609884 = score(doc=741,freq=7.0), product of:
             0.17803635 = queryWeight, product of:
               3.0402489 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.016834078 = queryNorm
             0.50332355 = fieldWeight in 741, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.49260435 = weight(abstract_txt:rankings in 741) [ClassicSimilarity], result of:
           0.49260435 = score(doc=741,freq=8.0), product of:
             0.46334997 = queryWeight, product of:
               4.0046425 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016834078 = queryNorm
             1.0631367 = fieldWeight in 741, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.1570924 = weight(abstract_txt:search in 741) [ClassicSimilarity], result of:
           0.1570924 = score(doc=741,freq=9.0), product of:
             0.262003 = queryWeight, product of:
               4.2587028 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016834078 = queryNorm
             0.5995825 = fieldWeight in 741, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
         0.3675808 = weight(abstract_txt:engines in 741) [ClassicSimilarity], result of:
           0.3675808 = score(doc=741,freq=7.0), product of:
             0.48027375 = queryWeight, product of:
               5.393524 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.016834078 = queryNorm
             0.76535684 = fieldWeight in 741, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0546875 = fieldNorm(doc=741)
       0.4 = coord(10/25)
   

2. Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007) 0.54

   0.54095 = sum of:
     0.54095 = product of:
       1.352375 = sum of:
         0.08171257 = weight(abstract_txt:urls in 1470) [ClassicSimilarity], result of:
           0.08171257 = score(doc=1470,freq=2.0), product of:
             0.12797002 = queryWeight, product of:
               1.0522848 = boost
               7.2241306 = idf(docFreq=87, maxDocs=44421)
               0.016834078 = queryNorm
             0.63852894 = fieldWeight in 1470, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.2241306 = idf(docFreq=87, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.06272946 = weight(abstract_txt:identical in 1470) [ClassicSimilarity], result of:
           0.06272946 = score(doc=1470,freq=1.0), product of:
             0.13517822 = queryWeight, product of:
               1.081515 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016834078 = queryNorm
             0.46405008 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.02687112 = weight(abstract_txt:large in 1470) [ClassicSimilarity], result of:
           0.02687112 = score(doc=1470,freq=1.0), product of:
             0.09678161 = queryWeight, product of:
               1.2941679 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.016834078 = queryNorm
             0.27764696 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.016216785 = weight(abstract_txt:that in 1470) [ClassicSimilarity], result of:
           0.016216785 = score(doc=1470,freq=4.0), product of:
             0.054857437 = queryWeight, product of:
               1.3779293 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.016834078 = queryNorm
             0.2956169 = fieldWeight in 1470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.057554666 = weight(abstract_txt:queries in 1470) [ClassicSimilarity], result of:
           0.057554666 = score(doc=1470,freq=2.0), product of:
             0.12763782 = queryWeight, product of:
               1.4862226 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.016834078 = queryNorm
             0.45092174 = fieldWeight in 1470, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.13582627 = weight(abstract_txt:computed in 1470) [ClassicSimilarity], result of:
           0.13582627 = score(doc=1470,freq=1.0), product of:
             0.2850525 = queryWeight, product of:
               2.2210412 = boost
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.016834078 = queryNorm
             0.47649562 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.08655335 = weight(abstract_txt:results in 1470) [ClassicSimilarity], result of:
           0.08655335 = score(doc=1470,freq=5.0), product of:
             0.17803635 = queryWeight, product of:
               3.0402489 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.016834078 = queryNorm
             0.4861555 = fieldWeight in 1470, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.39808443 = weight(abstract_txt:rankings in 1470) [ClassicSimilarity], result of:
           0.39808443 = score(doc=1470,freq=4.0), product of:
             0.46334997 = queryWeight, product of:
               4.0046425 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016834078 = queryNorm
             0.8591442 = fieldWeight in 1470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.16926646 = weight(abstract_txt:search in 1470) [ClassicSimilarity], result of:
           0.16926646 = score(doc=1470,freq=8.0), product of:
             0.262003 = queryWeight, product of:
               4.2587028 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016834078 = queryNorm
             0.6460478 = fieldWeight in 1470, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.31756 = weight(abstract_txt:engines in 1470) [ClassicSimilarity], result of:
           0.31756 = score(doc=1470,freq=4.0), product of:
             0.48027375 = queryWeight, product of:
               5.393524 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.016834078 = queryNorm
             0.6612062 = fieldWeight in 1470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
       0.4 = coord(10/25)
   

3. Spink, A.; Jansen, B.J.; Blakely, C.; Koshman, S.: ¬A study of results overlap and uniqueness among major Web search engines (2006) 0.42

   0.41730607 = sum of:
     0.41730607 = product of:
       1.1591835 = sum of:
         0.089952156 = weight(abstract_txt:overlap in 1993) [ClassicSimilarity], result of:
           0.089952156 = score(doc=1993,freq=4.0), product of:
             0.118369915 = queryWeight, product of:
               1.012045 = boost
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.016834078 = queryNorm
             0.7599241 = fieldWeight in 1993, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.04601537 = weight(abstract_txt:submitted in 1993) [ClassicSimilarity], result of:
           0.04601537 = score(doc=1993,freq=1.0), product of:
             0.12018647 = queryWeight, product of:
               1.0197811 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.016834078 = queryNorm
             0.38286647 = fieldWeight in 1993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.040724374 = weight(abstract_txt:large in 1993) [ClassicSimilarity], result of:
           0.040724374 = score(doc=1993,freq=3.0), product of:
             0.09678161 = queryWeight, product of:
               1.2941679 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.016834078 = queryNorm
             0.4207863 = fieldWeight in 1993, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.007094844 = weight(abstract_txt:that in 1993) [ClassicSimilarity], result of:
           0.007094844 = score(doc=1993,freq=1.0), product of:
             0.054857437 = queryWeight, product of:
               1.3779293 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.016834078 = queryNorm
             0.1293324 = fieldWeight in 1993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.10072067 = weight(abstract_txt:queries in 1993) [ClassicSimilarity], result of:
           0.10072067 = score(doc=1993,freq=8.0), product of:
             0.12763782 = queryWeight, product of:
               1.4862226 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.016834078 = queryNorm
             0.78911304 = fieldWeight in 1993, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.03732741 = weight(abstract_txt:sets in 1993) [ClassicSimilarity], result of:
           0.03732741 = score(doc=1993,freq=1.0), product of:
             0.13170902 = queryWeight, product of:
               1.5097393 = boost
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.016834078 = queryNorm
             0.28340814 = fieldWeight in 1993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.10160807 = weight(abstract_txt:results in 1993) [ClassicSimilarity], result of:
           0.10160807 = score(doc=1993,freq=9.0), product of:
             0.17803635 = queryWeight, product of:
               3.0402489 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.016834078 = queryNorm
             0.5707153 = fieldWeight in 1993, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.21590288 = weight(abstract_txt:search in 1993) [ClassicSimilarity], result of:
           0.21590288 = score(doc=1993,freq=17.0), product of:
             0.262003 = queryWeight, product of:
               4.2587028 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016834078 = queryNorm
             0.8240473 = fieldWeight in 1993, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.5198378 = weight(abstract_txt:engines in 1993) [ClassicSimilarity], result of:
           0.5198378 = score(doc=1993,freq=14.0), product of:
             0.48027375 = queryWeight, product of:
               5.393524 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.016834078 = queryNorm
             1.0823781 = fieldWeight in 1993, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
       0.36 = coord(9/25)
   

4. Jahani, H.; Azzopardi, L.; Sanderson, M.: Measuring the retrievability of digital library content using analytics data (2024) 0.27

   0.2692544 = sum of:
     0.2692544 = product of:
       0.7479288 = sum of:
         0.06573625 = weight(abstract_txt:submitted in 2386) [ClassicSimilarity], result of:
           0.06573625 = score(doc=2386,freq=1.0), product of:
             0.12018647 = queryWeight, product of:
               1.0197811 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.016834078 = queryNorm
             0.5469521 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
         0.022771794 = weight(abstract_txt:well in 2386) [ClassicSimilarity], result of:
           0.022771794 = score(doc=2386,freq=1.0), product of:
             0.074689664 = queryWeight, product of:
               1.1369057 = boost
               3.9025342 = idf(docFreq=2437, maxDocs=44421)
               0.016834078 = queryNorm
             0.30488548 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9025342 = idf(docFreq=2437, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
         0.022663647 = weight(abstract_txt:that in 2386) [ClassicSimilarity], result of:
           0.022663647 = score(doc=2386,freq=5.0), product of:
             0.054857437 = queryWeight, product of:
               1.3779293 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.016834078 = queryNorm
             0.4131372 = fieldWeight in 2386, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
         0.05087162 = weight(abstract_txt:queries in 2386) [ClassicSimilarity], result of:
           0.05087162 = score(doc=2386,freq=1.0), product of:
             0.12763782 = queryWeight, product of:
               1.4862226 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.016834078 = queryNorm
             0.39856228 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
         0.053324867 = weight(abstract_txt:sets in 2386) [ClassicSimilarity], result of:
           0.053324867 = score(doc=2386,freq=1.0), product of:
             0.13170902 = queryWeight, product of:
               1.5097393 = boost
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.016834078 = queryNorm
             0.40486875 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
         0.05387803 = weight(abstract_txt:known in 2386) [ClassicSimilarity], result of:
           0.05387803 = score(doc=2386,freq=1.0), product of:
             0.13261831 = queryWeight, product of:
               1.5149417 = boost
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.016834078 = queryNorm
             0.40626392 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
         0.048384793 = weight(abstract_txt:results in 2386) [ClassicSimilarity], result of:
           0.048384793 = score(doc=2386,freq=1.0), product of:
             0.17803635 = queryWeight, product of:
               3.0402489 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.016834078 = queryNorm
             0.2717692 = fieldWeight in 2386, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
         0.14961182 = weight(abstract_txt:search in 2386) [ClassicSimilarity], result of:
           0.14961182 = score(doc=2386,freq=4.0), product of:
             0.262003 = queryWeight, product of:
               4.2587028 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016834078 = queryNorm
             0.5710309 = fieldWeight in 2386, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
         0.28068602 = weight(abstract_txt:engines in 2386) [ClassicSimilarity], result of:
           0.28068602 = score(doc=2386,freq=2.0), product of:
             0.48027375 = queryWeight, product of:
               5.393524 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.016834078 = queryNorm
             0.5844292 = fieldWeight in 2386, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.078125 = fieldNorm(doc=2386)
       0.36 = coord(9/25)
   

5. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 0.27

   0.26871 = sum of:
     0.26871 = product of:
       0.74641657 = sum of:
         0.02351223 = weight(abstract_txt:large in 4071) [ClassicSimilarity], result of:
           0.02351223 = score(doc=4071,freq=1.0), product of:
             0.09678161 = queryWeight, product of:
               1.2941679 = boost
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.016834078 = queryNorm
             0.24294108 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4423513 = idf(docFreq=1420, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.014189688 = weight(abstract_txt:that in 4071) [ClassicSimilarity], result of:
           0.014189688 = score(doc=4071,freq=4.0), product of:
             0.054857437 = queryWeight, product of:
               1.3779293 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.016834078 = queryNorm
             0.2586648 = fieldWeight in 4071, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.035610136 = weight(abstract_txt:queries in 4071) [ClassicSimilarity], result of:
           0.035610136 = score(doc=4071,freq=1.0), product of:
             0.12763782 = queryWeight, product of:
               1.4862226 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.016834078 = queryNorm
             0.2789936 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.03732741 = weight(abstract_txt:sets in 4071) [ClassicSimilarity], result of:
           0.03732741 = score(doc=4071,freq=1.0), product of:
             0.13170902 = queryWeight, product of:
               1.5097393 = boost
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.016834078 = queryNorm
             0.28340814 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.053336527 = weight(abstract_txt:known in 4071) [ClassicSimilarity], result of:
           0.053336527 = score(doc=4071,freq=2.0), product of:
             0.13261831 = queryWeight, product of:
               1.5149417 = boost
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.016834078 = queryNorm
             0.40218073 = fieldWeight in 4071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.058663443 = weight(abstract_txt:results in 4071) [ClassicSimilarity], result of:
           0.058663443 = score(doc=4071,freq=3.0), product of:
             0.17803635 = queryWeight, product of:
               3.0402489 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.016834078 = queryNorm
             0.3295026 = fieldWeight in 4071, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.24630217 = weight(abstract_txt:rankings in 4071) [ClassicSimilarity], result of:
           0.24630217 = score(doc=4071,freq=2.0), product of:
             0.46334997 = queryWeight, product of:
               4.0046425 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016834078 = queryNorm
             0.53156835 = fieldWeight in 4071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.13854247 = weight(abstract_txt:search in 4071) [ClassicSimilarity], result of:
           0.13854247 = score(doc=4071,freq=7.0), product of:
             0.262003 = queryWeight, product of:
               4.2587028 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016834078 = queryNorm
             0.528782 = fieldWeight in 4071, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.13893248 = weight(abstract_txt:engines in 4071) [ClassicSimilarity], result of:
           0.13893248 = score(doc=4071,freq=1.0), product of:
             0.48027375 = queryWeight, product of:
               5.393524 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.016834078 = queryNorm
             0.2892777 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
       0.36 = coord(9/25)