Document (#31742)

Author

Bar-Ilan, J.
Levene, M.
Mat-Hassan, M.

Title

Methods for evaluating dynamic changes in search engine rankings : a case study

Source

Journal of documentation. 62(2006) no.6, S.708-729

Year

2006

Abstract

Purpose - The objective of this paper is to characterize the changes in the rankings of the top ten results of major search engines over time and to compare the rankings between these engines. Design/methodology/approach - The papers compare rankings of the top-ten results of the search engines Google and AlltheWeb on ten identical queries over a period of three weeks. Only the top-ten results were considered, since users do not normally inspect more than the first results page returned by a search engine. The experiment was repeated twice, in October 2003 and in January 2004, in order to assess changes to the top-ten results of some of the queries during the three months interval. In order to assess the changes in the rankings, three measures were computed for each data collection point and each search engine. Findings - The findings in this paper show that the rankings of AlltheWeb were highly stable over each period, while the rankings of Google underwent constant yet minor changes, with occasional major ones. Changes over time can be explained by the dynamic nature of the web or by fluctuations in the search engines' indexes. The top-ten results of the two search engines had surprisingly low overlap. With such small overlap, the task of comparing the rankings of the two engines becomes extremely challenging. Originality/value - The paper shows that because of the abundance of information on the web, ranking search results is of extreme importance. The paper compares several measures for computing the similarity between rankings of search tools, and shows that none of the measures is fully satisfactory as a standalone measure. It also demonstrates the apparent differences in the ranking algorithms of two widely used search engines.

Theme

Suchmaschinen
Retrievalalgorithmen

Similar documents (author)

1. Mat-Hassan, M.; Levene, M.: Associating search and navigation behavior through log analysis (2005) 3.46

   3.4616 = sum of:
     3.4616 = product of:
       5.1924 = sum of:
         2.5527925 = weight(author_txt:levene in 4681) [ClassicSimilarity], result of:
           2.5527925 = score(doc=4681,freq=1.0), product of:
             0.6208136 = queryWeight, product of:
               1.1617113 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.056857366 = queryNorm
             4.1120114 = fieldWeight in 4681, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.4375 = fieldNorm(doc=4681)
         2.6396074 = weight(author_txt:hassan in 4681) [ClassicSimilarity], result of:
           2.6396074 = score(doc=4681,freq=1.0), product of:
             0.63481 = queryWeight, product of:
               1.1747339 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.056857366 = queryNorm
             4.1581063 = fieldWeight in 4681, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.4375 = fieldNorm(doc=4681)
       0.6666667 = coord(2/3)
   

2. Bar-Ilan, J.; Levene, M.: ¬The hw-rank : an h-index variant for ranking web pages (2015) 2.79

   2.7873611 = sum of:
     2.7873611 = product of:
       4.1810417 = sum of:
         1.628249 = weight(author_txt:ilan in 2694) [ClassicSimilarity], result of:
           1.628249 = score(doc=2694,freq=1.0), product of:
             0.46000734 = queryWeight, product of:
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.056857366 = queryNorm
             3.5396154 = fieldWeight in 2694, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.4375 = fieldNorm(doc=2694)
         2.5527925 = weight(author_txt:levene in 2694) [ClassicSimilarity], result of:
           2.5527925 = score(doc=2694,freq=1.0), product of:
             0.6208136 = queryWeight, product of:
               1.1617113 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.056857366 = queryNorm
             4.1120114 = fieldWeight in 2694, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.4375 = fieldNorm(doc=2694)
       0.6666667 = coord(2/3)
   

3. Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007) 1.99

   1.9909723 = sum of:
     1.9909723 = product of:
       2.9864583 = sum of:
         1.163035 = weight(author_txt:ilan in 1470) [ClassicSimilarity], result of:
           1.163035 = score(doc=1470,freq=1.0), product of:
             0.46000734 = queryWeight, product of:
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.056857366 = queryNorm
             2.5282967 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.3125 = fieldNorm(doc=1470)
         1.8234233 = weight(author_txt:levene in 1470) [ClassicSimilarity], result of:
           1.8234233 = score(doc=1470,freq=1.0), product of:
             0.6208136 = queryWeight, product of:
               1.1617113 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.056857366 = queryNorm
             2.937151 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.3125 = fieldNorm(doc=1470)
       0.6666667 = coord(2/3)
   

4. Bar-Ilan, J.; Keenoy, K.; Levene, M.; Yaari, E.: Presentation bias is significant in determining user preference for search results : a user study (2009) 1.99

   1.9909723 = sum of:
     1.9909723 = product of:
       2.9864583 = sum of:
         1.163035 = weight(author_txt:ilan in 3703) [ClassicSimilarity], result of:
           1.163035 = score(doc=3703,freq=1.0), product of:
             0.46000734 = queryWeight, product of:
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.056857366 = queryNorm
             2.5282967 = fieldWeight in 3703, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.3125 = fieldNorm(doc=3703)
         1.8234233 = weight(author_txt:levene in 3703) [ClassicSimilarity], result of:
           1.8234233 = score(doc=3703,freq=1.0), product of:
             0.6208136 = queryWeight, product of:
               1.1617113 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.056857366 = queryNorm
             2.937151 = fieldWeight in 3703, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.3125 = fieldNorm(doc=3703)
       0.6666667 = coord(2/3)
   

5. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 1.99

   1.9909723 = sum of:
     1.9909723 = product of:
       2.9864583 = sum of:
         1.163035 = weight(author_txt:ilan in 4071) [ClassicSimilarity], result of:
           1.163035 = score(doc=4071,freq=1.0), product of:
             0.46000734 = queryWeight, product of:
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.056857366 = queryNorm
             2.5282967 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.3125 = fieldNorm(doc=4071)
         1.8234233 = weight(author_txt:levene in 4071) [ClassicSimilarity], result of:
           1.8234233 = score(doc=4071,freq=1.0), product of:
             0.6208136 = queryWeight, product of:
               1.1617113 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.056857366 = queryNorm
             2.937151 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.3125 = fieldNorm(doc=4071)
       0.6666667 = coord(2/3)
   

Similar documents (content)

1. Bar-Ilan, J.: Comparing rankings of search results on the Web (2005) 0.65

   0.64511716 = sum of:
     0.64511716 = product of:
       1.3439941 = sum of:
         0.0390114 = weight(abstract_txt:queries in 2068) [ClassicSimilarity], result of:
           0.0390114 = score(doc=2068,freq=2.0), product of:
             0.08651479 = queryWeight, product of:
               1.1258808 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.015062316 = queryNorm
             0.45092174 = fieldWeight in 2068, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.015372847 = weight(abstract_txt:were in 2068) [ClassicSimilarity], result of:
           0.015372847 = score(doc=2068,freq=1.0), product of:
             0.06706655 = queryWeight, product of:
               1.214076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015062316 = queryNorm
             0.2292178 = fieldWeight in 2068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.03642069 = weight(abstract_txt:ranking in 2068) [ClassicSimilarity], result of:
           0.03642069 = score(doc=2068,freq=1.0), product of:
             0.10412095 = queryWeight, product of:
               1.2351403 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.015062316 = queryNorm
             0.34979215 = fieldWeight in 2068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.03668455 = weight(abstract_txt:compare in 2068) [ClassicSimilarity], result of:
           0.03668455 = score(doc=2068,freq=1.0), product of:
             0.104623236 = queryWeight, product of:
               1.238116 = boost
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.015062316 = queryNorm
             0.35063484 = fieldWeight in 2068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.06968102 = weight(abstract_txt:overlap in 2068) [ClassicSimilarity], result of:
           0.06968102 = score(doc=2068,freq=1.0), product of:
             0.16046575 = queryWeight, product of:
               1.5333399 = boost
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.015062316 = queryNorm
             0.43424234 = fieldWeight in 2068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.049751516 = weight(abstract_txt:measures in 2068) [ClassicSimilarity], result of:
           0.049751516 = score(doc=2068,freq=1.0), product of:
             0.14673734 = queryWeight, product of:
               1.7958217 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.015062316 = queryNorm
             0.3390515 = fieldWeight in 2068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.052222956 = weight(abstract_txt:engine in 2068) [ClassicSimilarity], result of:
           0.052222956 = score(doc=2068,freq=1.0), product of:
             0.15155749 = queryWeight, product of:
               1.8250787 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.015062316 = queryNorm
             0.34457523 = fieldWeight in 2068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.031733394 = weight(abstract_txt:over in 2068) [ClassicSimilarity], result of:
           0.031733394 = score(doc=2068,freq=1.0), product of:
             0.11967231 = queryWeight, product of:
               1.8726606 = boost
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.015062316 = queryNorm
             0.26516905 = fieldWeight in 2068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.06844499 = weight(abstract_txt:results in 2068) [ClassicSimilarity], result of:
           0.06844499 = score(doc=2068,freq=5.0), product of:
             0.14078826 = queryWeight, product of:
               2.6869805 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.015062316 = queryNorm
             0.4861555 = fieldWeight in 2068, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.13415161 = weight(abstract_txt:search in 2068) [ClassicSimilarity], result of:
           0.13415161 = score(doc=2068,freq=7.0), product of:
             0.22198685 = queryWeight, product of:
               4.0326996 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.015062316 = queryNorm
             0.6043223 = fieldWeight in 2068, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.2847448 = weight(abstract_txt:engines in 2068) [ClassicSimilarity], result of:
           0.2847448 = score(doc=2068,freq=7.0), product of:
             0.32553667 = queryWeight, product of:
               4.085839 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.015062316 = queryNorm
             0.8746935 = fieldWeight in 2068, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
         0.5257743 = weight(abstract_txt:rankings in 2068) [ClassicSimilarity], result of:
           0.5257743 = score(doc=2068,freq=3.0), product of:
             0.7066472 = queryWeight, product of:
               6.82582 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015062316 = queryNorm
             0.7440407 = fieldWeight in 2068, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2068)
       0.48 = coord(12/25)
   

2. Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007) 0.63

   0.62752426 = sum of:
     0.62752426 = product of:
       1.3073422 = sum of:
         0.020989325 = weight(abstract_txt:major in 1470) [ClassicSimilarity], result of:
           0.020989325 = score(doc=1470,freq=1.0), product of:
             0.07210604 = queryWeight, product of:
               1.0278579 = boost
               4.657435 = idf(docFreq=1145, maxDocs=44421)
               0.015062316 = queryNorm
             0.29108968 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.657435 = idf(docFreq=1145, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.0390114 = weight(abstract_txt:queries in 1470) [ClassicSimilarity], result of:
           0.0390114 = score(doc=1470,freq=2.0), product of:
             0.08651479 = queryWeight, product of:
               1.1258808 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.015062316 = queryNorm
             0.45092174 = fieldWeight in 1470, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.032044295 = weight(abstract_txt:google in 1470) [ClassicSimilarity], result of:
           0.032044295 = score(doc=1470,freq=1.0), product of:
             0.095603354 = queryWeight, product of:
               1.1835424 = boost
               5.3628736 = idf(docFreq=565, maxDocs=44421)
               0.015062316 = queryNorm
             0.3351796 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3628736 = idf(docFreq=565, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.030745694 = weight(abstract_txt:were in 1470) [ClassicSimilarity], result of:
           0.030745694 = score(doc=1470,freq=4.0), product of:
             0.06706655 = queryWeight, product of:
               1.214076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015062316 = queryNorm
             0.4584356 = fieldWeight in 1470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.021757904 = weight(abstract_txt:each in 1470) [ClassicSimilarity], result of:
           0.021757904 = score(doc=1470,freq=1.0), product of:
             0.084543675 = queryWeight, product of:
               1.3631179 = boost
               4.1177115 = idf(docFreq=1965, maxDocs=44421)
               0.015062316 = queryNorm
             0.25735697 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1177115 = idf(docFreq=1965, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.026601246 = weight(abstract_txt:three in 1470) [ClassicSimilarity], result of:
           0.026601246 = score(doc=1470,freq=1.0), product of:
             0.096665405 = queryWeight, product of:
               1.4575666 = boost
               4.4030223 = idf(docFreq=1477, maxDocs=44421)
               0.015062316 = queryNorm
             0.2751889 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4030223 = idf(docFreq=1477, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.049751516 = weight(abstract_txt:measures in 1470) [ClassicSimilarity], result of:
           0.049751516 = score(doc=1470,freq=1.0), product of:
             0.14673734 = queryWeight, product of:
               1.7958217 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.015062316 = queryNorm
             0.3390515 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.052222956 = weight(abstract_txt:engine in 1470) [ClassicSimilarity], result of:
           0.052222956 = score(doc=1470,freq=1.0), product of:
             0.15155749 = queryWeight, product of:
               1.8250787 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.015062316 = queryNorm
             0.34457523 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.06844499 = weight(abstract_txt:results in 1470) [ClassicSimilarity], result of:
           0.06844499 = score(doc=1470,freq=5.0), product of:
             0.14078826 = queryWeight, product of:
               2.6869805 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.015062316 = queryNorm
             0.4861555 = fieldWeight in 1470, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.14341411 = weight(abstract_txt:search in 1470) [ClassicSimilarity], result of:
           0.14341411 = score(doc=1470,freq=8.0), product of:
             0.22198685 = queryWeight, product of:
               4.0326996 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.015062316 = queryNorm
             0.6460478 = fieldWeight in 1470, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.21524686 = weight(abstract_txt:engines in 1470) [ClassicSimilarity], result of:
           0.21524686 = score(doc=1470,freq=4.0), product of:
             0.32553667 = queryWeight, product of:
               4.085839 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.015062316 = queryNorm
             0.6612062 = fieldWeight in 1470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.6071119 = weight(abstract_txt:rankings in 1470) [ClassicSimilarity], result of:
           0.6071119 = score(doc=1470,freq=4.0), product of:
             0.7066472 = queryWeight, product of:
               6.82582 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015062316 = queryNorm
             0.8591442 = fieldWeight in 1470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
       0.48 = coord(12/25)
   

3. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 0.51

   0.51381403 = sum of:
     0.51381403 = product of:
       0.988104 = sum of:
         0.024137074 = weight(abstract_txt:queries in 4071) [ClassicSimilarity], result of:
           0.024137074 = score(doc=4071,freq=1.0), product of:
             0.08651479 = queryWeight, product of:
               1.1258808 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.015062316 = queryNorm
             0.2789936 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.019022927 = weight(abstract_txt:were in 4071) [ClassicSimilarity], result of:
           0.019022927 = score(doc=4071,freq=2.0), product of:
             0.06706655 = queryWeight, product of:
               1.214076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015062316 = queryNorm
             0.28364253 = fieldWeight in 4071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.0450683 = weight(abstract_txt:ranking in 4071) [ClassicSimilarity], result of:
           0.0450683 = score(doc=4071,freq=2.0), product of:
             0.10412095 = queryWeight, product of:
               1.2351403 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.015062316 = queryNorm
             0.43284568 = fieldWeight in 4071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.045394816 = weight(abstract_txt:compare in 4071) [ClassicSimilarity], result of:
           0.045394816 = score(doc=4071,freq=2.0), product of:
             0.104623236 = queryWeight, product of:
               1.238116 = boost
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.015062316 = queryNorm
             0.43388847 = fieldWeight in 4071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.015081016 = weight(abstract_txt:paper in 4071) [ClassicSimilarity], result of:
           0.015081016 = score(doc=4071,freq=1.0), product of:
             0.07966442 = queryWeight, product of:
               1.5278983 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.015062316 = queryNorm
             0.18930681 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.043532576 = weight(abstract_txt:measures in 4071) [ClassicSimilarity], result of:
           0.043532576 = score(doc=4071,freq=1.0), product of:
             0.14673734 = queryWeight, product of:
               1.7958217 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.015062316 = queryNorm
             0.29667008 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.04569509 = weight(abstract_txt:engine in 4071) [ClassicSimilarity], result of:
           0.04569509 = score(doc=4071,freq=1.0), product of:
             0.15155749 = queryWeight, product of:
               1.8250787 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.015062316 = queryNorm
             0.30150333 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.04809337 = weight(abstract_txt:over in 4071) [ClassicSimilarity], result of:
           0.04809337 = score(doc=4071,freq=3.0), product of:
             0.11967231 = queryWeight, product of:
               1.8726606 = boost
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.015062316 = queryNorm
             0.4018755 = fieldWeight in 4071, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.242705 = idf(docFreq=1734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.046390098 = weight(abstract_txt:results in 4071) [ClassicSimilarity], result of:
           0.046390098 = score(doc=4071,freq=3.0), product of:
             0.14078826 = queryWeight, product of:
               2.6869805 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.015062316 = queryNorm
             0.3295026 = fieldWeight in 4071, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.06850429 = weight(abstract_txt:changes in 4071) [ClassicSimilarity], result of:
           0.06850429 = score(doc=4071,freq=1.0), product of:
             0.25012258 = queryWeight, product of:
               3.3157694 = boost
               5.008144 = idf(docFreq=806, maxDocs=44421)
               0.015062316 = queryNorm
             0.27388287 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.008144 = idf(docFreq=806, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.11738265 = weight(abstract_txt:search in 4071) [ClassicSimilarity], result of:
           0.11738265 = score(doc=4071,freq=7.0), product of:
             0.22198685 = queryWeight, product of:
               4.0326996 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.015062316 = queryNorm
             0.528782 = fieldWeight in 4071, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.094170496 = weight(abstract_txt:engines in 4071) [ClassicSimilarity], result of:
           0.094170496 = score(doc=4071,freq=1.0), product of:
             0.32553667 = queryWeight, product of:
               4.085839 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.015062316 = queryNorm
             0.2892777 = fieldWeight in 4071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
         0.3756313 = weight(abstract_txt:rankings in 4071) [ClassicSimilarity], result of:
           0.3756313 = score(doc=4071,freq=2.0), product of:
             0.7066472 = queryWeight, product of:
               6.82582 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015062316 = queryNorm
             0.53156835 = fieldWeight in 4071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4071)
       0.52 = coord(13/25)
   

4. Spink, A.; Jansen, B.J.; Blakely, C.; Koshman, S.: ¬A study of results overlap and uniqueness among major Web search engines (2006) 0.49

   0.4875238 = sum of:
     0.4875238 = product of:
       1.0156746 = sum of:
         0.025972962 = weight(abstract_txt:major in 1993) [ClassicSimilarity], result of:
           0.025972962 = score(doc=1993,freq=2.0), product of:
             0.07210604 = queryWeight, product of:
               1.0278579 = boost
               4.657435 = idf(docFreq=1145, maxDocs=44421)
               0.015062316 = queryNorm
             0.36020508 = fieldWeight in 1993, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.657435 = idf(docFreq=1145, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.06826995 = weight(abstract_txt:queries in 1993) [ClassicSimilarity], result of:
           0.06826995 = score(doc=1993,freq=8.0), product of:
             0.08651479 = queryWeight, product of:
               1.1258808 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.015062316 = queryNorm
             0.78911304 = fieldWeight in 1993, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.02417577 = weight(abstract_txt:shows in 1993) [ClassicSimilarity], result of:
           0.02417577 = score(doc=1993,freq=1.0), product of:
             0.08660723 = queryWeight, product of:
               1.1264822 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.015062316 = queryNorm
             0.27914262 = fieldWeight in 1993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.028038757 = weight(abstract_txt:google in 1993) [ClassicSimilarity], result of:
           0.028038757 = score(doc=1993,freq=1.0), product of:
             0.095603354 = queryWeight, product of:
               1.1835424 = boost
               5.3628736 = idf(docFreq=565, maxDocs=44421)
               0.015062316 = queryNorm
             0.29328215 = fieldWeight in 1993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3628736 = idf(docFreq=565, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.019022927 = weight(abstract_txt:were in 1993) [ClassicSimilarity], result of:
           0.019022927 = score(doc=1993,freq=2.0), product of:
             0.06706655 = queryWeight, product of:
               1.214076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015062316 = queryNorm
             0.28364253 = fieldWeight in 1993, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.03291736 = weight(abstract_txt:three in 1993) [ClassicSimilarity], result of:
           0.03291736 = score(doc=1993,freq=2.0), product of:
             0.096665405 = queryWeight, product of:
               1.4575666 = boost
               4.4030223 = idf(docFreq=1477, maxDocs=44421)
               0.015062316 = queryNorm
             0.34052888 = fieldWeight in 1993, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4030223 = idf(docFreq=1477, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.015081016 = weight(abstract_txt:paper in 1993) [ClassicSimilarity], result of:
           0.015081016 = score(doc=1993,freq=1.0), product of:
             0.07966442 = queryWeight, product of:
               1.5278983 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.015062316 = queryNorm
             0.18930681 = fieldWeight in 1993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.12194179 = weight(abstract_txt:overlap in 1993) [ClassicSimilarity], result of:
           0.12194179 = score(doc=1993,freq=4.0), product of:
             0.16046575 = queryWeight, product of:
               1.5333399 = boost
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.015062316 = queryNorm
             0.7599241 = fieldWeight in 1993, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.9478774 = idf(docFreq=115, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.06462261 = weight(abstract_txt:engine in 1993) [ClassicSimilarity], result of:
           0.06462261 = score(doc=1993,freq=2.0), product of:
             0.15155749 = queryWeight, product of:
               1.8250787 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.015062316 = queryNorm
             0.42639008 = fieldWeight in 1993, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.08035001 = weight(abstract_txt:results in 1993) [ClassicSimilarity], result of:
           0.08035001 = score(doc=1993,freq=9.0), product of:
             0.14078826 = queryWeight, product of:
               2.6869805 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.015062316 = queryNorm
             0.5707153 = fieldWeight in 1993, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.18292767 = weight(abstract_txt:search in 1993) [ClassicSimilarity], result of:
           0.18292767 = score(doc=1993,freq=17.0), product of:
             0.22198685 = queryWeight, product of:
               4.0326996 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.015062316 = queryNorm
             0.8240473 = fieldWeight in 1993, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
         0.35235378 = weight(abstract_txt:engines in 1993) [ClassicSimilarity], result of:
           0.35235378 = score(doc=1993,freq=14.0), product of:
             0.32553667 = queryWeight, product of:
               4.085839 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.015062316 = queryNorm
             1.0823781 = fieldWeight in 1993, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1993)
       0.48 = coord(12/25)
   

5. Vaughan, L.: New measurements for search engine evaluation proposed and tested (2004) 0.42

   0.41597095 = sum of:
     0.41597095 = product of:
       1.1554748 = sum of:
         0.04806644 = weight(abstract_txt:google in 3535) [ClassicSimilarity], result of:
           0.04806644 = score(doc=3535,freq=1.0), product of:
             0.095603354 = queryWeight, product of:
               1.1835424 = boost
               5.3628736 = idf(docFreq=565, maxDocs=44421)
               0.015062316 = queryNorm
             0.5027694 = fieldWeight in 3535, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3628736 = idf(docFreq=565, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
         0.023059271 = weight(abstract_txt:were in 3535) [ClassicSimilarity], result of:
           0.023059271 = score(doc=3535,freq=1.0), product of:
             0.06706655 = queryWeight, product of:
               1.214076 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015062316 = queryNorm
             0.3438267 = fieldWeight in 3535, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
         0.05502683 = weight(abstract_txt:compare in 3535) [ClassicSimilarity], result of:
           0.05502683 = score(doc=3535,freq=1.0), product of:
             0.104623236 = queryWeight, product of:
               1.238116 = boost
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.015062316 = queryNorm
             0.5259523 = fieldWeight in 3535, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
         0.039901868 = weight(abstract_txt:three in 3535) [ClassicSimilarity], result of:
           0.039901868 = score(doc=3535,freq=1.0), product of:
             0.096665405 = queryWeight, product of:
               1.4575666 = boost
               4.4030223 = idf(docFreq=1477, maxDocs=44421)
               0.015062316 = queryNorm
             0.41278332 = fieldWeight in 3535, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4030223 = idf(docFreq=1477, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
         0.15666887 = weight(abstract_txt:engine in 3535) [ClassicSimilarity], result of:
           0.15666887 = score(doc=3535,freq=4.0), product of:
             0.15155749 = queryWeight, product of:
               1.8250787 = boost
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.015062316 = queryNorm
             1.0337257 = fieldWeight in 3535, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.5132036 = idf(docFreq=486, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
         0.045914292 = weight(abstract_txt:results in 3535) [ClassicSimilarity], result of:
           0.045914292 = score(doc=3535,freq=1.0), product of:
             0.14078826 = queryWeight, product of:
               2.6869805 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.015062316 = queryNorm
             0.32612303 = fieldWeight in 3535, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
         0.1700682 = weight(abstract_txt:search in 3535) [ClassicSimilarity], result of:
           0.1700682 = score(doc=3535,freq=5.0), product of:
             0.22198685 = queryWeight, product of:
               4.0326996 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.015062316 = queryNorm
             0.7661184 = fieldWeight in 3535, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
         0.16143514 = weight(abstract_txt:engines in 3535) [ClassicSimilarity], result of:
           0.16143514 = score(doc=3535,freq=1.0), product of:
             0.32553667 = queryWeight, product of:
               4.085839 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.015062316 = queryNorm
             0.49590462 = fieldWeight in 3535, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
         0.4553339 = weight(abstract_txt:rankings in 3535) [ClassicSimilarity], result of:
           0.4553339 = score(doc=3535,freq=1.0), product of:
             0.7066472 = queryWeight, product of:
               6.82582 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015062316 = queryNorm
             0.64435816 = fieldWeight in 3535, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.09375 = fieldNorm(doc=3535)
       0.36 = coord(9/25)