Document (#34704)

Author

Bar-Ilan, J.
Keenoy, K.
Levene, M.
Yaari, E.

Title

Presentation bias is significant in determining user preference for search results : a user study

Source

Journal of the American Society for Information Science and Technology. 60(2009) no.1, S.135-149

Year

2009

Abstract

We describe the results of an experiment designed to study user preferences for different orderings of search results from three major search engines. In the experiment, 65 users were asked to choose the best ordering from two different orderings of the same set of search results: Each pair consisted of the search engine's original top-10 ordering and a synthetic ordering created from the same top-10 results retrieved by the search engine. This process was repeated for 12 queries and nine different synthetic orderings. The results show that there is a slight overall preference for the search engines' original orderings, but the preference is rarely significant. Users' choice of the best result from each of the different orderings indicates that placement on the page (i.e., whether the result appears near the top) is the most important factor used in determining the quality of the result, not the actual content displayed in the top-10 snippets. In addition to the placement bias, we detected a small bias due to the reputation of the sites appearing in the search results.

Similar documents (author)

1. Bar-Ilan, J.; Levene, M.: ¬The hw-rank : an h-index variant for ranking web pages (2015) 5.41

   5.411173 = sum of:
     5.411173 = sum of:
       2.1073067 = weight(author_txt:ilan in 2694) [ClassicSimilarity], result of:
         2.1073067 = score(doc=2694,freq=1.0), product of:
           0.5953491 = queryWeight, product of:
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.07358574 = queryNorm
           3.5396154 = fieldWeight in 2694, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.4375 = fieldNorm(doc=2694)
       3.3038661 = weight(author_txt:levene in 2694) [ClassicSimilarity], result of:
         3.3038661 = score(doc=2694,freq=1.0), product of:
           0.80346715 = queryWeight, product of:
             1.1617113 = boost
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07358574 = queryNorm
           4.1120114 = fieldWeight in 2694, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.4375 = fieldNorm(doc=2694)
   

2. Bar-Ilan, J.; Levene, M.; Mat-Hassan, M.: Methods for evaluating dynamic changes in search engine rankings : a case study (2006) 3.87

   3.8651233 = sum of:
     3.8651233 = sum of:
       1.5052191 = weight(author_txt:ilan in 741) [ClassicSimilarity], result of:
         1.5052191 = score(doc=741,freq=1.0), product of:
           0.5953491 = queryWeight, product of:
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.07358574 = queryNorm
           2.5282967 = fieldWeight in 741, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.3125 = fieldNorm(doc=741)
       2.3599043 = weight(author_txt:levene in 741) [ClassicSimilarity], result of:
         2.3599043 = score(doc=741,freq=1.0), product of:
           0.80346715 = queryWeight, product of:
             1.1617113 = boost
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07358574 = queryNorm
           2.937151 = fieldWeight in 741, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.3125 = fieldNorm(doc=741)
   

3. Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007) 3.87

   3.8651233 = sum of:
     3.8651233 = sum of:
       1.5052191 = weight(author_txt:ilan in 1470) [ClassicSimilarity], result of:
         1.5052191 = score(doc=1470,freq=1.0), product of:
           0.5953491 = queryWeight, product of:
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.07358574 = queryNorm
           2.5282967 = fieldWeight in 1470, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.3125 = fieldNorm(doc=1470)
       2.3599043 = weight(author_txt:levene in 1470) [ClassicSimilarity], result of:
         2.3599043 = score(doc=1470,freq=1.0), product of:
           0.80346715 = queryWeight, product of:
             1.1617113 = boost
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07358574 = queryNorm
           2.937151 = fieldWeight in 1470, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.3125 = fieldNorm(doc=1470)
   

4. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 3.87

   3.8651233 = sum of:
     3.8651233 = sum of:
       1.5052191 = weight(author_txt:ilan in 4071) [ClassicSimilarity], result of:
         1.5052191 = score(doc=4071,freq=1.0), product of:
           0.5953491 = queryWeight, product of:
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.07358574 = queryNorm
           2.5282967 = fieldWeight in 4071, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.3125 = fieldNorm(doc=4071)
       2.3599043 = weight(author_txt:levene in 4071) [ClassicSimilarity], result of:
         2.3599043 = score(doc=4071,freq=1.0), product of:
           0.80346715 = queryWeight, product of:
             1.1617113 = boost
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07358574 = queryNorm
           2.937151 = fieldWeight in 4071, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.3125 = fieldNorm(doc=4071)
   

5. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Analysis of change in users' assessment of search results over time (2017) 3.87

   3.8651233 = sum of:
     3.8651233 = sum of:
       1.5052191 = weight(author_txt:ilan in 4593) [ClassicSimilarity], result of:
         1.5052191 = score(doc=4593,freq=1.0), product of:
           0.5953491 = queryWeight, product of:
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.07358574 = queryNorm
           2.5282967 = fieldWeight in 4593, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.3125 = fieldNorm(doc=4593)
       2.3599043 = weight(author_txt:levene in 4593) [ClassicSimilarity], result of:
         2.3599043 = score(doc=4593,freq=1.0), product of:
           0.80346715 = queryWeight, product of:
             1.1617113 = boost
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07358574 = queryNorm
           2.937151 = fieldWeight in 4593, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.3125 = fieldNorm(doc=4593)
   

Similar documents (content)

1. Moffat, A.; Mackenzie, J.: How much freedom does an effectiveness metric really have? (2024) 0.19

   0.18776914 = sum of:
     0.18776914 = product of:
       0.6706041 = sum of:
         0.02199616 = weight(abstract_txt:same in 2289) [ClassicSimilarity], result of:
           0.02199616 = score(doc=2289,freq=1.0), product of:
             0.07421624 = queryWeight, product of:
               1.2175629 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.01285404 = queryNorm
             0.29637933 = fieldWeight in 2289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=2289)
         0.02022187 = weight(abstract_txt:different in 2289) [ClassicSimilarity], result of:
           0.02022187 = score(doc=2289,freq=1.0), product of:
             0.088408075 = queryWeight, product of:
               1.8793293 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.01285404 = queryNorm
             0.2287333 = fieldWeight in 2289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=2289)
         0.04091856 = weight(abstract_txt:result in 2289) [ClassicSimilarity], result of:
           0.04091856 = score(doc=2289,freq=1.0), product of:
             0.12850253 = queryWeight, product of:
               1.9622006 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.01285404 = queryNorm
             0.3184261 = fieldWeight in 2289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.0625 = fieldNorm(doc=2289)
         0.101531185 = weight(abstract_txt:ordering in 2289) [ClassicSimilarity], result of:
           0.101531185 = score(doc=2289,freq=1.0), product of:
             0.2355218 = queryWeight, product of:
               2.656459 = boost
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.01285404 = queryNorm
             0.4310904 = fieldWeight in 2289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.0625 = fieldNorm(doc=2289)
         0.030390775 = weight(abstract_txt:results in 2289) [ClassicSimilarity], result of:
           0.030390775 = score(doc=2289,freq=1.0), product of:
             0.1397821 = queryWeight, product of:
               3.126092 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.01285404 = queryNorm
             0.21741535 = fieldWeight in 2289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=2289)
         0.04027374 = weight(abstract_txt:search in 2289) [ClassicSimilarity], result of:
           0.04027374 = score(doc=2289,freq=1.0), product of:
             0.17632031 = queryWeight, product of:
               3.753385 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01285404 = queryNorm
             0.22841237 = fieldWeight in 2289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=2289)
         0.41527182 = weight(abstract_txt:orderings in 2289) [ClassicSimilarity], result of:
           0.41527182 = score(doc=2289,freq=1.0), product of:
             0.71417177 = queryWeight, product of:
               5.9719105 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.01285404 = queryNorm
             0.5814733 = fieldWeight in 2289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0625 = fieldNorm(doc=2289)
       0.28 = coord(7/25)
   

2. Losee, R.M.: When information retrieval measures agree about the relative quality of document rankings (2000) 0.17

   0.16664147 = sum of:
     0.16664147 = product of:
       0.83320737 = sum of:
         0.038162243 = weight(abstract_txt:engines in 5860) [ClassicSimilarity], result of:
           0.038162243 = score(doc=5860,freq=1.0), product of:
             0.09234576 = queryWeight, product of:
               1.3581583 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.01285404 = queryNorm
             0.41325387 = fieldWeight in 5860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.078125 = fieldNorm(doc=5860)
         0.025277339 = weight(abstract_txt:different in 5860) [ClassicSimilarity], result of:
           0.025277339 = score(doc=5860,freq=1.0), product of:
             0.088408075 = queryWeight, product of:
               1.8793293 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.01285404 = queryNorm
             0.28591663 = fieldWeight in 5860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.078125 = fieldNorm(doc=5860)
         0.17948347 = weight(abstract_txt:ordering in 5860) [ClassicSimilarity], result of:
           0.17948347 = score(doc=5860,freq=2.0), product of:
             0.2355218 = queryWeight, product of:
               2.656459 = boost
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.01285404 = queryNorm
             0.7620674 = fieldWeight in 5860, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.078125 = fieldNorm(doc=5860)
         0.07119459 = weight(abstract_txt:search in 5860) [ClassicSimilarity], result of:
           0.07119459 = score(doc=5860,freq=2.0), product of:
             0.17632031 = queryWeight, product of:
               3.753385 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01285404 = queryNorm
             0.40377986 = fieldWeight in 5860, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=5860)
         0.51908976 = weight(abstract_txt:orderings in 5860) [ClassicSimilarity], result of:
           0.51908976 = score(doc=5860,freq=1.0), product of:
             0.71417177 = queryWeight, product of:
               5.9719105 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.01285404 = queryNorm
             0.7268416 = fieldWeight in 5860, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.078125 = fieldNorm(doc=5860)
       0.2 = coord(5/25)
   

3. Spina, D.; Trippas, J.R.; Cavedon, L.; Sanderson, M.: Extracting audio summaries to support effective spoken document search (2017) 0.16

   0.16497576 = sum of:
     0.16497576 = product of:
       0.458266 = sum of:
         0.09377725 = weight(abstract_txt:snippets in 4788) [ClassicSimilarity], result of:
           0.09377725 = score(doc=4788,freq=1.0), product of:
             0.1334697 = queryWeight, product of:
               1.1545647 = boost
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.01285404 = queryNorm
             0.70261073 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.027495198 = weight(abstract_txt:same in 4788) [ClassicSimilarity], result of:
           0.027495198 = score(doc=4788,freq=1.0), product of:
             0.07421624 = queryWeight, product of:
               1.2175629 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.01285404 = queryNorm
             0.37047416 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.027745511 = weight(abstract_txt:significant in 4788) [ClassicSimilarity], result of:
           0.027745511 = score(doc=4788,freq=1.0), product of:
             0.07466599 = queryWeight, product of:
               1.2212466 = boost
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.01285404 = queryNorm
             0.37159503 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7564163 = idf(docFreq=1037, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.021669887 = weight(abstract_txt:from in 4788) [ClassicSimilarity], result of:
           0.021669887 = score(doc=4788,freq=4.0), product of:
             0.05025996 = queryWeight, product of:
               1.416994 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.01285404 = queryNorm
             0.4311561 = fieldWeight in 4788, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.019288363 = weight(abstract_txt:user in 4788) [ClassicSimilarity], result of:
           0.019288363 = score(doc=4788,freq=1.0), product of:
             0.06707413 = queryWeight, product of:
               1.4176371 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.01285404 = queryNorm
             0.28756785 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.046723377 = weight(abstract_txt:experiment in 4788) [ClassicSimilarity], result of:
           0.046723377 = score(doc=4788,freq=1.0), product of:
             0.10568593 = queryWeight, product of:
               1.4529495 = boost
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.01285404 = queryNorm
             0.44209647 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.13323575 = weight(abstract_txt:preference in 4788) [ClassicSimilarity], result of:
           0.13323575 = score(doc=4788,freq=1.0), product of:
             0.24327938 = queryWeight, product of:
               2.6998537 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.01285404 = queryNorm
             0.5476656 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.03798847 = weight(abstract_txt:results in 4788) [ClassicSimilarity], result of:
           0.03798847 = score(doc=4788,freq=1.0), product of:
             0.1397821 = queryWeight, product of:
               3.126092 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.01285404 = queryNorm
             0.2717692 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
         0.050342176 = weight(abstract_txt:search in 4788) [ClassicSimilarity], result of:
           0.050342176 = score(doc=4788,freq=1.0), product of:
             0.17632031 = queryWeight, product of:
               3.753385 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01285404 = queryNorm
             0.28551546 = fieldWeight in 4788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=4788)
       0.36 = coord(9/25)
   

4. Paramita, M.L.; Kasinidou, M.; Kleanthous, S.; Rosso, P.; Kuflik, T.; Hopfgartner, F.: Towards improving user awareness of search engine biases : a participatory design approach (2024) 0.16

   0.16457456 = sum of:
     0.16457456 = product of:
       0.5142955 = sum of:
         0.014401606 = weight(abstract_txt:each in 2274) [ClassicSimilarity], result of:
           0.014401606 = score(doc=2274,freq=1.0), product of:
             0.05595965 = queryWeight, product of:
               1.0572542 = boost
               4.1177115 = idf(docFreq=1965, maxDocs=44421)
               0.01285404 = queryNorm
             0.25735697 = fieldWeight in 2274, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1177115 = idf(docFreq=1965, maxDocs=44421)
               0.0625 = fieldNorm(doc=2274)
         0.074782416 = weight(abstract_txt:engines in 2274) [ClassicSimilarity], result of:
           0.074782416 = score(doc=2274,freq=6.0), product of:
             0.09234576 = queryWeight, product of:
               1.3581583 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.01285404 = queryNorm
             0.8098089 = fieldWeight in 2274, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=2274)
         0.03450407 = weight(abstract_txt:user in 2274) [ClassicSimilarity], result of:
           0.03450407 = score(doc=2274,freq=5.0), product of:
             0.06707413 = queryWeight, product of:
               1.4176371 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.01285404 = queryNorm
             0.514417 = fieldWeight in 2274, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=2274)
         0.02022187 = weight(abstract_txt:different in 2274) [ClassicSimilarity], result of:
           0.02022187 = score(doc=2274,freq=1.0), product of:
             0.088408075 = queryWeight, product of:
               1.8793293 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.01285404 = queryNorm
             0.2287333 = fieldWeight in 2274, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.0625 = fieldNorm(doc=2274)
         0.04091856 = weight(abstract_txt:result in 2274) [ClassicSimilarity], result of:
           0.04091856 = score(doc=2274,freq=1.0), product of:
             0.12850253 = queryWeight, product of:
               1.9622006 = boost
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.01285404 = queryNorm
             0.3184261 = fieldWeight in 2274, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0948176 = idf(docFreq=739, maxDocs=44421)
               0.0625 = fieldNorm(doc=2274)
         0.14786422 = weight(abstract_txt:bias in 2274) [ClassicSimilarity], result of:
           0.14786422 = score(doc=2274,freq=2.0), product of:
             0.24017632 = queryWeight, product of:
               2.68258 = boost
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.01285404 = queryNorm
             0.6156486 = fieldWeight in 2274, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.0625 = fieldNorm(doc=2274)
         0.06078155 = weight(abstract_txt:results in 2274) [ClassicSimilarity], result of:
           0.06078155 = score(doc=2274,freq=4.0), product of:
             0.1397821 = queryWeight, product of:
               3.126092 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.01285404 = queryNorm
             0.4348307 = fieldWeight in 2274, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=2274)
         0.12082122 = weight(abstract_txt:search in 2274) [ClassicSimilarity], result of:
           0.12082122 = score(doc=2274,freq=9.0), product of:
             0.17632031 = queryWeight, product of:
               3.753385 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01285404 = queryNorm
             0.6852371 = fieldWeight in 2274, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=2274)
       0.32 = coord(8/25)
   

5. Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007) 0.16

   0.15527032 = sum of:
     0.15527032 = product of:
       0.43130642 = sum of:
         0.014401606 = weight(abstract_txt:each in 1470) [ClassicSimilarity], result of:
           0.014401606 = score(doc=1470,freq=1.0), product of:
             0.05595965 = queryWeight, product of:
               1.0572542 = boost
               4.1177115 = idf(docFreq=1965, maxDocs=44421)
               0.01285404 = queryNorm
             0.25735697 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1177115 = idf(docFreq=1965, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.075021796 = weight(abstract_txt:snippets in 1470) [ClassicSimilarity], result of:
           0.075021796 = score(doc=1470,freq=1.0), product of:
             0.1334697 = queryWeight, product of:
               1.1545647 = boost
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.01285404 = queryNorm
             0.5620886 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.02199616 = weight(abstract_txt:same in 1470) [ClassicSimilarity], result of:
           0.02199616 = score(doc=1470,freq=1.0), product of:
             0.07421624 = queryWeight, product of:
               1.2175629 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.01285404 = queryNorm
             0.29637933 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.061059587 = weight(abstract_txt:engines in 1470) [ClassicSimilarity], result of:
           0.061059587 = score(doc=1470,freq=4.0), product of:
             0.09234576 = queryWeight, product of:
               1.3581583 = boost
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.01285404 = queryNorm
             0.6612062 = fieldWeight in 1470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.2896495 = idf(docFreq=608, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.008667955 = weight(abstract_txt:from in 1470) [ClassicSimilarity], result of:
           0.008667955 = score(doc=1470,freq=1.0), product of:
             0.05025996 = queryWeight, product of:
               1.416994 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.01285404 = queryNorm
             0.17246243 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.01543069 = weight(abstract_txt:user in 1470) [ClassicSimilarity], result of:
           0.01543069 = score(doc=1470,freq=1.0), product of:
             0.06707413 = queryWeight, product of:
               1.4176371 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.01285404 = queryNorm
             0.23005427 = fieldWeight in 1470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.052861463 = weight(abstract_txt:experiment in 1470) [ClassicSimilarity], result of:
           0.052861463 = score(doc=1470,freq=2.0), product of:
             0.10568593 = queryWeight, product of:
               1.4529495 = boost
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.01285404 = queryNorm
             0.50017506 = fieldWeight in 1470, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.658835 = idf(docFreq=420, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.06795584 = weight(abstract_txt:results in 1470) [ClassicSimilarity], result of:
           0.06795584 = score(doc=1470,freq=5.0), product of:
             0.1397821 = queryWeight, product of:
               3.126092 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.01285404 = queryNorm
             0.4861555 = fieldWeight in 1470, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
         0.113911346 = weight(abstract_txt:search in 1470) [ClassicSimilarity], result of:
           0.113911346 = score(doc=1470,freq=8.0), product of:
             0.17632031 = queryWeight, product of:
               3.753385 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.01285404 = queryNorm
             0.6460478 = fieldWeight in 1470, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=1470)
       0.36 = coord(9/25)