Document (#37380)

Author

Balatsoukas, P.
Ruthven, I.

Title

¬An eye-tracking approach to the analysis of relevance judgments on the Web : the case of Google search engine

Source

Journal of the American Society for Information Science and Technology. 63(2012) no.9, S.1728-1746

Year

2012

Abstract

Eye movement data can provide an in-depth view of human reasoning and the decision-making process, and modern information retrieval (IR) research can benefit from the analysis of this type of data. The aim of this research was to examine the relationship between relevance criteria use and visual behavior in the context of predictive relevance judgments. To address this objective, a multimethod research design was employed that involved observation of participants' eye movements, talk-aloud protocols, and postsearch interviews. Specifically, the results reported in this article came from the analysis of 281 predictive relevance judgments made by 24 participants using the Google search engine. We present a novel stepwise methodological framework for the analysis of relevance judgments and eye movements on the Web and show new patterns of relevance criteria use during predictive relevance judgment. For example, the findings showed an effect of ranking order and surrogate components (Title, Summary, and URL) on the use of relevance criteria. Also, differences were observed in the cognitive effort spent between very relevant and not relevant judgments. We conclude with the implications of this study for IR research.

Theme

Benutzerstudien

Object

Google

Similar documents (author)

1. Balatsoukas, P.; Demian, P.: Effects of granularity of search results on the relevance judgment behavior of engineers : building systems for retrieval and understanding of context (2010) 2.05

   2.0527072 = sum of:
     2.0527072 = product of:
       4.1054144 = sum of:
         4.1054144 = weight(author_txt:balatsoukas in 406) [ClassicSimilarity], result of:
           4.1054144 = score(doc=406,freq=1.0), product of:
             0.8285641 = queryWeight, product of:
               1.2164943 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.0687314 = queryNorm
             4.954854 = fieldWeight in 406, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.5 = fieldNorm(doc=406)
       0.5 = coord(1/2)
   

2. Garoufallou, E.; Siatri, R.; Balatsoukas, P.: Virtual maps-virtual worlds : testing the usability of a greek virtual cultural map (2008) 1.54

   1.5395303 = sum of:
     1.5395303 = product of:
       3.0790606 = sum of:
         3.0790606 = weight(author_txt:balatsoukas in 2379) [ClassicSimilarity], result of:
           3.0790606 = score(doc=2379,freq=1.0), product of:
             0.8285641 = queryWeight, product of:
               1.2164943 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.0687314 = queryNorm
             3.7161405 = fieldWeight in 2379, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.375 = fieldNorm(doc=2379)
       0.5 = coord(1/2)
   

3. Gaitanou, P.; Garoufallou, E.; Balatsoukas, P.: ¬The effectiveness of big data in health care : a systematic review (2014) 1.54

   1.5395303 = sum of:
     1.5395303 = product of:
       3.0790606 = sum of:
         3.0790606 = weight(author_txt:balatsoukas in 2579) [ClassicSimilarity], result of:
           3.0790606 = score(doc=2579,freq=1.0), product of:
             0.8285641 = queryWeight, product of:
               1.2164943 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.0687314 = queryNorm
             3.7161405 = fieldWeight in 2579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.375 = fieldNorm(doc=2579)
       0.5 = coord(1/2)
   

4. Ruthven, R.: Interactive information retrieval (2008) 1.43

   1.4253013 = sum of:
     1.4253013 = product of:
       2.8506026 = sum of:
         2.8506026 = weight(author_txt:ruthven in 2838) [ClassicSimilarity], result of:
           2.8506026 = score(doc=2838,freq=1.0), product of:
             0.55989414 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.0687314 = queryNorm
             5.0913243 = fieldWeight in 2838, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.625 = fieldNorm(doc=2838)
       0.5 = coord(1/2)
   

5. Ruthven, I.: Integrating approaches to relevance (2005) 1.43

   1.4253013 = sum of:
     1.4253013 = product of:
       2.8506026 = sum of:
         2.8506026 = weight(author_txt:ruthven in 763) [ClassicSimilarity], result of:
           2.8506026 = score(doc=763,freq=1.0), product of:
             0.55989414 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.0687314 = queryNorm
             5.0913243 = fieldWeight in 763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.625 = fieldNorm(doc=763)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Taylor, A.: User relevance criteria choices and the information search process (2012) 0.42

   0.42289597 = sum of:
     0.42289597 = product of:
       1.174711 = sum of:
         0.015497309 = weight(abstract_txt:between in 3745) [ClassicSimilarity], result of:
           0.015497309 = score(doc=3745,freq=2.0), product of:
             0.05071216 = queryWeight, product of:
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.014667732 = queryNorm
             0.30559355 = fieldWeight in 3745, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
         0.03660645 = weight(abstract_txt:search in 3745) [ClassicSimilarity], result of:
           0.03660645 = score(doc=3745,freq=8.0), product of:
             0.056662142 = queryWeight, product of:
               1.0570376 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014667732 = queryNorm
             0.6460478 = fieldWeight in 3745, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
         0.0900447 = weight(abstract_txt:judgment in 3745) [ClassicSimilarity], result of:
           0.0900447 = score(doc=3745,freq=3.0), product of:
             0.11364219 = queryWeight, product of:
               1.0585192 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.014667732 = queryNorm
             0.7923527 = fieldWeight in 3745, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
         0.009235232 = weight(abstract_txt:this in 3745) [ClassicSimilarity], result of:
           0.009235232 = score(doc=3745,freq=1.0), product of:
             0.061408684 = queryWeight, product of:
               1.7399182 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014667732 = queryNorm
             0.15038967 = fieldWeight in 3745, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
         0.016726792 = weight(abstract_txt:research in 3745) [ClassicSimilarity], result of:
           0.016726792 = score(doc=3745,freq=1.0), product of:
             0.084703825 = queryWeight, product of:
               1.8277233 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014667732 = queryNorm
             0.19747387 = fieldWeight in 3745, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
         0.025695538 = weight(abstract_txt:analysis in 3745) [ClassicSimilarity], result of:
           0.025695538 = score(doc=3745,freq=1.0), product of:
             0.11277159 = queryWeight, product of:
               2.1089137 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.014667732 = queryNorm
             0.2278547 = fieldWeight in 3745, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
         0.1677882 = weight(abstract_txt:criteria in 3745) [ClassicSimilarity], result of:
           0.1677882 = score(doc=3745,freq=6.0), product of:
             0.19698758 = queryWeight, product of:
               2.413843 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.014667732 = queryNorm
             0.8517704 = fieldWeight in 3745, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
         0.4319701 = weight(abstract_txt:judgments in 3745) [ClassicSimilarity], result of:
           0.4319701 = score(doc=3745,freq=4.0), product of:
             0.50220424 = queryWeight, product of:
               4.9756994 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.014667732 = queryNorm
             0.86014825 = fieldWeight in 3745, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
         0.38114667 = weight(abstract_txt:relevance in 3745) [ClassicSimilarity], result of:
           0.38114667 = score(doc=3745,freq=9.0), product of:
             0.4123682 = queryWeight, product of:
               5.7031727 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.014667732 = queryNorm
             0.92428726 = fieldWeight in 3745, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3745)
       0.36 = coord(9/25)
   

2. Hughes, B.; Wareham, J.; Joshi, I.: Doctors' online information needs, cognitive search strategies, and judgments of information quality and cognitive authority : how predictive judgments introduce bias into cognitive search models (2010) 0.32

   0.3233042 = sum of:
     0.3233042 = product of:
       1.0103257 = sum of:
         0.03660645 = weight(abstract_txt:search in 404) [ClassicSimilarity], result of:
           0.03660645 = score(doc=404,freq=8.0), product of:
             0.056662142 = queryWeight, product of:
               1.0570376 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014667732 = queryNorm
             0.6460478 = fieldWeight in 404, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=404)
         0.07352119 = weight(abstract_txt:judgment in 404) [ClassicSimilarity], result of:
           0.07352119 = score(doc=404,freq=2.0), product of:
             0.11364219 = queryWeight, product of:
               1.0585192 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.014667732 = queryNorm
             0.6469533 = fieldWeight in 404, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.0625 = fieldNorm(doc=404)
         0.026315222 = weight(abstract_txt:relevant in 404) [ClassicSimilarity], result of:
           0.026315222 = score(doc=404,freq=1.0), product of:
             0.09094021 = queryWeight, product of:
               1.3391274 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.014667732 = queryNorm
             0.2893684 = fieldWeight in 404, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=404)
         0.01306059 = weight(abstract_txt:this in 404) [ClassicSimilarity], result of:
           0.01306059 = score(doc=404,freq=2.0), product of:
             0.061408684 = queryWeight, product of:
               1.7399182 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014667732 = queryNorm
             0.21268311 = fieldWeight in 404, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=404)
         0.016726792 = weight(abstract_txt:research in 404) [ClassicSimilarity], result of:
           0.016726792 = score(doc=404,freq=1.0), product of:
             0.084703825 = queryWeight, product of:
               1.8277233 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014667732 = queryNorm
             0.19747387 = fieldWeight in 404, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=404)
         0.025695538 = weight(abstract_txt:analysis in 404) [ClassicSimilarity], result of:
           0.025695538 = score(doc=404,freq=1.0), product of:
             0.11277159 = queryWeight, product of:
               2.1089137 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.014667732 = queryNorm
             0.2278547 = fieldWeight in 404, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=404)
         0.28934672 = weight(abstract_txt:predictive in 404) [ClassicSimilarity], result of:
           0.28934672 = score(doc=404,freq=2.0), product of:
             0.40855518 = queryWeight, product of:
               3.4762814 = boost
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.014667732 = queryNorm
             0.70821947 = fieldWeight in 404, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.0625 = fieldNorm(doc=404)
         0.52905315 = weight(abstract_txt:judgments in 404) [ClassicSimilarity], result of:
           0.52905315 = score(doc=404,freq=6.0), product of:
             0.50220424 = queryWeight, product of:
               4.9756994 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.014667732 = queryNorm
             1.0534621 = fieldWeight in 404, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=404)
       0.32 = coord(8/25)
   

3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.32

   0.32312885 = sum of:
     0.32312885 = product of:
       1.0097777 = sum of:
         0.07352119 = weight(abstract_txt:judgment in 739) [ClassicSimilarity], result of:
           0.07352119 = score(doc=739,freq=2.0), product of:
             0.11364219 = queryWeight, product of:
               1.0585192 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.014667732 = queryNorm
             0.6469533 = fieldWeight in 739, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.06265898 = weight(abstract_txt:aloud in 739) [ClassicSimilarity], result of:
           0.06265898 = score(doc=739,freq=1.0), product of:
             0.12870541 = queryWeight, product of:
               1.12649 = boost
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.014667732 = queryNorm
             0.48684028 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.009235232 = weight(abstract_txt:this in 739) [ClassicSimilarity], result of:
           0.009235232 = score(doc=739,freq=1.0), product of:
             0.061408684 = queryWeight, product of:
               1.7399182 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014667732 = queryNorm
             0.15038967 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.016726792 = weight(abstract_txt:research in 739) [ClassicSimilarity], result of:
           0.016726792 = score(doc=739,freq=1.0), product of:
             0.084703825 = queryWeight, product of:
               1.8277233 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014667732 = queryNorm
             0.19747387 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.025695538 = weight(abstract_txt:analysis in 739) [ClassicSimilarity], result of:
           0.025695538 = score(doc=739,freq=1.0), product of:
             0.11277159 = queryWeight, product of:
               2.1089137 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.014667732 = queryNorm
             0.2278547 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.1937451 = weight(abstract_txt:criteria in 739) [ClassicSimilarity], result of:
           0.1937451 = score(doc=739,freq=8.0), product of:
             0.19698758 = queryWeight, product of:
               2.413843 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.014667732 = queryNorm
             0.9835397 = fieldWeight in 739, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.37409708 = weight(abstract_txt:judgments in 739) [ClassicSimilarity], result of:
           0.37409708 = score(doc=739,freq=3.0), product of:
             0.50220424 = queryWeight, product of:
               4.9756994 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.014667732 = queryNorm
             0.74491024 = fieldWeight in 739, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.2540978 = weight(abstract_txt:relevance in 739) [ClassicSimilarity], result of:
           0.2540978 = score(doc=739,freq=4.0), product of:
             0.4123682 = queryWeight, product of:
               5.7031727 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.014667732 = queryNorm
             0.6161915 = fieldWeight in 739, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
       0.32 = coord(8/25)
   

4. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.31

   0.31310362 = sum of:
     0.31310362 = product of:
       0.97844887 = sum of:
         0.038827002 = weight(abstract_txt:search in 595) [ClassicSimilarity], result of:
           0.038827002 = score(doc=595,freq=9.0), product of:
             0.056662142 = queryWeight, product of:
               1.0570376 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014667732 = queryNorm
             0.6852371 = fieldWeight in 595, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.052630443 = weight(abstract_txt:relevant in 595) [ClassicSimilarity], result of:
           0.052630443 = score(doc=595,freq=4.0), product of:
             0.09094021 = queryWeight, product of:
               1.3391274 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.014667732 = queryNorm
             0.5787368 = fieldWeight in 595, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.009235232 = weight(abstract_txt:this in 595) [ClassicSimilarity], result of:
           0.009235232 = score(doc=595,freq=1.0), product of:
             0.061408684 = queryWeight, product of:
               1.7399182 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014667732 = queryNorm
             0.15038967 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.016726792 = weight(abstract_txt:research in 595) [ClassicSimilarity], result of:
           0.016726792 = score(doc=595,freq=1.0), product of:
             0.084703825 = queryWeight, product of:
               1.8277233 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014667732 = queryNorm
             0.19747387 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.025695538 = weight(abstract_txt:analysis in 595) [ClassicSimilarity], result of:
           0.025695538 = score(doc=595,freq=1.0), product of:
             0.11277159 = queryWeight, product of:
               2.1089137 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.014667732 = queryNorm
             0.2278547 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.1937451 = weight(abstract_txt:criteria in 595) [ClassicSimilarity], result of:
           0.1937451 = score(doc=595,freq=8.0), product of:
             0.19698758 = queryWeight, product of:
               2.413843 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.014667732 = queryNorm
             0.9835397 = fieldWeight in 595, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.30544898 = weight(abstract_txt:judgments in 595) [ClassicSimilarity], result of:
           0.30544898 = score(doc=595,freq=2.0), product of:
             0.50220424 = queryWeight, product of:
               4.9756994 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.014667732 = queryNorm
             0.60821664 = fieldWeight in 595, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.33613977 = weight(abstract_txt:relevance in 595) [ClassicSimilarity], result of:
           0.33613977 = score(doc=595,freq=7.0), product of:
             0.4123682 = queryWeight, product of:
               5.7031727 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.014667732 = queryNorm
             0.8151447 = fieldWeight in 595, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
       0.32 = coord(8/25)
   

5. Rieh, S.Y.: Judgment of information quality and cognitive authority in the Web (2002) 0.31

   0.3125112 = sum of:
     0.3125112 = product of:
       1.1161114 = sum of:
         0.056865867 = weight(abstract_txt:protocols in 1202) [ClassicSimilarity], result of:
           0.056865867 = score(doc=1202,freq=1.0), product of:
             0.103968635 = queryWeight, product of:
               1.0124652 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.014667732 = queryNorm
             0.5469521 = fieldWeight in 1202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.078125 = fieldNorm(doc=1202)
         0.022879032 = weight(abstract_txt:search in 1202) [ClassicSimilarity], result of:
           0.022879032 = score(doc=1202,freq=2.0), product of:
             0.056662142 = queryWeight, product of:
               1.0570376 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.014667732 = queryNorm
             0.40377986 = fieldWeight in 1202, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=1202)
         0.15917805 = weight(abstract_txt:judgment in 1202) [ClassicSimilarity], result of:
           0.15917805 = score(doc=1202,freq=6.0), product of:
             0.11364219 = queryWeight, product of:
               1.0585192 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.014667732 = queryNorm
             1.400695 = fieldWeight in 1202, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.078125 = fieldNorm(doc=1202)
         0.14227429 = weight(abstract_txt:postsearch in 1202) [ClassicSimilarity], result of:
           0.14227429 = score(doc=1202,freq=1.0), product of:
             0.1916103 = queryWeight, product of:
               1.3744799 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.014667732 = queryNorm
             0.74251896 = fieldWeight in 1202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.078125 = fieldNorm(doc=1202)
         0.0115440395 = weight(abstract_txt:this in 1202) [ClassicSimilarity], result of:
           0.0115440395 = score(doc=1202,freq=1.0), product of:
             0.061408684 = queryWeight, product of:
               1.7399182 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.014667732 = queryNorm
             0.18798709 = fieldWeight in 1202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=1202)
         0.25574878 = weight(abstract_txt:predictive in 1202) [ClassicSimilarity], result of:
           0.25574878 = score(doc=1202,freq=1.0), product of:
             0.40855518 = queryWeight, product of:
               3.4762814 = boost
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.014667732 = queryNorm
             0.6259835 = fieldWeight in 1202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.078125 = fieldNorm(doc=1202)
         0.46762136 = weight(abstract_txt:judgments in 1202) [ClassicSimilarity], result of:
           0.46762136 = score(doc=1202,freq=3.0), product of:
             0.50220424 = queryWeight, product of:
               4.9756994 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.014667732 = queryNorm
             0.9311378 = fieldWeight in 1202, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.078125 = fieldNorm(doc=1202)
       0.28 = coord(7/25)