Document (#24607)

Author

Bateman, J.

Title

Modelling the importance of end-user relevance criteria

Source

Knowledge: creation, organization and use. Proceedings of the 62nd Annual Meeting of the American Society for Information Science, 31.10.-4.11.1999. Ed.: L. Woods

Imprint

Medford, NJ : Information Today

Year

1999

Pages

S.396-406

Series

Proceedings of the American Society for Information Science; vol.36

Abstract

In most information retrieval research, the concept of relevance has been defined a priori as a single variable by the researcher and the meaning of relevance to the end-user who is making relevance judgments has not been taken into account. However, a number of criteria that users employ in making relevance judgments has been identified (Schamher, 1991; Barry, 1993). Understanding these criteria and their importance to end-users can help researchers better understand end-user evaluation behavior. This study reports end-users' ratings of the relative importance of 40 relevance criteria as used in their own information-seeking situations, and examines relationships between criteria that they rated most important. Data were collected from 210 graduate students who were instructed in a mail survey to rate 40 relevance criteria by importance in their selection of the most valuable information source for a recent or current paper or project. The criteria were selected from previous studies in which open-ended interviews were used to elicit criteria from end-users making judgments in their own information-seeking situations (Schamher, 1991; Su, 1992; Barry, 1993). A model of relevance with three constructs that contribute to the concept of relevance was proposed using the eleven criteria that survey respondents rated as most important (75 or more on a scale of 0 to 100). The development of this model was guided by similarities in criteria and criteria groupings from previous research (Barry & Schamher, 1998). Confirmatory factor analysis was used to confirm the model and verify that the constructs would produce reliable subscale scores. The three constructs are information quality, information credibility, and information completeness. Second-order factor analysis indicated that these constructs explain 48% of positive relevance judgments for these respondents. Three additional constructs, information availability, information topicality, and information currency are also suggested. The constructs developed from this analysis are thought to underlie the concept of relevance for this group of users

Theme

Retrievalstudien

Similar documents (author)

1. Bateman, J.A.: On the relationship between ontology construction and natural language : a socio-semiotic view (1995) 6.10

   6.0972233 = sum of:
     6.0972233 = weight(author_txt:bateman in 4853) [ClassicSimilarity], result of:
       6.0972233 = fieldWeight in 4853, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.625 = fieldNorm(doc=4853)
   

2. Bateman, J.A.: Automated discourse generation (1998) 6.10

   6.0972233 = sum of:
     6.0972233 = weight(author_txt:bateman in 2308) [ClassicSimilarity], result of:
       6.0972233 = fieldWeight in 2308, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.625 = fieldNorm(doc=2308)
   

3. Bateman, J.; Teich, E.: Selective information presentation in an integrated publication system : an application of genre-driven text generation (1995) 4.88

   4.8777785 = sum of:
     4.8777785 = weight(author_txt:bateman in 2996) [ClassicSimilarity], result of:
       4.8777785 = fieldWeight in 2996, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.5 = fieldNorm(doc=2996)
   

4. Schamber, L.; Bateman, J.: User criteria in relevance evaluation : toward development of a measurement scale (1996) 4.88

   4.8777785 = sum of:
     4.8777785 = weight(author_txt:bateman in 420) [ClassicSimilarity], result of:
       4.8777785 = fieldWeight in 420, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.5 = fieldNorm(doc=420)
   

5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 4.88

   4.8777785 = sum of:
     4.8777785 = weight(author_txt:bateman in 691) [ClassicSimilarity], result of:
       4.8777785 = fieldWeight in 691, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.755557 = idf(docFreq=6, maxDocs=44421)
         0.5 = fieldNorm(doc=691)
   

Similar documents (content)

1. Choi, Y.; Rasmussen, E.M.: Users' relevance criteria in image retrieval in American history (2002) 0.82

   0.8221788 = sum of:
     0.8221788 = product of:
       1.3702979 = sum of:
         0.016912172 = weight(abstract_txt:user in 3592) [ClassicSimilarity], result of:
           0.016912172 = score(doc=3592,freq=2.0), product of:
             0.05940815 = queryWeight, product of:
               1.0096534 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.015985396 = queryNorm
             0.28467762 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.031171978 = weight(abstract_txt:factor in 3592) [ClassicSimilarity], result of:
           0.031171978 = score(doc=3592,freq=1.0), product of:
             0.09829594 = queryWeight, product of:
               1.0604043 = boost
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.015985396 = queryNorm
             0.31712374 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.010015933 = weight(abstract_txt:their in 3592) [ClassicSimilarity], result of:
           0.010015933 = score(doc=3592,freq=1.0), product of:
             0.058098324 = queryWeight, product of:
               1.1529235 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.015985396 = queryNorm
             0.17239624 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.008397031 = weight(abstract_txt:from in 3592) [ClassicSimilarity], result of:
           0.008397031 = score(doc=3592,freq=1.0), product of:
             0.05564462 = queryWeight, product of:
               1.2614943 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015985396 = queryNorm
             0.15090463 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.008970904 = weight(abstract_txt:that in 3592) [ClassicSimilarity], result of:
           0.008970904 = score(doc=3592,freq=2.0), product of:
             0.04904717 = queryWeight, product of:
               1.2973922 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015985396 = queryNorm
             0.18290362 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.022304485 = weight(abstract_txt:were in 3592) [ClassicSimilarity], result of:
           0.022304485 = score(doc=3592,freq=2.0), product of:
             0.078635894 = queryWeight, product of:
               1.3413098 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015985396 = queryNorm
             0.28364253 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.042221457 = weight(abstract_txt:making in 3592) [ClassicSimilarity], result of:
           0.042221457 = score(doc=3592,freq=2.0), product of:
             0.10932897 = queryWeight, product of:
               1.3696733 = boost
               4.9933834 = idf(docFreq=818, maxDocs=44421)
               0.015985396 = queryNorm
             0.3861873 = fieldWeight in 3592, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9933834 = idf(docFreq=818, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.019589107 = weight(abstract_txt:most in 3592) [ClassicSimilarity], result of:
           0.019589107 = score(doc=3592,freq=1.0), product of:
             0.090861335 = queryWeight, product of:
               1.4418107 = boost
               3.94228 = idf(docFreq=2342, maxDocs=44421)
               0.015985396 = queryNorm
             0.21559344 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.94228 = idf(docFreq=2342, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.04056802 = weight(abstract_txt:users in 3592) [ClassicSimilarity], result of:
           0.04056802 = score(doc=3592,freq=5.0), product of:
             0.09299763 = queryWeight, product of:
               1.6308336 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.015985396 = queryNorm
             0.43622637 = fieldWeight in 3592, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.04218161 = weight(abstract_txt:importance in 3592) [ClassicSimilarity], result of:
           0.04218161 = score(doc=3592,freq=1.0), product of:
             0.15151355 = queryWeight, product of:
               1.8618488 = boost
               5.0907717 = idf(docFreq=742, maxDocs=44421)
               0.015985396 = queryNorm
             0.27840158 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0907717 = idf(docFreq=742, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.022625374 = weight(abstract_txt:information in 3592) [ClassicSimilarity], result of:
           0.022625374 = score(doc=3592,freq=4.0), product of:
             0.08551846 = queryWeight, product of:
               2.2116613 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015985396 = queryNorm
             0.26456714 = fieldWeight in 3592, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.23294163 = weight(abstract_txt:judgments in 3592) [ClassicSimilarity], result of:
           0.23294163 = score(doc=3592,freq=5.0), product of:
             0.27682847 = queryWeight, product of:
               2.5166574 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.015985396 = queryNorm
             0.8414656 = fieldWeight in 3592, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.19310021 = weight(abstract_txt:barry in 3592) [ClassicSimilarity], result of:
           0.19310021 = score(doc=3592,freq=1.0), product of:
             0.37952897 = queryWeight, product of:
               2.5519478 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.015985396 = queryNorm
             0.5087891 = fieldWeight in 3592, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.2786577 = weight(abstract_txt:relevance in 3592) [ClassicSimilarity], result of:
           0.2786577 = score(doc=3592,freq=7.0), product of:
             0.39068636 = queryWeight, product of:
               4.9579163 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015985396 = queryNorm
             0.71325165 = fieldWeight in 3592, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
         0.40064025 = weight(abstract_txt:criteria in 3592) [ClassicSimilarity], result of:
           0.40064025 = score(doc=3592,freq=7.0), product of:
             0.49768052 = queryWeight, product of:
               5.5957766 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.015985396 = queryNorm
             0.80501497 = fieldWeight in 3592, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3592)
       0.6 = coord(15/25)
   

2. Crystal, A.; Greenberg, J.: Relevance criteria identified by health information users during Web searches (2006) 0.59

   0.5929305 = sum of:
     0.5929305 = product of:
       1.140251 = sum of:
         0.013278817 = weight(abstract_txt:analysis in 909) [ClassicSimilarity], result of:
           0.013278817 = score(doc=909,freq=1.0), product of:
             0.058277562 = queryWeight, product of:
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.015985396 = queryNorm
             0.2278547 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.013667099 = weight(abstract_txt:user in 909) [ClassicSimilarity], result of:
           0.013667099 = score(doc=909,freq=1.0), product of:
             0.05940815 = queryWeight, product of:
               1.0096534 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.015985396 = queryNorm
             0.23005427 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.016188191 = weight(abstract_txt:their in 909) [ClassicSimilarity], result of:
           0.016188191 = score(doc=909,freq=2.0), product of:
             0.058098324 = queryWeight, product of:
               1.1529235 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.015985396 = queryNorm
             0.2786344 = fieldWeight in 909, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.04741123 = weight(abstract_txt:situations in 909) [ClassicSimilarity], result of:
           0.04741123 = score(doc=909,freq=1.0), product of:
             0.11892839 = queryWeight, product of:
               1.1663972 = boost
               6.3784575 = idf(docFreq=204, maxDocs=44421)
               0.015985396 = queryNorm
             0.3986536 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3784575 = idf(docFreq=204, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.009596607 = weight(abstract_txt:from in 909) [ClassicSimilarity], result of:
           0.009596607 = score(doc=909,freq=1.0), product of:
             0.05564462 = queryWeight, product of:
               1.2614943 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015985396 = queryNorm
             0.17246243 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.01255665 = weight(abstract_txt:that in 909) [ClassicSimilarity], result of:
           0.01255665 = score(doc=909,freq=3.0), product of:
             0.04904717 = queryWeight, product of:
               1.2973922 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015985396 = queryNorm
             0.25601172 = fieldWeight in 909, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.025490839 = weight(abstract_txt:were in 909) [ClassicSimilarity], result of:
           0.025490839 = score(doc=909,freq=2.0), product of:
             0.078635894 = queryWeight, product of:
               1.3413098 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015985396 = queryNorm
             0.3241629 = fieldWeight in 909, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.03166078 = weight(abstract_txt:most in 909) [ClassicSimilarity], result of:
           0.03166078 = score(doc=909,freq=2.0), product of:
             0.090861335 = queryWeight, product of:
               1.4418107 = boost
               3.94228 = idf(docFreq=2342, maxDocs=44421)
               0.015985396 = queryNorm
             0.3484516 = fieldWeight in 909, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.94228 = idf(docFreq=2342, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.06556782 = weight(abstract_txt:users in 909) [ClassicSimilarity], result of:
           0.06556782 = score(doc=909,freq=10.0), product of:
             0.09299763 = queryWeight, product of:
               1.6308336 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.015985396 = queryNorm
             0.70504826 = fieldWeight in 909, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.02585757 = weight(abstract_txt:information in 909) [ClassicSimilarity], result of:
           0.02585757 = score(doc=909,freq=4.0), product of:
             0.08551846 = queryWeight, product of:
               2.2116613 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015985396 = queryNorm
             0.30236244 = fieldWeight in 909, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.11905676 = weight(abstract_txt:judgments in 909) [ClassicSimilarity], result of:
           0.11905676 = score(doc=909,freq=1.0), product of:
             0.27682847 = queryWeight, product of:
               2.5166574 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.015985396 = queryNorm
             0.43007413 = fieldWeight in 909, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.24073762 = weight(abstract_txt:relevance in 909) [ClassicSimilarity], result of:
           0.24073762 = score(doc=909,freq=4.0), product of:
             0.39068636 = queryWeight, product of:
               4.9579163 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015985396 = queryNorm
             0.6161915 = fieldWeight in 909, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
         0.519181 = weight(abstract_txt:criteria in 909) [ClassicSimilarity], result of:
           0.519181 = score(doc=909,freq=9.0), product of:
             0.49768052 = queryWeight, product of:
               5.5957766 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.015985396 = queryNorm
             1.0432014 = fieldWeight in 909, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=909)
       0.52 = coord(13/25)
   

3. Savolainen, R.; Kari, J.: User-defined relevance criteria in web searching (2006) 0.43

   0.42944765 = sum of:
     0.42944765 = product of:
       1.0736191 = sum of:
         0.013278817 = weight(abstract_txt:analysis in 739) [ClassicSimilarity], result of:
           0.013278817 = score(doc=739,freq=1.0), product of:
             0.058277562 = queryWeight, product of:
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.015985396 = queryNorm
             0.2278547 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.019328197 = weight(abstract_txt:user in 739) [ClassicSimilarity], result of:
           0.019328197 = score(doc=739,freq=2.0), product of:
             0.05940815 = queryWeight, product of:
               1.0096534 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.015985396 = queryNorm
             0.32534587 = fieldWeight in 739, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.009596607 = weight(abstract_txt:from in 739) [ClassicSimilarity], result of:
           0.009596607 = score(doc=739,freq=1.0), product of:
             0.05564462 = queryWeight, product of:
               1.2614943 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015985396 = queryNorm
             0.17246243 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.007249586 = weight(abstract_txt:that in 739) [ClassicSimilarity], result of:
           0.007249586 = score(doc=739,freq=1.0), product of:
             0.04904717 = queryWeight, product of:
               1.2973922 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015985396 = queryNorm
             0.14780845 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.031219775 = weight(abstract_txt:were in 739) [ClassicSimilarity], result of:
           0.031219775 = score(doc=739,freq=3.0), product of:
             0.078635894 = queryWeight, product of:
               1.3413098 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015985396 = queryNorm
             0.39701685 = fieldWeight in 739, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.03412009 = weight(abstract_txt:making in 739) [ClassicSimilarity], result of:
           0.03412009 = score(doc=739,freq=1.0), product of:
             0.10932897 = queryWeight, product of:
               1.3696733 = boost
               4.9933834 = idf(docFreq=818, maxDocs=44421)
               0.015985396 = queryNorm
             0.31208646 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9933834 = idf(docFreq=818, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.022387551 = weight(abstract_txt:most in 739) [ClassicSimilarity], result of:
           0.022387551 = score(doc=739,freq=1.0), product of:
             0.090861335 = queryWeight, product of:
               1.4418107 = boost
               3.94228 = idf(docFreq=2342, maxDocs=44421)
               0.015985396 = queryNorm
             0.2463925 = fieldWeight in 739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.94228 = idf(docFreq=2342, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.20621236 = weight(abstract_txt:judgments in 739) [ClassicSimilarity], result of:
           0.20621236 = score(doc=739,freq=3.0), product of:
             0.27682847 = queryWeight, product of:
               2.5166574 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.015985396 = queryNorm
             0.74491024 = fieldWeight in 739, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.24073762 = weight(abstract_txt:relevance in 739) [ClassicSimilarity], result of:
           0.24073762 = score(doc=739,freq=4.0), product of:
             0.39068636 = queryWeight, product of:
               4.9579163 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015985396 = queryNorm
             0.6161915 = fieldWeight in 739, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
         0.48948854 = weight(abstract_txt:criteria in 739) [ClassicSimilarity], result of:
           0.48948854 = score(doc=739,freq=8.0), product of:
             0.49768052 = queryWeight, product of:
               5.5957766 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.015985396 = queryNorm
             0.9835397 = fieldWeight in 739, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=739)
       0.4 = coord(10/25)
   

4. Taylor, A.; Zhang, X.; Amadio, W.J.: Examination of relevance criteria choices and the information search process (2009) 0.41

   0.40631202 = sum of:
     0.40631202 = product of:
       1.1286445 = sum of:
         0.013278817 = weight(abstract_txt:analysis in 595) [ClassicSimilarity], result of:
           0.013278817 = score(doc=595,freq=1.0), product of:
             0.058277562 = queryWeight, product of:
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.015985396 = queryNorm
             0.2278547 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.019328197 = weight(abstract_txt:user in 595) [ClassicSimilarity], result of:
           0.019328197 = score(doc=595,freq=2.0), product of:
             0.05940815 = queryWeight, product of:
               1.0096534 = boost
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.015985396 = queryNorm
             0.32534587 = fieldWeight in 595, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6808684 = idf(docFreq=3042, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.009596607 = weight(abstract_txt:from in 595) [ClassicSimilarity], result of:
           0.009596607 = score(doc=595,freq=1.0), product of:
             0.05564462 = queryWeight, product of:
               1.2614943 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015985396 = queryNorm
             0.17246243 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.036049493 = weight(abstract_txt:were in 595) [ClassicSimilarity], result of:
           0.036049493 = score(doc=595,freq=4.0), product of:
             0.078635894 = queryWeight, product of:
               1.3413098 = boost
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.015985396 = queryNorm
             0.4584356 = fieldWeight in 595, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6674848 = idf(docFreq=3083, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.048207555 = weight(abstract_txt:importance in 595) [ClassicSimilarity], result of:
           0.048207555 = score(doc=595,freq=1.0), product of:
             0.15151355 = queryWeight, product of:
               1.8618488 = boost
               5.0907717 = idf(docFreq=742, maxDocs=44421)
               0.015985396 = queryNorm
             0.31817323 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0907717 = idf(docFreq=742, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.02585757 = weight(abstract_txt:information in 595) [ClassicSimilarity], result of:
           0.02585757 = score(doc=595,freq=4.0), product of:
             0.08551846 = queryWeight, product of:
               2.2116613 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015985396 = queryNorm
             0.30236244 = fieldWeight in 595, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.16837168 = weight(abstract_txt:judgments in 595) [ClassicSimilarity], result of:
           0.16837168 = score(doc=595,freq=2.0), product of:
             0.27682847 = queryWeight, product of:
               2.5166574 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.015985396 = queryNorm
             0.60821664 = fieldWeight in 595, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.31846592 = weight(abstract_txt:relevance in 595) [ClassicSimilarity], result of:
           0.31846592 = score(doc=595,freq=7.0), product of:
             0.39068636 = queryWeight, product of:
               4.9579163 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015985396 = queryNorm
             0.8151447 = fieldWeight in 595, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
         0.48948854 = weight(abstract_txt:criteria in 595) [ClassicSimilarity], result of:
           0.48948854 = score(doc=595,freq=8.0), product of:
             0.49768052 = queryWeight, product of:
               5.5957766 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.015985396 = queryNorm
             0.9835397 = fieldWeight in 595, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0625 = fieldNorm(doc=595)
       0.36 = coord(9/25)
   

5. Schamber, L.; Bateman, J.: Relevance criteria uses and importance : progress in development of a measurement scale (1999) 0.39

   0.39418578 = sum of:
     0.39418578 = product of:
       0.98546445 = sum of:
         0.014308475 = weight(abstract_txt:their in 691) [ClassicSimilarity], result of:
           0.014308475 = score(doc=691,freq=1.0), product of:
             0.058098324 = queryWeight, product of:
               1.1529235 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.015985396 = queryNorm
             0.24628034 = fieldWeight in 691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.059264038 = weight(abstract_txt:situations in 691) [ClassicSimilarity], result of:
           0.059264038 = score(doc=691,freq=1.0), product of:
             0.11892839 = queryWeight, product of:
               1.1663972 = boost
               6.3784575 = idf(docFreq=204, maxDocs=44421)
               0.015985396 = queryNorm
             0.498317 = fieldWeight in 691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3784575 = idf(docFreq=204, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.012815579 = weight(abstract_txt:that in 691) [ClassicSimilarity], result of:
           0.012815579 = score(doc=691,freq=2.0), product of:
             0.04904717 = queryWeight, product of:
               1.2973922 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.015985396 = queryNorm
             0.2612909 = fieldWeight in 691, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.042650115 = weight(abstract_txt:making in 691) [ClassicSimilarity], result of:
           0.042650115 = score(doc=691,freq=1.0), product of:
             0.10932897 = queryWeight, product of:
               1.3696733 = boost
               4.9933834 = idf(docFreq=818, maxDocs=44421)
               0.015985396 = queryNorm
             0.39010808 = fieldWeight in 691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9933834 = idf(docFreq=818, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.05795431 = weight(abstract_txt:users in 691) [ClassicSimilarity], result of:
           0.05795431 = score(doc=691,freq=5.0), product of:
             0.09299763 = queryWeight, product of:
               1.6308336 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.015985396 = queryNorm
             0.6231805 = fieldWeight in 691, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.06025944 = weight(abstract_txt:importance in 691) [ClassicSimilarity], result of:
           0.06025944 = score(doc=691,freq=1.0), product of:
             0.15151355 = queryWeight, product of:
               1.8618488 = boost
               5.0907717 = idf(docFreq=742, maxDocs=44421)
               0.015985396 = queryNorm
             0.39771652 = fieldWeight in 691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0907717 = idf(docFreq=742, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.022855079 = weight(abstract_txt:information in 691) [ClassicSimilarity], result of:
           0.022855079 = score(doc=691,freq=2.0), product of:
             0.08551846 = queryWeight, product of:
               2.2116613 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015985396 = queryNorm
             0.26725316 = fieldWeight in 691, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.14882095 = weight(abstract_txt:judgments in 691) [ClassicSimilarity], result of:
           0.14882095 = score(doc=691,freq=1.0), product of:
             0.27682847 = queryWeight, product of:
               2.5166574 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.015985396 = queryNorm
             0.53759265 = fieldWeight in 691, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.2606061 = weight(abstract_txt:relevance in 691) [ClassicSimilarity], result of:
           0.2606061 = score(doc=691,freq=3.0), product of:
             0.39068636 = queryWeight, product of:
               4.9579163 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.015985396 = queryNorm
             0.66704684 = fieldWeight in 691, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
         0.30593035 = weight(abstract_txt:criteria in 691) [ClassicSimilarity], result of:
           0.30593035 = score(doc=691,freq=2.0), product of:
             0.49768052 = queryWeight, product of:
               5.5957766 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.015985396 = queryNorm
             0.6147123 = fieldWeight in 691, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.078125 = fieldNorm(doc=691)
       0.4 = coord(10/25)