Document (#3831)

Author

Janes, J.W.

Title

Relevance judgements and the incremental presentation of document representations

Source

Information processing and management. 27(1991) no.6, S.629-646

Year

1991

Abstract

Examines how users' judgements of the relevance of documents change as more information about the document is revealed to them. Subjects (university faculty and doctoral students) viewed 3 incremental versions of ducuments, and recorded ratio-level relevance judgements for each version. These judgements were analysed by a variety of methods, including graphical inspection and examination of the number and degree of changes of judgements as new information is seen. A questionnaire was aöso administered to obtain subjects' perceptions of the process and the individual fields of information presented. A consistent pattern of perception and importance of these fields is seen: Abstracts are by far the most important field and have the greatest impact, following by titles, bibliographic information and indexing

Similar documents (author)

1. Janes, J.W.: ¬An alternative to precision (1991) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 3053) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 3053, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=3053)
   

2. Janes, J.W.: Towards a search theory of information (1989) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 4490) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 4490, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=4490)
   

3. Janes, J.W.: ¬The binary nature of continous relevance judgements : a study of users' perceptions (1991) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 4844) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 4844, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=4844)
   

4. Janes, J.W.: Other people's judgments : a comparison of users' and others' judgments of document relevance, topicality, and utility (1994) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 6928) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 6928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=6928)
   

5. Janes, J.W.: Why I stopped teaching 'online searching' (1995) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 3203) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 3203, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=3203)
   

Similar documents (content)

1. Janes, J.W.: ¬The binary nature of continous relevance judgements : a study of users' perceptions (1991) 0.53

   0.5255889 = sum of:
     0.5255889 = product of:
       1.3139724 = sum of:
         0.05883857 = weight(abstract_txt:versions in 4844) [ClassicSimilarity], result of:
           0.05883857 = score(doc=4844,freq=1.0), product of:
             0.10041093 = queryWeight, product of:
               1.002051 = boost
               6.250429 = idf(docFreq=232, maxDocs=44421)
               0.016031764 = queryNorm
             0.58597773 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.250429 = idf(docFreq=232, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.06238573 = weight(abstract_txt:faculty in 4844) [ClassicSimilarity], result of:
           0.06238573 = score(doc=4844,freq=1.0), product of:
             0.10440704 = queryWeight, product of:
               1.0217961 = boost
               6.3735914 = idf(docFreq=205, maxDocs=44421)
               0.016031764 = queryNorm
             0.59752417 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3735914 = idf(docFreq=205, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.06370673 = weight(abstract_txt:perceptions in 4844) [ClassicSimilarity], result of:
           0.06370673 = score(doc=4844,freq=1.0), product of:
             0.105875745 = queryWeight, product of:
               1.0289578 = boost
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.016031764 = queryNorm
             0.6017122 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.11388121 = weight(abstract_txt:doctoral in 4844) [ClassicSimilarity], result of:
           0.11388121 = score(doc=4844,freq=1.0), product of:
             0.15594602 = queryWeight, product of:
               1.2487816 = boost
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.016031764 = queryNorm
             0.73026043 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.038158756 = weight(abstract_txt:document in 4844) [ClassicSimilarity], result of:
           0.038158756 = score(doc=4844,freq=1.0), product of:
             0.09478633 = queryWeight, product of:
               1.3768518 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.016031764 = queryNorm
             0.40257657 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.013640996 = weight(abstract_txt:information in 4844) [ClassicSimilarity], result of:
           0.013640996 = score(doc=4844,freq=1.0), product of:
             0.060152955 = queryWeight, product of:
               1.5511644 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.016031764 = queryNorm
             0.22677183 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.07685434 = weight(abstract_txt:subjects in 4844) [ClassicSimilarity], result of:
           0.07685434 = score(doc=4844,freq=1.0), product of:
             0.1511687 = queryWeight, product of:
               1.7387825 = boost
               5.422946 = idf(docFreq=532, maxDocs=44421)
               0.016031764 = queryNorm
             0.50840116 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.422946 = idf(docFreq=532, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.14997937 = weight(abstract_txt:relevance in 4844) [ClassicSimilarity], result of:
           0.14997937 = score(doc=4844,freq=3.0), product of:
             0.18736736 = queryWeight, product of:
               2.3708656 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016031764 = queryNorm
             0.80045617 = fieldWeight in 4844, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.24340153 = weight(abstract_txt:incremental in 4844) [ClassicSimilarity], result of:
           0.24340153 = score(doc=4844,freq=1.0), product of:
             0.32601064 = queryWeight, product of:
               2.5534668 = boost
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.016031764 = queryNorm
             0.74660605 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
         0.4931251 = weight(abstract_txt:judgements in 4844) [ClassicSimilarity], result of:
           0.4931251 = score(doc=4844,freq=1.0), product of:
             0.7084366 = queryWeight, product of:
               5.9516153 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016031764 = queryNorm
             0.69607514 = fieldWeight in 4844, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.09375 = fieldNorm(doc=4844)
       0.4 = coord(10/25)
   

2. Janes, J.W.; McKinney, R.: Relevance judgements of actual users and secondary judges : a comparative study (1992) 0.20

   0.20276135 = sum of:
     0.20276135 = product of:
       0.844839 = sum of:
         0.073050916 = weight(abstract_txt:analysed in 4275) [ClassicSimilarity], result of:
           0.073050916 = score(doc=4275,freq=1.0), product of:
             0.11599075 = queryWeight, product of:
               1.0769883 = boost
               6.717861 = idf(docFreq=145, maxDocs=44421)
               0.016031764 = queryNorm
             0.6297995 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.717861 = idf(docFreq=145, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.053964626 = weight(abstract_txt:document in 4275) [ClassicSimilarity], result of:
           0.053964626 = score(doc=4275,freq=2.0), product of:
             0.09478633 = queryWeight, product of:
               1.3768518 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.016031764 = queryNorm
             0.5693292 = fieldWeight in 4275, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.013640996 = weight(abstract_txt:information in 4275) [ClassicSimilarity], result of:
           0.013640996 = score(doc=4275,freq=1.0), product of:
             0.060152955 = queryWeight, product of:
               1.5511644 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.016031764 = queryNorm
             0.22677183 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.061077986 = weight(abstract_txt:fields in 4275) [ClassicSimilarity], result of:
           0.061077986 = score(doc=4275,freq=1.0), product of:
             0.12969983 = queryWeight, product of:
               1.6105864 = boost
               5.0231256 = idf(docFreq=794, maxDocs=44421)
               0.016031764 = queryNorm
             0.47091803 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0231256 = idf(docFreq=794, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.14997937 = weight(abstract_txt:relevance in 4275) [ClassicSimilarity], result of:
           0.14997937 = score(doc=4275,freq=3.0), product of:
             0.18736736 = queryWeight, product of:
               2.3708656 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016031764 = queryNorm
             0.80045617 = fieldWeight in 4275, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.4931251 = weight(abstract_txt:judgements in 4275) [ClassicSimilarity], result of:
           0.4931251 = score(doc=4275,freq=1.0), product of:
             0.7084366 = queryWeight, product of:
               5.9516153 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016031764 = queryNorm
             0.69607514 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
       0.24 = coord(6/25)
   

3. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.20

   0.20002444 = sum of:
     0.20002444 = product of:
       1.2501528 = sum of:
         0.038158756 = weight(abstract_txt:document in 3307) [ClassicSimilarity], result of:
           0.038158756 = score(doc=3307,freq=1.0), product of:
             0.09478633 = queryWeight, product of:
               1.3768518 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.016031764 = queryNorm
             0.40257657 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.013640996 = weight(abstract_txt:information in 3307) [ClassicSimilarity], result of:
           0.013640996 = score(doc=3307,freq=1.0), product of:
             0.060152955 = queryWeight, product of:
               1.5511644 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.016031764 = queryNorm
             0.22677183 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.21210289 = weight(abstract_txt:relevance in 3307) [ClassicSimilarity], result of:
           0.21210289 = score(doc=3307,freq=6.0), product of:
             0.18736736 = queryWeight, product of:
               2.3708656 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016031764 = queryNorm
             1.1320162 = fieldWeight in 3307, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.9862502 = weight(abstract_txt:judgements in 3307) [ClassicSimilarity], result of:
           0.9862502 = score(doc=3307,freq=4.0), product of:
             0.7084366 = queryWeight, product of:
               5.9516153 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016031764 = queryNorm
             1.3921503 = fieldWeight in 3307, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
       0.16 = coord(4/25)
   

4. Park, H.: Relevance of science information : origins and dimensions of relevance and their implications to information retrieval (1997) 0.16

   0.15514104 = sum of:
     0.15514104 = product of:
       0.9696315 = sum of:
         0.018312821 = weight(abstract_txt:these in 1154) [ClassicSimilarity], result of:
           0.018312821 = score(doc=1154,freq=2.0), product of:
             0.052075155 = queryWeight, product of:
               1.020539 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.016031764 = queryNorm
             0.35166138 = fieldWeight in 1154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.078125 = fieldNorm(doc=1154)
         0.011367496 = weight(abstract_txt:information in 1154) [ClassicSimilarity], result of:
           0.011367496 = score(doc=1154,freq=1.0), product of:
             0.060152955 = queryWeight, product of:
               1.5511644 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.016031764 = queryNorm
             0.18897653 = fieldWeight in 1154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=1154)
         0.22818637 = weight(abstract_txt:relevance in 1154) [ClassicSimilarity], result of:
           0.22818637 = score(doc=1154,freq=10.0), product of:
             0.18736736 = queryWeight, product of:
               2.3708656 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016031764 = queryNorm
             1.2178555 = fieldWeight in 1154, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=1154)
         0.7117648 = weight(abstract_txt:judgements in 1154) [ClassicSimilarity], result of:
           0.7117648 = score(doc=1154,freq=3.0), product of:
             0.7084366 = queryWeight, product of:
               5.9516153 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016031764 = queryNorm
             1.0046979 = fieldWeight in 1154, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.078125 = fieldNorm(doc=1154)
       0.16 = coord(4/25)
   

5. Barry, C.L.; Schamber, L.: Users' criteria for relevance evaluation : a cross-situational comparison (1998) 0.15

   0.15027967 = sum of:
     0.15027967 = product of:
       0.62616533 = sum of:
         0.05028706 = weight(abstract_txt:obtain in 4271) [ClassicSimilarity], result of:
           0.05028706 = score(doc=4271,freq=1.0), product of:
             0.10211697 = queryWeight, product of:
               1.0105278 = boost
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.016031764 = queryNorm
             0.49244568 = fieldWeight in 4271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.078125 = fieldNorm(doc=4271)
         0.012949119 = weight(abstract_txt:these in 4271) [ClassicSimilarity], result of:
           0.012949119 = score(doc=4271,freq=1.0), product of:
             0.052075155 = queryWeight, product of:
               1.020539 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.016031764 = queryNorm
             0.24866214 = fieldWeight in 4271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.078125 = fieldNorm(doc=4271)
         0.051988114 = weight(abstract_txt:faculty in 4271) [ClassicSimilarity], result of:
           0.051988114 = score(doc=4271,freq=1.0), product of:
             0.10440704 = queryWeight, product of:
               1.0217961 = boost
               6.3735914 = idf(docFreq=205, maxDocs=44421)
               0.016031764 = queryNorm
             0.49793684 = fieldWeight in 4271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3735914 = idf(docFreq=205, maxDocs=44421)
               0.078125 = fieldNorm(doc=4271)
         0.027844567 = weight(abstract_txt:information in 4271) [ClassicSimilarity], result of:
           0.027844567 = score(doc=4271,freq=6.0), product of:
             0.060152955 = queryWeight, product of:
               1.5511644 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.016031764 = queryNorm
             0.46289608 = fieldWeight in 4271, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=4271)
         0.07215886 = weight(abstract_txt:relevance in 4271) [ClassicSimilarity], result of:
           0.07215886 = score(doc=4271,freq=1.0), product of:
             0.18736736 = queryWeight, product of:
               2.3708656 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016031764 = queryNorm
             0.38511968 = fieldWeight in 4271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=4271)
         0.4109376 = weight(abstract_txt:judgements in 4271) [ClassicSimilarity], result of:
           0.4109376 = score(doc=4271,freq=1.0), product of:
             0.7084366 = queryWeight, product of:
               5.9516153 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016031764 = queryNorm
             0.5800626 = fieldWeight in 4271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.078125 = fieldNorm(doc=4271)
       0.24 = coord(6/25)