Document (#4845)

Author

Janes, J.W.

Title

¬The binary nature of continous relevance judgements : a study of users' perceptions

Source

Journal of the American Society for Information Science. 42(1991) no.10, S.754-756

Year

1991

Abstract

Replicates a previous study by Eisenberg and Hu regarding users' perceptions of the binary or dichotomous nature of their relevance judgements. The studies examined the assumptions that searchers divide documents evenly into relevant and nonrelevant. 35 staff, faculty and doctoral students at Michigan Univ., School of Education and Dept. of Psychology conducted searchers and the retrieved documents submitted to the searchers in 3 incremental versions: title only; title and abstract; title, abstract and indexing information: At each stage the subjects were asked to judge the relevance of the document to the query. The findings support the earlier study and the break points between relevance and nonrelevance was not at or near 50%

Similar documents (author)

1. Janes, J.W.: ¬An alternative to precision (1991) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 3053) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 3053, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=3053)
   

2. Janes, J.W.: Relevance judgements and the incremental presentation of document representations (1991) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 3830) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 3830, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=3830)
   

3. Janes, J.W.: Towards a search theory of information (1989) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 4490) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 4490, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=4490)
   

4. Janes, J.W.: Other people's judgments : a comparison of users' and others' judgments of document relevance, topicality, and utility (1994) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 6928) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 6928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=6928)
   

5. Janes, J.W.: Why I stopped teaching 'online searching' (1995) 5.51

   5.506935 = sum of:
     5.506935 = weight(author_txt:janes in 3203) [ClassicSimilarity], result of:
       5.506935 = fieldWeight in 3203, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.811096 = idf(docFreq=17, maxDocs=44421)
         0.625 = fieldNorm(doc=3203)
   

Similar documents (content)

1. Janes, J.W.: Relevance judgements and the incremental presentation of document representations (1991) 0.24

   0.24037628 = sum of:
     0.24037628 = product of:
       0.8584867 = sum of:
         0.019234039 = weight(abstract_txt:users in 3830) [ClassicSimilarity], result of:
           0.019234039 = score(doc=3830,freq=1.0), product of:
             0.0690147 = queryWeight, product of:
               1.095256 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.017663922 = queryNorm
             0.2786948 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=3830)
         0.10012519 = weight(abstract_txt:doctoral in 3830) [ClassicSimilarity], result of:
           0.10012519 = score(doc=3830,freq=1.0), product of:
             0.16453066 = queryWeight, product of:
               1.1957854 = boost
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.017663922 = queryNorm
             0.60855037 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.078125 = fieldNorm(doc=3830)
         0.10700022 = weight(abstract_txt:incremental in 3830) [ClassicSimilarity], result of:
           0.10700022 = score(doc=3830,freq=1.0), product of:
             0.1719786 = queryWeight, product of:
               1.2225511 = boost
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.017663922 = queryNorm
             0.6221717 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.078125 = fieldNorm(doc=3830)
         0.029702684 = weight(abstract_txt:documents in 3830) [ClassicSimilarity], result of:
           0.029702684 = score(doc=3830,freq=1.0), product of:
             0.09220584 = queryWeight, product of:
               1.2659718 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017663922 = queryNorm
             0.32213452 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=3830)
         0.11202286 = weight(abstract_txt:perceptions in 3830) [ClassicSimilarity], result of:
           0.11202286 = score(doc=3830,freq=1.0), product of:
             0.22340818 = queryWeight, product of:
               1.9705813 = boost
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.017663922 = queryNorm
             0.5014269 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.078125 = fieldNorm(doc=3830)
         0.34684744 = weight(abstract_txt:judgements in 3830) [ClassicSimilarity], result of:
           0.34684744 = score(doc=3830,freq=4.0), product of:
             0.29897413 = queryWeight, product of:
               2.2796156 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.017663922 = queryNorm
             1.1601253 = fieldWeight in 3830, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.078125 = fieldNorm(doc=3830)
         0.14355426 = weight(abstract_txt:relevance in 3830) [ClassicSimilarity], result of:
           0.14355426 = score(doc=3830,freq=2.0), product of:
             0.26357567 = queryWeight, product of:
               3.0270004 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017663922 = queryNorm
             0.5446415 = fieldWeight in 3830, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=3830)
       0.28 = coord(7/25)
   

2. Janes, J.W.; McKinney, R.: Relevance judgements of actual users and secondary judges : a comparative study (1992) 0.21

   0.20911099 = sum of:
     0.20911099 = product of:
       0.746825 = sum of:
         0.039977193 = weight(abstract_txt:users in 4275) [ClassicSimilarity], result of:
           0.039977193 = score(doc=4275,freq=3.0), product of:
             0.0690147 = queryWeight, product of:
               1.095256 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.017663922 = queryNorm
             0.57925624 = fieldWeight in 4275, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.099687085 = weight(abstract_txt:univ in 4275) [ClassicSimilarity], result of:
           0.099687085 = score(doc=4275,freq=1.0), product of:
             0.14527461 = queryWeight, product of:
               1.1236335 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.017663922 = queryNorm
             0.6861976 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.122049175 = weight(abstract_txt:michigan in 4275) [ClassicSimilarity], result of:
           0.122049175 = score(doc=4275,freq=1.0), product of:
             0.16625972 = queryWeight, product of:
               1.2020522 = boost
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.017663922 = queryNorm
             0.73408747 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.8302665 = idf(docFreq=47, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.035643224 = weight(abstract_txt:documents in 4275) [ClassicSimilarity], result of:
           0.035643224 = score(doc=4275,freq=1.0), product of:
             0.09220584 = queryWeight, product of:
               1.2659718 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017663922 = queryNorm
             0.38656145 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.030379046 = weight(abstract_txt:study in 4275) [ClassicSimilarity], result of:
           0.030379046 = score(doc=4275,freq=1.0), product of:
             0.09488268 = queryWeight, product of:
               1.5728377 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.017663922 = queryNorm
             0.3201748 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.20810845 = weight(abstract_txt:judgements in 4275) [ClassicSimilarity], result of:
           0.20810845 = score(doc=4275,freq=1.0), product of:
             0.29897413 = queryWeight, product of:
               2.2796156 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.017663922 = queryNorm
             0.69607514 = fieldWeight in 4275, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
         0.21098077 = weight(abstract_txt:relevance in 4275) [ClassicSimilarity], result of:
           0.21098077 = score(doc=4275,freq=3.0), product of:
             0.26357567 = queryWeight, product of:
               3.0270004 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017663922 = queryNorm
             0.80045617 = fieldWeight in 4275, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=4275)
       0.28 = coord(7/25)
   

3. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 0.17

   0.16846588 = sum of:
     0.16846588 = product of:
       0.8423294 = sum of:
         0.057377048 = weight(abstract_txt:nature in 4268) [ClassicSimilarity], result of:
           0.057377048 = score(doc=4268,freq=1.0), product of:
             0.12664826 = queryWeight, product of:
               1.4836943 = boost
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.017663922 = queryNorm
             0.4530425 = fieldWeight in 4268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
         0.05261805 = weight(abstract_txt:study in 4268) [ClassicSimilarity], result of:
           0.05261805 = score(doc=4268,freq=3.0), product of:
             0.09488268 = queryWeight, product of:
               1.5728377 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.017663922 = queryNorm
             0.55455905 = fieldWeight in 4268, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
         0.2943098 = weight(abstract_txt:judgements in 4268) [ClassicSimilarity], result of:
           0.2943098 = score(doc=4268,freq=2.0), product of:
             0.29897413 = queryWeight, product of:
               2.2796156 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.017663922 = queryNorm
             0.98439884 = fieldWeight in 4268, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
         0.16564944 = weight(abstract_txt:searchers in 4268) [ClassicSimilarity], result of:
           0.16564944 = score(doc=4268,freq=1.0), product of:
             0.29394373 = queryWeight, product of:
               2.76836 = boost
               6.011108 = idf(docFreq=295, maxDocs=44421)
               0.017663922 = queryNorm
             0.56354135 = fieldWeight in 4268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.011108 = idf(docFreq=295, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
         0.27237502 = weight(abstract_txt:relevance in 4268) [ClassicSimilarity], result of:
           0.27237502 = score(doc=4268,freq=5.0), product of:
             0.26357567 = queryWeight, product of:
               3.0270004 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017663922 = queryNorm
             1.0333846 = fieldWeight in 4268, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=4268)
       0.2 = coord(5/25)
   

4. Spink, A.; Greisdorf, H.: Regions and levels : Measuring and mapping users' relevance judgements (2001) 0.15

   0.15278432 = sum of:
     0.15278432 = product of:
       0.6366013 = sum of:
         0.03077446 = weight(abstract_txt:users in 6586) [ClassicSimilarity], result of:
           0.03077446 = score(doc=6586,freq=4.0), product of:
             0.0690147 = queryWeight, product of:
               1.095256 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.017663922 = queryNorm
             0.44591168 = fieldWeight in 6586, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.08410884 = weight(abstract_txt:judge in 6586) [ClassicSimilarity], result of:
           0.08410884 = score(doc=6586,freq=1.0), product of:
             0.16997527 = queryWeight, product of:
               1.2154096 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.017663922 = queryNorm
             0.49482986 = fieldWeight in 6586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.15097797 = weight(abstract_txt:dichotomous in 6586) [ClassicSimilarity], result of:
           0.15097797 = score(doc=6586,freq=1.0), product of:
             0.25105393 = queryWeight, product of:
               1.4771117 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.017663922 = queryNorm
             0.60137665 = fieldWeight in 6586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.038251363 = weight(abstract_txt:nature in 6586) [ClassicSimilarity], result of:
           0.038251363 = score(doc=6586,freq=1.0), product of:
             0.12664826 = queryWeight, product of:
               1.4836943 = boost
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.017663922 = queryNorm
             0.30202833 = fieldWeight in 6586, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8324533 = idf(docFreq=961, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.028641637 = weight(abstract_txt:study in 6586) [ClassicSimilarity], result of:
           0.028641637 = score(doc=6586,freq=2.0), product of:
             0.09488268 = queryWeight, product of:
               1.5728377 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.017663922 = queryNorm
             0.3018637 = fieldWeight in 6586, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
         0.30384707 = weight(abstract_txt:relevance in 6586) [ClassicSimilarity], result of:
           0.30384707 = score(doc=6586,freq=14.0), product of:
             0.26357567 = queryWeight, product of:
               3.0270004 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017663922 = queryNorm
             1.1527888 = fieldWeight in 6586, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=6586)
       0.24 = coord(6/25)
   

5. Moreira Orengo, V.; Huyck, C.: Relevance feedback and cross-language information retrieval (2006) 0.14

   0.13663906 = sum of:
     0.13663906 = product of:
       0.56932944 = sum of:
         0.019234039 = weight(abstract_txt:users in 1970) [ClassicSimilarity], result of:
           0.019234039 = score(doc=1970,freq=1.0), product of:
             0.0690147 = queryWeight, product of:
               1.095256 = boost
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.017663922 = queryNorm
             0.2786948 = fieldWeight in 1970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5672934 = idf(docFreq=3408, maxDocs=44421)
               0.078125 = fieldNorm(doc=1970)
         0.105136044 = weight(abstract_txt:judge in 1970) [ClassicSimilarity], result of:
           0.105136044 = score(doc=1970,freq=1.0), product of:
             0.16997527 = queryWeight, product of:
               1.2154096 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.017663922 = queryNorm
             0.6185373 = fieldWeight in 1970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.078125 = fieldNorm(doc=1970)
         0.078585915 = weight(abstract_txt:documents in 1970) [ClassicSimilarity], result of:
           0.078585915 = score(doc=1970,freq=7.0), product of:
             0.09220584 = queryWeight, product of:
               1.2659718 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.017663922 = queryNorm
             0.8522879 = fieldWeight in 1970, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=1970)
         0.025315871 = weight(abstract_txt:study in 1970) [ClassicSimilarity], result of:
           0.025315871 = score(doc=1970,freq=1.0), product of:
             0.09488268 = queryWeight, product of:
               1.5728377 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.017663922 = queryNorm
             0.26681235 = fieldWeight in 1970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.078125 = fieldNorm(doc=1970)
         0.13804121 = weight(abstract_txt:searchers in 1970) [ClassicSimilarity], result of:
           0.13804121 = score(doc=1970,freq=1.0), product of:
             0.29394373 = queryWeight, product of:
               2.76836 = boost
               6.011108 = idf(docFreq=295, maxDocs=44421)
               0.017663922 = queryNorm
             0.4696178 = fieldWeight in 1970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.011108 = idf(docFreq=295, maxDocs=44421)
               0.078125 = fieldNorm(doc=1970)
         0.20301636 = weight(abstract_txt:relevance in 1970) [ClassicSimilarity], result of:
           0.20301636 = score(doc=1970,freq=4.0), product of:
             0.26357567 = queryWeight, product of:
               3.0270004 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.017663922 = queryNorm
             0.77023935 = fieldWeight in 1970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=1970)
       0.24 = coord(6/25)