Document (#21269)

Author

Tang, R.
Solomon, P.

Title

Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior

Source

Information processing and management. 34(1998) nos.2/3, S.237-256

Year

1998

Abstract

Investigates the cognitive nature of an end-user's relevance judgements using the concept of mental modes. Identifies situational factors of relevance by noting the judgement criteria used by subjects as they move through the relevance judgement process. Tests the feasibility of the specific research strategy employed in this study that incorporates an intensive case study of the search behaviour of searchers with naturalistic inquiry for which the cognitive development and situational factors of end-user relevance judgements are the centre of the investigation. Introduces a dynamic model or relevance on which the study is built, presents methodology, results and discussion

Similar documents (author)

1. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 5.90

   5.8989305 = sum of:
     5.8989305 = sum of:
       2.570637 = weight(author_txt:tang in 5213) [ClassicSimilarity], result of:
         2.570637 = score(doc=5213,freq=1.0), product of:
           0.6440024 = queryWeight, product of:
             7.983315 = idf(docFreq=40, maxDocs=44218)
             0.08066854 = queryNorm
           3.9916575 = fieldWeight in 5213, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.983315 = idf(docFreq=40, maxDocs=44218)
             0.5 = fieldNorm(doc=5213)
       3.3282936 = weight(author_txt:solomon in 5213) [ClassicSimilarity], result of:
         3.3282936 = score(doc=5213,freq=1.0), product of:
           0.7650234 = queryWeight, product of:
             1.0899175 = boost
             8.701155 = idf(docFreq=19, maxDocs=44218)
             0.08066854 = queryNorm
           4.3505774 = fieldWeight in 5213, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.701155 = idf(docFreq=19, maxDocs=44218)
             0.5 = fieldNorm(doc=5213)
   

2. Solomon, P.: Children's information retrieval behavior : a case analysis of an OPAC (1993) 2.08

   2.0801835 = sum of:
     2.0801835 = product of:
       4.160367 = sum of:
         4.160367 = weight(author_txt:solomon in 4349) [ClassicSimilarity], result of:
           4.160367 = score(doc=4349,freq=1.0), product of:
             0.7650234 = queryWeight, product of:
               1.0899175 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.08066854 = queryNorm
             5.438222 = fieldWeight in 4349, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.625 = fieldNorm(doc=4349)
       0.5 = coord(1/2)
   

3. Solomon, P.: On the dynamics of information system use : from novice to? (1992) 2.08

   2.0801835 = sum of:
     2.0801835 = product of:
       4.160367 = sum of:
         4.160367 = weight(author_txt:solomon in 4519) [ClassicSimilarity], result of:
           4.160367 = score(doc=4519,freq=1.0), product of:
             0.7650234 = queryWeight, product of:
               1.0899175 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.08066854 = queryNorm
             5.438222 = fieldWeight in 4519, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.625 = fieldNorm(doc=4519)
       0.5 = coord(1/2)
   

4. Solomon, P.: Children, technology, and instruction : a case study of elementary school children using an online public access catalog (OPAC) (1994) 2.08

   2.0801835 = sum of:
     2.0801835 = product of:
       4.160367 = sum of:
         4.160367 = weight(author_txt:solomon in 1423) [ClassicSimilarity], result of:
           4.160367 = score(doc=1423,freq=1.0), product of:
             0.7650234 = queryWeight, product of:
               1.0899175 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.08066854 = queryNorm
             5.438222 = fieldWeight in 1423, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.625 = fieldNorm(doc=1423)
       0.5 = coord(1/2)
   

5. Solomon, P.: Dicovering information bahavior in sense making : I. time and timing (1997) 2.08

   2.0801835 = sum of:
     2.0801835 = product of:
       4.160367 = sum of:
         4.160367 = weight(author_txt:solomon in 957) [ClassicSimilarity], result of:
           4.160367 = score(doc=957,freq=1.0), product of:
             0.7650234 = queryWeight, product of:
               1.0899175 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.08066854 = queryNorm
             5.438222 = fieldWeight in 957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.625 = fieldNorm(doc=957)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Eisenberg, M.; Schamber, L.: Relevance : the search for a definition (1988) 0.31

   0.31329167 = sum of:
     0.31329167 = product of:
       1.305382 = sum of:
         0.06409304 = weight(abstract_txt:factors in 3552) [ClassicSimilarity], result of:
           0.06409304 = score(doc=3552,freq=1.0), product of:
             0.13780373 = queryWeight, product of:
               1.673628 = boost
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.016596764 = queryNorm
             0.4651038 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.07649127 = weight(abstract_txt:cognitive in 3552) [ClassicSimilarity], result of:
           0.07649127 = score(doc=3552,freq=1.0), product of:
             0.15504637 = queryWeight, product of:
               1.7752489 = boost
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.016596764 = queryNorm
             0.49334443 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.21690153 = weight(abstract_txt:judgements in 3552) [ClassicSimilarity], result of:
           0.21690153 = score(doc=3552,freq=1.0), product of:
             0.31061956 = queryWeight, product of:
               2.5127127 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.016596764 = queryNorm
             0.6982868 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.23064902 = weight(abstract_txt:situational in 3552) [ClassicSimilarity], result of:
           0.23064902 = score(doc=3552,freq=1.0), product of:
             0.32360965 = queryWeight, product of:
               2.5647154 = boost
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.016596764 = queryNorm
             0.7127384 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.39006773 = weight(abstract_txt:judgement in 3552) [ClassicSimilarity], result of:
           0.39006773 = score(doc=3552,freq=1.0), product of:
             0.52582854 = queryWeight, product of:
               4.0040193 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.016596764 = queryNorm
             0.74181545 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.3271794 = weight(abstract_txt:relevance in 3552) [ClassicSimilarity], result of:
           0.3271794 = score(doc=3552,freq=3.0), product of:
             0.4085492 = queryWeight, product of:
               4.991272 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016596764 = queryNorm
             0.80083233 = fieldWeight in 3552, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
       0.24 = coord(6/25)
   

2. Huang, M.-h.: Factors affecting relevance judgement : a preliminary study (1998) 0.24

   0.237221 = sum of:
     0.237221 = product of:
       1.186105 = sum of:
         0.06646548 = weight(abstract_txt:searchers in 926) [ClassicSimilarity], result of:
           0.06646548 = score(doc=926,freq=1.0), product of:
             0.10111369 = queryWeight, product of:
               1.013721 = boost
               6.009912 = idf(docFreq=294, maxDocs=44218)
               0.016596764 = queryNorm
             0.65733415 = fieldWeight in 926, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.009912 = idf(docFreq=294, maxDocs=44218)
               0.109375 = fieldNorm(doc=926)
         0.051919702 = weight(abstract_txt:search in 926) [ClassicSimilarity], result of:
           0.051919702 = score(doc=926,freq=3.0), product of:
             0.074921004 = queryWeight, product of:
               1.2340429 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016596764 = queryNorm
             0.6929926 = fieldWeight in 926, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.109375 = fieldNorm(doc=926)
         0.35786927 = weight(abstract_txt:judgements in 926) [ClassicSimilarity], result of:
           0.35786927 = score(doc=926,freq=2.0), product of:
             0.31061956 = queryWeight, product of:
               2.5127127 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.016596764 = queryNorm
             1.1521144 = fieldWeight in 926, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.109375 = fieldNorm(doc=926)
         0.26909053 = weight(abstract_txt:situational in 926) [ClassicSimilarity], result of:
           0.26909053 = score(doc=926,freq=1.0), product of:
             0.32360965 = queryWeight, product of:
               2.5647154 = boost
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.016596764 = queryNorm
             0.8315281 = fieldWeight in 926, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.109375 = fieldNorm(doc=926)
         0.44075996 = weight(abstract_txt:relevance in 926) [ClassicSimilarity], result of:
           0.44075996 = score(doc=926,freq=4.0), product of:
             0.4085492 = queryWeight, product of:
               4.991272 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016596764 = queryNorm
             1.0788418 = fieldWeight in 926, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.109375 = fieldNorm(doc=926)
       0.2 = coord(5/25)
   

3. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 0.23

   0.23057567 = sum of:
     0.23057567 = product of:
       0.82348454 = sum of:
         0.13880803 = weight(abstract_txt:naturalistic in 5213) [ClassicSimilarity], result of:
           0.13880803 = score(doc=5213,freq=3.0), product of:
             0.18183124 = queryWeight, product of:
               1.3594013 = boost
               8.059301 = idf(docFreq=37, maxDocs=44218)
               0.016596764 = queryNorm
             0.7633893 = fieldWeight in 5213, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.059301 = idf(docFreq=37, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.09329186 = weight(abstract_txt:person's in 5213) [ClassicSimilarity], result of:
           0.09329186 = score(doc=5213,freq=1.0), product of:
             0.20121562 = queryWeight, product of:
               1.4300271 = boost
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.016596764 = queryNorm
             0.46364123 = fieldWeight in 5213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.478011 = idf(docFreq=24, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.036867227 = weight(abstract_txt:study in 5213) [ClassicSimilarity], result of:
           0.036867227 = score(doc=5213,freq=4.0), product of:
             0.098449446 = queryWeight, product of:
               1.7325298 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.016596764 = queryNorm
             0.3744788 = fieldWeight in 5213, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.044619903 = weight(abstract_txt:cognitive in 5213) [ClassicSimilarity], result of:
           0.044619903 = score(doc=5213,freq=1.0), product of:
             0.15504637 = queryWeight, product of:
               1.7752489 = boost
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.016596764 = queryNorm
             0.28778425 = fieldWeight in 5213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.1265259 = weight(abstract_txt:judgements in 5213) [ClassicSimilarity], result of:
           0.1265259 = score(doc=5213,freq=1.0), product of:
             0.31061956 = queryWeight, product of:
               2.5127127 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.016596764 = queryNorm
             0.40733394 = fieldWeight in 5213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.22753951 = weight(abstract_txt:judgement in 5213) [ClassicSimilarity], result of:
           0.22753951 = score(doc=5213,freq=1.0), product of:
             0.52582854 = queryWeight, product of:
               4.0040193 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.016596764 = queryNorm
             0.43272567 = fieldWeight in 5213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.15583216 = weight(abstract_txt:relevance in 5213) [ClassicSimilarity], result of:
           0.15583216 = score(doc=5213,freq=2.0), product of:
             0.4085492 = queryWeight, product of:
               4.991272 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016596764 = queryNorm
             0.38142815 = fieldWeight in 5213, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
       0.28 = coord(7/25)
   

4. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.22

   0.21507654 = sum of:
     0.21507654 = product of:
       1.3442284 = sum of:
         0.057656083 = weight(abstract_txt:investigates in 3308) [ClassicSimilarity], result of:
           0.057656083 = score(doc=3308,freq=1.0), product of:
             0.101923384 = queryWeight, product of:
               1.0177717 = boost
               6.033927 = idf(docFreq=287, maxDocs=44218)
               0.016596764 = queryNorm
             0.5656806 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.033927 = idf(docFreq=287, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.43380305 = weight(abstract_txt:judgements in 3308) [ClassicSimilarity], result of:
           0.43380305 = score(doc=3308,freq=4.0), product of:
             0.31061956 = queryWeight, product of:
               2.5127127 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.016596764 = queryNorm
             1.3965735 = fieldWeight in 3308, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.39006773 = weight(abstract_txt:judgement in 3308) [ClassicSimilarity], result of:
           0.39006773 = score(doc=3308,freq=1.0), product of:
             0.52582854 = queryWeight, product of:
               4.0040193 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.016596764 = queryNorm
             0.74181545 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.46270156 = weight(abstract_txt:relevance in 3308) [ClassicSimilarity], result of:
           0.46270156 = score(doc=3308,freq=6.0), product of:
             0.4085492 = queryWeight, product of:
               4.991272 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016596764 = queryNorm
             1.132548 = fieldWeight in 3308, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
       0.16 = coord(4/25)
   

5. Xu, Y.: Relevance judgment in epistemic and hedonic information searches (2007) 0.20

   0.19886169 = sum of:
     0.19886169 = product of:
       0.8285904 = sum of:
         0.04804674 = weight(abstract_txt:investigates in 64) [ClassicSimilarity], result of:
           0.04804674 = score(doc=64,freq=1.0), product of:
             0.101923384 = queryWeight, product of:
               1.0177717 = boost
               6.033927 = idf(docFreq=287, maxDocs=44218)
               0.016596764 = queryNorm
             0.47140056 = fieldWeight in 64, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.033927 = idf(docFreq=287, maxDocs=44218)
               0.078125 = fieldNorm(doc=64)
         0.049070604 = weight(abstract_txt:tests in 64) [ClassicSimilarity], result of:
           0.049070604 = score(doc=64,freq=1.0), product of:
             0.10336626 = queryWeight, product of:
               1.0249504 = boost
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.016596764 = queryNorm
             0.4747255 = fieldWeight in 64, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.078125 = fieldNorm(doc=64)
         0.021411326 = weight(abstract_txt:search in 64) [ClassicSimilarity], result of:
           0.021411326 = score(doc=64,freq=1.0), product of:
             0.074921004 = queryWeight, product of:
               1.2340429 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016596764 = queryNorm
             0.28578535 = fieldWeight in 64, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=64)
         0.045611367 = weight(abstract_txt:study in 64) [ClassicSimilarity], result of:
           0.045611367 = score(doc=64,freq=3.0), product of:
             0.098449446 = queryWeight, product of:
               1.7325298 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.016596764 = queryNorm
             0.46329734 = fieldWeight in 64, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.078125 = fieldNorm(doc=64)
         0.19220752 = weight(abstract_txt:situational in 64) [ClassicSimilarity], result of:
           0.19220752 = score(doc=64,freq=1.0), product of:
             0.32360965 = queryWeight, product of:
               2.5647154 = boost
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.016596764 = queryNorm
             0.59394866 = fieldWeight in 64, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.078125 = fieldNorm(doc=64)
         0.4722428 = weight(abstract_txt:relevance in 64) [ClassicSimilarity], result of:
           0.4722428 = score(doc=64,freq=9.0), product of:
             0.4085492 = queryWeight, product of:
               4.991272 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016596764 = queryNorm
             1.1559019 = fieldWeight in 64, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=64)
       0.24 = coord(6/25)