Document (#21269)

Author

Tang, R.
Solomon, P.

Title

Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior

Source

Information processing and management. 34(1998) nos.2/3, S.237-256

Year

1998

Abstract

Investigates the cognitive nature of an end-user's relevance judgements using the concept of mental modes. Identifies situational factors of relevance by noting the judgement criteria used by subjects as they move through the relevance judgement process. Tests the feasibility of the specific research strategy employed in this study that incorporates an intensive case study of the search behaviour of searchers with naturalistic inquiry for which the cognitive development and situational factors of end-user relevance judgements are the centre of the investigation. Introduces a dynamic model or relevance on which the study is built, presents methodology, results and discussion

Similar documents (author)

1. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 5.90

   5.902169 = sum of:
     5.902169 = sum of:
       2.5722544 = weight(author_txt:tang in 213) [ClassicSimilarity], result of:
         2.5722544 = score(doc=213,freq=1.0), product of:
           0.6440381 = queryWeight, product of:
             7.9878955 = idf(docFreq=40, maxDocs=44421)
             0.080626756 = queryNorm
           3.9939477 = fieldWeight in 213, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             7.9878955 = idf(docFreq=40, maxDocs=44421)
             0.5 = fieldNorm(doc=213)
       3.329915 = weight(author_txt:solomon in 213) [ClassicSimilarity], result of:
         3.329915 = score(doc=213,freq=1.0), product of:
           0.7649934 = queryWeight, product of:
             1.0898659 = boost
             8.705735 = idf(docFreq=19, maxDocs=44421)
             0.080626756 = queryNorm
           4.3528676 = fieldWeight in 213, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.705735 = idf(docFreq=19, maxDocs=44421)
             0.5 = fieldNorm(doc=213)
   

2. Solomon, P.: Children's information retrieval behavior : a case analysis of an OPAC (1993) 2.08

   2.0811968 = sum of:
     2.0811968 = product of:
       4.1623936 = sum of:
         4.1623936 = weight(author_txt:solomon in 4348) [ClassicSimilarity], result of:
           4.1623936 = score(doc=4348,freq=1.0), product of:
             0.7649934 = queryWeight, product of:
               1.0898659 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.080626756 = queryNorm
             5.4410844 = fieldWeight in 4348, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.625 = fieldNorm(doc=4348)
       0.5 = coord(1/2)
   

3. Solomon, P.: On the dynamics of information system use : from novice to? (1992) 2.08

   2.0811968 = sum of:
     2.0811968 = product of:
       4.1623936 = sum of:
         4.1623936 = weight(author_txt:solomon in 4518) [ClassicSimilarity], result of:
           4.1623936 = score(doc=4518,freq=1.0), product of:
             0.7649934 = queryWeight, product of:
               1.0898659 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.080626756 = queryNorm
             5.4410844 = fieldWeight in 4518, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.625 = fieldNorm(doc=4518)
       0.5 = coord(1/2)
   

4. Solomon, P.: Children, technology, and instruction : a case study of elementary school children using an online public access catalog (OPAC) (1994) 2.08

   2.0811968 = sum of:
     2.0811968 = product of:
       4.1623936 = sum of:
         4.1623936 = weight(author_txt:solomon in 1491) [ClassicSimilarity], result of:
           4.1623936 = score(doc=1491,freq=1.0), product of:
             0.7649934 = queryWeight, product of:
               1.0898659 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.080626756 = queryNorm
             5.4410844 = fieldWeight in 1491, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.625 = fieldNorm(doc=1491)
       0.5 = coord(1/2)
   

5. Solomon, P.: Dicovering information bahavior in sense making : I. time and timing (1997) 2.08

   2.0811968 = sum of:
     2.0811968 = product of:
       4.1623936 = sum of:
         4.1623936 = weight(author_txt:solomon in 957) [ClassicSimilarity], result of:
           4.1623936 = score(doc=957,freq=1.0), product of:
             0.7649934 = queryWeight, product of:
               1.0898659 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.080626756 = queryNorm
             5.4410844 = fieldWeight in 957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.625 = fieldNorm(doc=957)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Eisenberg, M.; Schamber, L.: Relevance : the search for a definition (1988) 0.31

   0.31288788 = sum of:
     0.31288788 = product of:
       1.3036995 = sum of:
         0.06389178 = weight(abstract_txt:factors in 3620) [ClassicSimilarity], result of:
           0.06389178 = score(doc=3620,freq=1.0), product of:
             0.1375714 = queryWeight, product of:
               1.6725307 = boost
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.016603837 = queryNorm
             0.46442637 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.076505825 = weight(abstract_txt:cognitive in 3620) [ClassicSimilarity], result of:
           0.076505825 = score(doc=3620,freq=1.0), product of:
             0.15512952 = queryWeight, product of:
               1.7760584 = boost
               5.260521 = idf(docFreq=626, maxDocs=44421)
               0.016603837 = queryNorm
             0.49317384 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.260521 = idf(docFreq=626, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.21511106 = weight(abstract_txt:judgements in 3620) [ClassicSimilarity], result of:
           0.21511106 = score(doc=3620,freq=1.0), product of:
             0.30903426 = queryWeight, product of:
               2.5067632 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016603837 = queryNorm
             0.69607514 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.22984524 = weight(abstract_txt:situational in 3620) [ClassicSimilarity], result of:
           0.22984524 = score(doc=3620,freq=1.0), product of:
             0.32298955 = queryWeight, product of:
               2.5627382 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.016603837 = queryNorm
             0.7116182 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.3912255 = weight(abstract_txt:judgement in 3620) [ClassicSimilarity], result of:
           0.3912255 = score(doc=3620,freq=1.0), product of:
             0.5270842 = queryWeight, product of:
               4.00955 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.016603837 = queryNorm
             0.7422448 = fieldWeight in 3620, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
         0.32712004 = weight(abstract_txt:relevance in 3620) [ClassicSimilarity], result of:
           0.32712004 = score(doc=3620,freq=3.0), product of:
             0.40866703 = queryWeight, product of:
               4.9929295 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016603837 = queryNorm
             0.80045617 = fieldWeight in 3620, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=3620)
       0.24 = coord(6/25)
   

2. Huang, M.-h.: Factors affecting relevance judgement : a preliminary study (1998) 0.24

   0.23643422 = sum of:
     0.23643422 = product of:
       1.1821711 = sum of:
         0.06658687 = weight(abstract_txt:searchers in 1926) [ClassicSimilarity], result of:
           0.06658687 = score(doc=1926,freq=1.0), product of:
             0.10127821 = queryWeight, product of:
               1.0147359 = boost
               6.011108 = idf(docFreq=295, maxDocs=44421)
               0.016603837 = queryNorm
             0.6574649 = fieldWeight in 1926, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.011108 = idf(docFreq=295, maxDocs=44421)
               0.109375 = fieldNorm(doc=1926)
         0.051836364 = weight(abstract_txt:search in 1926) [ClassicSimilarity], result of:
           0.051836364 = score(doc=1926,freq=3.0), product of:
             0.07487144 = queryWeight, product of:
               1.2338663 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016603837 = queryNorm
             0.6923382 = fieldWeight in 1926, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.109375 = fieldNorm(doc=1926)
         0.35491514 = weight(abstract_txt:judgements in 1926) [ClassicSimilarity], result of:
           0.35491514 = score(doc=1926,freq=2.0), product of:
             0.30903426 = queryWeight, product of:
               2.5067632 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016603837 = queryNorm
             1.1484654 = fieldWeight in 1926, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.109375 = fieldNorm(doc=1926)
         0.26815277 = weight(abstract_txt:situational in 1926) [ClassicSimilarity], result of:
           0.26815277 = score(doc=1926,freq=1.0), product of:
             0.32298955 = queryWeight, product of:
               2.5627382 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.016603837 = queryNorm
             0.8302212 = fieldWeight in 1926, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.109375 = fieldNorm(doc=1926)
         0.44068003 = weight(abstract_txt:relevance in 1926) [ClassicSimilarity], result of:
           0.44068003 = score(doc=1926,freq=4.0), product of:
             0.40866703 = queryWeight, product of:
               4.9929295 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016603837 = queryNorm
             1.0783352 = fieldWeight in 1926, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.109375 = fieldNorm(doc=1926)
       0.2 = coord(5/25)
   

3. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 0.23

   0.23059036 = sum of:
     0.23059036 = product of:
       0.823537 = sum of:
         0.13921565 = weight(abstract_txt:naturalistic in 213) [ClassicSimilarity], result of:
           0.13921565 = score(doc=213,freq=3.0), product of:
             0.18226163 = queryWeight, product of:
               1.361265 = boost
               8.063882 = idf(docFreq=37, maxDocs=44421)
               0.016603837 = queryNorm
             0.76382315 = fieldWeight in 213, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.063882 = idf(docFreq=37, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.093557954 = weight(abstract_txt:person's in 213) [ClassicSimilarity], result of:
           0.093557954 = score(doc=213,freq=1.0), product of:
             0.20168057 = queryWeight, product of:
               1.4319474 = boost
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.016603837 = queryNorm
             0.46389174 = fieldWeight in 213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.036634814 = weight(abstract_txt:study in 213) [ClassicSimilarity], result of:
           0.036634814 = score(doc=213,freq=4.0), product of:
             0.09807538 = queryWeight, product of:
               1.72956 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.016603837 = queryNorm
             0.3735373 = fieldWeight in 213, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.044628397 = weight(abstract_txt:cognitive in 213) [ClassicSimilarity], result of:
           0.044628397 = score(doc=213,freq=1.0), product of:
             0.15512952 = queryWeight, product of:
               1.7760584 = boost
               5.260521 = idf(docFreq=626, maxDocs=44421)
               0.016603837 = queryNorm
             0.28768474 = fieldWeight in 213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.260521 = idf(docFreq=626, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.12548146 = weight(abstract_txt:judgements in 213) [ClassicSimilarity], result of:
           0.12548146 = score(doc=213,freq=1.0), product of:
             0.30903426 = queryWeight, product of:
               2.5067632 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016603837 = queryNorm
             0.40604383 = fieldWeight in 213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.22821486 = weight(abstract_txt:judgement in 213) [ClassicSimilarity], result of:
           0.22821486 = score(doc=213,freq=1.0), product of:
             0.5270842 = queryWeight, product of:
               4.00955 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.016603837 = queryNorm
             0.43297613 = fieldWeight in 213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.1558039 = weight(abstract_txt:relevance in 213) [ClassicSimilarity], result of:
           0.1558039 = score(doc=213,freq=2.0), product of:
             0.40866703 = queryWeight, product of:
               4.9929295 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016603837 = queryNorm
             0.381249 = fieldWeight in 213, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
       0.28 = coord(7/25)
   

4. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.21

   0.21452133 = sum of:
     0.21452133 = product of:
       1.3407583 = sum of:
         0.05669297 = weight(abstract_txt:investigates in 3307) [ClassicSimilarity], result of:
           0.05669297 = score(doc=3307,freq=1.0), product of:
             0.1008264 = queryWeight, product of:
               1.01247 = boost
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.016603837 = queryNorm
             0.562283 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.43022212 = weight(abstract_txt:judgements in 3307) [ClassicSimilarity], result of:
           0.43022212 = score(doc=3307,freq=4.0), product of:
             0.30903426 = queryWeight, product of:
               2.5067632 = boost
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.016603837 = queryNorm
             1.3921503 = fieldWeight in 3307, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.4248013 = idf(docFreq=71, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.3912255 = weight(abstract_txt:judgement in 3307) [ClassicSimilarity], result of:
           0.3912255 = score(doc=3307,freq=1.0), product of:
             0.5270842 = queryWeight, product of:
               4.00955 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.016603837 = queryNorm
             0.7422448 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
         0.4626177 = weight(abstract_txt:relevance in 3307) [ClassicSimilarity], result of:
           0.4626177 = score(doc=3307,freq=6.0), product of:
             0.40866703 = queryWeight, product of:
               4.9929295 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016603837 = queryNorm
             1.1320162 = fieldWeight in 3307, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=3307)
       0.16 = coord(4/25)
   

5. Xu, Y.: Relevance judgment in epistemic and hedonic information searches (2007) 0.20

   0.19843057 = sum of:
     0.19843057 = product of:
       0.826794 = sum of:
         0.04724414 = weight(abstract_txt:investigates in 1064) [ClassicSimilarity], result of:
           0.04724414 = score(doc=1064,freq=1.0), product of:
             0.1008264 = queryWeight, product of:
               1.01247 = boost
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.016603837 = queryNorm
             0.46856913 = fieldWeight in 1064, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.078125 = fieldNorm(doc=1064)
         0.049154267 = weight(abstract_txt:tests in 1064) [ClassicSimilarity], result of:
           0.049154267 = score(doc=1064,freq=1.0), product of:
             0.103526086 = queryWeight, product of:
               1.0259352 = boost
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.016603837 = queryNorm
             0.4748008 = fieldWeight in 1064, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.078125 = fieldNorm(doc=1064)
         0.021376954 = weight(abstract_txt:search in 1064) [ClassicSimilarity], result of:
           0.021376954 = score(doc=1064,freq=1.0), product of:
             0.07487144 = queryWeight, product of:
               1.2338663 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.016603837 = queryNorm
             0.28551546 = fieldWeight in 1064, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.078125 = fieldNorm(doc=1064)
         0.045323826 = weight(abstract_txt:study in 1064) [ClassicSimilarity], result of:
           0.045323826 = score(doc=1064,freq=3.0), product of:
             0.09807538 = queryWeight, product of:
               1.72956 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.016603837 = queryNorm
             0.46213254 = fieldWeight in 1064, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.078125 = fieldNorm(doc=1064)
         0.1915377 = weight(abstract_txt:situational in 1064) [ClassicSimilarity], result of:
           0.1915377 = score(doc=1064,freq=1.0), product of:
             0.32298955 = queryWeight, product of:
               2.5627382 = boost
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.016603837 = queryNorm
             0.59301513 = fieldWeight in 1064, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.590594 = idf(docFreq=60, maxDocs=44421)
               0.078125 = fieldNorm(doc=1064)
         0.47215715 = weight(abstract_txt:relevance in 1064) [ClassicSimilarity], result of:
           0.47215715 = score(doc=1064,freq=9.0), product of:
             0.40866703 = queryWeight, product of:
               4.9929295 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.016603837 = queryNorm
             1.155359 = fieldWeight in 1064, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.078125 = fieldNorm(doc=1064)
       0.24 = coord(6/25)