Document (#21769)

Author

Rorvig, M.

Title

¬A visual exploration of the orderliness of TREC relevance judgements

Source

Journal of the American Society for Information Science. 50(1999) no.8, S.652-660

Year

1999

Abstract

TREC topic specification statements 1-50 are converted to a similarity matrix, scaled, and plotted. 2 close topics and 2 distant topics are selected from within the topic visual field. Subsequent scaling and visualization of documents associated with the close topics reveals a strong mixing of documents from both topic sets. Scaling and visualization of documents associated with the distant topics reveals a bifurcated distribution of documents from both topic sets. Relevant documents in both cases present near the center of both visualizations. Scaling and visualization of documents by multidimensional scaling using a maximum likelihood estimation method is shown to accurately model token similarity relationships among topic specification statements. The implications of these findings for prior critical arguments regarding IR test collections generally, and TREC specifically, by othe scholars is examined

Similar documents (author)

1. Rorvig, M.E.: ¬A method for automatically abstracting visual documents (1993) 5.66

   5.661144 = sum of:
     5.661144 = weight(author_txt:rorvig in 2723) [ClassicSimilarity], result of:
       5.661144 = fieldWeight in 2723, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.05783 = idf(docFreq=13, maxDocs=44218)
         0.625 = fieldNorm(doc=2723)
   

2. Rorvig, M.E.: Image information retrieval (1987) 5.66

   5.661144 = sum of:
     5.661144 = weight(author_txt:rorvig in 5640) [ClassicSimilarity], result of:
       5.661144 = fieldWeight in 5640, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.05783 = idf(docFreq=13, maxDocs=44218)
         0.625 = fieldNorm(doc=5640)
   

3. Rorvig, M.E.: ¬The bibliographic control of microcomputer software (1988) 5.66

   5.661144 = sum of:
     5.661144 = weight(author_txt:rorvig in 1275) [ClassicSimilarity], result of:
       5.661144 = fieldWeight in 1275, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.05783 = idf(docFreq=13, maxDocs=44218)
         0.625 = fieldNorm(doc=1275)
   

4. Rorvig, M.E.: Psychometric measurement and information retrieval (1989) 5.66

   5.661144 = sum of:
     5.661144 = weight(author_txt:rorvig in 333) [ClassicSimilarity], result of:
       5.661144 = fieldWeight in 333, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.05783 = idf(docFreq=13, maxDocs=44218)
         0.625 = fieldNorm(doc=333)
   

5. Rorvig, M.: Scaled structure in visualized TREC data and query feedback (1998) 5.66

   5.661144 = sum of:
     5.661144 = weight(author_txt:rorvig in 3269) [ClassicSimilarity], result of:
       5.661144 = fieldWeight in 3269, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.05783 = idf(docFreq=13, maxDocs=44218)
         0.625 = fieldNorm(doc=3269)
   

Similar documents (content)

1. Rorvig, M.: Images of similarity : a visual exploration of optimal similarity metrics and scaling properties of TREC topic-document sets (1999) 0.28

   0.27658057 = sum of:
     0.27658057 = product of:
       0.9877877 = sum of:
         0.020276653 = weight(abstract_txt:from in 3767) [ClassicSimilarity], result of:
           0.020276653 = score(doc=3767,freq=2.0), product of:
             0.04742896 = queryWeight, product of:
               1.0999793 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015600536 = queryNorm
             0.42751628 = fieldWeight in 3767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.109375 = fieldNorm(doc=3767)
         0.1820157 = weight(abstract_txt:scaled in 3767) [ClassicSimilarity], result of:
           0.1820157 = score(doc=3767,freq=1.0), product of:
             0.17895958 = queryWeight, product of:
               1.2336147 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.015600536 = queryNorm
             1.0170772 = fieldWeight in 3767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.109375 = fieldNorm(doc=3767)
         0.08925411 = weight(abstract_txt:sets in 3767) [ClassicSimilarity], result of:
           0.08925411 = score(doc=3767,freq=2.0), product of:
             0.11128446 = queryWeight, product of:
               1.3757335 = boost
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.015600536 = queryNorm
             0.80203575 = fieldWeight in 3767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.109375 = fieldNorm(doc=3767)
         0.12616102 = weight(abstract_txt:similarity in 3767) [ClassicSimilarity], result of:
           0.12616102 = score(doc=3767,freq=2.0), product of:
             0.1401627 = queryWeight, product of:
               1.5439502 = boost
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.015600536 = queryNorm
             0.90010405 = fieldWeight in 3767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.109375 = fieldNorm(doc=3767)
         0.28880104 = weight(abstract_txt:trec in 3767) [ClassicSimilarity], result of:
           0.28880104 = score(doc=3767,freq=2.0), product of:
             0.27868393 = queryWeight, product of:
               2.6663592 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.015600536 = queryNorm
             1.0363032 = fieldWeight in 3767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.109375 = fieldNorm(doc=3767)
         0.13445315 = weight(abstract_txt:documents in 3767) [ClassicSimilarity], result of:
           0.13445315 = score(doc=3767,freq=2.0), product of:
             0.21091303 = queryWeight, product of:
               3.2804196 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015600536 = queryNorm
             0.63748145 = fieldWeight in 3767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.109375 = fieldNorm(doc=3767)
         0.14682601 = weight(abstract_txt:topic in 3767) [ClassicSimilarity], result of:
           0.14682601 = score(doc=3767,freq=1.0), product of:
             0.26518017 = queryWeight, product of:
               3.3578212 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.015600536 = queryNorm
             0.553684 = fieldWeight in 3767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.109375 = fieldNorm(doc=3767)
       0.28 = coord(7/25)
   

2. Rorvig, M.: Scaled structure in visualized TREC data and query feedback (1998) 0.20

   0.20132326 = sum of:
     0.20132326 = product of:
       0.8388469 = sum of:
         0.020482514 = weight(abstract_txt:from in 3269) [ClassicSimilarity], result of:
           0.020482514 = score(doc=3269,freq=4.0), product of:
             0.04742896 = queryWeight, product of:
               1.0999793 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015600536 = queryNorm
             0.43185666 = fieldWeight in 3269, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.078125 = fieldNorm(doc=3269)
         0.18386362 = weight(abstract_txt:scaled in 3269) [ClassicSimilarity], result of:
           0.18386362 = score(doc=3269,freq=2.0), product of:
             0.17895958 = queryWeight, product of:
               1.2336147 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.015600536 = queryNorm
             1.0274031 = fieldWeight in 3269, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.078125 = fieldNorm(doc=3269)
         0.110746086 = weight(abstract_txt:specification in 3269) [ClassicSimilarity], result of:
           0.110746086 = score(doc=3269,freq=1.0), product of:
             0.20261112 = queryWeight, product of:
               1.8563023 = boost
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.015600536 = queryNorm
             0.5465943 = fieldWeight in 3269, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.078125 = fieldNorm(doc=3269)
         0.20628645 = weight(abstract_txt:trec in 3269) [ClassicSimilarity], result of:
           0.20628645 = score(doc=3269,freq=2.0), product of:
             0.27868393 = queryWeight, product of:
               2.6663592 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.015600536 = queryNorm
             0.7402165 = fieldWeight in 3269, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.078125 = fieldNorm(doc=3269)
         0.1358182 = weight(abstract_txt:documents in 3269) [ClassicSimilarity], result of:
           0.1358182 = score(doc=3269,freq=4.0), product of:
             0.21091303 = queryWeight, product of:
               3.2804196 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015600536 = queryNorm
             0.64395356 = fieldWeight in 3269, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=3269)
         0.18165009 = weight(abstract_txt:topic in 3269) [ClassicSimilarity], result of:
           0.18165009 = score(doc=3269,freq=3.0), product of:
             0.26518017 = queryWeight, product of:
               3.3578212 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.015600536 = queryNorm
             0.6850063 = fieldWeight in 3269, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.078125 = fieldNorm(doc=3269)
       0.24 = coord(6/25)
   

3. Information visualization : human-centered issues and perspectives (2008) 0.16

   0.15750167 = sum of:
     0.15750167 = product of:
       0.656257 = sum of:
         0.08080287 = weight(abstract_txt:visualizations in 3285) [ClassicSimilarity], result of:
           0.08080287 = score(doc=3285,freq=1.0), product of:
             0.13033235 = queryWeight, product of:
               1.0527571 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.015600536 = queryNorm
             0.61997557 = fieldWeight in 3285, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.078125 = fieldNorm(doc=3285)
         0.010241257 = weight(abstract_txt:from in 3285) [ClassicSimilarity], result of:
           0.010241257 = score(doc=3285,freq=1.0), product of:
             0.04742896 = queryWeight, product of:
               1.0999793 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015600536 = queryNorm
             0.21592833 = fieldWeight in 3285, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.078125 = fieldNorm(doc=3285)
         0.080650225 = weight(abstract_txt:visual in 3285) [ClassicSimilarity], result of:
           0.080650225 = score(doc=3285,freq=2.0), product of:
             0.13016817 = queryWeight, product of:
               1.4878852 = boost
               5.6078424 = idf(docFreq=440, maxDocs=44218)
               0.015600536 = queryNorm
             0.61958486 = fieldWeight in 3285, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6078424 = idf(docFreq=440, maxDocs=44218)
               0.078125 = fieldNorm(doc=3285)
         0.33155707 = weight(abstract_txt:visualization in 3285) [ClassicSimilarity], result of:
           0.33155707 = score(doc=3285,freq=8.0), product of:
             0.24088901 = queryWeight, product of:
               2.4789696 = boost
               6.228827 = idf(docFreq=236, maxDocs=44218)
               0.015600536 = queryNorm
             1.3763893 = fieldWeight in 3285, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.228827 = idf(docFreq=236, maxDocs=44218)
               0.078125 = fieldNorm(doc=3285)
         0.085096404 = weight(abstract_txt:topics in 3285) [ClassicSimilarity], result of:
           0.085096404 = score(doc=3285,freq=1.0), product of:
             0.21415514 = queryWeight, product of:
               2.698959 = boost
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.015600536 = queryNorm
             0.3973587 = fieldWeight in 3285, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.078125 = fieldNorm(doc=3285)
         0.0679091 = weight(abstract_txt:documents in 3285) [ClassicSimilarity], result of:
           0.0679091 = score(doc=3285,freq=1.0), product of:
             0.21091303 = queryWeight, product of:
               3.2804196 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015600536 = queryNorm
             0.32197678 = fieldWeight in 3285, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=3285)
       0.24 = coord(6/25)
   

4. Osiñska, V.: Visual analysis of classification scheme (2010) 0.15

   0.14668709 = sum of:
     0.14668709 = product of:
       0.6111962 = sum of:
         0.008193005 = weight(abstract_txt:from in 4068) [ClassicSimilarity], result of:
           0.008193005 = score(doc=4068,freq=1.0), product of:
             0.04742896 = queryWeight, product of:
               1.0999793 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015600536 = queryNorm
             0.17274266 = fieldWeight in 4068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=4068)
         0.07209201 = weight(abstract_txt:similarity in 4068) [ClassicSimilarity], result of:
           0.07209201 = score(doc=4068,freq=2.0), product of:
             0.1401627 = queryWeight, product of:
               1.5439502 = boost
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.015600536 = queryNorm
             0.51434517 = fieldWeight in 4068, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.0625 = fieldNorm(doc=4068)
         0.13262282 = weight(abstract_txt:visualization in 4068) [ClassicSimilarity], result of:
           0.13262282 = score(doc=4068,freq=2.0), product of:
             0.24088901 = queryWeight, product of:
               2.4789696 = boost
               6.228827 = idf(docFreq=236, maxDocs=44218)
               0.015600536 = queryNorm
             0.5505557 = fieldWeight in 4068, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.228827 = idf(docFreq=236, maxDocs=44218)
               0.0625 = fieldNorm(doc=4068)
         0.09627559 = weight(abstract_txt:topics in 4068) [ClassicSimilarity], result of:
           0.09627559 = score(doc=4068,freq=2.0), product of:
             0.21415514 = queryWeight, product of:
               2.698959 = boost
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.015600536 = queryNorm
             0.44956002 = fieldWeight in 4068, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.0625 = fieldNorm(doc=4068)
         0.0940976 = weight(abstract_txt:documents in 4068) [ClassicSimilarity], result of:
           0.0940976 = score(doc=4068,freq=3.0), product of:
             0.21091303 = queryWeight, product of:
               3.2804196 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015600536 = queryNorm
             0.44614407 = fieldWeight in 4068, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=4068)
         0.20791519 = weight(abstract_txt:scaling in 4068) [ClassicSimilarity], result of:
           0.20791519 = score(doc=4068,freq=1.0), product of:
             0.4508013 = queryWeight, product of:
               3.9158373 = boost
               7.3793993 = idf(docFreq=74, maxDocs=44218)
               0.015600536 = queryNorm
             0.46121246 = fieldWeight in 4068, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3793993 = idf(docFreq=74, maxDocs=44218)
               0.0625 = fieldNorm(doc=4068)
       0.24 = coord(6/25)
   

5. Maaten, L. van den; Hinton, G.: Visualizing non-metric similarities in multiple maps (2012) 0.14

   0.14072366 = sum of:
     0.14072366 = product of:
       0.7036183 = sum of:
         0.064642295 = weight(abstract_txt:visualizations in 3884) [ClassicSimilarity], result of:
           0.064642295 = score(doc=3884,freq=1.0), product of:
             0.13033235 = queryWeight, product of:
               1.0527571 = boost
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.015600536 = queryNorm
             0.49598044 = fieldWeight in 3884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.935687 = idf(docFreq=42, maxDocs=44218)
               0.0625 = fieldNorm(doc=3884)
         0.008193005 = weight(abstract_txt:from in 3884) [ClassicSimilarity], result of:
           0.008193005 = score(doc=3884,freq=1.0), product of:
             0.04742896 = queryWeight, product of:
               1.0999793 = boost
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.015600536 = queryNorm
             0.17274266 = fieldWeight in 3884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.7638826 = idf(docFreq=7577, maxDocs=44218)
               0.0625 = fieldNorm(doc=3884)
         0.07209201 = weight(abstract_txt:similarity in 3884) [ClassicSimilarity], result of:
           0.07209201 = score(doc=3884,freq=2.0), product of:
             0.1401627 = queryWeight, product of:
               1.5439502 = boost
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.015600536 = queryNorm
             0.51434517 = fieldWeight in 3884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8191514 = idf(docFreq=356, maxDocs=44218)
               0.0625 = fieldNorm(doc=3884)
         0.0937785 = weight(abstract_txt:visualization in 3884) [ClassicSimilarity], result of:
           0.0937785 = score(doc=3884,freq=1.0), product of:
             0.24088901 = queryWeight, product of:
               2.4789696 = boost
               6.228827 = idf(docFreq=236, maxDocs=44218)
               0.015600536 = queryNorm
             0.3893017 = fieldWeight in 3884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.228827 = idf(docFreq=236, maxDocs=44218)
               0.0625 = fieldNorm(doc=3884)
         0.4649125 = weight(abstract_txt:scaling in 3884) [ClassicSimilarity], result of:
           0.4649125 = score(doc=3884,freq=5.0), product of:
             0.4508013 = queryWeight, product of:
               3.9158373 = boost
               7.3793993 = idf(docFreq=74, maxDocs=44218)
               0.015600536 = queryNorm
             1.0313025 = fieldWeight in 3884, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.3793993 = idf(docFreq=74, maxDocs=44218)
               0.0625 = fieldNorm(doc=3884)
       0.2 = coord(5/25)