Document (#21769)

Author

Rorvig, M.

Title

¬A visual exploration of the orderliness of TREC relevance judgements

Source

Journal of the American Society for Information Science. 50(1999) no.8, S.652-660

Year

1999

Abstract

TREC topic specification statements 1-50 are converted to a similarity matrix, scaled, and plotted. 2 close topics and 2 distant topics are selected from within the topic visual field. Subsequent scaling and visualization of documents associated with the close topics reveals a strong mixing of documents from both topic sets. Scaling and visualization of documents associated with the distant topics reveals a bifurcated distribution of documents from both topic sets. Relevant documents in both cases present near the center of both visualizations. Scaling and visualization of documents by multidimensional scaling using a maximum likelihood estimation method is shown to accurately model token similarity relationships among topic specification statements. The implications of these findings for prior critical arguments regarding IR test collections generally, and TREC specifically, by othe scholars is examined

Similar documents (author)

1. Rorvig, M.E.: ¬A method for automatically abstracting visual documents (1993) 5.66

   5.664006 = sum of:
     5.664006 = weight(author_txt:rorvig in 2722) [ClassicSimilarity], result of:
       5.664006 = fieldWeight in 2722, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.06241 = idf(docFreq=13, maxDocs=44421)
         0.625 = fieldNorm(doc=2722)
   

2. Rorvig, M.E.: Image information retrieval (1987) 5.66

   5.664006 = sum of:
     5.664006 = weight(author_txt:rorvig in 5639) [ClassicSimilarity], result of:
       5.664006 = fieldWeight in 5639, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.06241 = idf(docFreq=13, maxDocs=44421)
         0.625 = fieldNorm(doc=5639)
   

3. Rorvig, M.E.: ¬The bibliographic control of microcomputer software (1988) 5.66

   5.664006 = sum of:
     5.664006 = weight(author_txt:rorvig in 1343) [ClassicSimilarity], result of:
       5.664006 = fieldWeight in 1343, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.06241 = idf(docFreq=13, maxDocs=44421)
         0.625 = fieldNorm(doc=1343)
   

4. Rorvig, M.E.: Psychometric measurement and information retrieval (1989) 5.66

   5.664006 = sum of:
     5.664006 = weight(author_txt:rorvig in 333) [ClassicSimilarity], result of:
       5.664006 = fieldWeight in 333, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.06241 = idf(docFreq=13, maxDocs=44421)
         0.625 = fieldNorm(doc=333)
   

5. Rorvig, M.: Scaled structure in visualized TREC data and query feedback (1998) 5.66

   5.664006 = sum of:
     5.664006 = weight(author_txt:rorvig in 4269) [ClassicSimilarity], result of:
       5.664006 = fieldWeight in 4269, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.06241 = idf(docFreq=13, maxDocs=44421)
         0.625 = fieldNorm(doc=4269)
   

Similar documents (content)

1. Rorvig, M.: Images of similarity : a visual exploration of optimal similarity metrics and scaling properties of TREC topic-document sets (1999) 0.28

   0.27680278 = sum of:
     0.27680278 = product of:
       0.98858136 = sum of:
         0.020194061 = weight(abstract_txt:from in 4767) [ClassicSimilarity], result of:
           0.020194061 = score(doc=4767,freq=2.0), product of:
             0.047312524 = queryWeight, product of:
               1.0997884 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015590228 = queryNorm
             0.42682272 = fieldWeight in 4767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.109375 = fieldNorm(doc=4767)
         0.18242873 = weight(abstract_txt:scaled in 4767) [ClassicSimilarity], result of:
           0.18242873 = score(doc=4767,freq=1.0), product of:
             0.17927735 = queryWeight, product of:
               1.2360134 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.015590228 = queryNorm
             1.0175782 = fieldWeight in 4767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.109375 = fieldNorm(doc=4767)
         0.089178815 = weight(abstract_txt:sets in 4767) [ClassicSimilarity], result of:
           0.089178815 = score(doc=4767,freq=2.0), product of:
             0.111251116 = queryWeight, product of:
               1.3769801 = boost
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.015590228 = queryNorm
             0.80159926 = fieldWeight in 4767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.109375 = fieldNorm(doc=4767)
         0.12619515 = weight(abstract_txt:similarity in 4767) [ClassicSimilarity], result of:
           0.12619515 = score(doc=4767,freq=2.0), product of:
             0.14022487 = queryWeight, product of:
               1.5459235 = boost
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.015590228 = queryNorm
             0.8999484 = fieldWeight in 4767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.109375 = fieldNorm(doc=4767)
         0.2896222 = weight(abstract_txt:trec in 4767) [ClassicSimilarity], result of:
           0.2896222 = score(doc=4767,freq=2.0), product of:
             0.2792854 = queryWeight, product of:
               2.672054 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.015590228 = queryNorm
             1.0370115 = fieldWeight in 4767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.109375 = fieldNorm(doc=4767)
         0.1347572 = weight(abstract_txt:documents in 4767) [ClassicSimilarity], result of:
           0.1347572 = score(doc=4767,freq=2.0), product of:
             0.21128646 = queryWeight, product of:
               3.28679 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.015590228 = queryNorm
             0.63779384 = fieldWeight in 4767, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.109375 = fieldNorm(doc=4767)
         0.14620519 = weight(abstract_txt:topic in 4767) [ClassicSimilarity], result of:
           0.14620519 = score(doc=4767,freq=1.0), product of:
             0.2645017 = queryWeight, product of:
               3.3570647 = boost
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.015590228 = queryNorm
             0.5527571 = fieldWeight in 4767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.109375 = fieldNorm(doc=4767)
       0.28 = coord(7/25)
   

2. Rorvig, M.: Scaled structure in visualized TREC data and query feedback (1998) 0.20

   0.20150676 = sum of:
     0.20150676 = product of:
       0.83961153 = sum of:
         0.020399082 = weight(abstract_txt:from in 4269) [ClassicSimilarity], result of:
           0.020399082 = score(doc=4269,freq=4.0), product of:
             0.047312524 = queryWeight, product of:
               1.0997884 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015590228 = queryNorm
             0.4311561 = fieldWeight in 4269, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.078125 = fieldNorm(doc=4269)
         0.18428084 = weight(abstract_txt:scaled in 4269) [ClassicSimilarity], result of:
           0.18428084 = score(doc=4269,freq=2.0), product of:
             0.17927735 = queryWeight, product of:
               1.2360134 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.015590228 = queryNorm
             1.0279093 = fieldWeight in 4269, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.078125 = fieldNorm(doc=4269)
         0.11105133 = weight(abstract_txt:specification in 4269) [ClassicSimilarity], result of:
           0.11105133 = score(doc=4269,freq=1.0), product of:
             0.20303665 = queryWeight, product of:
               1.8602132 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.015590228 = queryNorm
             0.5469521 = fieldWeight in 4269, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.078125 = fieldNorm(doc=4269)
         0.20687297 = weight(abstract_txt:trec in 4269) [ClassicSimilarity], result of:
           0.20687297 = score(doc=4269,freq=2.0), product of:
             0.2792854 = queryWeight, product of:
               2.672054 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.015590228 = queryNorm
             0.7407225 = fieldWeight in 4269, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.078125 = fieldNorm(doc=4269)
         0.13612533 = weight(abstract_txt:documents in 4269) [ClassicSimilarity], result of:
           0.13612533 = score(doc=4269,freq=4.0), product of:
             0.21128646 = queryWeight, product of:
               3.28679 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.015590228 = queryNorm
             0.64426905 = fieldWeight in 4269, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=4269)
         0.180882 = weight(abstract_txt:topic in 4269) [ClassicSimilarity], result of:
           0.180882 = score(doc=4269,freq=3.0), product of:
             0.2645017 = queryWeight, product of:
               3.3570647 = boost
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.015590228 = queryNorm
             0.6838595 = fieldWeight in 4269, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.078125 = fieldNorm(doc=4269)
       0.24 = coord(6/25)
   

3. Information visualization : human-centered issues and perspectives (2008) 0.16

   0.15726751 = sum of:
     0.15726751 = product of:
       0.6552813 = sum of:
         0.08030518 = weight(abstract_txt:visualizations in 272) [ClassicSimilarity], result of:
           0.08030518 = score(doc=272,freq=1.0), product of:
             0.12983078 = queryWeight, product of:
               1.0518391 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.015590228 = queryNorm
             0.6185373 = fieldWeight in 272, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.078125 = fieldNorm(doc=272)
         0.010199541 = weight(abstract_txt:from in 272) [ClassicSimilarity], result of:
           0.010199541 = score(doc=272,freq=1.0), product of:
             0.047312524 = queryWeight, product of:
               1.0997884 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015590228 = queryNorm
             0.21557805 = fieldWeight in 272, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.078125 = fieldNorm(doc=272)
         0.08071628 = weight(abstract_txt:visual in 272) [ClassicSimilarity], result of:
           0.08071628 = score(doc=272,freq=2.0), product of:
             0.13027349 = queryWeight, product of:
               1.4900591 = boost
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.015590228 = queryNorm
             0.619591 = fieldWeight in 272, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.078125 = fieldNorm(doc=272)
         0.33120823 = weight(abstract_txt:visualization in 272) [ClassicSimilarity], result of:
           0.33120823 = score(doc=272,freq=8.0), product of:
             0.24078335 = queryWeight, product of:
               2.4810433 = boost
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.015590228 = queryNorm
             1.3755445 = fieldWeight in 272, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.078125 = fieldNorm(doc=272)
         0.0847894 = weight(abstract_txt:topics in 272) [ClassicSimilarity], result of:
           0.0847894 = score(doc=272,freq=1.0), product of:
             0.21369597 = queryWeight, product of:
               2.6989114 = boost
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.015590228 = queryNorm
             0.39677587 = fieldWeight in 272, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.078125 = fieldNorm(doc=272)
         0.06806266 = weight(abstract_txt:documents in 272) [ClassicSimilarity], result of:
           0.06806266 = score(doc=272,freq=1.0), product of:
             0.21128646 = queryWeight, product of:
               3.28679 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.015590228 = queryNorm
             0.32213452 = fieldWeight in 272, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=272)
       0.24 = coord(6/25)
   

4. Osiñska, V.: Visual analysis of classification scheme (2010) 0.15

   0.14648165 = sum of:
     0.14648165 = product of:
       0.61034024 = sum of:
         0.008159633 = weight(abstract_txt:from in 68) [ClassicSimilarity], result of:
           0.008159633 = score(doc=68,freq=1.0), product of:
             0.047312524 = queryWeight, product of:
               1.0997884 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015590228 = queryNorm
             0.17246243 = fieldWeight in 68, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=68)
         0.07211152 = weight(abstract_txt:similarity in 68) [ClassicSimilarity], result of:
           0.07211152 = score(doc=68,freq=2.0), product of:
             0.14022487 = queryWeight, product of:
               1.5459235 = boost
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.015590228 = queryNorm
             0.51425624 = fieldWeight in 68, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.0625 = fieldNorm(doc=68)
         0.13248329 = weight(abstract_txt:visualization in 68) [ClassicSimilarity], result of:
           0.13248329 = score(doc=68,freq=2.0), product of:
             0.24078335 = queryWeight, product of:
               2.4810433 = boost
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.015590228 = queryNorm
             0.5502178 = fieldWeight in 68, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.0625 = fieldNorm(doc=68)
         0.09592826 = weight(abstract_txt:topics in 68) [ClassicSimilarity], result of:
           0.09592826 = score(doc=68,freq=2.0), product of:
             0.21369597 = queryWeight, product of:
               2.6989114 = boost
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.015590228 = queryNorm
             0.44890064 = fieldWeight in 68, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.0625 = fieldNorm(doc=68)
         0.094310395 = weight(abstract_txt:documents in 68) [ClassicSimilarity], result of:
           0.094310395 = score(doc=68,freq=3.0), product of:
             0.21128646 = queryWeight, product of:
               3.28679 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.015590228 = queryNorm
             0.4463627 = fieldWeight in 68, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=68)
         0.20734718 = weight(abstract_txt:scaling in 68) [ClassicSimilarity], result of:
           0.20734718 = score(doc=68,freq=1.0), product of:
             0.4500983 = queryWeight, product of:
               3.9169152 = boost
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.015590228 = queryNorm
             0.4606709 = fieldWeight in 68, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.0625 = fieldNorm(doc=68)
       0.24 = coord(6/25)
   

5. Maaten, L. van den; Hinton, G.: Visualizing non-metric similarities in multiple maps (2012) 0.14

   0.14036751 = sum of:
     0.14036751 = product of:
       0.70183754 = sum of:
         0.06424414 = weight(abstract_txt:visualizations in 4884) [ClassicSimilarity], result of:
           0.06424414 = score(doc=4884,freq=1.0), product of:
             0.12983078 = queryWeight, product of:
               1.0518391 = boost
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.015590228 = queryNorm
             0.49482986 = fieldWeight in 4884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.917278 = idf(docFreq=43, maxDocs=44421)
               0.0625 = fieldNorm(doc=4884)
         0.008159633 = weight(abstract_txt:from in 4884) [ClassicSimilarity], result of:
           0.008159633 = score(doc=4884,freq=1.0), product of:
             0.047312524 = queryWeight, product of:
               1.0997884 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.015590228 = queryNorm
             0.17246243 = fieldWeight in 4884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=4884)
         0.07211152 = weight(abstract_txt:similarity in 4884) [ClassicSimilarity], result of:
           0.07211152 = score(doc=4884,freq=2.0), product of:
             0.14022487 = queryWeight, product of:
               1.5459235 = boost
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.015590228 = queryNorm
             0.51425624 = fieldWeight in 4884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.0625 = fieldNorm(doc=4884)
         0.09367984 = weight(abstract_txt:visualization in 4884) [ClassicSimilarity], result of:
           0.09367984 = score(doc=4884,freq=1.0), product of:
             0.24078335 = queryWeight, product of:
               2.4810433 = boost
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.015590228 = queryNorm
             0.38906276 = fieldWeight in 4884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.0625 = fieldNorm(doc=4884)
         0.4636424 = weight(abstract_txt:scaling in 4884) [ClassicSimilarity], result of:
           0.4636424 = score(doc=4884,freq=5.0), product of:
             0.4500983 = queryWeight, product of:
               3.9169152 = boost
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.015590228 = queryNorm
             1.0300914 = fieldWeight in 4884, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.0625 = fieldNorm(doc=4884)
       0.2 = coord(5/25)