Document (#12071)

Author

Blair, D.C.

Title

STAIRS Redux : thoughts on the STAIRS evaluation, ten years after

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.4-22

Year

1996

Abstract

The test of retrieval effectiveness performed on IBM's STAIRS and reported in 'Communications of the ACM' 10 years ago, continues to be cited frequently in the information retrieval literature. The reasons for the study's continuing pertinence to today's research are discussed, and the political, legal, and commercial aspects of the study are presented. In addition, the method of calculating recall that was used in the STAIRS study is discussed in some detail, especially how it reduces the 5 major types of uncertainty in recall estimations. It is also suggested that this method of recall estimation may serve as the basis for recall estimations that might be truly comparable between systems

Theme

Retrievalstudien

Object

STAIRS

Similar documents (author)

1. Blair, D.C.: ¬An extended relational document retrieval model (1988) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:blair in 5280) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 5280, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=5280)
   

2. Blair, D.C.: Full text retrieval : Evaluation and implications (1986) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:blair in 2115) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 2115, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=2115)
   

3. Blair, D.C.: Knowledge management : hype, hope, or help? (2002) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:blair in 1982) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 1982, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=1982)
   

4. Blair, D.C.: ¬The challenge of commercial document retrieval : Part II: a strategy for document searching based on identifiable document partitions (2002) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:blair in 3576) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 3576, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=3576)
   

5. Blair, D.C.: ¬The challenge of commercial document retrieval : Part I: Major issues, and a framework based on search exhaustivity, determinacy of representation and document collection size (2002) 5.62

   5.620886 = sum of:
     5.620886 = weight(author_txt:blair in 3580) [ClassicSimilarity], result of:
       5.620886 = fieldWeight in 3580, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.993418 = idf(docFreq=14, maxDocs=44421)
         0.625 = fieldNorm(doc=3580)
   

Similar documents (content)

1. Berger, F.C.; Hofstede, A.H.M. ter; Van der Weide, T.P.: Supporting query by navigation (1996) 0.15

   0.14821133 = sum of:
     0.14821133 = product of:
       0.92632085 = sum of:
         0.031484436 = weight(abstract_txt:study in 35) [ClassicSimilarity], result of:
           0.031484436 = score(doc=35,freq=2.0), product of:
             0.069533445 = queryWeight, product of:
               1.1369336 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.017907823 = queryNorm
             0.45279557 = fieldWeight in 35, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.09375 = fieldNorm(doc=35)
         0.023483347 = weight(abstract_txt:retrieval in 35) [ClassicSimilarity], result of:
           0.023483347 = score(doc=35,freq=1.0), product of:
             0.07205207 = queryWeight, product of:
               1.1573412 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017907823 = queryNorm
             0.3259219 = fieldWeight in 35, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=35)
         0.13750784 = weight(abstract_txt:estimation in 35) [ClassicSimilarity], result of:
           0.13750784 = score(doc=35,freq=1.0), product of:
             0.18578677 = queryWeight, product of:
               1.3141067 = boost
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.017907823 = queryNorm
             0.74013793 = fieldWeight in 35, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.09375 = fieldNorm(doc=35)
         0.73384523 = weight(abstract_txt:estimations in 35) [ClassicSimilarity], result of:
           0.73384523 = score(doc=35,freq=2.0), product of:
             0.5673697 = queryWeight, product of:
               3.2476654 = boost
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.017907823 = queryNorm
             1.2934164 = fieldWeight in 35, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.755557 = idf(docFreq=6, maxDocs=44421)
               0.09375 = fieldNorm(doc=35)
       0.16 = coord(4/25)
   

2. Cox, K.: ¬An experiment to test the utility of repeating phrases for information retrieval systems (1994) 0.10

   0.10407793 = sum of:
     0.10407793 = product of:
       0.5203896 = sum of:
         0.027397238 = weight(abstract_txt:retrieval in 895) [ClassicSimilarity], result of:
           0.027397238 = score(doc=895,freq=1.0), product of:
             0.07205207 = queryWeight, product of:
               1.1573412 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017907823 = queryNorm
             0.3802422 = fieldWeight in 895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=895)
         0.012936866 = weight(abstract_txt:that in 895) [ClassicSimilarity], result of:
           0.012936866 = score(doc=895,freq=1.0), product of:
             0.05001402 = queryWeight, product of:
               1.1809452 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017907823 = queryNorm
             0.2586648 = fieldWeight in 895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=895)
         0.17265695 = weight(abstract_txt:calculating in 895) [ClassicSimilarity], result of:
           0.17265695 = score(doc=895,freq=1.0), product of:
             0.19511381 = queryWeight, product of:
               1.3466887 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.017907823 = queryNorm
             0.88490385 = fieldWeight in 895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.109375 = fieldNorm(doc=895)
         0.05937068 = weight(abstract_txt:method in 895) [ClassicSimilarity], result of:
           0.05937068 = score(doc=895,freq=1.0), product of:
             0.120658144 = queryWeight, product of:
               1.4976714 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.017907823 = queryNorm
             0.49205697 = fieldWeight in 895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.109375 = fieldNorm(doc=895)
         0.24802788 = weight(abstract_txt:recall in 895) [ClassicSimilarity], result of:
           0.24802788 = score(doc=895,freq=1.0), product of:
             0.39432314 = queryWeight, product of:
               3.828947 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017907823 = queryNorm
             0.6289965 = fieldWeight in 895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.109375 = fieldNorm(doc=895)
       0.2 = coord(5/25)
   

3. Alemayehu, N.: Analysis of performance variation using quey expansion (2003) 0.10

   0.09533854 = sum of:
     0.09533854 = product of:
       0.39724392 = sum of:
         0.020989623 = weight(abstract_txt:study in 2454) [ClassicSimilarity], result of:
           0.020989623 = score(doc=2454,freq=2.0), product of:
             0.069533445 = queryWeight, product of:
               1.1369336 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.017907823 = queryNorm
             0.3018637 = fieldWeight in 2454, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=2454)
         0.038348146 = weight(abstract_txt:retrieval in 2454) [ClassicSimilarity], result of:
           0.038348146 = score(doc=2454,freq=6.0), product of:
             0.07205207 = queryWeight, product of:
               1.1573412 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017907823 = queryNorm
             0.53222823 = fieldWeight in 2454, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=2454)
         0.012804175 = weight(abstract_txt:that in 2454) [ClassicSimilarity], result of:
           0.012804175 = score(doc=2454,freq=3.0), product of:
             0.05001402 = queryWeight, product of:
               1.1809452 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017907823 = queryNorm
             0.25601172 = fieldWeight in 2454, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2454)
         0.076686434 = weight(abstract_txt:truly in 2454) [ClassicSimilarity], result of:
           0.076686434 = score(doc=2454,freq=1.0), product of:
             0.16494393 = queryWeight, product of:
               1.2382017 = boost
               7.438788 = idf(docFreq=70, maxDocs=44421)
               0.017907823 = queryNorm
             0.46492425 = fieldWeight in 2454, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.438788 = idf(docFreq=70, maxDocs=44421)
               0.0625 = fieldNorm(doc=2454)
         0.047978755 = weight(abstract_txt:method in 2454) [ClassicSimilarity], result of:
           0.047978755 = score(doc=2454,freq=2.0), product of:
             0.120658144 = queryWeight, product of:
               1.4976714 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.017907823 = queryNorm
             0.39764208 = fieldWeight in 2454, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=2454)
         0.20043679 = weight(abstract_txt:recall in 2454) [ClassicSimilarity], result of:
           0.20043679 = score(doc=2454,freq=2.0), product of:
             0.39432314 = queryWeight, product of:
               3.828947 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017907823 = queryNorm
             0.5083059 = fieldWeight in 2454, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0625 = fieldNorm(doc=2454)
       0.24 = coord(6/25)
   

4. Keen, E.M.: Presenting results of experimental retrieval comparisons (1992) 0.09

   0.08698036 = sum of:
     0.08698036 = product of:
       0.54362726 = sum of:
         0.040674344 = weight(abstract_txt:retrieval in 3643) [ClassicSimilarity], result of:
           0.040674344 = score(doc=3643,freq=3.0), product of:
             0.07205207 = queryWeight, product of:
               1.1573412 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.017907823 = queryNorm
             0.5645132 = fieldWeight in 3643, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=3643)
         0.14799167 = weight(abstract_txt:calculating in 3643) [ClassicSimilarity], result of:
           0.14799167 = score(doc=3643,freq=1.0), product of:
             0.19511381 = queryWeight, product of:
               1.3466887 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.017907823 = queryNorm
             0.758489 = fieldWeight in 3643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.09375 = fieldNorm(doc=3643)
         0.054306075 = weight(abstract_txt:discussed in 3643) [ClassicSimilarity], result of:
           0.054306075 = score(doc=3643,freq=1.0), product of:
             0.12600045 = queryWeight, product of:
               1.530468 = boost
               4.5973234 = idf(docFreq=1216, maxDocs=44421)
               0.017907823 = queryNorm
             0.43099907 = fieldWeight in 3643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5973234 = idf(docFreq=1216, maxDocs=44421)
               0.09375 = fieldNorm(doc=3643)
         0.3006552 = weight(abstract_txt:recall in 3643) [ClassicSimilarity], result of:
           0.3006552 = score(doc=3643,freq=2.0), product of:
             0.39432314 = queryWeight, product of:
               3.828947 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017907823 = queryNorm
             0.76245886 = fieldWeight in 3643, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.09375 = fieldNorm(doc=3643)
       0.16 = coord(4/25)
   

5. Chen, H.; Martinez, J.; Kirchhoff, A.; Ng, T.D.; Schatz, B.R.: Alleviating search uncertainty through concept associations : automatic indexing, co-occurence analysis, and parallel computing (1998) 0.08

   0.08379454 = sum of:
     0.08379454 = product of:
       0.4189727 = sum of:
         0.07669036 = weight(abstract_txt:comparable in 6202) [ClassicSimilarity], result of:
           0.07669036 = score(doc=6202,freq=1.0), product of:
             0.14214922 = queryWeight, product of:
               1.1494642 = boost
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.017907823 = queryNorm
             0.539506 = fieldWeight in 6202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.078125 = fieldNorm(doc=6202)
         0.10964374 = weight(abstract_txt:uncertainty in 6202) [ClassicSimilarity], result of:
           0.10964374 = score(doc=6202,freq=2.0), product of:
             0.14318468 = queryWeight, product of:
               1.1536431 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.017907823 = queryNorm
             0.7657505 = fieldWeight in 6202, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.078125 = fieldNorm(doc=6202)
         0.0130682085 = weight(abstract_txt:that in 6202) [ClassicSimilarity], result of:
           0.0130682085 = score(doc=6202,freq=2.0), product of:
             0.05001402 = queryWeight, product of:
               1.1809452 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.017907823 = queryNorm
             0.2612909 = fieldWeight in 6202, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=6202)
         0.04240763 = weight(abstract_txt:method in 6202) [ClassicSimilarity], result of:
           0.04240763 = score(doc=6202,freq=1.0), product of:
             0.120658144 = queryWeight, product of:
               1.4976714 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.017907823 = queryNorm
             0.35146925 = fieldWeight in 6202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=6202)
         0.17716275 = weight(abstract_txt:recall in 6202) [ClassicSimilarity], result of:
           0.17716275 = score(doc=6202,freq=1.0), product of:
             0.39432314 = queryWeight, product of:
               3.828947 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017907823 = queryNorm
             0.44928318 = fieldWeight in 6202, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=6202)
       0.2 = coord(5/25)