Document (#4865)

Author

Katzer, J.
Snyder, H.

Title

Toward a more realistic assessment of information retrieval performance

Source

ASIS'90: Information in the year 2000, from research to applications. Proc. of the 53rd Annual Meeting of the American Society for Information Science, Toronto, Canada, 4.-8.11.1990. Ed. by Diana Henderson

Imprint

Medford, NJ : Learned Information Inc.

Year

1990

Pages

S.80-85

Abstract

The dominant approach to information retrieval (IR) experiments contains several questionable assumptions which are no longer necessary for pragmatic reasons nor warranted conceptually. The consequence of continued acceptance of one particular untenable assumption, namely that the user's information need does not change as a result of interacting with the system or with the search intermediary, is that our understanding of the IR process and the evaluation of IR systems is distored. This distortion tends to underestimate the performance of the system and its benefits of the user. Describes work-in-progress empirically to test this assertion and obtain estimates of the value added to the user's output by various components of the search process

Similar documents (author)

1. Snyder, J.: Diving into the Internet : the trouble with Gopher (1994) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:snyder in 7946) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 7946, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=7946)
   

2. Snyder, I.: Hypertext: the electronic labrynth (1996) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:snyder in 1289) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 1289, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=1289)
   

3. Snyder, H.L.: ¬The application of information technology to the bibliography of early printed books (1998) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:snyder in 3100) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 3100, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=3100)
   

4. Snyder, J.: Visual representation of information as communicative practice (2014) 5.58

   5.5805492 = sum of:
     5.5805492 = weight(author_txt:snyder in 2529) [ClassicSimilarity], result of:
       5.5805492 = fieldWeight in 2529, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.625 = fieldNorm(doc=2529)
   

5. Snyder, H.; Bonzi, S.: Patterns of self-citation across disciplines : 1980-1989 (1998) 4.46

   4.4644394 = sum of:
     4.4644394 = weight(author_txt:snyder in 4692) [ClassicSimilarity], result of:
       4.4644394 = fieldWeight in 4692, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.928879 = idf(docFreq=15, maxDocs=44421)
         0.5 = fieldNorm(doc=4692)
   

Similar documents (content)

1. Conlon, J.R.; Conlon, S.J.: Robustness of well-designed retrieval performance measures under optimal user behavior (1998) 0.12

   0.12481477 = sum of:
     0.12481477 = product of:
       0.52006155 = sum of:
         0.109833285 = weight(abstract_txt:assumptions in 3880) [ClassicSimilarity], result of:
           0.109833285 = score(doc=3880,freq=1.0), product of:
             0.1541568 = queryWeight, product of:
               6.514082 = idf(docFreq=178, maxDocs=44421)
               0.023665162 = queryNorm
             0.7124777 = fieldWeight in 3880, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.514082 = idf(docFreq=178, maxDocs=44421)
               0.109375 = fieldNorm(doc=3880)
         0.030490633 = weight(abstract_txt:system in 3880) [ClassicSimilarity], result of:
           0.030490633 = score(doc=3880,freq=1.0), product of:
             0.082653455 = queryWeight, product of:
               1.0355335 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.023665162 = queryNorm
             0.36889726 = fieldWeight in 3880, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.109375 = fieldNorm(doc=3880)
         0.057835117 = weight(abstract_txt:retrieval in 3880) [ClassicSimilarity], result of:
           0.057835117 = score(doc=3880,freq=3.0), product of:
             0.087815404 = queryWeight, product of:
               1.0673798 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.023665162 = queryNorm
             0.6585988 = fieldWeight in 3880, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.109375 = fieldNorm(doc=3880)
         0.029221984 = weight(abstract_txt:information in 3880) [ClassicSimilarity], result of:
           0.029221984 = score(doc=3880,freq=3.0), product of:
             0.06376953 = queryWeight, product of:
               1.1140018 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023665162 = queryNorm
             0.4582437 = fieldWeight in 3880, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.109375 = fieldNorm(doc=3880)
         0.13571347 = weight(abstract_txt:performance in 3880) [ClassicSimilarity], result of:
           0.13571347 = score(doc=3880,freq=3.0), product of:
             0.15506898 = queryWeight, product of:
               1.4183915 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.023665162 = queryNorm
             0.8751813 = fieldWeight in 3880, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.109375 = fieldNorm(doc=3880)
         0.15696703 = weight(abstract_txt:user's in 3880) [ClassicSimilarity], result of:
           0.15696703 = score(doc=3880,freq=1.0), product of:
             0.24642739 = queryWeight, product of:
               1.7880437 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.023665162 = queryNorm
             0.6369707 = fieldWeight in 3880, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.109375 = fieldNorm(doc=3880)
       0.24 = coord(6/25)
   

2. Muresan, G.; Harper, D.J.: Topic modeling for mediated access to very large document collections (2004) 0.12

   0.11911594 = sum of:
     0.11911594 = product of:
       0.37223732 = sum of:
         0.054916643 = weight(abstract_txt:assumptions in 3507) [ClassicSimilarity], result of:
           0.054916643 = score(doc=3507,freq=1.0), product of:
             0.1541568 = queryWeight, product of:
               6.514082 = idf(docFreq=178, maxDocs=44421)
               0.023665162 = queryNorm
             0.35623884 = fieldWeight in 3507, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.514082 = idf(docFreq=178, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3507)
         0.026405662 = weight(abstract_txt:system in 3507) [ClassicSimilarity], result of:
           0.026405662 = score(doc=3507,freq=3.0), product of:
             0.082653455 = queryWeight, product of:
               1.0355335 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.023665162 = queryNorm
             0.3194744 = fieldWeight in 3507, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3507)
         0.02361109 = weight(abstract_txt:retrieval in 3507) [ClassicSimilarity], result of:
           0.02361109 = score(doc=3507,freq=2.0), product of:
             0.087815404 = queryWeight, product of:
               1.0673798 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.023665162 = queryNorm
             0.26887184 = fieldWeight in 3507, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3507)
         0.016871322 = weight(abstract_txt:information in 3507) [ClassicSimilarity], result of:
           0.016871322 = score(doc=3507,freq=4.0), product of:
             0.06376953 = queryWeight, product of:
               1.1140018 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023665162 = queryNorm
             0.26456714 = fieldWeight in 3507, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3507)
         0.019395148 = weight(abstract_txt:search in 3507) [ClassicSimilarity], result of:
           0.019395148 = score(doc=3507,freq=1.0), product of:
             0.097043276 = queryWeight, product of:
               1.1220608 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.023665162 = queryNorm
             0.19986083 = fieldWeight in 3507, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3507)
         0.080867924 = weight(abstract_txt:intermediary in 3507) [ClassicSimilarity], result of:
           0.080867924 = score(doc=3507,freq=1.0), product of:
             0.19953124 = queryWeight, product of:
               1.1376904 = boost
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.023665162 = queryNorm
             0.40528953 = fieldWeight in 3507, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3507)
         0.039177105 = weight(abstract_txt:performance in 3507) [ClassicSimilarity], result of:
           0.039177105 = score(doc=3507,freq=1.0), product of:
             0.15506898 = queryWeight, product of:
               1.4183915 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.023665162 = queryNorm
             0.25264308 = fieldWeight in 3507, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3507)
         0.11099244 = weight(abstract_txt:user's in 3507) [ClassicSimilarity], result of:
           0.11099244 = score(doc=3507,freq=2.0), product of:
             0.24642739 = queryWeight, product of:
               1.7880437 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.023665162 = queryNorm
             0.45040625 = fieldWeight in 3507, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3507)
       0.32 = coord(8/25)
   

3. Ennis, M.; Sutcliffe, A.G.; Watkinson, S.J.: Towards a predictive model of information seeking : empirical studies of end-user-searching (1999) 0.11

   0.10717451 = sum of:
     0.10717451 = product of:
       0.3827661 = sum of:
         0.021560133 = weight(abstract_txt:system in 1296) [ClassicSimilarity], result of:
           0.021560133 = score(doc=1296,freq=2.0), product of:
             0.082653455 = queryWeight, product of:
               1.0355335 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.023665162 = queryNorm
             0.26084974 = fieldWeight in 1296, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1296)
         0.020663064 = weight(abstract_txt:information in 1296) [ClassicSimilarity], result of:
           0.020663064 = score(doc=1296,freq=6.0), product of:
             0.06376953 = queryWeight, product of:
               1.1140018 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023665162 = queryNorm
             0.32402724 = fieldWeight in 1296, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1296)
         0.05818545 = weight(abstract_txt:search in 1296) [ClassicSimilarity], result of:
           0.05818545 = score(doc=1296,freq=9.0), product of:
             0.097043276 = queryWeight, product of:
               1.1220608 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.023665162 = queryNorm
             0.5995825 = fieldWeight in 1296, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1296)
         0.080867924 = weight(abstract_txt:intermediary in 1296) [ClassicSimilarity], result of:
           0.080867924 = score(doc=1296,freq=1.0), product of:
             0.19953124 = queryWeight, product of:
               1.1376904 = boost
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.023665162 = queryNorm
             0.40528953 = fieldWeight in 1296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1296)
         0.026375007 = weight(abstract_txt:process in 1296) [ClassicSimilarity], result of:
           0.026375007 = score(doc=1296,freq=1.0), product of:
             0.11911462 = queryWeight, product of:
               1.243129 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.023665162 = queryNorm
             0.22142543 = fieldWeight in 1296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1296)
         0.039177105 = weight(abstract_txt:performance in 1296) [ClassicSimilarity], result of:
           0.039177105 = score(doc=1296,freq=1.0), product of:
             0.15506898 = queryWeight, product of:
               1.4183915 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.023665162 = queryNorm
             0.25264308 = fieldWeight in 1296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1296)
         0.13593742 = weight(abstract_txt:user's in 1296) [ClassicSimilarity], result of:
           0.13593742 = score(doc=1296,freq=3.0), product of:
             0.24642739 = queryWeight, product of:
               1.7880437 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.023665162 = queryNorm
             0.55163276 = fieldWeight in 1296, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1296)
       0.28 = coord(7/25)
   

4. Stojanovic, N.: Ontology-based Information Retrieval : methods and tools for cooperative query answering (2005) 0.10

   0.09862414 = sum of:
     0.09862414 = product of:
       0.4109339 = sum of:
         0.022633426 = weight(abstract_txt:system in 1701) [ClassicSimilarity], result of:
           0.022633426 = score(doc=1701,freq=3.0), product of:
             0.082653455 = queryWeight, product of:
               1.0355335 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.023665162 = queryNorm
             0.2738352 = fieldWeight in 1701, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.046875 = fieldNorm(doc=1701)
         0.051597174 = weight(abstract_txt:retrieval in 1701) [ClassicSimilarity], result of:
           0.051597174 = score(doc=1701,freq=13.0), product of:
             0.087815404 = queryWeight, product of:
               1.0673798 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.023665162 = queryNorm
             0.58756405 = fieldWeight in 1701, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.046875 = fieldNorm(doc=1701)
         0.02045113 = weight(abstract_txt:information in 1701) [ClassicSimilarity], result of:
           0.02045113 = score(doc=1701,freq=8.0), product of:
             0.06376953 = queryWeight, product of:
               1.1140018 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023665162 = queryNorm
             0.3207038 = fieldWeight in 1701, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.046875 = fieldNorm(doc=1701)
         0.07649172 = weight(abstract_txt:conceptually in 1701) [ClassicSimilarity], result of:
           0.07649172 = score(doc=1701,freq=1.0), product of:
             0.21307583 = queryWeight, product of:
               1.1756709 = boost
               7.6584163 = idf(docFreq=56, maxDocs=44421)
               0.023665162 = queryNorm
             0.35898826 = fieldWeight in 1701, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.6584163 = idf(docFreq=56, maxDocs=44421)
               0.046875 = fieldNorm(doc=1701)
         0.074979424 = weight(abstract_txt:process in 1701) [ClassicSimilarity], result of:
           0.074979424 = score(doc=1701,freq=11.0), product of:
             0.11911462 = queryWeight, product of:
               1.243129 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.023665162 = queryNorm
             0.6294729 = fieldWeight in 1701, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.046875 = fieldNorm(doc=1701)
         0.16478105 = weight(abstract_txt:user's in 1701) [ClassicSimilarity], result of:
           0.16478105 = score(doc=1701,freq=6.0), product of:
             0.24642739 = queryWeight, product of:
               1.7880437 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.023665162 = queryNorm
             0.66867995 = fieldWeight in 1701, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.046875 = fieldNorm(doc=1701)
       0.24 = coord(6/25)
   

5. Cole, C.: Interaction with an enabling information retrieval system : modeling the user's decoding and encoding operations (2000) 0.10

   0.09543596 = sum of:
     0.09543596 = product of:
       0.39764985 = sum of:
         0.046097506 = weight(abstract_txt:system in 5585) [ClassicSimilarity], result of:
           0.046097506 = score(doc=5585,freq=7.0), product of:
             0.082653455 = queryWeight, product of:
               1.0355335 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.023665162 = queryNorm
             0.55772024 = fieldWeight in 5585, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=5585)
         0.01908064 = weight(abstract_txt:retrieval in 5585) [ClassicSimilarity], result of:
           0.01908064 = score(doc=5585,freq=1.0), product of:
             0.087815404 = queryWeight, product of:
               1.0673798 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.023665162 = queryNorm
             0.21728125 = fieldWeight in 5585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.0625 = fieldNorm(doc=5585)
         0.02550704 = weight(abstract_txt:information in 5585) [ClassicSimilarity], result of:
           0.02550704 = score(doc=5585,freq=7.0), product of:
             0.06376953 = queryWeight, product of:
               1.1140018 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.023665162 = queryNorm
             0.3999879 = fieldWeight in 5585, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=5585)
         0.09743093 = weight(abstract_txt:interacting in 5585) [ClassicSimilarity], result of:
           0.09743093 = score(doc=5585,freq=1.0), product of:
             0.20667914 = queryWeight, product of:
               1.1578891 = boost
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.023665162 = queryNorm
             0.47141153 = fieldWeight in 5585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.0625 = fieldNorm(doc=5585)
         0.030142864 = weight(abstract_txt:process in 5585) [ClassicSimilarity], result of:
           0.030142864 = score(doc=5585,freq=1.0), product of:
             0.11911462 = queryWeight, product of:
               1.243129 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.023665162 = queryNorm
             0.25305763 = fieldWeight in 5585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=5585)
         0.17939088 = weight(abstract_txt:user's in 5585) [ClassicSimilarity], result of:
           0.17939088 = score(doc=5585,freq=4.0), product of:
             0.24642739 = queryWeight, product of:
               1.7880437 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.023665162 = queryNorm
             0.7279665 = fieldWeight in 5585, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0625 = fieldNorm(doc=5585)
       0.24 = coord(6/25)