Document (#21803)

Author

Fricke, M.

Title

Measuring recall

Source

Journal of information science. 24(1998) no.6, S.409-417

Year

1998

Abstract

Recall, the proortion of the relevant documents retrieved, is a key indicator of the performance of an information retrieval system. With large information systems, like the WWW, recal is almost impossible to measure or estimate by all standard techniques. Proposes an 'needle hiding' technique for measuring recall under these circumstances. Shows that ranking by relative recall does not have to be isomorphic to ranking by recall and hence the use of relative recall for comparative evaluation might not be entirely sound

Theme

Retrievalstudien

Similar documents (content)

1. Thenmalar, S.; Geetha, T.V.: Enhanced ontology-based indexing and searching (2014) 0.22

   0.22200769 = sum of:
     0.22200769 = product of:
       0.616688 = sum of:
         0.013471718 = weight(abstract_txt:standard in 1633) [ClassicSimilarity], result of:
           0.013471718 = score(doc=1633,freq=1.0), product of:
             0.072986245 = queryWeight, product of:
               4.725219 = idf(docFreq=1065, maxDocs=44218)
               0.01544611 = queryNorm
             0.18457887 = fieldWeight in 1633, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.725219 = idf(docFreq=1065, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
         0.009587198 = weight(abstract_txt:information in 1633) [ClassicSimilarity], result of:
           0.009587198 = score(doc=1633,freq=7.0), product of:
             0.038317528 = queryWeight, product of:
               1.0246917 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01544611 = queryNorm
             0.25020397 = fieldWeight in 1633, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
         0.017045207 = weight(abstract_txt:shows in 1633) [ClassicSimilarity], result of:
           0.017045207 = score(doc=1633,freq=1.0), product of:
             0.08538087 = queryWeight, product of:
               1.0815828 = boost
               5.1107154 = idf(docFreq=724, maxDocs=44218)
               0.01544611 = queryNorm
             0.19963732 = fieldWeight in 1633, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1107154 = idf(docFreq=724, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
         0.029028429 = weight(abstract_txt:measure in 1633) [ClassicSimilarity], result of:
           0.029028429 = score(doc=1633,freq=2.0), product of:
             0.096641734 = queryWeight, product of:
               1.1506993 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.01544611 = queryNorm
             0.30037156 = fieldWeight in 1633, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
         0.022302885 = weight(abstract_txt:technique in 1633) [ClassicSimilarity], result of:
           0.022302885 = score(doc=1633,freq=1.0), product of:
             0.10214091 = queryWeight, product of:
               1.1829853 = boost
               5.5898643 = idf(docFreq=448, maxDocs=44218)
               0.01544611 = queryNorm
             0.21835408 = fieldWeight in 1633, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5898643 = idf(docFreq=448, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
         0.023746094 = weight(abstract_txt:retrieved in 1633) [ClassicSimilarity], result of:
           0.023746094 = score(doc=1633,freq=1.0), product of:
             0.106501035 = queryWeight, product of:
               1.2079707 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.01544611 = queryNorm
             0.22296585 = fieldWeight in 1633, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
         0.06731949 = weight(abstract_txt:estimate in 1633) [ClassicSimilarity], result of:
           0.06731949 = score(doc=1633,freq=2.0), product of:
             0.16932052 = queryWeight, product of:
               1.5231205 = boost
               7.1970778 = idf(docFreq=89, maxDocs=44218)
               0.01544611 = queryNorm
             0.3975861 = fieldWeight in 1633, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1970778 = idf(docFreq=89, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
         0.0776311 = weight(abstract_txt:ranking in 1633) [ClassicSimilarity], result of:
           0.0776311 = score(doc=1633,freq=3.0), product of:
             0.2049364 = queryWeight, product of:
               2.3697581 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.01544611 = queryNorm
             0.37880582 = fieldWeight in 1633, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
         0.35655588 = weight(abstract_txt:recall in 1633) [ClassicSimilarity], result of:
           0.35655588 = score(doc=1633,freq=6.0), product of:
             0.6482026 = queryWeight, product of:
               7.2997923 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.01544611 = queryNorm
             0.55006856 = fieldWeight in 1633, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0390625 = fieldNorm(doc=1633)
       0.36 = coord(9/25)
   

2. Della Mea, V.; Mizzaro, S.: Measuring retrieval effectiveness : a new proposal and a first experimental validation (2004) 0.13

   0.13275902 = sum of:
     0.13275902 = product of:
       0.6637951 = sum of:
         0.012298975 = weight(abstract_txt:information in 2263) [ClassicSimilarity], result of:
           0.012298975 = score(doc=2263,freq=2.0), product of:
             0.038317528 = queryWeight, product of:
               1.0246917 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01544611 = queryNorm
             0.32097518 = fieldWeight in 2263, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.069668226 = weight(abstract_txt:measure in 2263) [ClassicSimilarity], result of:
           0.069668226 = score(doc=2263,freq=2.0), product of:
             0.096641734 = queryWeight, product of:
               1.1506993 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.01544611 = queryNorm
             0.7208917 = fieldWeight in 2263, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.056990627 = weight(abstract_txt:retrieved in 2263) [ClassicSimilarity], result of:
           0.056990627 = score(doc=2263,freq=1.0), product of:
             0.106501035 = queryWeight, product of:
               1.2079707 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.01544611 = queryNorm
             0.53511804 = fieldWeight in 2263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.17548536 = weight(abstract_txt:measuring in 2263) [ClassicSimilarity], result of:
           0.17548536 = score(doc=2263,freq=1.0), product of:
             0.28400248 = queryWeight, product of:
               2.7896874 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.01544611 = queryNorm
             0.6179008 = fieldWeight in 2263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
         0.34935197 = weight(abstract_txt:recall in 2263) [ClassicSimilarity], result of:
           0.34935197 = score(doc=2263,freq=1.0), product of:
             0.6482026 = queryWeight, product of:
               7.2997923 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.01544611 = queryNorm
             0.5389549 = fieldWeight in 2263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.09375 = fieldNorm(doc=2263)
       0.2 = coord(5/25)
   

3. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.12

   0.12305295 = sum of:
     0.12305295 = product of:
       0.76908094 = sum of:
         0.07110484 = weight(abstract_txt:measure in 5515) [ClassicSimilarity], result of:
           0.07110484 = score(doc=5515,freq=3.0), product of:
             0.096641734 = queryWeight, product of:
               1.1506993 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.01544611 = queryNorm
             0.73575705 = fieldWeight in 5515, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.047492187 = weight(abstract_txt:retrieved in 5515) [ClassicSimilarity], result of:
           0.047492187 = score(doc=5515,freq=1.0), product of:
             0.106501035 = queryWeight, product of:
               1.2079707 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.01544611 = queryNorm
             0.4459317 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.14623779 = weight(abstract_txt:measuring in 5515) [ClassicSimilarity], result of:
           0.14623779 = score(doc=5515,freq=1.0), product of:
             0.28400248 = queryWeight, product of:
               2.7896874 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.01544611 = queryNorm
             0.5149173 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.5042461 = weight(abstract_txt:recall in 5515) [ClassicSimilarity], result of:
           0.5042461 = score(doc=5515,freq=3.0), product of:
             0.6482026 = queryWeight, product of:
               7.2997923 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.01544611 = queryNorm
             0.7779144 = fieldWeight in 5515, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
       0.16 = coord(4/25)
   

4. Kenter, T.; Balog, K.; Rijke, M. de: Evaluating document filtering systems over time (2015) 0.12

   0.11905167 = sum of:
     0.11905167 = product of:
       0.49604866 = sum of:
         0.007174402 = weight(abstract_txt:information in 2672) [ClassicSimilarity], result of:
           0.007174402 = score(doc=2672,freq=2.0), product of:
             0.038317528 = queryWeight, product of:
               1.0246917 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01544611 = queryNorm
             0.18723552 = fieldWeight in 2672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2672)
         0.035799462 = weight(abstract_txt:like in 2672) [ClassicSimilarity], result of:
           0.035799462 = score(doc=2672,freq=2.0), product of:
             0.088807166 = queryWeight, product of:
               1.1030711 = boost
               5.212252 = idf(docFreq=654, maxDocs=44218)
               0.01544611 = queryNorm
             0.40311456 = fieldWeight in 2672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.212252 = idf(docFreq=654, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2672)
         0.03589413 = weight(abstract_txt:does in 2672) [ClassicSimilarity], result of:
           0.03589413 = score(doc=2672,freq=2.0), product of:
             0.088963665 = queryWeight, product of:
               1.1040425 = boost
               5.2168427 = idf(docFreq=651, maxDocs=44218)
               0.01544611 = queryNorm
             0.40346956 = fieldWeight in 2672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2168427 = idf(docFreq=651, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2672)
         0.026613532 = weight(abstract_txt:might in 2672) [ClassicSimilarity], result of:
           0.026613532 = score(doc=2672,freq=1.0), product of:
             0.091821 = queryWeight, product of:
               1.1216322 = boost
               5.2999578 = idf(docFreq=599, maxDocs=44218)
               0.01544611 = queryNorm
             0.28984144 = fieldWeight in 2672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2999578 = idf(docFreq=599, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2672)
         0.10236646 = weight(abstract_txt:measuring in 2672) [ClassicSimilarity], result of:
           0.10236646 = score(doc=2672,freq=1.0), product of:
             0.28400248 = queryWeight, product of:
               2.7896874 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.01544611 = queryNorm
             0.36044213 = fieldWeight in 2672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2672)
         0.28820068 = weight(abstract_txt:recall in 2672) [ClassicSimilarity], result of:
           0.28820068 = score(doc=2672,freq=2.0), product of:
             0.6482026 = queryWeight, product of:
               7.2997923 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.01544611 = queryNorm
             0.44461513 = fieldWeight in 2672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2672)
       0.24 = coord(6/25)
   

5. Huuskonen, S.; Vakkari, P.: Students' search process and outcome in Medline in writing an essay for a class on evidence-based medicine (2008) 0.11

   0.11362485 = sum of:
     0.11362485 = product of:
       0.7101553 = sum of:
         0.0124264285 = weight(abstract_txt:information in 1891) [ClassicSimilarity], result of:
           0.0124264285 = score(doc=1891,freq=6.0), product of:
             0.038317528 = queryWeight, product of:
               1.0246917 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.01544611 = queryNorm
             0.32430142 = fieldWeight in 1891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.05758122 = weight(abstract_txt:retrieved in 1891) [ClassicSimilarity], result of:
           0.05758122 = score(doc=1891,freq=3.0), product of:
             0.106501035 = queryWeight, product of:
               1.2079707 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.01544611 = queryNorm
             0.5406635 = fieldWeight in 1891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.14096946 = weight(abstract_txt:relative in 1891) [ClassicSimilarity], result of:
           0.14096946 = score(doc=1891,freq=3.0), product of:
             0.2437399 = queryWeight, product of:
               2.5843885 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.01544611 = queryNorm
             0.5783602 = fieldWeight in 1891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
         0.4991782 = weight(abstract_txt:recall in 1891) [ClassicSimilarity], result of:
           0.4991782 = score(doc=1891,freq=6.0), product of:
             0.6482026 = queryWeight, product of:
               7.2997923 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.01544611 = queryNorm
             0.77009594 = fieldWeight in 1891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0546875 = fieldNorm(doc=1891)
       0.16 = coord(4/25)