Document (#21803)

Author

Fricke, M.

Title

Measuring recall

Source

Journal of information science. 24(1998) no.6, S.409-417.

Year

1998

Abstract

Recall, the proortion of the relevant documents retrieved, is a key indicator of the performance of an information retrieval system. With large information systems, like the WWW, recal is almost impossible to measure or estimate by all standard techniques. Proposes an 'needle hiding' technique for measuring recall under these circumstances. Shows that ranking by relative recall does not have to be isomorphic to ranking by recall and hence the use of relative recall for comparative evaluation might not be entirely sound

Theme

Retrievalstudien

Similar documents (content)

1. Thenmalar, S.; Geetha, T.V.: Enhanced ontology-based indexing and searching (2014) 0.22

   0.2220365 = sum of:
     0.2220365 = product of:
       0.616768 = sum of:
         0.01350377 = weight(abstract_txt:standard in 2633) [ClassicSimilarity], result of:
           0.01350377 = score(doc=2633,freq=1.0), product of:
             0.07310355 = queryWeight, product of:
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.015459017 = queryNorm
             0.18472114 = fieldWeight in 2633, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
         0.009563522 = weight(abstract_txt:information in 2633) [ClassicSimilarity], result of:
           0.009563522 = score(doc=2633,freq=7.0), product of:
             0.038255244 = queryWeight, product of:
               1.0230368 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015459017 = queryNorm
             0.24999245 = fieldWeight in 2633, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
         0.016982418 = weight(abstract_txt:shows in 2633) [ClassicSimilarity], result of:
           0.016982418 = score(doc=2633,freq=1.0), product of:
             0.0851729 = queryWeight, product of:
               1.0793977 = boost
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.015459017 = queryNorm
             0.19938758 = fieldWeight in 2633, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.104322 = idf(docFreq=732, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
         0.029012054 = weight(abstract_txt:measure in 2633) [ClassicSimilarity], result of:
           0.029012054 = score(doc=2633,freq=2.0), product of:
             0.09660748 = queryWeight, product of:
               1.1495719 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.015459017 = queryNorm
             0.3003086 = fieldWeight in 2633, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
         0.022359202 = weight(abstract_txt:technique in 2633) [ClassicSimilarity], result of:
           0.022359202 = score(doc=2633,freq=1.0), product of:
             0.102314994 = queryWeight, product of:
               1.1830426 = boost
               5.5944448 = idf(docFreq=448, maxDocs=44421)
               0.015459017 = queryNorm
             0.218533 = fieldWeight in 2633, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5944448 = idf(docFreq=448, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
         0.023711327 = weight(abstract_txt:retrieved in 2633) [ClassicSimilarity], result of:
           0.023711327 = score(doc=2633,freq=1.0), product of:
             0.10639936 = queryWeight, product of:
               1.2064248 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.015459017 = queryNorm
             0.22285217 = fieldWeight in 2633, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
         0.06714245 = weight(abstract_txt:estimate in 2633) [ClassicSimilarity], result of:
           0.06714245 = score(doc=2633,freq=2.0), product of:
             0.16902718 = queryWeight, product of:
               1.5205792 = boost
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.015459017 = queryNorm
             0.39722872 = fieldWeight in 2633, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
         0.0775472 = weight(abstract_txt:ranking in 2633) [ClassicSimilarity], result of:
           0.0775472 = score(doc=2633,freq=3.0), product of:
             0.20479314 = queryWeight, product of:
               2.3670285 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.015459017 = queryNorm
             0.37866113 = fieldWeight in 2633, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
         0.3569461 = weight(abstract_txt:recall in 2633) [ClassicSimilarity], result of:
           0.3569461 = score(doc=2633,freq=6.0), product of:
             0.64868945 = queryWeight, product of:
               7.2966723 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015459017 = queryNorm
             0.5502573 = fieldWeight in 2633, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0390625 = fieldNorm(doc=2633)
       0.36 = coord(9/25)
   

2. Della Mea, V.; Mizzaro, S.: Measuring retrieval effectiveness : a new proposal and a first experimental validation (2004) 0.13

   0.13268797 = sum of:
     0.13268797 = product of:
       0.66343987 = sum of:
         0.012268603 = weight(abstract_txt:information in 3263) [ClassicSimilarity], result of:
           0.012268603 = score(doc=3263,freq=2.0), product of:
             0.038255244 = queryWeight, product of:
               1.0230368 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015459017 = queryNorm
             0.3207038 = fieldWeight in 3263, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.06962893 = weight(abstract_txt:measure in 3263) [ClassicSimilarity], result of:
           0.06962893 = score(doc=3263,freq=2.0), product of:
             0.09660748 = queryWeight, product of:
               1.1495719 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.015459017 = queryNorm
             0.7207406 = fieldWeight in 3263, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.05690719 = weight(abstract_txt:retrieved in 3263) [ClassicSimilarity], result of:
           0.05690719 = score(doc=3263,freq=1.0), product of:
             0.10639936 = queryWeight, product of:
               1.2064248 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.015459017 = queryNorm
             0.53484523 = fieldWeight in 3263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.17490086 = weight(abstract_txt:measuring in 3263) [ClassicSimilarity], result of:
           0.17490086 = score(doc=3263,freq=1.0), product of:
             0.28337762 = queryWeight, product of:
               2.7843802 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.015459017 = queryNorm
             0.6172007 = fieldWeight in 3263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
         0.34973434 = weight(abstract_txt:recall in 3263) [ClassicSimilarity], result of:
           0.34973434 = score(doc=3263,freq=1.0), product of:
             0.64868945 = queryWeight, product of:
               7.2966723 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015459017 = queryNorm
             0.53913987 = fieldWeight in 3263, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.09375 = fieldNorm(doc=3263)
       0.2 = coord(5/25)
   

3. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.12

   0.12304577 = sum of:
     0.12304577 = product of:
       0.7690361 = sum of:
         0.07106473 = weight(abstract_txt:measure in 5514) [ClassicSimilarity], result of:
           0.07106473 = score(doc=5514,freq=3.0), product of:
             0.09660748 = queryWeight, product of:
               1.1495719 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.015459017 = queryNorm
             0.73560286 = fieldWeight in 5514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.047422655 = weight(abstract_txt:retrieved in 5514) [ClassicSimilarity], result of:
           0.047422655 = score(doc=5514,freq=1.0), product of:
             0.10639936 = queryWeight, product of:
               1.2064248 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.015459017 = queryNorm
             0.44570434 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.14575072 = weight(abstract_txt:measuring in 5514) [ClassicSimilarity], result of:
           0.14575072 = score(doc=5514,freq=1.0), product of:
             0.28337762 = queryWeight, product of:
               2.7843802 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.015459017 = queryNorm
             0.5143339 = fieldWeight in 5514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
         0.504798 = weight(abstract_txt:recall in 5514) [ClassicSimilarity], result of:
           0.504798 = score(doc=5514,freq=3.0), product of:
             0.64868945 = queryWeight, product of:
               7.2966723 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015459017 = queryNorm
             0.7781813 = fieldWeight in 5514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=5514)
       0.16 = coord(4/25)
   

4. Kenter, T.; Balog, K.; Rijke, M. de: Evaluating document filtering systems over time (2015) 0.12

   0.11900288 = sum of:
     0.11900288 = product of:
       0.49584535 = sum of:
         0.0071566845 = weight(abstract_txt:information in 3672) [ClassicSimilarity], result of:
           0.0071566845 = score(doc=3672,freq=2.0), product of:
             0.038255244 = queryWeight, product of:
               1.0230368 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015459017 = queryNorm
             0.18707721 = fieldWeight in 3672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3672)
         0.035553552 = weight(abstract_txt:like in 3672) [ClassicSimilarity], result of:
           0.035553552 = score(doc=3672,freq=2.0), product of:
             0.08840193 = queryWeight, product of:
               1.0996681 = boost
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.015459017 = queryNorm
             0.40218073 = fieldWeight in 3672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.200178 = idf(docFreq=665, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3672)
         0.035959408 = weight(abstract_txt:does in 3672) [ClassicSimilarity], result of:
           0.035959408 = score(doc=3672,freq=2.0), product of:
             0.08907341 = queryWeight, product of:
               1.1038367 = boost
               5.2198906 = idf(docFreq=652, maxDocs=44421)
               0.015459017 = queryNorm
             0.4037053 = fieldWeight in 3672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2198906 = idf(docFreq=652, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3672)
         0.026634121 = weight(abstract_txt:might in 3672) [ClassicSimilarity], result of:
           0.026634121 = score(doc=3672,freq=1.0), product of:
             0.09187033 = queryWeight, product of:
               1.1210331 = boost
               5.30121 = idf(docFreq=601, maxDocs=44421)
               0.015459017 = queryNorm
             0.28990993 = fieldWeight in 3672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.30121 = idf(docFreq=601, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3672)
         0.1020255 = weight(abstract_txt:measuring in 3672) [ClassicSimilarity], result of:
           0.1020255 = score(doc=3672,freq=1.0), product of:
             0.28337762 = queryWeight, product of:
               2.7843802 = boost
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.015459017 = queryNorm
             0.36003372 = fieldWeight in 3672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5834737 = idf(docFreq=166, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3672)
         0.28851607 = weight(abstract_txt:recall in 3672) [ClassicSimilarity], result of:
           0.28851607 = score(doc=3672,freq=2.0), product of:
             0.64868945 = queryWeight, product of:
               7.2966723 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015459017 = queryNorm
             0.44476765 = fieldWeight in 3672, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3672)
       0.24 = coord(6/25)
   

5. Huuskonen, S.; Vakkari, P.: Students' search process and outcome in Medline in writing an essay for a class on evidence-based medicine (2008) 0.11

   0.1136228 = sum of:
     0.1136228 = product of:
       0.7101425 = sum of:
         0.012395741 = weight(abstract_txt:information in 2891) [ClassicSimilarity], result of:
           0.012395741 = score(doc=2891,freq=6.0), product of:
             0.038255244 = queryWeight, product of:
               1.0230368 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.015459017 = queryNorm
             0.32402724 = fieldWeight in 2891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.057496917 = weight(abstract_txt:retrieved in 2891) [ClassicSimilarity], result of:
           0.057496917 = score(doc=2891,freq=3.0), product of:
             0.10639936 = queryWeight, product of:
               1.2064248 = boost
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.015459017 = queryNorm
             0.5403878 = fieldWeight in 2891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7050157 = idf(docFreq=401, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.14052528 = weight(abstract_txt:relative in 2891) [ClassicSimilarity], result of:
           0.14052528 = score(doc=2891,freq=3.0), product of:
             0.24323288 = queryWeight, product of:
               2.579627 = boost
               6.099349 = idf(docFreq=270, maxDocs=44421)
               0.015459017 = queryNorm
             0.57773966 = fieldWeight in 2891, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.099349 = idf(docFreq=270, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
         0.49972457 = weight(abstract_txt:recall in 2891) [ClassicSimilarity], result of:
           0.49972457 = score(doc=2891,freq=6.0), product of:
             0.64868945 = queryWeight, product of:
               7.2966723 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015459017 = queryNorm
             0.77036023 = fieldWeight in 2891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2891)
       0.16 = coord(4/25)