Document (#13224)

Author

Robertson, S.E.

Title

¬The parametric description of retrieval tests : Part I: The basic parameters

Source

Journal of documentation. 25(1969) no.1, S.1-27

Year

1969

Abstract

Some parameters and techniques in use for describing the results of test on IR system are analysed. Several considerations outside the scope of the usual 2X2 table are relevant to the choice of parameters. In particular, a variable which produces a 'performance curve' of a system corresponds to an extension of the 2x2 table. Also, the statistical relationships between parameters are all-important. It is considered that precision is not such a useful measure of performance (in conjunction with recall)as fallout. A more powerful alternative to Cleverdon's 'invitable inverse relationship between recall and precision'is proposed and justified, namely that the recall-fallout graph is convex.

Theme

Retrievalstudien

Similar documents (author)

1. Robertson, M.A.: Windows 3.0 for the online searcher (1991) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 591) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 591, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=591)
   

2. Robertson, S.E.: Some recent theories and models in information retrieval (1980) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 1325) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 1325, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=1325)
   

3. Robertson, S.E.: Theories and models in information retrieval (1977) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 1843) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 1843, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=1843)
   

4. Robertson, S.E.: On term selection for query expansion (1990) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 2649) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 2649, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=2649)
   

5. Robertson, S.E.: On relevance weight estimation and query expansion (1986) 4.57

   4.574651 = sum of:
     4.574651 = weight(author_txt:robertson in 3874) [ClassicSimilarity], result of:
       4.574651 = fieldWeight in 3874, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.319441 = idf(docFreq=79, maxDocs=44421)
         0.625 = fieldNorm(doc=3874)
   

Similar documents (content)

1. Robertson, S.E.: ¬The parametric description of retrieval tests : Part II: Overall measures (1969) 0.26

   0.25777367 = sum of:
     0.25777367 = product of:
       1.074057 = sum of:
         0.051159505 = weight(abstract_txt:namely in 4224) [ClassicSimilarity], result of:
           0.051159505 = score(doc=4224,freq=1.0), product of:
             0.103739 = queryWeight, product of:
               1.0386586 = boost
               6.312396 = idf(docFreq=218, maxDocs=44421)
               0.015822496 = queryNorm
             0.49315596 = fieldWeight in 4224, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.312396 = idf(docFreq=218, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.1571589 = weight(abstract_txt:curve in 4224) [ClassicSimilarity], result of:
           0.1571589 = score(doc=4224,freq=2.0), product of:
             0.1739965 = queryWeight, product of:
               1.345154 = boost
               8.175107 = idf(docFreq=33, maxDocs=44421)
               0.015822496 = queryNorm
             0.90323025 = fieldWeight in 4224, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.175107 = idf(docFreq=33, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.040108055 = weight(abstract_txt:performance in 4224) [ClassicSimilarity], result of:
           0.040108055 = score(doc=4224,freq=1.0), product of:
             0.11112768 = queryWeight, product of:
               1.5202951 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015822496 = queryNorm
             0.36091867 = fieldWeight in 4224, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.13071886 = weight(abstract_txt:table in 4224) [ClassicSimilarity], result of:
           0.13071886 = score(doc=4224,freq=1.0), product of:
             0.24428305 = queryWeight, product of:
               2.2540495 = boost
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.015822496 = queryNorm
             0.53511226 = fieldWeight in 4224, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.2010092 = weight(abstract_txt:recall in 4224) [ClassicSimilarity], result of:
           0.2010092 = score(doc=4224,freq=3.0), product of:
             0.25830638 = queryWeight, product of:
               2.8387687 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015822496 = queryNorm
             0.7781813 = fieldWeight in 4224, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
         0.49390242 = weight(abstract_txt:fallout in 4224) [ClassicSimilarity], result of:
           0.49390242 = score(doc=4224,freq=2.0), product of:
             0.4703473 = queryWeight, product of:
               3.1277072 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.015822496 = queryNorm
             1.0500803 = fieldWeight in 4224, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.078125 = fieldNorm(doc=4224)
       0.24 = coord(6/25)
   

2. Egghe, L.: ¬The measures precision, recall, fallout and miss as a function of the number of retrieved documents and their mutual interrelations (2008) 0.17

   0.17212208 = sum of:
     0.17212208 = product of:
       1.075763 = sum of:
         0.019020682 = weight(abstract_txt:between in 3067) [ClassicSimilarity], result of:
           0.019020682 = score(doc=3067,freq=2.0), product of:
             0.062241763 = queryWeight, product of:
               1.1377785 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.015822496 = queryNorm
             0.30559355 = fieldWeight in 3067, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
         0.14495502 = weight(abstract_txt:convex in 3067) [ClassicSimilarity], result of:
           0.14495502 = score(doc=3067,freq=1.0), product of:
             0.24103865 = queryWeight, product of:
               1.5832341 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.015822496 = queryNorm
             0.60137665 = fieldWeight in 3067, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
         0.22741596 = weight(abstract_txt:recall in 3067) [ClassicSimilarity], result of:
           0.22741596 = score(doc=3067,freq=6.0), product of:
             0.25830638 = queryWeight, product of:
               2.8387687 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015822496 = queryNorm
             0.8804117 = fieldWeight in 3067, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
         0.68437135 = weight(abstract_txt:fallout in 3067) [ClassicSimilarity], result of:
           0.68437135 = score(doc=3067,freq=6.0), product of:
             0.4703473 = queryWeight, product of:
               3.1277072 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.015822496 = queryNorm
             1.4550341 = fieldWeight in 3067, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.0625 = fieldNorm(doc=3067)
       0.16 = coord(4/25)
   

3. Bollmann, P.; Cherniavsky, V.S.: Probleme der Bewertung von Information-Retrieval-Systemen (1980) 0.15

   0.14897102 = sum of:
     0.14897102 = product of:
       1.2414252 = sum of:
         0.12956646 = weight(abstract_txt:graph in 5494) [ClassicSimilarity], result of:
           0.12956646 = score(doc=5494,freq=2.0), product of:
             0.11183118 = queryWeight, product of:
               1.0784084 = boost
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.015822496 = queryNorm
             1.1585897 = fieldWeight in 5494, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.553973 = idf(docFreq=171, maxDocs=44421)
               0.125 = fieldNorm(doc=5494)
         0.32161474 = weight(abstract_txt:recall in 5494) [ClassicSimilarity], result of:
           0.32161474 = score(doc=5494,freq=3.0), product of:
             0.25830638 = queryWeight, product of:
               2.8387687 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015822496 = queryNorm
             1.2450901 = fieldWeight in 5494, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.125 = fieldNorm(doc=5494)
         0.7902439 = weight(abstract_txt:fallout in 5494) [ClassicSimilarity], result of:
           0.7902439 = score(doc=5494,freq=2.0), product of:
             0.4703473 = queryWeight, product of:
               3.1277072 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.015822496 = queryNorm
             1.6801286 = fieldWeight in 5494, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.125 = fieldNorm(doc=5494)
       0.12 = coord(3/25)
   

4. Egghe, L.: Existence theorem of the quadruple (P, R, F, M) : precision, recall, fallout and miss (2007) 0.11

   0.10930444 = sum of:
     0.10930444 = product of:
       0.6831528 = sum of:
         0.02497214 = weight(abstract_txt:system in 3011) [ClassicSimilarity], result of:
           0.02497214 = score(doc=3011,freq=4.0), product of:
             0.05923227 = queryWeight, product of:
               1.109931 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.015822496 = queryNorm
             0.42159688 = fieldWeight in 3011, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.013449652 = weight(abstract_txt:between in 3011) [ClassicSimilarity], result of:
           0.013449652 = score(doc=3011,freq=1.0), product of:
             0.062241763 = queryWeight, product of:
               1.1377785 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.015822496 = queryNorm
             0.21608727 = fieldWeight in 3011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.16080737 = weight(abstract_txt:recall in 3011) [ClassicSimilarity], result of:
           0.16080737 = score(doc=3011,freq=3.0), product of:
             0.25830638 = queryWeight, product of:
               2.8387687 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015822496 = queryNorm
             0.62254506 = fieldWeight in 3011, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
         0.4839236 = weight(abstract_txt:fallout in 3011) [ClassicSimilarity], result of:
           0.4839236 = score(doc=3011,freq=3.0), product of:
             0.4703473 = queryWeight, product of:
               3.1277072 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.015822496 = queryNorm
             1.0288645 = fieldWeight in 3011, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.0625 = fieldNorm(doc=3011)
       0.16 = coord(4/25)
   

5. Chen, H.; Zhang, Y.; Houston, A.L.: Semantic indexing and searching using a Hopfield net (1998) 0.10

   0.10287803 = sum of:
     0.10287803 = product of:
       0.5143901 = sum of:
         0.07908033 = weight(abstract_txt:tests in 6704) [ClassicSimilarity], result of:
           0.07908033 = score(doc=6704,freq=3.0), product of:
             0.096160434 = queryWeight, product of:
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.015822496 = queryNorm
             0.82237905 = fieldWeight in 6704, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.078125 = fieldNorm(doc=6704)
         0.016812066 = weight(abstract_txt:between in 6704) [ClassicSimilarity], result of:
           0.016812066 = score(doc=6704,freq=1.0), product of:
             0.062241763 = queryWeight, product of:
               1.1377785 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.015822496 = queryNorm
             0.2701091 = fieldWeight in 6704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.078125 = fieldNorm(doc=6704)
         0.040108055 = weight(abstract_txt:performance in 6704) [ClassicSimilarity], result of:
           0.040108055 = score(doc=6704,freq=1.0), product of:
             0.11112768 = queryWeight, product of:
               1.5202951 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015822496 = queryNorm
             0.36091867 = fieldWeight in 6704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.078125 = fieldNorm(doc=6704)
         0.11605272 = weight(abstract_txt:recall in 6704) [ClassicSimilarity], result of:
           0.11605272 = score(doc=6704,freq=1.0), product of:
             0.25830638 = queryWeight, product of:
               2.8387687 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015822496 = queryNorm
             0.44928318 = fieldWeight in 6704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=6704)
         0.2623369 = weight(abstract_txt:parameters in 6704) [ClassicSimilarity], result of:
           0.2623369 = score(doc=6704,freq=1.0), product of:
             0.48968574 = queryWeight, product of:
               4.513262 = boost
               6.8572807 = idf(docFreq=126, maxDocs=44421)
               0.015822496 = queryNorm
             0.53572506 = fieldWeight in 6704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8572807 = idf(docFreq=126, maxDocs=44421)
               0.078125 = fieldNorm(doc=6704)
       0.2 = coord(5/25)