Document (#14067)

Author

Prasher, R.G.

Title

Evaluation of indexing system

Source

Herald of library science. 28(1989) no.3, S.157-65

Year

1989

Abstract

Describes information system and its various components-index file construstion, query formulation and searching. Discusses an indexing system, and brings out the need for its evaluation. Explains the concept of the efficiency of indexing systems and discusses factors which control this efficiency. Gives criteria for evaluation. Discusses recall and precision ratios, as also noise ratio, novelty ratio, and exhaustivity and specificity and the impact of each on the efficiency of indexing system. Mention also various steps for evaluation.

Theme

Indexierungsstudien
Retrievalstudien

Similar documents (content)

1. Lancaster, F.W.: Evaluating the performance of a large computerized information system (1985) 0.25

   0.24787663 = sum of:
     0.24787663 = product of:
       0.61969155 = sum of:
         0.03460496 = weight(abstract_txt:factors in 4649) [ClassicSimilarity], result of:
           0.03460496 = score(doc=4649,freq=3.0), product of:
             0.086038105 = queryWeight, product of:
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.017367817 = queryNorm
             0.40220502 = fieldWeight in 4649, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.039165575 = weight(abstract_txt:precision in 4649) [ClassicSimilarity], result of:
           0.039165575 = score(doc=4649,freq=2.0), product of:
             0.10696262 = queryWeight, product of:
               1.114989 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.017367817 = queryNorm
             0.36616132 = fieldWeight in 4649, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.054136727 = weight(abstract_txt:recall in 4649) [ClassicSimilarity], result of:
           0.054136727 = score(doc=4649,freq=3.0), product of:
             0.11594711 = queryWeight, product of:
               1.1608726 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017367817 = queryNorm
             0.4669088 = fieldWeight in 4649, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.012861408 = weight(abstract_txt:also in 4649) [ClassicSimilarity], result of:
           0.012861408 = score(doc=4649,freq=1.0), product of:
             0.08081799 = queryWeight, product of:
               1.3706406 = boost
               3.3949955 = idf(docFreq=4049, maxDocs=44421)
               0.017367817 = queryNorm
             0.15914041 = fieldWeight in 4649, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3949955 = idf(docFreq=4049, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.06803454 = weight(abstract_txt:specificity in 4649) [ClassicSimilarity], result of:
           0.06803454 = score(doc=4649,freq=1.0), product of:
             0.19474156 = queryWeight, product of:
               1.5044713 = boost
               7.4529724 = idf(docFreq=69, maxDocs=44421)
               0.017367817 = queryNorm
             0.34935808 = fieldWeight in 4649, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4529724 = idf(docFreq=69, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.10030593 = weight(abstract_txt:exhaustivity in 4649) [ClassicSimilarity], result of:
           0.10030593 = score(doc=4649,freq=1.0), product of:
             0.25226486 = queryWeight, product of:
               1.7123122 = boost
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.017367817 = queryNorm
             0.39762148 = fieldWeight in 4649, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.027761716 = weight(abstract_txt:various in 4649) [ClassicSimilarity], result of:
           0.027761716 = score(doc=4649,freq=1.0), product of:
             0.13498326 = queryWeight, product of:
               1.771371 = boost
               4.387581 = idf(docFreq=1500, maxDocs=44421)
               0.017367817 = queryNorm
             0.20566785 = fieldWeight in 4649, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.387581 = idf(docFreq=1500, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.056395978 = weight(abstract_txt:system in 4649) [ClassicSimilarity], result of:
           0.056395978 = score(doc=4649,freq=5.0), product of:
             0.1595271 = queryWeight, product of:
               2.7233396 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.017367817 = queryNorm
             0.35351974 = fieldWeight in 4649, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.10824089 = weight(abstract_txt:indexing in 4649) [ClassicSimilarity], result of:
           0.10824089 = score(doc=4649,freq=4.0), product of:
             0.2653994 = queryWeight, product of:
               3.5126472 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.017367817 = queryNorm
             0.4078415 = fieldWeight in 4649, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
         0.1181838 = weight(abstract_txt:evaluation in 4649) [ClassicSimilarity], result of:
           0.1181838 = score(doc=4649,freq=4.0), product of:
             0.2814131 = queryWeight, product of:
               3.6170685 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017367817 = queryNorm
             0.4199655 = fieldWeight in 4649, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.046875 = fieldNorm(doc=4649)
       0.4 = coord(10/25)
   

2. Su, L.T.; Chen, H.L.: Evaluation of Web search engines by undergraduate students (1999) 0.19

   0.18696745 = sum of:
     0.18696745 = product of:
       0.5842733 = sum of:
         0.023309046 = weight(abstract_txt:factors in 546) [ClassicSimilarity], result of:
           0.023309046 = score(doc=546,freq=1.0), product of:
             0.086038105 = queryWeight, product of:
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.017367817 = queryNorm
             0.2709154 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.032309953 = weight(abstract_txt:precision in 546) [ClassicSimilarity], result of:
           0.032309953 = score(doc=546,freq=1.0), product of:
             0.10696262 = queryWeight, product of:
               1.114989 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.017367817 = queryNorm
             0.3020677 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.03302086 = weight(abstract_txt:criteria in 546) [ClassicSimilarity], result of:
           0.03302086 = score(doc=546,freq=1.0), product of:
             0.10852591 = queryWeight, product of:
               1.1231074 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.017367817 = queryNorm
             0.30426708 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.036465164 = weight(abstract_txt:recall in 546) [ClassicSimilarity], result of:
           0.036465164 = score(doc=546,freq=1.0), product of:
             0.11594711 = queryWeight, product of:
               1.1608726 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017367817 = queryNorm
             0.31449825 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.041612603 = weight(abstract_txt:system in 546) [ClassicSimilarity], result of:
           0.041612603 = score(doc=546,freq=2.0), product of:
             0.1595271 = queryWeight, product of:
               2.7233396 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.017367817 = queryNorm
             0.26084974 = fieldWeight in 546, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.16880256 = weight(abstract_txt:ratio in 546) [ClassicSimilarity], result of:
           0.16880256 = score(doc=546,freq=1.0), product of:
             0.4057612 = queryWeight, product of:
               3.071177 = boost
               7.607123 = idf(docFreq=59, maxDocs=44421)
               0.017367817 = queryNorm
             0.41601452 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.607123 = idf(docFreq=59, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.119408526 = weight(abstract_txt:evaluation in 546) [ClassicSimilarity], result of:
           0.119408526 = score(doc=546,freq=3.0), product of:
             0.2814131 = queryWeight, product of:
               3.6170685 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017367817 = queryNorm
             0.42431757 = fieldWeight in 546, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
         0.12934458 = weight(abstract_txt:efficiency in 546) [ClassicSimilarity], result of:
           0.12934458 = score(doc=546,freq=1.0), product of:
             0.38893804 = queryWeight, product of:
               3.6826074 = boost
               6.0810666 = idf(docFreq=275, maxDocs=44421)
               0.017367817 = queryNorm
             0.33255833 = fieldWeight in 546, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0810666 = idf(docFreq=275, maxDocs=44421)
               0.0546875 = fieldNorm(doc=546)
       0.32 = coord(8/25)
   

3. Soergel, D.: Indexing and retrieval performance : the logical evidence (1994) 0.17

   0.16676003 = sum of:
     0.16676003 = product of:
       0.69483346 = sum of:
         0.05209309 = weight(abstract_txt:recall in 1579) [ClassicSimilarity], result of:
           0.05209309 = score(doc=1579,freq=1.0), product of:
             0.11594711 = queryWeight, product of:
               1.1608726 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017367817 = queryNorm
             0.44928318 = fieldWeight in 1579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=1579)
         0.079916045 = weight(abstract_txt:formulation in 1579) [ClassicSimilarity], result of:
           0.079916045 = score(doc=1579,freq=1.0), product of:
             0.15422775 = queryWeight, product of:
               1.3388621 = boost
               6.6325636 = idf(docFreq=158, maxDocs=44421)
               0.017367817 = queryNorm
             0.51816905 = fieldWeight in 1579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6325636 = idf(docFreq=158, maxDocs=44421)
               0.078125 = fieldNorm(doc=1579)
         0.16717653 = weight(abstract_txt:exhaustivity in 1579) [ClassicSimilarity], result of:
           0.16717653 = score(doc=1579,freq=1.0), product of:
             0.25226486 = queryWeight, product of:
               1.7123122 = boost
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.017367817 = queryNorm
             0.66270244 = fieldWeight in 1579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.078125 = fieldNorm(doc=1579)
         0.04203508 = weight(abstract_txt:system in 1579) [ClassicSimilarity], result of:
           0.04203508 = score(doc=1579,freq=1.0), product of:
             0.1595271 = queryWeight, product of:
               2.7233396 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.017367817 = queryNorm
             0.26349807 = fieldWeight in 1579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=1579)
         0.25512624 = weight(abstract_txt:indexing in 1579) [ClassicSimilarity], result of:
           0.25512624 = score(doc=1579,freq=8.0), product of:
             0.2653994 = queryWeight, product of:
               3.5126472 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.017367817 = queryNorm
             0.9612917 = fieldWeight in 1579, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.078125 = fieldNorm(doc=1579)
         0.09848649 = weight(abstract_txt:evaluation in 1579) [ClassicSimilarity], result of:
           0.09848649 = score(doc=1579,freq=1.0), product of:
             0.2814131 = queryWeight, product of:
               3.6170685 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017367817 = queryNorm
             0.34997123 = fieldWeight in 1579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=1579)
       0.24 = coord(6/25)
   

4. Blagden, J.F.: How much noise in a role-free and link-free co-ordinate indexing system? (1966) 0.16

   0.15643664 = sum of:
     0.15643664 = product of:
       0.65181935 = sum of:
         0.05209309 = weight(abstract_txt:recall in 2717) [ClassicSimilarity], result of:
           0.05209309 = score(doc=2717,freq=1.0), product of:
             0.11594711 = queryWeight, product of:
               1.1608726 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017367817 = queryNorm
             0.44928318 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.078125 = fieldNorm(doc=2717)
         0.12945212 = weight(abstract_txt:noise in 2717) [ClassicSimilarity], result of:
           0.12945212 = score(doc=2717,freq=1.0), product of:
             0.21272211 = queryWeight, product of:
               1.5723922 = boost
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.017367817 = queryNorm
             0.60855037 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7894444 = idf(docFreq=49, maxDocs=44421)
               0.078125 = fieldNorm(doc=2717)
         0.059446577 = weight(abstract_txt:system in 2717) [ClassicSimilarity], result of:
           0.059446577 = score(doc=2717,freq=2.0), product of:
             0.1595271 = queryWeight, product of:
               2.7233396 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.017367817 = queryNorm
             0.37264252 = fieldWeight in 2717, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=2717)
         0.12756312 = weight(abstract_txt:indexing in 2717) [ClassicSimilarity], result of:
           0.12756312 = score(doc=2717,freq=2.0), product of:
             0.2653994 = queryWeight, product of:
               3.5126472 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.017367817 = queryNorm
             0.48064584 = fieldWeight in 2717, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.078125 = fieldNorm(doc=2717)
         0.09848649 = weight(abstract_txt:evaluation in 2717) [ClassicSimilarity], result of:
           0.09848649 = score(doc=2717,freq=1.0), product of:
             0.2814131 = queryWeight, product of:
               3.6170685 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017367817 = queryNorm
             0.34997123 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=2717)
         0.18477798 = weight(abstract_txt:efficiency in 2717) [ClassicSimilarity], result of:
           0.18477798 = score(doc=2717,freq=1.0), product of:
             0.38893804 = queryWeight, product of:
               3.6826074 = boost
               6.0810666 = idf(docFreq=275, maxDocs=44421)
               0.017367817 = queryNorm
             0.47508332 = fieldWeight in 2717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0810666 = idf(docFreq=275, maxDocs=44421)
               0.078125 = fieldNorm(doc=2717)
       0.24 = coord(6/25)
   

5. Fugmann, R.: Representational predictibility : key to the resolution of several pending issues in indexing and information supply (1994) 0.15

   0.15212362 = sum of:
     0.15212362 = product of:
       0.6338484 = sum of:
         0.039958365 = weight(abstract_txt:factors in 7738) [ClassicSimilarity], result of:
           0.039958365 = score(doc=7738,freq=1.0), product of:
             0.086038105 = queryWeight, product of:
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.017367817 = queryNorm
             0.46442637 = fieldWeight in 7738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9538813 = idf(docFreq=851, maxDocs=44421)
               0.09375 = fieldNorm(doc=7738)
         0.055388488 = weight(abstract_txt:precision in 7738) [ClassicSimilarity], result of:
           0.055388488 = score(doc=7738,freq=1.0), product of:
             0.10696262 = queryWeight, product of:
               1.114989 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.017367817 = queryNorm
             0.5178303 = fieldWeight in 7738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.09375 = fieldNorm(doc=7738)
         0.06251171 = weight(abstract_txt:recall in 7738) [ClassicSimilarity], result of:
           0.06251171 = score(doc=7738,freq=1.0), product of:
             0.11594711 = queryWeight, product of:
               1.1608726 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.017367817 = queryNorm
             0.53913987 = fieldWeight in 7738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.09375 = fieldNorm(doc=7738)
         0.20061186 = weight(abstract_txt:exhaustivity in 7738) [ClassicSimilarity], result of:
           0.20061186 = score(doc=7738,freq=1.0), product of:
             0.25226486 = queryWeight, product of:
               1.7123122 = boost
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.017367817 = queryNorm
             0.79524297 = fieldWeight in 7738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.09375 = fieldNorm(doc=7738)
         0.10824089 = weight(abstract_txt:indexing in 7738) [ClassicSimilarity], result of:
           0.10824089 = score(doc=7738,freq=1.0), product of:
             0.2653994 = queryWeight, product of:
               3.5126472 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.017367817 = queryNorm
             0.4078415 = fieldWeight in 7738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.09375 = fieldNorm(doc=7738)
         0.16713712 = weight(abstract_txt:evaluation in 7738) [ClassicSimilarity], result of:
           0.16713712 = score(doc=7738,freq=2.0), product of:
             0.2814131 = queryWeight, product of:
               3.6170685 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.017367817 = queryNorm
             0.5939209 = fieldWeight in 7738, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.09375 = fieldNorm(doc=7738)
       0.24 = coord(6/25)