Document (#33967)

Author

Oyarce, G.

Title

Using the shape recovery method to evaluate indexing techniques

Source

Journal of the American Society for Information Science and Technology. 59(2008) no.9, S.1479-1492

Year

2008

Abstract

Text representation, central to information processing, must be descriptive and discriminative. Although some of the many techniques to construct document representations may outperform others for certain tasks, no one is consistently better than others. Representations are still problematic. Evaluation techniques are needed to penetrate foundational questions about term behavior in representation. A study that applies the shape recovery analysis method is reported here as an evaluative tool to compare different indexing schemes. Three weight coefficients are used to rank indexing terms and are compared to the documents' full text. Two of the weight coefficients are novel and the third relies on the chi-squared distribution. Multidimensional scaling reduces the dimensional space of the document surrogates into a two-dimensional Cartesian space. Ten concentric circles evenly separated at 10% intervals of relevant data points starting at the centroid are used to construct a precision-recall curve. ANOVA is used for a straightforward computation of the 4 × 11 matrix of test data to see whether the four treatments yield the same P-R result. A post hoc HSD Tukey multiple comparisons test among pairwise treatments is also used to discover homogeneous groups. The findings show the value of the methodology to study term weighting schemes, and their descriptiveness and discriminative power, as well as the potential strength of the novel coefficients introduced.

Similar documents (content)

1. Burgin, R.: ¬The effect of indexing exhaustivity on retrieval performance (1991) 0.21

   0.20737003 = sum of:
     0.20737003 = product of:
       0.64803135 = sum of:
         0.061919335 = weight(abstract_txt:term in 6262) [ClassicSimilarity], result of:
           0.061919335 = score(doc=6262,freq=3.0), product of:
             0.09543617 = queryWeight, product of:
               1.0307251 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.019311123 = queryNorm
             0.64880365 = fieldWeight in 6262, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.078125 = fieldNorm(doc=6262)
         0.05482806 = weight(abstract_txt:representation in 6262) [ClassicSimilarity], result of:
           0.05482806 = score(doc=6262,freq=2.0), product of:
             0.10073827 = queryWeight, product of:
               1.0589699 = boost
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.019311123 = queryNorm
             0.54426247 = fieldWeight in 6262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.078125 = fieldNorm(doc=6262)
         0.058930695 = weight(abstract_txt:test in 6262) [ClassicSimilarity], result of:
           0.058930695 = score(doc=6262,freq=2.0), product of:
             0.10570291 = queryWeight, product of:
               1.0847504 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.019311123 = queryNorm
             0.5575125 = fieldWeight in 6262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.078125 = fieldNorm(doc=6262)
         0.07195703 = weight(abstract_txt:space in 6262) [ClassicSimilarity], result of:
           0.07195703 = score(doc=6262,freq=2.0), product of:
             0.120755814 = queryWeight, product of:
               1.159419 = boost
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.019311123 = queryNorm
             0.59588873 = fieldWeight in 6262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.078125 = fieldNorm(doc=6262)
         0.069972716 = weight(abstract_txt:representations in 6262) [ClassicSimilarity], result of:
           0.069972716 = score(doc=6262,freq=1.0), product of:
             0.14933275 = queryWeight, product of:
               1.2893294 = boost
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.019311123 = queryNorm
             0.46856913 = fieldWeight in 6262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.078125 = fieldNorm(doc=6262)
         0.07538537 = weight(abstract_txt:construct in 6262) [ClassicSimilarity], result of:
           0.07538537 = score(doc=6262,freq=1.0), product of:
             0.1569377 = queryWeight, product of:
               1.3217521 = boost
               6.148508 = idf(docFreq=257, maxDocs=44421)
               0.019311123 = queryNorm
             0.4803522 = fieldWeight in 6262, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.148508 = idf(docFreq=257, maxDocs=44421)
               0.078125 = fieldNorm(doc=6262)
         0.069372945 = weight(abstract_txt:indexing in 6262) [ClassicSimilarity], result of:
           0.069372945 = score(doc=6262,freq=3.0), product of:
             0.11784721 = queryWeight, product of:
               1.4027867 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.019311123 = queryNorm
             0.5886685 = fieldWeight in 6262, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.078125 = fieldNorm(doc=6262)
         0.18566519 = weight(abstract_txt:weight in 6262) [ClassicSimilarity], result of:
           0.18566519 = score(doc=6262,freq=2.0), product of:
             0.22716752 = queryWeight, product of:
               1.5902283 = boost
               7.3974023 = idf(docFreq=73, maxDocs=44421)
               0.019311123 = queryNorm
             0.8173052 = fieldWeight in 6262, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3974023 = idf(docFreq=73, maxDocs=44421)
               0.078125 = fieldNorm(doc=6262)
       0.32 = coord(8/25)
   

2. Bordogna, G.; Pagani, M.: ¬A flexible content-based image retrieval model and a customizable system for the retrieval of shapes (2010) 0.11

   0.10756426 = sum of:
     0.10756426 = product of:
       0.5378213 = sum of:
         0.031015435 = weight(abstract_txt:representation in 437) [ClassicSimilarity], result of:
           0.031015435 = score(doc=437,freq=1.0), product of:
             0.10073827 = queryWeight, product of:
               1.0589699 = boost
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.019311123 = queryNorm
             0.30788136 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.0625 = fieldNorm(doc=437)
         0.040705044 = weight(abstract_txt:space in 437) [ClassicSimilarity], result of:
           0.040705044 = score(doc=437,freq=1.0), product of:
             0.120755814 = queryWeight, product of:
               1.159419 = boost
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.019311123 = queryNorm
             0.33708557 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.0625 = fieldNorm(doc=437)
         0.079165086 = weight(abstract_txt:representations in 437) [ClassicSimilarity], result of:
           0.079165086 = score(doc=437,freq=2.0), product of:
             0.14933275 = queryWeight, product of:
               1.2893294 = boost
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.019311123 = queryNorm
             0.53012544 = fieldWeight in 437, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.997685 = idf(docFreq=299, maxDocs=44421)
               0.0625 = fieldNorm(doc=437)
         0.15878566 = weight(abstract_txt:shape in 437) [ClassicSimilarity], result of:
           0.15878566 = score(doc=437,freq=4.0), product of:
             0.18850814 = queryWeight, product of:
               1.4486098 = boost
               6.738623 = idf(docFreq=142, maxDocs=44421)
               0.019311123 = queryNorm
             0.8423279 = fieldWeight in 437, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.738623 = idf(docFreq=142, maxDocs=44421)
               0.0625 = fieldNorm(doc=437)
         0.22815008 = weight(abstract_txt:coefficients in 437) [ClassicSimilarity], result of:
           0.22815008 = score(doc=437,freq=1.0), product of:
             0.43616763 = queryWeight, product of:
               2.6987255 = boost
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.019311123 = queryNorm
             0.5230789 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.369263 = idf(docFreq=27, maxDocs=44421)
               0.0625 = fieldNorm(doc=437)
       0.2 = coord(5/25)
   

3. AlQenaei, Z.M.; Monarchi, D.E.: ¬The use of learning techniques to analyze the results of a manual classification system (2016) 0.11

   0.10733206 = sum of:
     0.10733206 = product of:
       0.33541268 = sum of:
         0.028599316 = weight(abstract_txt:term in 3836) [ClassicSimilarity], result of:
           0.028599316 = score(doc=3836,freq=1.0), product of:
             0.09543617 = queryWeight, product of:
               1.0307251 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.019311123 = queryNorm
             0.29966956 = fieldWeight in 3836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0625 = fieldNorm(doc=3836)
         0.031015435 = weight(abstract_txt:representation in 3836) [ClassicSimilarity], result of:
           0.031015435 = score(doc=3836,freq=1.0), product of:
             0.10073827 = queryWeight, product of:
               1.0589699 = boost
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.019311123 = queryNorm
             0.30788136 = fieldWeight in 3836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.0625 = fieldNorm(doc=3836)
         0.033336233 = weight(abstract_txt:test in 3836) [ClassicSimilarity], result of:
           0.033336233 = score(doc=3836,freq=1.0), product of:
             0.10570291 = queryWeight, product of:
               1.0847504 = boost
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.019311123 = queryNorm
             0.3153767 = fieldWeight in 3836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046027 = idf(docFreq=776, maxDocs=44421)
               0.0625 = fieldNorm(doc=3836)
         0.057565622 = weight(abstract_txt:space in 3836) [ClassicSimilarity], result of:
           0.057565622 = score(doc=3836,freq=2.0), product of:
             0.120755814 = queryWeight, product of:
               1.159419 = boost
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.019311123 = queryNorm
             0.47671098 = fieldWeight in 3836, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.0625 = fieldNorm(doc=3836)
         0.03204199 = weight(abstract_txt:indexing in 3836) [ClassicSimilarity], result of:
           0.03204199 = score(doc=3836,freq=1.0), product of:
             0.11784721 = queryWeight, product of:
               1.4027867 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.019311123 = queryNorm
             0.27189434 = fieldWeight in 3836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=3836)
         0.019634934 = weight(abstract_txt:used in 3836) [ClassicSimilarity], result of:
           0.019634934 = score(doc=3836,freq=1.0), product of:
             0.09357767 = queryWeight, product of:
               1.4434025 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.019311123 = queryNorm
             0.20982501 = fieldWeight in 3836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.0625 = fieldNorm(doc=3836)
         0.051236264 = weight(abstract_txt:techniques in 3836) [ClassicSimilarity], result of:
           0.051236264 = score(doc=3836,freq=2.0), product of:
             0.12790316 = queryWeight, product of:
               1.4614118 = boost
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.019311123 = queryNorm
             0.40058637 = fieldWeight in 3836, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.0625 = fieldNorm(doc=3836)
         0.08198287 = weight(abstract_txt:dimensional in 3836) [ClassicSimilarity], result of:
           0.08198287 = score(doc=3836,freq=1.0), product of:
             0.19258597 = queryWeight, product of:
               1.4641942 = boost
               6.8111186 = idf(docFreq=132, maxDocs=44421)
               0.019311123 = queryNorm
             0.4256949 = fieldWeight in 3836, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8111186 = idf(docFreq=132, maxDocs=44421)
               0.0625 = fieldNorm(doc=3836)
       0.32 = coord(8/25)
   

4. Wolfram, D.; Zhang, J.: ¬An investigation of the influence of indexing exhaustivity and term distributions on a document space (2002) 0.10

   0.10052894 = sum of:
     0.10052894 = product of:
       0.4188706 = sum of:
         0.15750897 = weight(abstract_txt:centroid in 238) [ClassicSimilarity], result of:
           0.15750897 = score(doc=238,freq=2.0), product of:
             0.18749633 = queryWeight, product of:
               1.0215691 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.019311123 = queryNorm
             0.8400643 = fieldWeight in 238, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.0625 = fieldNorm(doc=238)
         0.057198633 = weight(abstract_txt:term in 238) [ClassicSimilarity], result of:
           0.057198633 = score(doc=238,freq=4.0), product of:
             0.09543617 = queryWeight, product of:
               1.0307251 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.019311123 = queryNorm
             0.5993391 = fieldWeight in 238, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0625 = fieldNorm(doc=238)
         0.0705032 = weight(abstract_txt:space in 238) [ClassicSimilarity], result of:
           0.0705032 = score(doc=238,freq=3.0), product of:
             0.120755814 = queryWeight, product of:
               1.159419 = boost
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.019311123 = queryNorm
             0.5838493 = fieldWeight in 238, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.0625 = fieldNorm(doc=238)
         0.03204199 = weight(abstract_txt:indexing in 238) [ClassicSimilarity], result of:
           0.03204199 = score(doc=238,freq=1.0), product of:
             0.11784721 = queryWeight, product of:
               1.4027867 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.019311123 = queryNorm
             0.27189434 = fieldWeight in 238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=238)
         0.019634934 = weight(abstract_txt:used in 238) [ClassicSimilarity], result of:
           0.019634934 = score(doc=238,freq=1.0), product of:
             0.09357767 = queryWeight, product of:
               1.4434025 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.019311123 = queryNorm
             0.20982501 = fieldWeight in 238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.0625 = fieldNorm(doc=238)
         0.08198287 = weight(abstract_txt:dimensional in 238) [ClassicSimilarity], result of:
           0.08198287 = score(doc=238,freq=1.0), product of:
             0.19258597 = queryWeight, product of:
               1.4641942 = boost
               6.8111186 = idf(docFreq=132, maxDocs=44421)
               0.019311123 = queryNorm
             0.4256949 = fieldWeight in 238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8111186 = idf(docFreq=132, maxDocs=44421)
               0.0625 = fieldNorm(doc=238)
       0.24 = coord(6/25)
   

5. Wolfram, D.; Zhang, J.: ¬The influence of indexing practices and weighting algorithms on document spaces (2008) 0.10

   0.09862024 = sum of:
     0.09862024 = product of:
       0.4109177 = sum of:
         0.028599316 = weight(abstract_txt:term in 2963) [ClassicSimilarity], result of:
           0.028599316 = score(doc=2963,freq=1.0), product of:
             0.09543617 = queryWeight, product of:
               1.0307251 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.019311123 = queryNorm
             0.29966956 = fieldWeight in 2963, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.0625 = fieldNorm(doc=2963)
         0.08141009 = weight(abstract_txt:space in 2963) [ClassicSimilarity], result of:
           0.08141009 = score(doc=2963,freq=4.0), product of:
             0.120755814 = queryWeight, product of:
               1.159419 = boost
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.019311123 = queryNorm
             0.67417115 = fieldWeight in 2963, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.393369 = idf(docFreq=548, maxDocs=44421)
               0.0625 = fieldNorm(doc=2963)
         0.06408398 = weight(abstract_txt:indexing in 2963) [ClassicSimilarity], result of:
           0.06408398 = score(doc=2963,freq=4.0), product of:
             0.11784721 = queryWeight, product of:
               1.4027867 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.019311123 = queryNorm
             0.5437887 = fieldWeight in 2963, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.0625 = fieldNorm(doc=2963)
         0.019634934 = weight(abstract_txt:used in 2963) [ClassicSimilarity], result of:
           0.019634934 = score(doc=2963,freq=1.0), product of:
             0.09357767 = queryWeight, product of:
               1.4434025 = boost
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.019311123 = queryNorm
             0.20982501 = fieldWeight in 2963, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3572001 = idf(docFreq=4205, maxDocs=44421)
               0.0625 = fieldNorm(doc=2963)
         0.03622951 = weight(abstract_txt:techniques in 2963) [ClassicSimilarity], result of:
           0.03622951 = score(doc=2963,freq=1.0), product of:
             0.12790316 = queryWeight, product of:
               1.4614118 = boost
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.019311123 = queryNorm
             0.28325734 = fieldWeight in 2963, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5321174 = idf(docFreq=1298, maxDocs=44421)
               0.0625 = fieldNorm(doc=2963)
         0.18095987 = weight(abstract_txt:discriminative in 2963) [ClassicSimilarity], result of:
           0.18095987 = score(doc=2963,freq=1.0), product of:
             0.32648563 = queryWeight, product of:
               1.9064192 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.019311123 = queryNorm
             0.5542659 = fieldWeight in 2963, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.0625 = fieldNorm(doc=2963)
       0.24 = coord(6/25)