Document (#31299)

Author

Souza, R.R.
Raghavan, K.S.

Title

¬A methodology for noun phrase-based automatic indexing

Source

Knowledge organization. 33(2006) no.1, S.35-44

Year

2006

Abstract

The scholarly community is increasingly employing the Web both for publication of scholarly output and for locating and accessing relevant scholarly literature. Organization of this vast body of digital information assumes significance in this context. The sheer volume of digital information to be handled makes traditional indexing and knowledge representation strategies ineffective and impractical. It is, therefore, worth exploring new approaches. An approach being discussed considers the intrinsic semantics of texts of documents. Based on the hypothesis that noun phrases in a text are semantically rich in terms of their ability to represent the subject content of the document, this approach seeks to identify and extract noun phrases instead of single keywords, and use them as descriptors. This paper presents a methodology that has been developed for extracting noun phrases from Portuguese texts. The results of an experiment carried out to test the adequacy of the methodology are also presented.

Theme

Automatisches Indexieren

Similar documents (author)

1. Raghavan, K.S.: ¬The general theory of classification as the basis for structuring of subject headings (1985(?)) 1.83

   1.8260586 = sum of:
     1.8260586 = product of:
       3.6521173 = sum of:
         3.6521173 = weight(author_txt:raghavan in 1829) [ClassicSimilarity], result of:
           3.6521173 = score(doc=1829,freq=1.0), product of:
             0.71217746 = queryWeight, product of:
               1.0072231 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.08617595 = queryNorm
             5.1281 = fieldWeight in 1829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.625 = fieldNorm(doc=1829)
       0.5 = coord(1/2)
   

2. Raghavan, K.S.: Education for knowledge organization : the Indian scene (2005) 1.83

   1.8260586 = sum of:
     1.8260586 = product of:
       3.6521173 = sum of:
         3.6521173 = weight(author_txt:raghavan in 6806) [ClassicSimilarity], result of:
           3.6521173 = score(doc=6806,freq=1.0), product of:
             0.71217746 = queryWeight, product of:
               1.0072231 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.08617595 = queryNorm
             5.1281 = fieldWeight in 6806, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.625 = fieldNorm(doc=6806)
       0.5 = coord(1/2)
   

3. Raghavan, K.S.: Education for information management as a transformation force (2013) 1.83

   1.8260586 = sum of:
     1.8260586 = product of:
       3.6521173 = sum of:
         3.6521173 = weight(author_txt:raghavan in 1937) [ClassicSimilarity], result of:
           3.6521173 = score(doc=1937,freq=1.0), product of:
             0.71217746 = queryWeight, product of:
               1.0072231 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.08617595 = queryNorm
             5.1281 = fieldWeight in 1937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.625 = fieldNorm(doc=1937)
       0.5 = coord(1/2)
   

4. Raghavan, K.S.: ¬The Colon Classification : a few considerations on its future (2015) 1.83

   1.8260586 = sum of:
     1.8260586 = product of:
       3.6521173 = sum of:
         3.6521173 = weight(author_txt:raghavan in 3760) [ClassicSimilarity], result of:
           3.6521173 = score(doc=3760,freq=1.0), product of:
             0.71217746 = queryWeight, product of:
               1.0072231 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.08617595 = queryNorm
             5.1281 = fieldWeight in 3760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.625 = fieldNorm(doc=3760)
       0.5 = coord(1/2)
   

5. Souza, S.d.: Informacion : utopia y realidad de la bibliotelogia (1996) 1.79

   1.7870537 = sum of:
     1.7870537 = product of:
       3.5741074 = sum of:
         3.5741074 = weight(author_txt:souza in 824) [ClassicSimilarity], result of:
           3.5741074 = score(doc=824,freq=1.0), product of:
             0.70199955 = queryWeight, product of:
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.08617595 = queryNorm
             5.0913243 = fieldWeight in 824, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.146119 = idf(docFreq=34, maxDocs=44421)
               0.625 = fieldNorm(doc=824)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Styltsvig, H.B.: Ontology-based information retrieval (2006) 0.22

   0.21521316 = sum of:
     0.21521316 = product of:
       0.67254114 = sum of:
         0.0370059 = weight(abstract_txt:hypothesis in 2154) [ClassicSimilarity], result of:
           0.0370059 = score(doc=2154,freq=1.0), product of:
             0.11653887 = queryWeight, product of:
               1.0144703 = boost
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.016957918 = queryNorm
             0.31754127 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.012466298 = weight(abstract_txt:approach in 2154) [ClassicSimilarity], result of:
           0.012466298 = score(doc=2154,freq=1.0), product of:
             0.07108727 = queryWeight, product of:
               1.1205077 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.016957918 = queryNorm
             0.17536612 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.059593603 = weight(abstract_txt:handled in 2154) [ClassicSimilarity], result of:
           0.059593603 = score(doc=2154,freq=1.0), product of:
             0.16011176 = queryWeight, product of:
               1.1890923 = boost
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.016957918 = queryNorm
             0.37220004 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.02772041 = weight(abstract_txt:indexing in 2154) [ClassicSimilarity], result of:
           0.02772041 = score(doc=2154,freq=2.0), product of:
             0.0961221 = queryWeight, product of:
               1.3029585 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.016957918 = queryNorm
             0.28838748 = fieldWeight in 2154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.01326778 = weight(abstract_txt:this in 2154) [ClassicSimilarity], result of:
           0.01326778 = score(doc=2154,freq=4.0), product of:
             0.058815118 = queryWeight, product of:
               1.4413798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.016957918 = queryNorm
             0.2255845 = fieldWeight in 2154, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.042660512 = weight(abstract_txt:texts in 2154) [ClassicSimilarity], result of:
           0.042660512 = score(doc=2154,freq=1.0), product of:
             0.16142997 = queryWeight, product of:
               1.6885388 = boost
               5.6376824 = idf(docFreq=429, maxDocs=44421)
               0.016957918 = queryNorm
             0.26426637 = fieldWeight in 2154, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6376824 = idf(docFreq=429, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.16398293 = weight(abstract_txt:phrases in 2154) [ClassicSimilarity], result of:
           0.16398293 = score(doc=2154,freq=2.0), product of:
             0.35990372 = queryWeight, product of:
               3.087861 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016957918 = queryNorm
             0.45563 = fieldWeight in 2154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
         0.31584373 = weight(abstract_txt:noun in 2154) [ClassicSimilarity], result of:
           0.31584373 = score(doc=2154,freq=2.0), product of:
             0.6132181 = queryWeight, product of:
               4.6541615 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.016957918 = queryNorm
             0.51505935 = fieldWeight in 2154, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.046875 = fieldNorm(doc=2154)
       0.32 = coord(8/25)
   

2. Justeson, J.S.; Katz, S.M.: Technical terminology : some linguistic properties and an algorithm for identification in text (1995) 0.17

   0.17459056 = sum of:
     0.17459056 = product of:
       1.091191 = sum of:
         0.100692555 = weight(abstract_txt:phrase in 1755) [ClassicSimilarity], result of:
           0.100692555 = score(doc=1755,freq=2.0), product of:
             0.1282466 = queryWeight, product of:
               1.0642089 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.016957918 = queryNorm
             0.7851479 = fieldWeight in 1755, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.078125 = fieldNorm(doc=1755)
         0.011056483 = weight(abstract_txt:this in 1755) [ClassicSimilarity], result of:
           0.011056483 = score(doc=1755,freq=1.0), product of:
             0.058815118 = queryWeight, product of:
               1.4413798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.016957918 = queryNorm
             0.18798709 = fieldWeight in 1755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=1755)
         0.33472878 = weight(abstract_txt:phrases in 1755) [ClassicSimilarity], result of:
           0.33472878 = score(doc=1755,freq=3.0), product of:
             0.35990372 = queryWeight, product of:
               3.087861 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016957918 = queryNorm
             0.9300509 = fieldWeight in 1755, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=1755)
         0.6447133 = weight(abstract_txt:noun in 1755) [ClassicSimilarity], result of:
           0.6447133 = score(doc=1755,freq=3.0), product of:
             0.6132181 = queryWeight, product of:
               4.6541615 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.016957918 = queryNorm
             1.0513605 = fieldWeight in 1755, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.078125 = fieldNorm(doc=1755)
       0.16 = coord(4/25)
   

3. Mesquita, L.A.P.; Souza, R.R.; Baracho Porto, R.M.A.: Noun phrases in automatic indexing: : a structural analysis of the distribution of relevant terms in doctoral theses (2014) 0.17

   0.17231159 = sum of:
     0.17231159 = product of:
       0.86155796 = sum of:
         0.02772041 = weight(abstract_txt:indexing in 2442) [ClassicSimilarity], result of:
           0.02772041 = score(doc=2442,freq=2.0), product of:
             0.0961221 = queryWeight, product of:
               1.3029585 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.016957918 = queryNorm
             0.28838748 = fieldWeight in 2442, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.046875 = fieldNorm(doc=2442)
         0.014833828 = weight(abstract_txt:this in 2442) [ClassicSimilarity], result of:
           0.014833828 = score(doc=2442,freq=5.0), product of:
             0.058815118 = queryWeight, product of:
               1.4413798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.016957918 = queryNorm
             0.25221115 = fieldWeight in 2442, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.046875 = fieldNorm(doc=2442)
         0.060331076 = weight(abstract_txt:texts in 2442) [ClassicSimilarity], result of:
           0.060331076 = score(doc=2442,freq=2.0), product of:
             0.16142997 = queryWeight, product of:
               1.6885388 = boost
               5.6376824 = idf(docFreq=429, maxDocs=44421)
               0.016957918 = queryNorm
             0.37372908 = fieldWeight in 2442, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6376824 = idf(docFreq=429, maxDocs=44421)
               0.046875 = fieldNorm(doc=2442)
         0.25927982 = weight(abstract_txt:phrases in 2442) [ClassicSimilarity], result of:
           0.25927982 = score(doc=2442,freq=5.0), product of:
             0.35990372 = queryWeight, product of:
               3.087861 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016957918 = queryNorm
             0.72041434 = fieldWeight in 2442, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.046875 = fieldNorm(doc=2442)
         0.4993928 = weight(abstract_txt:noun in 2442) [ClassicSimilarity], result of:
           0.4993928 = score(doc=2442,freq=5.0), product of:
             0.6132181 = queryWeight, product of:
               4.6541615 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.016957918 = queryNorm
             0.81438035 = fieldWeight in 2442, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.046875 = fieldNorm(doc=2442)
       0.2 = coord(5/25)
   

4. Martins, A.L.; Souza, R.R.; Ribeiro de Mello, H.: ¬The use of noun phrases in information retrieval : proposing a mechanism for automatic classification (2014) 0.17

   0.16695388 = sum of:
     0.16695388 = product of:
       0.69564116 = sum of:
         0.043173548 = weight(abstract_txt:hypothesis in 2441) [ClassicSimilarity], result of:
           0.043173548 = score(doc=2441,freq=1.0), product of:
             0.11653887 = queryWeight, product of:
               1.0144703 = boost
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.016957918 = queryNorm
             0.3704648 = fieldWeight in 2441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2441)
         0.014544016 = weight(abstract_txt:approach in 2441) [ClassicSimilarity], result of:
           0.014544016 = score(doc=2441,freq=1.0), product of:
             0.07108727 = queryWeight, product of:
               1.1205077 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.016957918 = queryNorm
             0.20459381 = fieldWeight in 2441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2441)
         0.007739538 = weight(abstract_txt:this in 2441) [ClassicSimilarity], result of:
           0.007739538 = score(doc=2441,freq=1.0), product of:
             0.058815118 = queryWeight, product of:
               1.4413798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.016957918 = queryNorm
             0.13159096 = fieldWeight in 2441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2441)
         0.07038625 = weight(abstract_txt:texts in 2441) [ClassicSimilarity], result of:
           0.07038625 = score(doc=2441,freq=2.0), product of:
             0.16142997 = queryWeight, product of:
               1.6885388 = boost
               5.6376824 = idf(docFreq=429, maxDocs=44421)
               0.016957918 = queryNorm
             0.43601727 = fieldWeight in 2441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6376824 = idf(docFreq=429, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2441)
         0.19131343 = weight(abstract_txt:phrases in 2441) [ClassicSimilarity], result of:
           0.19131343 = score(doc=2441,freq=2.0), product of:
             0.35990372 = queryWeight, product of:
               3.087861 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016957918 = queryNorm
             0.53156835 = fieldWeight in 2441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2441)
         0.36848438 = weight(abstract_txt:noun in 2441) [ClassicSimilarity], result of:
           0.36848438 = score(doc=2441,freq=2.0), product of:
             0.6132181 = queryWeight, product of:
               4.6541615 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.016957918 = queryNorm
             0.6009026 = fieldWeight in 2441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2441)
       0.24 = coord(6/25)
   

5. Driscoll, J.R.; Rajala, D.A.; Shaffer, W.H.: ¬The operation and performance of an artificially intelligent keywording system (1991) 0.16

   0.16322024 = sum of:
     0.16322024 = product of:
       0.68008435 = sum of:
         0.064644694 = weight(abstract_txt:semantically in 6680) [ClassicSimilarity], result of:
           0.064644694 = score(doc=6680,freq=1.0), product of:
             0.120248474 = queryWeight, product of:
               1.0304899 = boost
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.016957918 = queryNorm
             0.53759265 = fieldWeight in 6680, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.881186 = idf(docFreq=123, maxDocs=44421)
               0.078125 = fieldNorm(doc=6680)
         0.100692555 = weight(abstract_txt:phrase in 6680) [ClassicSimilarity], result of:
           0.100692555 = score(doc=6680,freq=2.0), product of:
             0.1282466 = queryWeight, product of:
               1.0642089 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.016957918 = queryNorm
             0.7851479 = fieldWeight in 6680, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.078125 = fieldNorm(doc=6680)
         0.020777164 = weight(abstract_txt:approach in 6680) [ClassicSimilarity], result of:
           0.020777164 = score(doc=6680,freq=1.0), product of:
             0.07108727 = queryWeight, product of:
               1.1205077 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.016957918 = queryNorm
             0.29227686 = fieldWeight in 6680, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=6680)
         0.04620069 = weight(abstract_txt:indexing in 6680) [ClassicSimilarity], result of:
           0.04620069 = score(doc=6680,freq=2.0), product of:
             0.0961221 = queryWeight, product of:
               1.3029585 = boost
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.016957918 = queryNorm
             0.48064584 = fieldWeight in 6680, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3503094 = idf(docFreq=1557, maxDocs=44421)
               0.078125 = fieldNorm(doc=6680)
         0.015636228 = weight(abstract_txt:this in 6680) [ClassicSimilarity], result of:
           0.015636228 = score(doc=6680,freq=2.0), product of:
             0.058815118 = queryWeight, product of:
               1.4413798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.016957918 = queryNorm
             0.26585388 = fieldWeight in 6680, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=6680)
         0.432133 = weight(abstract_txt:phrases in 6680) [ClassicSimilarity], result of:
           0.432133 = score(doc=6680,freq=5.0), product of:
             0.35990372 = queryWeight, product of:
               3.087861 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.016957918 = queryNorm
             1.2006905 = fieldWeight in 6680, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=6680)
       0.24 = coord(6/25)