Document (#27591)

Author

Atlam, E.-S.
Morita, K.
Fuketa, M.
Aoe, J.-i.

Title

¬A new method for selecting English field association terms of compound words and its knowledge representation

Source

Information processing and management. 38(2002) no.6, S.807-821

Year

2002

Abstract

This paper presents a strategy for building a morphological machine dictionary of English that infers meaning of derivations by considering morphological affixes and their semantic classification. Derivations are grouped into a frame that is accessible to semantic stem and knowledge base. This paper also proposes an efficient method for selecting compound Field Association (FA) terms from a large pool of single FA terms for some specialized fields. For single FA terms, five levels of association are defined and two ranks are defined, based on stability and inheritance. About 85% of redundant compound FA terms can be removed effectively by using levels and ranks proposed in this paper. Recall averages of 60-80% are achieved, depending on the type of text. The proposed methods are applied to 22,000 relationships between verbs and nouns extracted from the large tagged corpus.

Theme

Computerlinguistik

Similar documents (author)

1. Atlam, E.S.: Similarity measurement using term negative weight and its application to word similarity (2000) 6.19

   6.1935673 = sum of:
     6.1935673 = weight(author_txt:atlam in 4912) [ClassicSimilarity], result of:
       6.1935673 = fieldWeight in 4912, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.625 = fieldNorm(doc=4912)
   

2. El-Sayed Atlam -> Atlam, E.-S.: 5.26

   5.2554164 = sum of:
     5.2554164 = weight(author_txt:atlam in 3525) [ClassicSimilarity], result of:
       5.2554164 = fieldWeight in 3525, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.375 = fieldNorm(doc=3525)
   

3. Atlam, E.-S.; Morita, K.; Fuketa, M.; Aoe, J.-i.: ¬A new approach for Arabic text classification using Arabic field-association terms (2011) 3.10

   3.0967836 = sum of:
     3.0967836 = weight(author_txt:atlam in 927) [ClassicSimilarity], result of:
       3.0967836 = fieldWeight in 927, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.3125 = fieldNorm(doc=927)
   

4. Rokaya, M.; Atlam, E.; Fuketa, M.; Dorji, T.C.; Aoe, J.-i.: Ranking of field association terms using Co-word analysis (2008) 2.48

   2.477427 = sum of:
     2.477427 = weight(author_txt:atlam in 3060) [ClassicSimilarity], result of:
       2.477427 = fieldWeight in 3060, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.25 = fieldNorm(doc=3060)
   

Similar documents (content)

1. Atlam, E.-S.; Morita, K.; Fuketa, M.; Aoe, J.-i.: ¬A new approach for Arabic text classification using Arabic field-association terms (2011) 0.17

   0.17202786 = sum of:
     0.17202786 = product of:
       0.6143852 = sum of:
         0.052863177 = weight(abstract_txt:field in 927) [ClassicSimilarity], result of:
           0.052863177 = score(doc=927,freq=4.0), product of:
             0.094221115 = queryWeight, product of:
               1.120346 = boost
               4.4884357 = idf(docFreq=1356, maxDocs=44421)
               0.018737044 = queryNorm
             0.56105447 = fieldWeight in 927, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4884357 = idf(docFreq=1356, maxDocs=44421)
               0.0625 = fieldNorm(doc=927)
         0.037639618 = weight(abstract_txt:method in 927) [ClassicSimilarity], result of:
           0.037639618 = score(doc=927,freq=2.0), product of:
             0.094657026 = queryWeight, product of:
               1.1229346 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.018737044 = queryNorm
             0.39764208 = fieldWeight in 927, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=927)
         0.041684184 = weight(abstract_txt:single in 927) [ClassicSimilarity], result of:
           0.041684184 = score(doc=927,freq=1.0), product of:
             0.12765768 = queryWeight, product of:
               1.3040718 = boost
               5.2244954 = idf(docFreq=649, maxDocs=44421)
               0.018737044 = queryNorm
             0.32653096 = fieldWeight in 927, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2244954 = idf(docFreq=649, maxDocs=44421)
               0.0625 = fieldNorm(doc=927)
         0.05063829 = weight(abstract_txt:english in 927) [ClassicSimilarity], result of:
           0.05063829 = score(doc=927,freq=1.0), product of:
             0.14534009 = queryWeight, product of:
               1.3914601 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.018737044 = queryNorm
             0.3484124 = fieldWeight in 927, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.0625 = fieldNorm(doc=927)
         0.110156246 = weight(abstract_txt:association in 927) [ClassicSimilarity], result of:
           0.110156246 = score(doc=927,freq=2.0), product of:
             0.22169672 = queryWeight, product of:
               2.1047635 = boost
               5.6215343 = idf(docFreq=436, maxDocs=44421)
               0.018737044 = queryNorm
             0.49687812 = fieldWeight in 927, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6215343 = idf(docFreq=436, maxDocs=44421)
               0.0625 = fieldNorm(doc=927)
         0.13666709 = weight(abstract_txt:terms in 927) [ClassicSimilarity], result of:
           0.13666709 = score(doc=927,freq=8.0), product of:
             0.19118716 = queryWeight, product of:
               2.5233495 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.018737044 = queryNorm
             0.71483403 = fieldWeight in 927, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=927)
         0.18473662 = weight(abstract_txt:compound in 927) [ClassicSimilarity], result of:
           0.18473662 = score(doc=927,freq=1.0), product of:
             0.39427432 = queryWeight, product of:
               2.806874 = boost
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.018737044 = queryNorm
             0.46854845 = fieldWeight in 927, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.0625 = fieldNorm(doc=927)
       0.28 = coord(7/25)
   

2. Li, N.; Sun, J.: Improving Chinese term association from the linguistic perspective (2017) 0.16

   0.15553367 = sum of:
     0.15553367 = product of:
       0.648057 = sum of:
         0.065466784 = weight(abstract_txt:semantic in 4381) [ClassicSimilarity], result of:
           0.065466784 = score(doc=4381,freq=4.0), product of:
             0.09363827 = queryWeight, product of:
               1.1168754 = boost
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.018737044 = queryNorm
             0.69914556 = fieldWeight in 4381, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.078125 = fieldNorm(doc=4381)
         0.047049522 = weight(abstract_txt:method in 4381) [ClassicSimilarity], result of:
           0.047049522 = score(doc=4381,freq=2.0), product of:
             0.094657026 = queryWeight, product of:
               1.1229346 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.018737044 = queryNorm
             0.4970526 = fieldWeight in 4381, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=4381)
         0.050561335 = weight(abstract_txt:proposed in 4381) [ClassicSimilarity], result of:
           0.050561335 = score(doc=4381,freq=2.0), product of:
             0.09931048 = queryWeight, product of:
               1.1502059 = boost
               4.608063 = idf(docFreq=1203, maxDocs=44421)
               0.018737044 = queryNorm
             0.50912386 = fieldWeight in 4381, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.608063 = idf(docFreq=1203, maxDocs=44421)
               0.078125 = fieldNorm(doc=4381)
         0.16864163 = weight(abstract_txt:association in 4381) [ClassicSimilarity], result of:
           0.16864163 = score(doc=4381,freq=3.0), product of:
             0.22169672 = queryWeight, product of:
               2.1047635 = boost
               5.6215343 = idf(docFreq=436, maxDocs=44421)
               0.018737044 = queryNorm
             0.76068616 = fieldWeight in 4381, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.6215343 = idf(docFreq=436, maxDocs=44421)
               0.078125 = fieldNorm(doc=4381)
         0.08541693 = weight(abstract_txt:terms in 4381) [ClassicSimilarity], result of:
           0.08541693 = score(doc=4381,freq=2.0), product of:
             0.19118716 = queryWeight, product of:
               2.5233495 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.018737044 = queryNorm
             0.44677126 = fieldWeight in 4381, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.078125 = fieldNorm(doc=4381)
         0.23092078 = weight(abstract_txt:compound in 4381) [ClassicSimilarity], result of:
           0.23092078 = score(doc=4381,freq=1.0), product of:
             0.39427432 = queryWeight, product of:
               2.806874 = boost
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.018737044 = queryNorm
             0.58568555 = fieldWeight in 4381, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.078125 = fieldNorm(doc=4381)
       0.24 = coord(6/25)
   

3. Seo, H.-C.; Kim, S.-B.; Rim, H.-C.; Myaeng, S.-H.: lmproving query translation in English-Korean Cross-language information retrieval (2005) 0.14

   0.13626868 = sum of:
     0.13626868 = product of:
       0.56778616 = sum of:
         0.066538066 = weight(abstract_txt:method in 2023) [ClassicSimilarity], result of:
           0.066538066 = score(doc=2023,freq=4.0), product of:
             0.094657026 = queryWeight, product of:
               1.1229346 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.018737044 = queryNorm
             0.7029385 = fieldWeight in 2023, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=2023)
         0.022733904 = weight(abstract_txt:paper in 2023) [ClassicSimilarity], result of:
           0.022733904 = score(doc=2023,freq=1.0), product of:
             0.08406318 = queryWeight, product of:
               1.2960644 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.018737044 = queryNorm
             0.2704383 = fieldWeight in 2023, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.078125 = fieldNorm(doc=2023)
         0.06329786 = weight(abstract_txt:english in 2023) [ClassicSimilarity], result of:
           0.06329786 = score(doc=2023,freq=1.0), product of:
             0.14534009 = queryWeight, product of:
               1.3914601 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.018737044 = queryNorm
             0.4355155 = fieldWeight in 2023, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.078125 = fieldNorm(doc=2023)
         0.14246498 = weight(abstract_txt:selecting in 2023) [ClassicSimilarity], result of:
           0.14246498 = score(doc=2023,freq=2.0), product of:
             0.19811688 = queryWeight, product of:
               1.6245713 = boost
               6.5085106 = idf(docFreq=179, maxDocs=44421)
               0.018737044 = queryNorm
             0.7190956 = fieldWeight in 2023, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.5085106 = idf(docFreq=179, maxDocs=44421)
               0.078125 = fieldNorm(doc=2023)
         0.13769531 = weight(abstract_txt:association in 2023) [ClassicSimilarity], result of:
           0.13769531 = score(doc=2023,freq=2.0), product of:
             0.22169672 = queryWeight, product of:
               2.1047635 = boost
               5.6215343 = idf(docFreq=436, maxDocs=44421)
               0.018737044 = queryNorm
             0.6210976 = fieldWeight in 2023, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6215343 = idf(docFreq=436, maxDocs=44421)
               0.078125 = fieldNorm(doc=2023)
         0.13505603 = weight(abstract_txt:terms in 2023) [ClassicSimilarity], result of:
           0.13505603 = score(doc=2023,freq=5.0), product of:
             0.19118716 = queryWeight, product of:
               2.5233495 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.018737044 = queryNorm
             0.7064074 = fieldWeight in 2023, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.078125 = fieldNorm(doc=2023)
       0.24 = coord(6/25)
   

4. Bounhas, I.; Elayeb, B.; Evrard, F.; Slimani, Y.: Organizing contextual knowledge for Arabic text disambiguation and terminology extraction (2011) 0.12

   0.12448206 = sum of:
     0.12448206 = product of:
       0.6224103 = sum of:
         0.1302229 = weight(abstract_txt:nouns in 846) [ClassicSimilarity], result of:
           0.1302229 = score(doc=846,freq=3.0), product of:
             0.15013222 = queryWeight, product of:
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.018737044 = queryNorm
             0.8673881 = fieldWeight in 846, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.026186712 = weight(abstract_txt:semantic in 846) [ClassicSimilarity], result of:
           0.026186712 = score(doc=846,freq=1.0), product of:
             0.09363827 = queryWeight, product of:
               1.1168754 = boost
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.018737044 = queryNorm
             0.27965823 = fieldWeight in 846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4745317 = idf(docFreq=1375, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.018187122 = weight(abstract_txt:paper in 846) [ClassicSimilarity], result of:
           0.018187122 = score(doc=846,freq=1.0), product of:
             0.08406318 = queryWeight, product of:
               1.2960644 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.018737044 = queryNorm
             0.21635064 = fieldWeight in 846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.12784036 = weight(abstract_txt:terms in 846) [ClassicSimilarity], result of:
           0.12784036 = score(doc=846,freq=7.0), product of:
             0.19118716 = queryWeight, product of:
               2.5233495 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.018737044 = queryNorm
             0.668666 = fieldWeight in 846, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.31997323 = weight(abstract_txt:compound in 846) [ClassicSimilarity], result of:
           0.31997323 = score(doc=846,freq=3.0), product of:
             0.39427432 = queryWeight, product of:
               2.806874 = boost
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.018737044 = queryNorm
             0.8115497 = fieldWeight in 846, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
       0.2 = coord(5/25)
   

5. Kettunen, K.; Kunttu, T.; Järvelin, K.: To stem or lemmatize a highly inflectional language in a probabilistic IR environment? (2005) 0.11

   0.107909344 = sum of:
     0.107909344 = product of:
       0.6744334 = sum of:
         0.14710243 = weight(abstract_txt:stem in 5395) [ClassicSimilarity], result of:
           0.14710243 = score(doc=5395,freq=5.0), product of:
             0.15013222 = queryWeight, product of:
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.018737044 = queryNorm
             0.9798191 = fieldWeight in 5395, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.0546875 = fieldNorm(doc=5395)
         0.04033656 = weight(abstract_txt:method in 5395) [ClassicSimilarity], result of:
           0.04033656 = score(doc=5395,freq=3.0), product of:
             0.094657026 = queryWeight, product of:
               1.1229346 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.018737044 = queryNorm
             0.42613384 = fieldWeight in 5395, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0546875 = fieldNorm(doc=5395)
         0.32534993 = weight(abstract_txt:morphological in 5395) [ClassicSimilarity], result of:
           0.32534993 = score(doc=5395,freq=6.0), product of:
             0.30216494 = queryWeight, product of:
               2.0063193 = boost
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.018737044 = queryNorm
             1.0767295 = fieldWeight in 5395, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.0546875 = fieldNorm(doc=5395)
         0.16164453 = weight(abstract_txt:compound in 5395) [ClassicSimilarity], result of:
           0.16164453 = score(doc=5395,freq=1.0), product of:
             0.39427432 = queryWeight, product of:
               2.806874 = boost
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.018737044 = queryNorm
             0.40997988 = fieldWeight in 5395, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.0546875 = fieldNorm(doc=5395)
       0.16 = coord(4/25)