Document (#37756)

Author

Justeson, J.S.
Katz, S.M.

Title

Technical terminology : some linguistic properties and an algorithm for identification in text

Source

Natural language engineering. 1(1995) no.1, S.9-27

Year

1995

Abstract

This paper identifies some linguistic properties of technical terminology, and uses them to formulate an algorithm for identifying technical terms in running text. The grammatical properties discussed are preferred phrase structures: technical terms consist mostly of noun phrases containing adjectives, nouns, and occasionally prepositions; rerely do terms contain verbs, adverbs, or conjunctions. The discourse properties are patterns of repetition that distinguish noun phrases that are technical terms, especially those multi-word phrases that constitute a substantial majority of all technical vocabulary, from other types of noun phrase. The paper presents a terminology indentification algorithm that is motivated by these linguistic properties. An implementation of the algorithm is described; it recovers a high proportion of the technical terms in a text, and a high proportaion of the recovered strings are vaild technical terms. The algorithm proves to be effective regardless of the domain of the text to which it is applied.

Theme

Computerlinguistik

Similar documents (author)

1. Katz, M.: Multimedia: the future of information delivery to homes and business (1993) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 6645) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 6645, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=6645)
   

2. Katz, B.: Community college reference services : a working guide for and by librarians (1992) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 729) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 729, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=729)
   

3. Katz, J.S.: Bibliometric standards : personal experience and lessons learned (1996) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 5126) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 5126, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=5126)
   

4. Katz, W.A.: Introduction to reference work (1997) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 2188) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 2188, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=2188)
   

5. Katz, W.A.: Introduction to reference work : Vol.1: Basic information sources; vol.2: Reference services and reference processes (1992) 5.54

   5.5426593 = sum of:
     5.5426593 = weight(author_txt:katz in 4364) [ClassicSimilarity], result of:
       5.5426593 = fieldWeight in 4364, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.868255 = idf(docFreq=16, maxDocs=44421)
         0.625 = fieldNorm(doc=4364)
   

Similar documents (content)

1. Szostak, R.: Basic Concepts Classification (BCC) (2020) 0.17

   0.17425142 = sum of:
     0.17425142 = product of:
       0.6223265 = sum of:
         0.048032653 = weight(abstract_txt:strings in 883) [ClassicSimilarity], result of:
           0.048032653 = score(doc=883,freq=1.0), product of:
             0.104817286 = queryWeight, product of:
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.014295827 = queryNorm
             0.45825124 = fieldWeight in 883, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.0625 = fieldNorm(doc=883)
         0.08499241 = weight(abstract_txt:adjectives in 883) [ClassicSimilarity], result of:
           0.08499241 = score(doc=883,freq=1.0), product of:
             0.15334229 = queryWeight, product of:
               1.2095242 = boost
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.014295827 = queryNorm
             0.5542659 = fieldWeight in 883, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.868255 = idf(docFreq=16, maxDocs=44421)
               0.0625 = fieldNorm(doc=883)
         0.015792796 = weight(abstract_txt:that in 883) [ClassicSimilarity], result of:
           0.015792796 = score(doc=883,freq=6.0), product of:
             0.043619845 = queryWeight, product of:
               1.2901957 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014295827 = queryNorm
             0.3620553 = fieldWeight in 883, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=883)
         0.10855886 = weight(abstract_txt:adverbs in 883) [ClassicSimilarity], result of:
           0.10855886 = score(doc=883,freq=1.0), product of:
             0.18051726 = queryWeight, product of:
               1.3123295 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.014295827 = queryNorm
             0.60137665 = fieldWeight in 883, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=883)
         0.06906265 = weight(abstract_txt:terminology in 883) [ClassicSimilarity], result of:
           0.06906265 = score(doc=883,freq=1.0), product of:
             0.19257997 = queryWeight, product of:
               2.3477385 = boost
               5.7378883 = idf(docFreq=388, maxDocs=44421)
               0.014295827 = queryNorm
             0.35861802 = fieldWeight in 883, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7378883 = idf(docFreq=388, maxDocs=44421)
               0.0625 = fieldNorm(doc=883)
         0.048345674 = weight(abstract_txt:terms in 883) [ClassicSimilarity], result of:
           0.048345674 = score(doc=883,freq=1.0), product of:
             0.19129224 = queryWeight, product of:
               3.3090844 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.014295827 = queryNorm
             0.252732 = fieldWeight in 883, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=883)
         0.24754141 = weight(abstract_txt:properties in 883) [ClassicSimilarity], result of:
           0.24754141 = score(doc=883,freq=4.0), product of:
             0.33688146 = queryWeight, product of:
               4.008733 = boost
               5.878422 = idf(docFreq=337, maxDocs=44421)
               0.014295827 = queryNorm
             0.7348027 = fieldWeight in 883, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.878422 = idf(docFreq=337, maxDocs=44421)
               0.0625 = fieldNorm(doc=883)
       0.28 = coord(7/25)
   

2. Vilares, J.; Alonso, M.A.; Vilares, M.: Extraction of complex index terms in non-English IR : a shallow parsing based approach (2008) 0.16

   0.16293655 = sum of:
     0.16293655 = product of:
       0.6789023 = sum of:
         0.011167192 = weight(abstract_txt:that in 3107) [ClassicSimilarity], result of:
           0.011167192 = score(doc=3107,freq=3.0), product of:
             0.043619845 = queryWeight, product of:
               1.2901957 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014295827 = queryNorm
             0.25601172 = fieldWeight in 3107, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.087465145 = weight(abstract_txt:phrase in 3107) [ClassicSimilarity], result of:
           0.087465145 = score(doc=3107,freq=1.0), product of:
             0.19692849 = queryWeight, product of:
               1.938442 = boost
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.014295827 = queryNorm
             0.44414672 = fieldWeight in 3107, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1063476 = idf(docFreq=98, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.10153385 = weight(abstract_txt:linguistic in 3107) [ClassicSimilarity], result of:
           0.10153385 = score(doc=3107,freq=2.0), product of:
             0.19762698 = queryWeight, product of:
               2.3783035 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.014295827 = queryNorm
             0.51376516 = fieldWeight in 3107, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.16786884 = weight(abstract_txt:phrases in 3107) [ClassicSimilarity], result of:
           0.16786884 = score(doc=3107,freq=2.0), product of:
             0.27632427 = queryWeight, product of:
               2.8122485 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.014295827 = queryNorm
             0.6075067 = fieldWeight in 3107, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.24249619 = weight(abstract_txt:noun in 3107) [ClassicSimilarity], result of:
           0.24249619 = score(doc=3107,freq=2.0), product of:
             0.3531091 = queryWeight, product of:
               3.1790593 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.014295827 = queryNorm
             0.6867458 = fieldWeight in 3107, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
         0.0683711 = weight(abstract_txt:terms in 3107) [ClassicSimilarity], result of:
           0.0683711 = score(doc=3107,freq=2.0), product of:
             0.19129224 = queryWeight, product of:
               3.3090844 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.014295827 = queryNorm
             0.35741702 = fieldWeight in 3107, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=3107)
       0.24 = coord(6/25)
   

3. Bounhas, I.; Elayeb, B.; Evrard, F.; Slimani, Y.: Organizing contextual knowledge for Arabic text disambiguation and terminology extraction (2011) 0.16

   0.1602046 = sum of:
     0.1602046 = product of:
       0.6675192 = sum of:
         0.10857875 = weight(abstract_txt:nouns in 846) [ClassicSimilarity], result of:
           0.10857875 = score(doc=846,freq=3.0), product of:
             0.12517896 = queryWeight, product of:
               1.0928215 = boost
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.014295827 = queryNorm
             0.8673881 = fieldWeight in 846, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.06906265 = weight(abstract_txt:terminology in 846) [ClassicSimilarity], result of:
           0.06906265 = score(doc=846,freq=1.0), product of:
             0.19257997 = queryWeight, product of:
               2.3477385 = boost
               5.7378883 = idf(docFreq=388, maxDocs=44421)
               0.014295827 = queryNorm
             0.35861802 = fieldWeight in 846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7378883 = idf(docFreq=388, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.071795285 = weight(abstract_txt:linguistic in 846) [ClassicSimilarity], result of:
           0.071795285 = score(doc=846,freq=1.0), product of:
             0.19762698 = queryWeight, product of:
               2.3783035 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.014295827 = queryNorm
             0.36328685 = fieldWeight in 846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.1187012 = weight(abstract_txt:phrases in 846) [ClassicSimilarity], result of:
           0.1187012 = score(doc=846,freq=1.0), product of:
             0.27632427 = queryWeight, product of:
               2.8122485 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.014295827 = queryNorm
             0.4295721 = fieldWeight in 846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.1714707 = weight(abstract_txt:noun in 846) [ClassicSimilarity], result of:
           0.1714707 = score(doc=846,freq=1.0), product of:
             0.3531091 = queryWeight, product of:
               3.1790593 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.014295827 = queryNorm
             0.48560262 = fieldWeight in 846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
         0.12791061 = weight(abstract_txt:terms in 846) [ClassicSimilarity], result of:
           0.12791061 = score(doc=846,freq=7.0), product of:
             0.19129224 = queryWeight, product of:
               3.3090844 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.014295827 = queryNorm
             0.668666 = fieldWeight in 846, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=846)
       0.24 = coord(6/25)
   

4. Godby, J.: WordSmith research project bridges gap between tokens and indexes (1998) 0.16

   0.15884438 = sum of:
     0.15884438 = product of:
       0.6618516 = sum of:
         0.013676962 = weight(abstract_txt:that in 5729) [ClassicSimilarity], result of:
           0.013676962 = score(doc=5729,freq=2.0), product of:
             0.043619845 = queryWeight, product of:
               1.2901957 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014295827 = queryNorm
             0.31354907 = fieldWeight in 5729, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=5729)
         0.068227656 = weight(abstract_txt:text in 5729) [ClassicSimilarity], result of:
           0.068227656 = score(doc=5729,freq=2.0), product of:
             0.12734972 = queryWeight, product of:
               2.2045124 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.014295827 = queryNorm
             0.5357503 = fieldWeight in 5729, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.09375 = fieldNorm(doc=5729)
         0.146504 = weight(abstract_txt:terminology in 5729) [ClassicSimilarity], result of:
           0.146504 = score(doc=5729,freq=2.0), product of:
             0.19257997 = queryWeight, product of:
               2.3477385 = boost
               5.7378883 = idf(docFreq=388, maxDocs=44421)
               0.014295827 = queryNorm
             0.7607437 = fieldWeight in 5729, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7378883 = idf(docFreq=388, maxDocs=44421)
               0.09375 = fieldNorm(doc=5729)
         0.1780518 = weight(abstract_txt:phrases in 5729) [ClassicSimilarity], result of:
           0.1780518 = score(doc=5729,freq=1.0), product of:
             0.27632427 = queryWeight, product of:
               2.8122485 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.014295827 = queryNorm
             0.64435816 = fieldWeight in 5729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.09375 = fieldNorm(doc=5729)
         0.072518505 = weight(abstract_txt:terms in 5729) [ClassicSimilarity], result of:
           0.072518505 = score(doc=5729,freq=1.0), product of:
             0.19129224 = queryWeight, product of:
               3.3090844 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.014295827 = queryNorm
             0.379098 = fieldWeight in 5729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.09375 = fieldNorm(doc=5729)
         0.1828727 = weight(abstract_txt:technical in 5729) [ClassicSimilarity], result of:
           0.1828727 = score(doc=5729,freq=1.0), product of:
             0.39007095 = queryWeight, product of:
               5.4563265 = boost
               5.0007367 = idf(docFreq=812, maxDocs=44421)
               0.014295827 = queryNorm
             0.46881908 = fieldWeight in 5729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0007367 = idf(docFreq=812, maxDocs=44421)
               0.09375 = fieldNorm(doc=5729)
       0.24 = coord(6/25)
   

5. Austin, D.; Sørensen, J.: PRECIS in a multilingual context : Pt.2: A linguistic and logical explanation of the syntax. (1976) 0.15

   0.15386297 = sum of:
     0.15386297 = product of:
       0.5495106 = sum of:
         0.048032653 = weight(abstract_txt:strings in 1981) [ClassicSimilarity], result of:
           0.048032653 = score(doc=1981,freq=1.0), product of:
             0.104817286 = queryWeight, product of:
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.014295827 = queryNorm
             0.45825124 = fieldWeight in 1981, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.0625 = fieldNorm(doc=1981)
         0.012132017 = weight(abstract_txt:some in 1981) [ClassicSimilarity], result of:
           0.012132017 = score(doc=1981,freq=1.0), product of:
             0.052768394 = queryWeight, product of:
               1.0034263 = boost
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.014295827 = queryNorm
             0.22991067 = fieldWeight in 1981, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6785707 = idf(docFreq=3049, maxDocs=44421)
               0.0625 = fieldNorm(doc=1981)
         0.014416784 = weight(abstract_txt:that in 1981) [ClassicSimilarity], result of:
           0.014416784 = score(doc=1981,freq=5.0), product of:
             0.043619845 = queryWeight, product of:
               1.2901957 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014295827 = queryNorm
             0.33050975 = fieldWeight in 1981, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1981)
         0.12435307 = weight(abstract_txt:linguistic in 1981) [ClassicSimilarity], result of:
           0.12435307 = score(doc=1981,freq=3.0), product of:
             0.19762698 = queryWeight, product of:
               2.3783035 = boost
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.014295827 = queryNorm
             0.6292313 = fieldWeight in 1981, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8125896 = idf(docFreq=360, maxDocs=44421)
               0.0625 = fieldNorm(doc=1981)
         0.1187012 = weight(abstract_txt:phrases in 1981) [ClassicSimilarity], result of:
           0.1187012 = score(doc=1981,freq=1.0), product of:
             0.27632427 = queryWeight, product of:
               2.8122485 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.014295827 = queryNorm
             0.4295721 = fieldWeight in 1981, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1981)
         0.10810421 = weight(abstract_txt:terms in 1981) [ClassicSimilarity], result of:
           0.10810421 = score(doc=1981,freq=5.0), product of:
             0.19129224 = queryWeight, product of:
               3.3090844 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.014295827 = queryNorm
             0.56512594 = fieldWeight in 1981, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=1981)
         0.12377071 = weight(abstract_txt:properties in 1981) [ClassicSimilarity], result of:
           0.12377071 = score(doc=1981,freq=1.0), product of:
             0.33688146 = queryWeight, product of:
               4.008733 = boost
               5.878422 = idf(docFreq=337, maxDocs=44421)
               0.014295827 = queryNorm
             0.36740136 = fieldWeight in 1981, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.878422 = idf(docFreq=337, maxDocs=44421)
               0.0625 = fieldNorm(doc=1981)
       0.28 = coord(7/25)