Document (#26856)

Author

L'Homme, D.
L'Homme, M.-C.
Lemay, C.

Title

Benchmarking the performance of two Part-of-Speech (POS) taggers for terminological purposes

Source

Knowledge organization. 29(2002) nos.3/4, S.204-216

Year

2002

Abstract

Part-of-Speech (POS) taggers are used in an increasing number of terminology applications. However, terminologists do not know exactly how they perform an specialized texts since most POS taggers have been trained an "general" Corpora, that is, Corpora containing all sorts of undifferentiated texts. In this article, we evaluate the Performance of two POS taggers an French and English medical texts. The taggers are TnT (a statistical tagger developed at Saarland University (Brants 2000)) and WinBrill (the Windows version of the tagger initially developed by Eric Brill (1992)). Ten extracts from medical texts were submitted to the taggers and the outputs scanned manually. Results pertain to the accuracy of tagging in terms of correctly and incorrectly tagged words. We also study the handling of unknown words from different viewpoints.

Theme

Computerlinguistik

Similar documents (content)

1. Manning, C.D.: Part-of-Speech Tagging from 97% to 100% : is it time for some linguistics? (2011) 0.18

   0.17795682 = sum of:
     0.17795682 = product of:
       0.7414868 = sum of:
         0.028579034 = weight(abstract_txt:part in 2121) [ClassicSimilarity], result of:
           0.028579034 = score(doc=2121,freq=2.0), product of:
             0.07058136 = queryWeight, product of:
               1.2580689 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.012246815 = queryNorm
             0.40490907 = fieldWeight in 2121, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.029310152 = weight(abstract_txt:performance in 2121) [ClassicSimilarity], result of:
           0.029310152 = score(doc=2121,freq=2.0), product of:
             0.07178005 = queryWeight, product of:
               1.2687068 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.012246815 = queryNorm
             0.40833285 = fieldWeight in 2121, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.03229429 = weight(abstract_txt:words in 2121) [ClassicSimilarity], result of:
           0.03229429 = score(doc=2121,freq=1.0), product of:
             0.09647589 = queryWeight, product of:
               1.4708514 = boost
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.012246815 = queryNorm
             0.33473945 = fieldWeight in 2121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.09652243 = weight(abstract_txt:speech in 2121) [ClassicSimilarity], result of:
           0.09652243 = score(doc=2121,freq=2.0), product of:
             0.1588829 = queryWeight, product of:
               1.8875479 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.012246815 = queryNorm
             0.6075067 = fieldWeight in 2121, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.13869521 = weight(abstract_txt:tagger in 2121) [ClassicSimilarity], result of:
           0.13869521 = score(doc=2121,freq=1.0), product of:
             0.2549036 = queryWeight, product of:
               2.3908226 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.012246815 = queryNorm
             0.54410845 = fieldWeight in 2121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.41608563 = weight(abstract_txt:taggers in 2121) [ClassicSimilarity], result of:
           0.41608563 = score(doc=2121,freq=1.0), product of:
             0.76471084 = queryWeight, product of:
               7.1724687 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.012246815 = queryNorm
             0.54410845 = fieldWeight in 2121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
       0.24 = coord(6/25)
   

2. Perovsek, M.; Kranjca, J.; Erjaveca, T.; Cestnika, B.; Lavraca, N.: TextFlows : a visual programming platform for text mining and natural language processing (2016) 0.12

   0.1153919 = sum of:
     0.1153919 = product of:
       0.7211994 = sum of:
         0.025260536 = weight(abstract_txt:part in 3697) [ClassicSimilarity], result of:
           0.025260536 = score(doc=3697,freq=1.0), product of:
             0.07058136 = queryWeight, product of:
               1.2580689 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.012246815 = queryNorm
             0.35789245 = fieldWeight in 3697, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.08531458 = weight(abstract_txt:speech in 3697) [ClassicSimilarity], result of:
           0.08531458 = score(doc=3697,freq=1.0), product of:
             0.1588829 = queryWeight, product of:
               1.8875479 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.012246815 = queryNorm
             0.53696513 = fieldWeight in 3697, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.09051726 = weight(abstract_txt:corpora in 3697) [ClassicSimilarity], result of:
           0.09051726 = score(doc=3697,freq=1.0), product of:
             0.16527835 = queryWeight, product of:
               1.9251624 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.012246815 = queryNorm
             0.5476656 = fieldWeight in 3697, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
         0.52010703 = weight(abstract_txt:taggers in 3697) [ClassicSimilarity], result of:
           0.52010703 = score(doc=3697,freq=1.0), product of:
             0.76471084 = queryWeight, product of:
               7.1724687 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.012246815 = queryNorm
             0.68013555 = fieldWeight in 3697, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.078125 = fieldNorm(doc=3697)
       0.16 = coord(4/25)
   

3. Toutanova, K.; Manning, C.D.: Enriching the knowledge sources used in a maximum entropy Part-of-Speech Tagger (2000) 0.11

   0.10530036 = sum of:
     0.10530036 = product of:
       0.5265018 = sum of:
         0.030312642 = weight(abstract_txt:part in 2060) [ClassicSimilarity], result of:
           0.030312642 = score(doc=2060,freq=1.0), product of:
             0.07058136 = queryWeight, product of:
               1.2580689 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.012246815 = queryNorm
             0.42947093 = fieldWeight in 2060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.031088114 = weight(abstract_txt:performance in 2060) [ClassicSimilarity], result of:
           0.031088114 = score(doc=2060,freq=1.0), product of:
             0.07178005 = queryWeight, product of:
               1.2687068 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.012246815 = queryNorm
             0.43310243 = fieldWeight in 2060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.068506524 = weight(abstract_txt:words in 2060) [ClassicSimilarity], result of:
           0.068506524 = score(doc=2060,freq=2.0), product of:
             0.09647589 = queryWeight, product of:
               1.4708514 = boost
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.012246815 = queryNorm
             0.71008956 = fieldWeight in 2060, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.1023775 = weight(abstract_txt:speech in 2060) [ClassicSimilarity], result of:
           0.1023775 = score(doc=2060,freq=1.0), product of:
             0.1588829 = queryWeight, product of:
               1.8875479 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.012246815 = queryNorm
             0.64435816 = fieldWeight in 2060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.29421696 = weight(abstract_txt:tagger in 2060) [ClassicSimilarity], result of:
           0.29421696 = score(doc=2060,freq=2.0), product of:
             0.2549036 = queryWeight, product of:
               2.3908226 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.012246815 = queryNorm
             1.1542283 = fieldWeight in 2060, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
       0.2 = coord(5/25)
   

4. Dias, G.: Multiword unit hybrid extraction (o.J.) 0.10

   0.09672069 = sum of:
     0.09672069 = product of:
       0.4030029 = sum of:
         0.05672874 = weight(abstract_txt:extracts in 1643) [ClassicSimilarity], result of:
           0.05672874 = score(doc=1643,freq=1.0), product of:
             0.09606984 = queryWeight, product of:
               1.037858 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.012246815 = queryNorm
             0.59049475 = fieldWeight in 1643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.078125 = fieldNorm(doc=1643)
         0.059012227 = weight(abstract_txt:tagged in 1643) [ClassicSimilarity], result of:
           0.059012227 = score(doc=1643,freq=1.0), product of:
             0.098630905 = queryWeight, product of:
               1.0516008 = boost
               7.6584163 = idf(docFreq=56, maxDocs=44421)
               0.012246815 = queryNorm
             0.59831375 = fieldWeight in 1643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.6584163 = idf(docFreq=56, maxDocs=44421)
               0.078125 = fieldNorm(doc=1643)
         0.035723794 = weight(abstract_txt:part in 1643) [ClassicSimilarity], result of:
           0.035723794 = score(doc=1643,freq=2.0), product of:
             0.07058136 = queryWeight, product of:
               1.2580689 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.012246815 = queryNorm
             0.50613636 = fieldWeight in 1643, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.078125 = fieldNorm(doc=1643)
         0.040367857 = weight(abstract_txt:words in 1643) [ClassicSimilarity], result of:
           0.040367857 = score(doc=1643,freq=1.0), product of:
             0.09647589 = queryWeight, product of:
               1.4708514 = boost
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.012246815 = queryNorm
             0.4184243 = fieldWeight in 1643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.078125 = fieldNorm(doc=1643)
         0.12065303 = weight(abstract_txt:speech in 1643) [ClassicSimilarity], result of:
           0.12065303 = score(doc=1643,freq=2.0), product of:
             0.1588829 = queryWeight, product of:
               1.8875479 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.012246815 = queryNorm
             0.7593834 = fieldWeight in 1643, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=1643)
         0.09051726 = weight(abstract_txt:corpora in 1643) [ClassicSimilarity], result of:
           0.09051726 = score(doc=1643,freq=1.0), product of:
             0.16527835 = queryWeight, product of:
               1.9251624 = boost
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.012246815 = queryNorm
             0.5476656 = fieldWeight in 1643, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.01012 = idf(docFreq=108, maxDocs=44421)
               0.078125 = fieldNorm(doc=1643)
       0.24 = coord(6/25)
   

5. Lin, N.; Li, D.; Ding, Y.; He, B.; Qin, Z.; Tang, J.; Li, J.; Dong, T.: ¬The dynamic features of Delicious, Flickr, and YouTube (2012) 0.08

   0.077669315 = sum of:
     0.077669315 = product of:
       0.97086644 = sum of:
         0.13869521 = weight(abstract_txt:tagger in 970) [ClassicSimilarity], result of:
           0.13869521 = score(doc=970,freq=1.0), product of:
             0.2549036 = queryWeight, product of:
               2.3908226 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.012246815 = queryNorm
             0.54410845 = fieldWeight in 970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=970)
         0.83217126 = weight(abstract_txt:taggers in 970) [ClassicSimilarity], result of:
           0.83217126 = score(doc=970,freq=4.0), product of:
             0.76471084 = queryWeight, product of:
               7.1724687 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.012246815 = queryNorm
             1.0882169 = fieldWeight in 970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=970)
       0.08 = coord(2/25)