Document (#38060)

Author

Toutanova, K.
Klein, D.
Manning, C.D.
Singer, Y.

Title

Feature-rich Part-of-Speech Tagging with a cyclic dependency network

Source

Proceedings of HLT-NAACL, 2003

Imprint

xx : xx

Year

2003

Pages

S.252-259

Abstract

We present a new part-of-speech tagger that demonstrates the following ideas: (i) explicit use of both preceding and following tag contexts via a dependency network representation, (ii) broad use of lexical features, including jointly conditioning on multiple consecutive words, (iii) effective use of priors in conditional loglinear models, and (iv) fine-grained modeling of unknown word features. Using these ideas together, the resulting tagger gives a 97.24%accuracy on the Penn TreebankWSJ, an error reduction of 4.4% on the best previous single automatically learned tagging result.

Content

Vgl.: http://nlp.stanford.edu/software/tagger.shtml.

Theme

Computerlinguistik

Object

Stanford POS Tagger

Similar documents (author)

1. Manning, R.W.: ¬The Anglo-American Cataloguing Rules and their future (1999) 1.25

   1.2483361 = sum of:
     1.2483361 = product of:
       3.745008 = sum of:
         3.745008 = weight(author_txt:manning in 809) [ClassicSimilarity], result of:
           3.745008 = score(doc=809,freq=1.0), product of:
             0.6501354 = queryWeight, product of:
               1.1607369 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.06077166 = queryNorm
             5.7603507 = fieldWeight in 809, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.625 = fieldNorm(doc=809)
       0.33333334 = coord(1/3)
   

2. Manning, R.W.: ¬The Anglo American Cataloguing Rules and their future (2000) 1.25

   1.2483361 = sum of:
     1.2483361 = product of:
       3.745008 = sum of:
         3.745008 = weight(author_txt:manning in 314) [ClassicSimilarity], result of:
           3.745008 = score(doc=314,freq=1.0), product of:
             0.6501354 = queryWeight, product of:
               1.1607369 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.06077166 = queryNorm
             5.7603507 = fieldWeight in 314, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.625 = fieldNorm(doc=314)
       0.33333334 = coord(1/3)
   

3. Manning, C.D.: Part-of-Speech Tagging from 97% to 100% : is it time for some linguistics? (2011) 1.25

   1.2483361 = sum of:
     1.2483361 = product of:
       3.745008 = sum of:
         3.745008 = weight(author_txt:manning in 2121) [ClassicSimilarity], result of:
           3.745008 = score(doc=2121,freq=1.0), product of:
             0.6501354 = queryWeight, product of:
               1.1607369 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.06077166 = queryNorm
             5.7603507 = fieldWeight in 2121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.625 = fieldNorm(doc=2121)
       0.33333334 = coord(1/3)
   

4. Singer, W.: Hirnentwicklung oder die Suche nach Kohärenz (1994) 1.07

   1.0707672 = sum of:
     1.0707672 = product of:
       3.2123013 = sum of:
         3.2123013 = weight(author_txt:singer in 5572) [ClassicSimilarity], result of:
           3.2123013 = score(doc=5572,freq=1.0), product of:
             0.5869208 = queryWeight, product of:
               1.1028632 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.06077166 = queryNorm
             5.4731426 = fieldWeight in 5572, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.625 = fieldNorm(doc=5572)
       0.33333334 = coord(1/3)
   

5. Singer, L.: Mammals: a multimedia encyclopedia (1992) 1.07

   1.0707672 = sum of:
     1.0707672 = product of:
       3.2123013 = sum of:
         3.2123013 = weight(author_txt:singer in 6394) [ClassicSimilarity], result of:
           3.2123013 = score(doc=6394,freq=1.0), product of:
             0.5869208 = queryWeight, product of:
               1.1028632 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.06077166 = queryNorm
             5.4731426 = fieldWeight in 6394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.625 = fieldNorm(doc=6394)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Toutanova, K.; Manning, C.D.: Enriching the knowledge sources used in a maximum entropy Part-of-Speech Tagger (2000) 0.35

   0.34589347 = sum of:
     0.34589347 = product of:
       1.2353338 = sum of:
         0.09881821 = weight(abstract_txt:unknown in 2060) [ClassicSimilarity], result of:
           0.09881821 = score(doc=2060,freq=1.0), product of:
             0.14636366 = queryWeight, product of:
               1.1953527 = boost
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.017002186 = queryNorm
             0.6751554 = fieldWeight in 2060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.0857978 = weight(abstract_txt:features in 2060) [ClassicSimilarity], result of:
           0.0857978 = score(doc=2060,freq=3.0), product of:
             0.11636677 = queryWeight, product of:
               1.5073318 = boost
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.017002186 = queryNorm
             0.73730505 = fieldWeight in 2060, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.2017817 = weight(abstract_txt:penn in 2060) [ClassicSimilarity], result of:
           0.2017817 = score(doc=2060,freq=1.0), product of:
             0.23557532 = queryWeight, product of:
               1.5165066 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.017002186 = queryNorm
             0.8565486 = fieldWeight in 2060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.050869457 = weight(abstract_txt:part in 2060) [ClassicSimilarity], result of:
           0.050869457 = score(doc=2060,freq=1.0), product of:
             0.1184468 = queryWeight, product of:
               1.5207438 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.017002186 = queryNorm
             0.42947093 = fieldWeight in 2060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.13251789 = weight(abstract_txt:tagging in 2060) [ClassicSimilarity], result of:
           0.13251789 = score(doc=2060,freq=1.0), product of:
             0.22425127 = queryWeight, product of:
               2.0924826 = boost
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.017002186 = queryNorm
             0.5909348 = fieldWeight in 2060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.17180578 = weight(abstract_txt:speech in 2060) [ClassicSimilarity], result of:
           0.17180578 = score(doc=2060,freq=1.0), product of:
             0.2666309 = queryWeight, product of:
               2.2816532 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.017002186 = queryNorm
             0.64435816 = fieldWeight in 2060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
         0.49374297 = weight(abstract_txt:tagger in 2060) [ClassicSimilarity], result of:
           0.49374297 = score(doc=2060,freq=2.0), product of:
             0.4277689 = queryWeight, product of:
               2.8900077 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.017002186 = queryNorm
             1.1542283 = fieldWeight in 2060, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.09375 = fieldNorm(doc=2060)
       0.28 = coord(7/25)
   

2. Manning, C.D.: Part-of-Speech Tagging from 97% to 100% : is it time for some linguistics? (2011) 0.16

   0.16454583 = sum of:
     0.16454583 = product of:
       0.6856077 = sum of:
         0.056872737 = weight(abstract_txt:error in 2121) [ClassicSimilarity], result of:
           0.056872737 = score(doc=2121,freq=1.0), product of:
             0.13270038 = queryWeight, product of:
               1.1381919 = boost
               6.8572807 = idf(docFreq=126, maxDocs=44421)
               0.017002186 = queryNorm
             0.42858005 = fieldWeight in 2121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8572807 = idf(docFreq=126, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.033023592 = weight(abstract_txt:features in 2121) [ClassicSimilarity], result of:
           0.033023592 = score(doc=2121,freq=1.0), product of:
             0.11636677 = queryWeight, product of:
               1.5073318 = boost
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.017002186 = queryNorm
             0.28378886 = fieldWeight in 2121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.047960185 = weight(abstract_txt:part in 2121) [ClassicSimilarity], result of:
           0.047960185 = score(doc=2121,freq=2.0), product of:
             0.1184468 = queryWeight, product of:
               1.5207438 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.017002186 = queryNorm
             0.40490907 = fieldWeight in 2121, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.15301846 = weight(abstract_txt:tagging in 2121) [ClassicSimilarity], result of:
           0.15301846 = score(doc=2121,freq=3.0), product of:
             0.22425127 = queryWeight, product of:
               2.0924826 = boost
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.017002186 = queryNorm
             0.6823527 = fieldWeight in 2121, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.16198005 = weight(abstract_txt:speech in 2121) [ClassicSimilarity], result of:
           0.16198005 = score(doc=2121,freq=2.0), product of:
             0.2666309 = queryWeight, product of:
               2.2816532 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.017002186 = queryNorm
             0.6075067 = fieldWeight in 2121, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
         0.23275267 = weight(abstract_txt:tagger in 2121) [ClassicSimilarity], result of:
           0.23275267 = score(doc=2121,freq=1.0), product of:
             0.4277689 = queryWeight, product of:
               2.8900077 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.017002186 = queryNorm
             0.54410845 = fieldWeight in 2121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=2121)
       0.24 = coord(6/25)
   

3. L'Homme, D.; L'Homme, M.-C.; Lemay, C.: Benchmarking the performance of two Part-of-Speech (POS) taggers for terminological purposes (2002) 0.16

   0.15795906 = sum of:
     0.15795906 = product of:
       0.7897953 = sum of:
         0.08234852 = weight(abstract_txt:unknown in 2855) [ClassicSimilarity], result of:
           0.08234852 = score(doc=2855,freq=1.0), product of:
             0.14636366 = queryWeight, product of:
               1.1953527 = boost
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.017002186 = queryNorm
             0.5626295 = fieldWeight in 2855, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.078125 = fieldNorm(doc=2855)
         0.042391215 = weight(abstract_txt:part in 2855) [ClassicSimilarity], result of:
           0.042391215 = score(doc=2855,freq=1.0), product of:
             0.1184468 = queryWeight, product of:
               1.5207438 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.017002186 = queryNorm
             0.35789245 = fieldWeight in 2855, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.078125 = fieldNorm(doc=2855)
         0.11043157 = weight(abstract_txt:tagging in 2855) [ClassicSimilarity], result of:
           0.11043157 = score(doc=2855,freq=1.0), product of:
             0.22425127 = queryWeight, product of:
               2.0924826 = boost
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.017002186 = queryNorm
             0.49244568 = fieldWeight in 2855, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.078125 = fieldNorm(doc=2855)
         0.14317149 = weight(abstract_txt:speech in 2855) [ClassicSimilarity], result of:
           0.14317149 = score(doc=2855,freq=1.0), product of:
             0.2666309 = queryWeight, product of:
               2.2816532 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.017002186 = queryNorm
             0.53696513 = fieldWeight in 2855, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=2855)
         0.41145244 = weight(abstract_txt:tagger in 2855) [ClassicSimilarity], result of:
           0.41145244 = score(doc=2855,freq=2.0), product of:
             0.4277689 = queryWeight, product of:
               2.8900077 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.017002186 = queryNorm
             0.9618569 = fieldWeight in 2855, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.078125 = fieldNorm(doc=2855)
       0.2 = coord(5/25)
   

4. Li, C.; Sun, A.: Extracting fine-grained location with temporal awareness in tweets : a two-stage approach (2017) 0.12

   0.12204591 = sum of:
     0.12204591 = product of:
       0.61022955 = sum of:
         0.08041242 = weight(abstract_txt:fine in 4686) [ClassicSimilarity], result of:
           0.08041242 = score(doc=4686,freq=2.0), product of:
             0.14503388 = queryWeight, product of:
               1.18991 = boost
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.017002186 = queryNorm
             0.5544388 = fieldWeight in 4686, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.168868 = idf(docFreq=92, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4686)
         0.106503375 = weight(abstract_txt:grained in 4686) [ClassicSimilarity], result of:
           0.106503375 = score(doc=4686,freq=2.0), product of:
             0.17491604 = queryWeight, product of:
               1.3067552 = boost
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.017002186 = queryNorm
             0.60888284 = fieldWeight in 4686, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.872826 = idf(docFreq=45, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4686)
         0.085248314 = weight(abstract_txt:conditional in 4686) [ClassicSimilarity], result of:
           0.085248314 = score(doc=4686,freq=1.0), product of:
             0.18998586 = queryWeight, product of:
               1.3618838 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.017002186 = queryNorm
             0.44870874 = fieldWeight in 4686, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4686)
         0.05004872 = weight(abstract_txt:features in 4686) [ClassicSimilarity], result of:
           0.05004872 = score(doc=4686,freq=3.0), product of:
             0.11636677 = queryWeight, product of:
               1.5073318 = boost
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.017002186 = queryNorm
             0.43009463 = fieldWeight in 4686, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4686)
         0.28801674 = weight(abstract_txt:tagger in 4686) [ClassicSimilarity], result of:
           0.28801674 = score(doc=4686,freq=2.0), product of:
             0.4277689 = queryWeight, product of:
               2.8900077 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.017002186 = queryNorm
             0.67329985 = fieldWeight in 4686, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4686)
       0.2 = coord(5/25)
   

5. Chowdhury, A.; Mccabe, M.C.: Improving information retrieval systems using part of speech tagging (1993) 0.09

   0.085571274 = sum of:
     0.085571274 = product of:
       0.5348205 = sum of:
         0.116458386 = weight(abstract_txt:reduction in 2061) [ClassicSimilarity], result of:
           0.116458386 = score(doc=2061,freq=2.0), product of:
             0.14636366 = queryWeight, product of:
               1.1953527 = boost
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.017002186 = queryNorm
             0.79567826 = fieldWeight in 2061, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.201658 = idf(docFreq=89, maxDocs=44421)
               0.078125 = fieldNorm(doc=2061)
         0.05995023 = weight(abstract_txt:part in 2061) [ClassicSimilarity], result of:
           0.05995023 = score(doc=2061,freq=2.0), product of:
             0.1184468 = queryWeight, product of:
               1.5207438 = boost
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.017002186 = queryNorm
             0.50613636 = fieldWeight in 2061, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.581023 = idf(docFreq=1236, maxDocs=44421)
               0.078125 = fieldNorm(doc=2061)
         0.11043157 = weight(abstract_txt:tagging in 2061) [ClassicSimilarity], result of:
           0.11043157 = score(doc=2061,freq=1.0), product of:
             0.22425127 = queryWeight, product of:
               2.0924826 = boost
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.017002186 = queryNorm
             0.49244568 = fieldWeight in 2061, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3033047 = idf(docFreq=220, maxDocs=44421)
               0.078125 = fieldNorm(doc=2061)
         0.2479803 = weight(abstract_txt:speech in 2061) [ClassicSimilarity], result of:
           0.2479803 = score(doc=2061,freq=3.0), product of:
             0.2666309 = queryWeight, product of:
               2.2816532 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.017002186 = queryNorm
             0.9300509 = fieldWeight in 2061, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=2061)
       0.16 = coord(4/25)