Document (#30292)

Author

Newman, D.J.
Block, S.

Title

Probabilistic topic decomposition of an eighteenth-century American newspaper

Source

Journal of the American Society for Information Science and Technology. 57(2006) no.6, S.753-767

Year

2006

Abstract

We use a probabilistic mixture decomposition method to determine topics in the Pennsylvania Gazette, a major colonial U.S. newspaper from 1728-1800. We assess the value of several topic decomposition techniques for historical research and compare the accuracy and efficacy of various methods. After determining the topics covered by the 80,000 articles and advertisements in the entire 18th century run of the Gazette, we calculate how the prevalence of those topics changed over time, and give historically relevant examples of our findings. This approach reveals important information about the content of this colonial newspaper, and suggests the value of such approaches to a more complete understanding of early American print culture and society.

Theme

Automatisches Indexieren

Form

Zeitungen

Similar documents (author)

1. Newman, N.: Search strategies and activities of BBC news interactive (2007) 2.32

   2.3231726 = sum of:
     2.3231726 = product of:
       4.646345 = sum of:
         4.646345 = weight(author_txt:newman in 1381) [ClassicSimilarity], result of:
           4.646345 = score(doc=1381,freq=1.0), product of:
             0.7501888 = queryWeight, product of:
               1.0651509 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.07107201 = queryNorm
             6.1935673 = fieldWeight in 1381, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.625 = fieldNorm(doc=1381)
       0.5 = coord(1/2)
   

2. Block, B.: Quality control makes WorldCat ever better (1999) 1.92

   1.9224195 = sum of:
     1.9224195 = product of:
       3.844839 = sum of:
         3.844839 = weight(author_txt:block in 5398) [ClassicSimilarity], result of:
           3.844839 = score(doc=5398,freq=1.0), product of:
             0.66122365 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.07107201 = queryNorm
             5.814733 = fieldWeight in 5398, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=5398)
       0.5 = coord(1/2)
   

3. Block, B.: Kooperative Neukatalogisierung : Eine neue Facette in der Zusammenlegung der Verbünde (2007) 1.92

   1.9224195 = sum of:
     1.9224195 = product of:
       3.844839 = sum of:
         3.844839 = weight(author_txt:block in 394) [ClassicSimilarity], result of:
           3.844839 = score(doc=394,freq=1.0), product of:
             0.66122365 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.07107201 = queryNorm
             5.814733 = fieldWeight in 394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=394)
       0.5 = coord(1/2)
   

4. Block, C.H.: ¬Das Intranet : die neue Informationsverarbeitung (2004) 1.92

   1.9224195 = sum of:
     1.9224195 = product of:
       3.844839 = sum of:
         3.844839 = weight(author_txt:block in 3396) [ClassicSimilarity], result of:
           3.844839 = score(doc=3396,freq=1.0), product of:
             0.66122365 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.07107201 = queryNorm
             5.814733 = fieldWeight in 3396, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=3396)
       0.5 = coord(1/2)
   

5. Block, B.: Noch kooperativer katalogisieren : aus der Arbeit der AG Kooperative Neukatalogisierung (2009) 1.92

   1.9224195 = sum of:
     1.9224195 = product of:
       3.844839 = sum of:
         3.844839 = weight(author_txt:block in 32) [ClassicSimilarity], result of:
           3.844839 = score(doc=32,freq=1.0), product of:
             0.66122365 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.07107201 = queryNorm
             5.814733 = fieldWeight in 32, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.625 = fieldNorm(doc=32)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Karpuk, S.: Cataloging seventeenth- and eighteenth-century German dissertations : guidelines and observations (2010) 0.10

   0.09943265 = sum of:
     0.09943265 = product of:
       0.8286054 = sum of:
         0.65236545 = weight(title_txt:eighteenth in 542) [ClassicSimilarity], result of:
           0.65236545 = score(doc=542,freq=1.0), product of:
             0.21695738 = queryWeight, product of:
               1.5297773 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.014739395 = queryNorm
             3.0068831 = fieldWeight in 542, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.3125 = fieldNorm(doc=542)
         0.08358283 = weight(abstract_txt:american in 542) [ClassicSimilarity], result of:
           0.08358283 = score(doc=542,freq=1.0), product of:
             0.13988027 = queryWeight, product of:
               1.7371377 = boost
               5.463143 = idf(docFreq=511, maxDocs=44421)
               0.014739395 = queryNorm
             0.59753126 = fieldWeight in 542, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.463143 = idf(docFreq=511, maxDocs=44421)
               0.109375 = fieldNorm(doc=542)
         0.09265714 = weight(abstract_txt:century in 542) [ClassicSimilarity], result of:
           0.09265714 = score(doc=542,freq=1.0), product of:
             0.14982961 = queryWeight, product of:
               1.7978556 = boost
               5.6540956 = idf(docFreq=422, maxDocs=44421)
               0.014739395 = queryNorm
             0.6184167 = fieldWeight in 542, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6540956 = idf(docFreq=422, maxDocs=44421)
               0.109375 = fieldNorm(doc=542)
       0.12 = coord(3/25)
   

2. Kratz, I.: ¬La conversion retrospective des fonds anciens : l'example des bibliothèques Americaines (1997) 0.07

   0.07096757 = sum of:
     0.07096757 = product of:
       0.4435473 = sum of:
         0.1449536 = weight(abstract_txt:18th in 974) [ClassicSimilarity], result of:
           0.1449536 = score(doc=974,freq=1.0), product of:
             0.1776038 = queryWeight, product of:
               1.3840989 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.014739395 = queryNorm
             0.8161627 = fieldWeight in 974, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.09375 = fieldNorm(doc=974)
         0.14753087 = weight(abstract_txt:1800 in 974) [ClassicSimilarity], result of:
           0.14753087 = score(doc=974,freq=1.0), product of:
             0.1797028 = queryWeight, product of:
               1.3922539 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.014739395 = queryNorm
             0.8209714 = fieldWeight in 974, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.09375 = fieldNorm(doc=974)
         0.07164243 = weight(abstract_txt:american in 974) [ClassicSimilarity], result of:
           0.07164243 = score(doc=974,freq=1.0), product of:
             0.13988027 = queryWeight, product of:
               1.7371377 = boost
               5.463143 = idf(docFreq=511, maxDocs=44421)
               0.014739395 = queryNorm
             0.51216966 = fieldWeight in 974, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.463143 = idf(docFreq=511, maxDocs=44421)
               0.09375 = fieldNorm(doc=974)
         0.0794204 = weight(abstract_txt:century in 974) [ClassicSimilarity], result of:
           0.0794204 = score(doc=974,freq=1.0), product of:
             0.14982961 = queryWeight, product of:
               1.7978556 = boost
               5.6540956 = idf(docFreq=422, maxDocs=44421)
               0.014739395 = queryNorm
             0.5300715 = fieldWeight in 974, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6540956 = idf(docFreq=422, maxDocs=44421)
               0.09375 = fieldNorm(doc=974)
       0.16 = coord(4/25)
   

3. Stover, M.: ¬The best family studies databases on CD-ROM : a survey of nine products (1993) 0.06

   0.0550901 = sum of:
     0.0550901 = product of:
       0.45908418 = sum of:
         0.08358283 = weight(abstract_txt:american in 5296) [ClassicSimilarity], result of:
           0.08358283 = score(doc=5296,freq=1.0), product of:
             0.13988027 = queryWeight, product of:
               1.7371377 = boost
               5.463143 = idf(docFreq=511, maxDocs=44421)
               0.014739395 = queryNorm
             0.59753126 = fieldWeight in 5296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.463143 = idf(docFreq=511, maxDocs=44421)
               0.109375 = fieldNorm(doc=5296)
         0.10072709 = weight(abstract_txt:topics in 5296) [ClassicSimilarity], result of:
           0.10072709 = score(doc=5296,freq=1.0), product of:
             0.1813314 = queryWeight, product of:
               2.4223568 = boost
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.014739395 = queryNorm
             0.5554862 = fieldWeight in 5296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.109375 = fieldNorm(doc=5296)
         0.27477425 = weight(abstract_txt:newspaper in 5296) [ClassicSimilarity], result of:
           0.27477425 = score(doc=5296,freq=1.0), product of:
             0.3540187 = queryWeight, product of:
               3.3846574 = boost
               7.0962973 = idf(docFreq=99, maxDocs=44421)
               0.014739395 = queryNorm
             0.7761575 = fieldWeight in 5296, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0962973 = idf(docFreq=99, maxDocs=44421)
               0.109375 = fieldNorm(doc=5296)
       0.12 = coord(3/25)
   

4. Ding, W.; Chen, C.: Dynamic topic detection and tracking : a comparison of HDP, C-word, and cocitation methods (2014) 0.05

   0.050673213 = sum of:
     0.050673213 = product of:
       0.4222768 = sum of:
         0.08185981 = weight(abstract_txt:topic in 2502) [ClassicSimilarity], result of:
           0.08185981 = score(doc=2502,freq=3.0), product of:
             0.11970267 = queryWeight, product of:
               1.6069705 = boost
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.014739395 = queryNorm
             0.6838595 = fieldWeight in 2502, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.078125 = fieldNorm(doc=2502)
         0.19652113 = weight(abstract_txt:probabilistic in 2502) [ClassicSimilarity], result of:
           0.19652113 = score(doc=2502,freq=3.0), product of:
             0.21461637 = queryWeight, product of:
               2.1517284 = boost
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.014739395 = queryNorm
             0.91568565 = fieldWeight in 2502, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.078125 = fieldNorm(doc=2502)
         0.14389585 = weight(abstract_txt:topics in 2502) [ClassicSimilarity], result of:
           0.14389585 = score(doc=2502,freq=4.0), product of:
             0.1813314 = queryWeight, product of:
               2.4223568 = boost
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.014739395 = queryNorm
             0.79355174 = fieldWeight in 2502, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.078125 = fieldNorm(doc=2502)
       0.12 = coord(3/25)
   

5. Luyt, B.: Centres of calculation and unruly colonists : the colonial library in Singapore and its users, 1874-1900 (2008) 0.05

   0.049616136 = sum of:
     0.049616136 = product of:
       0.6202017 = sum of:
         0.024463149 = weight(abstract_txt:value in 2895) [ClassicSimilarity], result of:
           0.024463149 = score(doc=2895,freq=1.0), product of:
             0.08954582 = queryWeight, product of:
               1.3898844 = boost
               4.3710623 = idf(docFreq=1525, maxDocs=44421)
               0.014739395 = queryNorm
             0.2731914 = fieldWeight in 2895, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3710623 = idf(docFreq=1525, maxDocs=44421)
               0.0625 = fieldNorm(doc=2895)
         0.59573853 = weight(abstract_txt:colonial in 2895) [ClassicSimilarity], result of:
           0.59573853 = score(doc=2895,freq=6.0), product of:
             0.41402236 = queryWeight, product of:
               2.9886007 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.014739395 = queryNorm
             1.4389043 = fieldWeight in 2895, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.0625 = fieldNorm(doc=2895)
       0.08 = coord(2/25)