Document (#40079)

Author

Lin, Y.-R.
Margolin, D.
Lazer, D.

Title

Uncovering social semantics from textual traces : a theory-driven approach and evidence from public statements of U.S. Members of Congress

Source

Journal of the Association for Information Science and Technology. 67(2016) no.9, S.2072-2089

Year

2016

Abstract

The increasing abundance of digital textual archives provides an opportunity for understanding human social systems. Yet the literature has not adequately considered the disparate social processes by which texts are produced. Drawing on communication theory, we identify three common processes by which documents might be detectably similar in their textual features-authors sharing subject matter, sharing goals, and sharing sources. We hypothesize that these processes produce distinct, detectable relationships between authors in different kinds of textual overlap. We develop a novel n-gram extraction technique to capture such signatures based on n-grams of different lengths. We test the hypothesis on a corpus where the author attributes are observable: the public statements of the members of the U.S. Congress. This article presents the first empirical finding that shows different social relationships are detectable through the structure of overlapping textual features. Our study has important implications for designing text modeling techniques to make sense of social phenomena from aggregate digital traces.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23540/full.

Location

USA

Similar documents (content)

1. Gordon, M.D.; Dumais, S.: Using latent semantic indexing for literature based discovery (1998) 0.13

   0.12766883 = sum of:
     0.12766883 = product of:
       0.53195345 = sum of:
         0.14341556 = weight(abstract_txt:hypothesize in 5892) [ClassicSimilarity], result of:
           0.14341556 = score(doc=5892,freq=1.0), product of:
             0.17858635 = queryWeight, product of:
               1.0788016 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.019325465 = queryNorm
             0.80306 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.14565985 = weight(abstract_txt:uncovering in 5892) [ClassicSimilarity], result of:
           0.14565985 = score(doc=5892,freq=1.0), product of:
             0.18044463 = queryWeight, product of:
               1.0843998 = boost
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.019325465 = queryNorm
             0.8072274 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.610425 = idf(docFreq=21, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.04574411 = weight(abstract_txt:authors in 5892) [ClassicSimilarity], result of:
           0.04574411 = score(doc=5892,freq=1.0), product of:
             0.10503907 = queryWeight, product of:
               1.1700593 = boost
               4.6452923 = idf(docFreq=1159, maxDocs=44421)
               0.019325465 = queryNorm
             0.43549615 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6452923 = idf(docFreq=1159, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.07136111 = weight(abstract_txt:relationships in 5892) [ClassicSimilarity], result of:
           0.07136111 = score(doc=5892,freq=2.0), product of:
             0.11213946 = queryWeight, product of:
               1.2089593 = boost
               4.7997303 = idf(docFreq=993, maxDocs=44421)
               0.019325465 = queryNorm
             0.63636035 = fieldWeight in 5892, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7997303 = idf(docFreq=993, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.03355332 = weight(abstract_txt:different in 5892) [ClassicSimilarity], result of:
           0.03355332 = score(doc=5892,freq=1.0), product of:
             0.09779459 = queryWeight, product of:
               1.382724 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.019325465 = queryNorm
             0.34309995 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
         0.092219494 = weight(abstract_txt:processes in 5892) [ClassicSimilarity], result of:
           0.092219494 = score(doc=5892,freq=1.0), product of:
             0.1918844 = queryWeight, product of:
               1.9368585 = boost
               5.126392 = idf(docFreq=716, maxDocs=44421)
               0.019325465 = queryNorm
             0.48059922 = fieldWeight in 5892, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.126392 = idf(docFreq=716, maxDocs=44421)
               0.09375 = fieldNorm(doc=5892)
       0.24 = coord(6/25)
   

2. Milard, B.; Tanguy, L.: Citations in scientific texts : do social relations matter? (2018) 0.11

   0.114313245 = sum of:
     0.114313245 = product of:
       0.5715662 = sum of:
         0.01198532 = weight(abstract_txt:from in 547) [ClassicSimilarity], result of:
           0.01198532 = score(doc=547,freq=1.0), product of:
             0.055596195 = queryWeight, product of:
               1.0425589 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.019325465 = queryNorm
             0.21557805 = fieldWeight in 547, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.078125 = fieldNorm(doc=547)
         0.050347254 = weight(abstract_txt:features in 547) [ClassicSimilarity], result of:
           0.050347254 = score(doc=547,freq=2.0), product of:
             0.10035879 = queryWeight, product of:
               1.1436949 = boost
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.019325465 = queryNorm
             0.50167257 = fieldWeight in 547, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.078125 = fieldNorm(doc=547)
         0.066025935 = weight(abstract_txt:authors in 547) [ClassicSimilarity], result of:
           0.066025935 = score(doc=547,freq=3.0), product of:
             0.10503907 = queryWeight, product of:
               1.1700593 = boost
               4.6452923 = idf(docFreq=1159, maxDocs=44421)
               0.019325465 = queryNorm
             0.62858456 = fieldWeight in 547, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6452923 = idf(docFreq=1159, maxDocs=44421)
               0.078125 = fieldNorm(doc=547)
         0.15785743 = weight(abstract_txt:social in 547) [ClassicSimilarity], result of:
           0.15785743 = score(doc=547,freq=5.0), product of:
             0.21498837 = queryWeight, product of:
               2.6467319 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.019325465 = queryNorm
             0.7342604 = fieldWeight in 547, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.078125 = fieldNorm(doc=547)
         0.28535026 = weight(abstract_txt:textual in 547) [ClassicSimilarity], result of:
           0.28535026 = score(doc=547,freq=2.0), product of:
             0.43298262 = queryWeight, product of:
               3.7561047 = boost
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.019325465 = queryNorm
             0.659034 = fieldWeight in 547, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.078125 = fieldNorm(doc=547)
       0.2 = coord(5/25)
   

3. Tang, R.; Safer, M.A.: Author-rated importance of cited references in biology and psychology publications (2008) 0.10

   0.10307923 = sum of:
     0.10307923 = product of:
       0.4294968 = sum of:
         0.008389723 = weight(abstract_txt:from in 2738) [ClassicSimilarity], result of:
           0.008389723 = score(doc=2738,freq=1.0), product of:
             0.055596195 = queryWeight, product of:
               1.0425589 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.019325465 = queryNorm
             0.15090463 = fieldWeight in 2738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2738)
         0.08241829 = weight(abstract_txt:lengths in 2738) [ClassicSimilarity], result of:
           0.08241829 = score(doc=2738,freq=1.0), product of:
             0.17681617 = queryWeight, product of:
               1.0734416 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.019325465 = queryNorm
             0.46612418 = fieldWeight in 2738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2738)
         0.049841236 = weight(abstract_txt:features in 2738) [ClassicSimilarity], result of:
           0.049841236 = score(doc=2738,freq=4.0), product of:
             0.10035879 = queryWeight, product of:
               1.1436949 = boost
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.019325465 = queryNorm
             0.4966305 = fieldWeight in 2738, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.5406218 = idf(docFreq=1287, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2738)
         0.059667382 = weight(abstract_txt:authors in 2738) [ClassicSimilarity], result of:
           0.059667382 = score(doc=2738,freq=5.0), product of:
             0.10503907 = queryWeight, product of:
               1.1700593 = boost
               4.6452923 = idf(docFreq=1159, maxDocs=44421)
               0.019325465 = queryNorm
             0.56804943 = fieldWeight in 2738, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.6452923 = idf(docFreq=1159, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2738)
         0.029434957 = weight(abstract_txt:relationships in 2738) [ClassicSimilarity], result of:
           0.029434957 = score(doc=2738,freq=1.0), product of:
             0.11213946 = queryWeight, product of:
               1.2089593 = boost
               4.7997303 = idf(docFreq=993, maxDocs=44421)
               0.019325465 = queryNorm
             0.26248527 = fieldWeight in 2738, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7997303 = idf(docFreq=993, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2738)
         0.19974521 = weight(abstract_txt:textual in 2738) [ClassicSimilarity], result of:
           0.19974521 = score(doc=2738,freq=2.0), product of:
             0.43298262 = queryWeight, product of:
               3.7561047 = boost
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.019325465 = queryNorm
             0.46132383 = fieldWeight in 2738, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.0546875 = fieldNorm(doc=2738)
       0.24 = coord(6/25)
   

4. Robertson, A.M.; Willett, P.: Applications of n-grams in textual information systems (1998) 0.10

   0.10247627 = sum of:
     0.10247627 = product of:
       0.6404767 = sum of:
         0.13326566 = weight(abstract_txt:gram in 5715) [ClassicSimilarity], result of:
           0.13326566 = score(doc=5715,freq=1.0), product of:
             0.15344936 = queryWeight, product of:
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.019325465 = queryNorm
             0.86846673 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9402676 = idf(docFreq=42, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.2079492 = weight(abstract_txt:grams in 5715) [ClassicSimilarity], result of:
           0.2079492 = score(doc=5715,freq=2.0), product of:
             0.16385049 = queryWeight, product of:
               1.0333354 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.019325465 = queryNorm
             1.26914 = fieldWeight in 5715, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.016779445 = weight(abstract_txt:from in 5715) [ClassicSimilarity], result of:
           0.016779445 = score(doc=5715,freq=1.0), product of:
             0.055596195 = queryWeight, product of:
               1.0425589 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.019325465 = queryNorm
             0.30180925 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
         0.28248236 = weight(abstract_txt:textual in 5715) [ClassicSimilarity], result of:
           0.28248236 = score(doc=5715,freq=1.0), product of:
             0.43298262 = queryWeight, product of:
               3.7561047 = boost
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.019325465 = queryNorm
             0.6524104 = fieldWeight in 5715, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.109375 = fieldNorm(doc=5715)
       0.16 = coord(4/25)
   

5. Baumer, E.P.S.; Mimno, D.; Guha, S.; Quan, E.; Gay, G.K.: Comparing grounded theory and topic modeling : extreme divergence or unlikely convergence? (2017) 0.10

   0.10215159 = sum of:
     0.10215159 = product of:
       0.5107579 = sum of:
         0.02075918 = weight(abstract_txt:from in 4639) [ClassicSimilarity], result of:
           0.02075918 = score(doc=4639,freq=3.0), product of:
             0.055596195 = queryWeight, product of:
               1.0425589 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.019325465 = queryNorm
             0.3733921 = fieldWeight in 4639, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.078125 = fieldNorm(doc=4639)
         0.0279611 = weight(abstract_txt:different in 4639) [ClassicSimilarity], result of:
           0.0279611 = score(doc=4639,freq=1.0), product of:
             0.09779459 = queryWeight, product of:
               1.382724 = boost
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.019325465 = queryNorm
             0.28591663 = fieldWeight in 4639, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6597328 = idf(docFreq=3107, maxDocs=44421)
               0.078125 = fieldNorm(doc=4639)
         0.07684958 = weight(abstract_txt:processes in 4639) [ClassicSimilarity], result of:
           0.07684958 = score(doc=4639,freq=1.0), product of:
             0.1918844 = queryWeight, product of:
               1.9368585 = boost
               5.126392 = idf(docFreq=716, maxDocs=44421)
               0.019325465 = queryNorm
             0.40049937 = fieldWeight in 4639, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.126392 = idf(docFreq=716, maxDocs=44421)
               0.078125 = fieldNorm(doc=4639)
         0.09983782 = weight(abstract_txt:social in 4639) [ClassicSimilarity], result of:
           0.09983782 = score(doc=4639,freq=2.0), product of:
             0.21498837 = queryWeight, product of:
               2.6467319 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.019325465 = queryNorm
             0.46438706 = fieldWeight in 4639, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.078125 = fieldNorm(doc=4639)
         0.28535026 = weight(abstract_txt:textual in 4639) [ClassicSimilarity], result of:
           0.28535026 = score(doc=4639,freq=2.0), product of:
             0.43298262 = queryWeight, product of:
               3.7561047 = boost
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.019325465 = queryNorm
             0.659034 = fieldWeight in 4639, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9648952 = idf(docFreq=309, maxDocs=44421)
               0.078125 = fieldNorm(doc=4639)
       0.2 = coord(5/25)