Document (#38099)

Author

Akiva, N.
Koppel, M.

Title

¬A generic unsupervised method for decomposing multi-author documents

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.11, S.2256-2264

Year

2013

Abstract

Given an unsegmented multi-author text, we wish to automatically separate out distinct authorial threads. We present a novel, entirely unsupervised, method that achieves strong results on multiple testbeds, including those for which authorial threads are topically identical. Unlike previous work, our method requires no specialized linguistic tools and can be easily applied to any text.

Similar documents (author)

1. Koppel, T.P.: Public access catalogs through Internet (1990) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:koppel in 4069) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 4069, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=4069)
   

2. Koppel, M.; Schweitzer, N.: Measuring direct and indirect authorial influence in historical corpora (2014) 4.81

   4.811013 = sum of:
     4.811013 = weight(author_txt:koppel in 2506) [ClassicSimilarity], result of:
       4.811013 = fieldWeight in 2506, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.5 = fieldNorm(doc=2506)
   

3. Koppel, M.; Winter, Y.: Determining if two documents are written by the same author (2014) 4.81

   4.811013 = sum of:
     4.811013 = weight(author_txt:koppel in 2602) [ClassicSimilarity], result of:
       4.811013 = fieldWeight in 2602, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.5 = fieldNorm(doc=2602)
   

4. Koppel, M.; Akiva, N.; Dagan, I.: Feature instability as a criterion for selecting potential style markers (2006) 3.61

   3.60826 = sum of:
     3.60826 = weight(author_txt:koppel in 92) [ClassicSimilarity], result of:
       3.60826 = fieldWeight in 92, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.375 = fieldNorm(doc=92)
   

5. Koppel, M.; Schler, J.; Argamon, S.: Computational methods in authorship attribution (2009) 3.61

   3.60826 = sum of:
     3.60826 = weight(author_txt:koppel in 3683) [ClassicSimilarity], result of:
       3.60826 = fieldWeight in 3683, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.375 = fieldNorm(doc=3683)
   

Similar documents (content)

1. Xu, L.; Qiu, J.: Unsupervised multi-class sentiment classification approach (2019) 0.11

   0.10869687 = sum of:
     0.10869687 = product of:
       0.54348433 = sum of:
         0.029905006 = weight(abstract_txt:novel in 3) [ClassicSimilarity], result of:
           0.029905006 = score(doc=3,freq=1.0), product of:
             0.086658396 = queryWeight, product of:
               5.521451 = idf(docFreq=482, maxDocs=44421)
               0.015694859 = queryNorm
             0.3450907 = fieldWeight in 3, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.521451 = idf(docFreq=482, maxDocs=44421)
               0.0625 = fieldNorm(doc=3)
         0.040385365 = weight(abstract_txt:distinct in 3) [ClassicSimilarity], result of:
           0.040385365 = score(doc=3,freq=1.0), product of:
             0.10587597 = queryWeight, product of:
               1.1053337 = boost
               6.1030455 = idf(docFreq=269, maxDocs=44421)
               0.015694859 = queryNorm
             0.38144034 = fieldWeight in 3, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1030455 = idf(docFreq=269, maxDocs=44421)
               0.0625 = fieldNorm(doc=3)
         0.16646792 = weight(abstract_txt:multi in 3) [ClassicSimilarity], result of:
           0.16646792 = score(doc=3,freq=5.0), product of:
             0.20054957 = queryWeight, product of:
               2.151397 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.015694859 = queryNorm
             0.8300587 = fieldWeight in 3, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=3)
         0.084053926 = weight(abstract_txt:method in 3) [ClassicSimilarity], result of:
           0.084053926 = score(doc=3,freq=3.0), product of:
             0.17259176 = queryWeight, product of:
               2.444361 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.015694859 = queryNorm
             0.4870101 = fieldWeight in 3, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=3)
         0.22267213 = weight(abstract_txt:unsupervised in 3) [ClassicSimilarity], result of:
           0.22267213 = score(doc=3,freq=2.0), product of:
             0.3304395 = queryWeight, product of:
               2.7615676 = boost
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.015694859 = queryNorm
             0.67386657 = fieldWeight in 3, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.0625 = fieldNorm(doc=3)
       0.2 = coord(5/25)
   

2. Giannella, C.: ¬An improved algorithm for unsupervised decomposition of a multi-author document (2016) 0.10

   0.097398624 = sum of:
     0.097398624 = product of:
       0.4869931 = sum of:
         0.041444577 = weight(abstract_txt:text in 3642) [ClassicSimilarity], result of:
           0.041444577 = score(doc=3642,freq=2.0), product of:
             0.09282961 = queryWeight, product of:
               1.4637029 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.015694859 = queryNorm
             0.4464586 = fieldWeight in 3642, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=3642)
         0.09501319 = weight(abstract_txt:author in 3642) [ClassicSimilarity], result of:
           0.09501319 = score(doc=3642,freq=3.0), product of:
             0.14099386 = queryWeight, product of:
               1.8038889 = boost
               4.980042 = idf(docFreq=829, maxDocs=44421)
               0.015694859 = queryNorm
             0.6738817 = fieldWeight in 3642, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.980042 = idf(docFreq=829, maxDocs=44421)
               0.078125 = fieldNorm(doc=3642)
         0.09305839 = weight(abstract_txt:multi in 3642) [ClassicSimilarity], result of:
           0.09305839 = score(doc=3642,freq=1.0), product of:
             0.20054957 = queryWeight, product of:
               2.151397 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.015694859 = queryNorm
             0.4640169 = fieldWeight in 3642, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.078125 = fieldNorm(doc=3642)
         0.060660698 = weight(abstract_txt:method in 3642) [ClassicSimilarity], result of:
           0.060660698 = score(doc=3642,freq=1.0), product of:
             0.17259176 = queryWeight, product of:
               2.444361 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.015694859 = queryNorm
             0.35146925 = fieldWeight in 3642, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=3642)
         0.19681624 = weight(abstract_txt:unsupervised in 3642) [ClassicSimilarity], result of:
           0.19681624 = score(doc=3642,freq=1.0), product of:
             0.3304395 = queryWeight, product of:
               2.7615676 = boost
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.015694859 = queryNorm
             0.59561956 = fieldWeight in 3642, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.078125 = fieldNorm(doc=3642)
       0.2 = coord(5/25)
   

3. Ferreira, A.A.; Veloso, A.; Gonçalves, M.A.; Laender, A.H.F.: Self-training author name disambiguation for information scarce scenarios (2014) 0.08

   0.08326665 = sum of:
     0.08326665 = product of:
       0.41633326 = sum of:
         0.029905006 = weight(abstract_txt:novel in 2292) [ClassicSimilarity], result of:
           0.029905006 = score(doc=2292,freq=1.0), product of:
             0.086658396 = queryWeight, product of:
               5.521451 = idf(docFreq=482, maxDocs=44421)
               0.015694859 = queryNorm
             0.3450907 = fieldWeight in 2292, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.521451 = idf(docFreq=482, maxDocs=44421)
               0.0625 = fieldNorm(doc=2292)
         0.033788946 = weight(abstract_txt:requires in 2292) [ClassicSimilarity], result of:
           0.033788946 = score(doc=2292,freq=1.0), product of:
             0.094007924 = queryWeight, product of:
               1.0415423 = boost
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.015694859 = queryNorm
             0.35942656 = fieldWeight in 2292, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.750825 = idf(docFreq=383, maxDocs=44421)
               0.0625 = fieldNorm(doc=2292)
         0.0981292 = weight(abstract_txt:author in 2292) [ClassicSimilarity], result of:
           0.0981292 = score(doc=2292,freq=5.0), product of:
             0.14099386 = queryWeight, product of:
               1.8038889 = boost
               4.980042 = idf(docFreq=829, maxDocs=44421)
               0.015694859 = queryNorm
             0.69598204 = fieldWeight in 2292, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.980042 = idf(docFreq=829, maxDocs=44421)
               0.0625 = fieldNorm(doc=2292)
         0.09705712 = weight(abstract_txt:method in 2292) [ClassicSimilarity], result of:
           0.09705712 = score(doc=2292,freq=4.0), product of:
             0.17259176 = queryWeight, product of:
               2.444361 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.015694859 = queryNorm
             0.5623508 = fieldWeight in 2292, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=2292)
         0.15745299 = weight(abstract_txt:unsupervised in 2292) [ClassicSimilarity], result of:
           0.15745299 = score(doc=2292,freq=1.0), product of:
             0.3304395 = queryWeight, product of:
               2.7615676 = boost
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.015694859 = queryNorm
             0.47649562 = fieldWeight in 2292, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.0625 = fieldNorm(doc=2292)
       0.2 = coord(5/25)
   

4. Ko, Y.; Seo, J.: Text classification from unlabeled documents with bootstrapping and feature projection techniques (2009) 0.08

   0.08193537 = sum of:
     0.08193537 = product of:
       0.40967685 = sum of:
         0.042292062 = weight(abstract_txt:automatically in 3452) [ClassicSimilarity], result of:
           0.042292062 = score(doc=3452,freq=2.0), product of:
             0.086658396 = queryWeight, product of:
               5.521451 = idf(docFreq=482, maxDocs=44421)
               0.015694859 = queryNorm
             0.48803192 = fieldWeight in 3452, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.521451 = idf(docFreq=482, maxDocs=44421)
               0.0625 = fieldNorm(doc=3452)
         0.03939011 = weight(abstract_txt:easily in 3452) [ClassicSimilarity], result of:
           0.03939011 = score(doc=3452,freq=1.0), product of:
             0.10412928 = queryWeight, product of:
               1.096178 = boost
               6.0524936 = idf(docFreq=283, maxDocs=44421)
               0.015694859 = queryNorm
             0.37828085 = fieldWeight in 3452, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0524936 = idf(docFreq=283, maxDocs=44421)
               0.0625 = fieldNorm(doc=3452)
         0.06202856 = weight(abstract_txt:text in 3452) [ClassicSimilarity], result of:
           0.06202856 = score(doc=3452,freq=7.0), product of:
             0.09282961 = queryWeight, product of:
               1.4637029 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.015694859 = queryNorm
             0.66819805 = fieldWeight in 3452, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=3452)
         0.108513154 = weight(abstract_txt:method in 3452) [ClassicSimilarity], result of:
           0.108513154 = score(doc=3452,freq=5.0), product of:
             0.17259176 = queryWeight, product of:
               2.444361 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.015694859 = queryNorm
             0.6287273 = fieldWeight in 3452, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=3452)
         0.15745299 = weight(abstract_txt:unsupervised in 3452) [ClassicSimilarity], result of:
           0.15745299 = score(doc=3452,freq=1.0), product of:
             0.3304395 = queryWeight, product of:
               2.7615676 = boost
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.015694859 = queryNorm
             0.47649562 = fieldWeight in 3452, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.0625 = fieldNorm(doc=3452)
       0.2 = coord(5/25)
   

5. Yu, C.; Xue, H.; An, L.; Li, G.: ¬A lightweight semantic-enhanced interactive network for efficient short-text matching (2023) 0.08

   0.080068044 = sum of:
     0.080068044 = product of:
       0.4003402 = sum of:
         0.06295624 = weight(abstract_txt:unlike in 1891) [ClassicSimilarity], result of:
           0.06295624 = score(doc=1891,freq=1.0), product of:
             0.14234446 = queryWeight, product of:
               1.2816368 = boost
               7.0764947 = idf(docFreq=101, maxDocs=44421)
               0.015694859 = queryNorm
             0.44228092 = fieldWeight in 1891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0764947 = idf(docFreq=101, maxDocs=44421)
               0.0625 = fieldNorm(doc=1891)
         0.07397511 = weight(abstract_txt:achieves in 1891) [ClassicSimilarity], result of:
           0.07397511 = score(doc=1891,freq=1.0), product of:
             0.15850335 = queryWeight, product of:
               1.3524272 = boost
               7.467361 = idf(docFreq=68, maxDocs=44421)
               0.015694859 = queryNorm
             0.46671006 = fieldWeight in 1891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.467361 = idf(docFreq=68, maxDocs=44421)
               0.0625 = fieldNorm(doc=1891)
         0.057427295 = weight(abstract_txt:text in 1891) [ClassicSimilarity], result of:
           0.057427295 = score(doc=1891,freq=6.0), product of:
             0.09282961 = queryWeight, product of:
               1.4637029 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.015694859 = queryNorm
             0.61863124 = fieldWeight in 1891, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.0625 = fieldNorm(doc=1891)
         0.04852856 = weight(abstract_txt:method in 1891) [ClassicSimilarity], result of:
           0.04852856 = score(doc=1891,freq=1.0), product of:
             0.17259176 = queryWeight, product of:
               2.444361 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.015694859 = queryNorm
             0.2811754 = fieldWeight in 1891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=1891)
         0.15745299 = weight(abstract_txt:unsupervised in 1891) [ClassicSimilarity], result of:
           0.15745299 = score(doc=1891,freq=1.0), product of:
             0.3304395 = queryWeight, product of:
               2.7615676 = boost
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.015694859 = queryNorm
             0.47649562 = fieldWeight in 1891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.0625 = fieldNorm(doc=1891)
       0.2 = coord(5/25)