Document (#41673)

Author

Zheng, X.
Sun, A.

Title

Collecting event-related tweets from twitter stream

Source

Journal of the Association for Information Science and Technology. 70(2019) no.2, S.176-186

Year

2019

Abstract

Twitter provides a channel of collecting and publishing instant information on major events like natural disasters. However, information flow on Twitter is of great volume. For a specific event, messages collected from the Twitter Stream based on either location constraint or predefined keywords would contain a lot of noise. In this article, we propose a method to achieve both high-precision and high-recall in collecting event-related tweets. Our method involves an automatic keyword generation component, and an event-related tweet identification component. For keyword generation, we consider three properties of candidate keywords, namely relevance, coverage, and evolvement. The keyword updating mechanism enables our method to track the main topics of tweets along event development. To minimize annotation effort in identifying event-related tweets, we adopt active learning and incorporate multiple-instance learning which assigns labels to bags instead of instances (that is, individual tweets). Through experiments on two real-world events, we demonstrate the superiority of our method against state-of-the-art alternatives.

Content

Vgl.: https://onlinelibrary.wiley.com/doi/10.1002/asi.24096.

Theme

Informetrie

Object

Twitter

Similar documents (author)

1. Hill, L.L.; Zheng, Q.: Indirect geospatial referencing through place names in the digital library : Alexandra digital library experience with developing and implementing gazetteers (1999) 4.31

   4.3052125 = sum of:
     4.3052125 = weight(author_txt:zheng in 543) [ClassicSimilarity], result of:
       4.3052125 = fieldWeight in 543, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.5 = fieldNorm(doc=543)
   

2. Zheng, X.; Ni, J.: ¬The significant yet short-term influence of research covidization on journal citation metrics (2024) 4.31

   4.3052125 = sum of:
     4.3052125 = weight(author_txt:zheng in 2342) [ClassicSimilarity], result of:
       4.3052125 = fieldWeight in 2342, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.5 = fieldNorm(doc=2342)
   

3. Rada, R.; Bird, G.; Zheng, M.: Hypertext interchange using ICA (1995) 3.23

   3.2289095 = sum of:
     3.2289095 = weight(author_txt:zheng in 6874) [ClassicSimilarity], result of:
       3.2289095 = fieldWeight in 6874, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.375 = fieldNorm(doc=6874)
   

4. Rada, R.; Liu, Z.; Zheng, M.: Connecting educational information spaces (1997) 3.23

   3.2289095 = sum of:
     3.2289095 = weight(author_txt:zheng in 1313) [ClassicSimilarity], result of:
       3.2289095 = fieldWeight in 1313, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.375 = fieldNorm(doc=1313)
   

5. Hill, L.L.; Frew, J.; Zheng, Q.: Geographic names : the implementation of a gazetteer in a georeferenced digital library (1999) 3.23

   3.2289095 = sum of:
     3.2289095 = weight(author_txt:zheng in 2240) [ClassicSimilarity], result of:
       3.2289095 = fieldWeight in 2240, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.610425 = idf(docFreq=21, maxDocs=44421)
         0.375 = fieldNorm(doc=2240)
   

Similar documents (content)

1. Bandaragoda, T.R.; Silva, D. de; Alahakoon, D.: Automatic event detection in microblogs using incremental machine learning (2017) 0.30

   0.30277553 = sum of:
     0.30277553 = product of:
       1.0813411 = sum of:
         0.022786906 = weight(abstract_txt:learning in 4826) [ClassicSimilarity], result of:
           0.022786906 = score(doc=4826,freq=1.0), product of:
             0.07688426 = queryWeight, product of:
               1.2957463 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.012512658 = queryNorm
             0.29637933 = fieldWeight in 4826, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=4826)
         0.03777747 = weight(abstract_txt:generation in 4826) [ClassicSimilarity], result of:
           0.03777747 = score(doc=4826,freq=1.0), product of:
             0.10769671 = queryWeight, product of:
               1.533566 = boost
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.012512658 = queryNorm
             0.35077643 = fieldWeight in 4826, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.612423 = idf(docFreq=440, maxDocs=44421)
               0.0625 = fieldNorm(doc=4826)
         0.07456588 = weight(abstract_txt:events in 4826) [ClassicSimilarity], result of:
           0.07456588 = score(doc=4826,freq=2.0), product of:
             0.13450259 = queryWeight, product of:
               1.7138255 = boost
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.012512658 = queryNorm
             0.5543825 = fieldWeight in 4826, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.0625 = fieldNorm(doc=4826)
         0.038913794 = weight(abstract_txt:method in 4826) [ClassicSimilarity], result of:
           0.038913794 = score(doc=4826,freq=1.0), product of:
             0.13839686 = queryWeight, product of:
               2.458552 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.012512658 = queryNorm
             0.2811754 = fieldWeight in 4826, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=4826)
         0.14074418 = weight(abstract_txt:twitter in 4826) [ClassicSimilarity], result of:
           0.14074418 = score(doc=4826,freq=1.0), product of:
             0.326095 = queryWeight, product of:
               3.7738822 = boost
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.012512658 = queryNorm
             0.4316048 = fieldWeight in 4826, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.0625 = fieldNorm(doc=4826)
         0.32829922 = weight(abstract_txt:tweets in 4826) [ClassicSimilarity], result of:
           0.32829922 = score(doc=4826,freq=2.0), product of:
             0.49037743 = queryWeight, product of:
               5.17412 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.012512658 = queryNorm
             0.66948277 = fieldWeight in 4826, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.0625 = fieldNorm(doc=4826)
         0.4382537 = weight(abstract_txt:event in 4826) [ClassicSimilarity], result of:
           0.4382537 = score(doc=4826,freq=4.0), product of:
             0.5014389 = queryWeight, product of:
               5.7315345 = boost
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.012512658 = queryNorm
             0.8739922 = fieldWeight in 4826, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.0625 = fieldNorm(doc=4826)
       0.28 = coord(7/25)
   

2. Luo, Z.; Yu, Y.; Osborne, M.; Wang, T.: Structuring tweets for improving Twitter search (2015) 0.27

   0.2691113 = sum of:
     0.2691113 = product of:
       1.1212971 = sum of:
         0.11459165 = weight(abstract_txt:tweet in 3335) [ClassicSimilarity], result of:
           0.11459165 = score(doc=3335,freq=3.0), product of:
             0.124193475 = queryWeight, product of:
               1.1644897 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.012512658 = queryNorm
             0.9226866 = fieldWeight in 3335, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.0625 = fieldNorm(doc=3335)
         0.022786906 = weight(abstract_txt:learning in 3335) [ClassicSimilarity], result of:
           0.022786906 = score(doc=3335,freq=1.0), product of:
             0.07688426 = queryWeight, product of:
               1.2957463 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.012512658 = queryNorm
             0.29637933 = fieldWeight in 3335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=3335)
         0.03162235 = weight(abstract_txt:related in 3335) [ClassicSimilarity], result of:
           0.03162235 = score(doc=3335,freq=1.0), product of:
             0.12051839 = queryWeight, product of:
               2.2942615 = boost
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.012512658 = queryNorm
             0.2623861 = fieldWeight in 3335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.0625 = fieldNorm(doc=3335)
         0.038913794 = weight(abstract_txt:method in 3335) [ClassicSimilarity], result of:
           0.038913794 = score(doc=3335,freq=1.0), product of:
             0.13839686 = queryWeight, product of:
               2.458552 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.012512658 = queryNorm
             0.2811754 = fieldWeight in 3335, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=3335)
         0.34475142 = weight(abstract_txt:twitter in 3335) [ClassicSimilarity], result of:
           0.34475142 = score(doc=3335,freq=6.0), product of:
             0.326095 = queryWeight, product of:
               3.7738822 = boost
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.012512658 = queryNorm
             1.0572115 = fieldWeight in 3335, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.0625 = fieldNorm(doc=3335)
         0.568631 = weight(abstract_txt:tweets in 3335) [ClassicSimilarity], result of:
           0.568631 = score(doc=3335,freq=6.0), product of:
             0.49037743 = queryWeight, product of:
               5.17412 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.012512658 = queryNorm
             1.1595782 = fieldWeight in 3335, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.0625 = fieldNorm(doc=3335)
       0.24 = coord(6/25)
   

3. Cotelo, J.M.; Cruz, F.L.; Troyano, J.A.: Dynamic topic-related tweet retrieval (2014) 0.24

   0.2357989 = sum of:
     0.2357989 = product of:
       0.9824954 = sum of:
         0.07731239 = weight(abstract_txt:instant in 2217) [ClassicSimilarity], result of:
           0.07731239 = score(doc=2217,freq=1.0), product of:
             0.11873988 = queryWeight, product of:
               1.1386352 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.012512658 = queryNorm
             0.6511072 = fieldWeight in 2217, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.078125 = fieldNorm(doc=2217)
         0.0826994 = weight(abstract_txt:tweet in 2217) [ClassicSimilarity], result of:
           0.0826994 = score(doc=2217,freq=1.0), product of:
             0.124193475 = queryWeight, product of:
               1.1644897 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.012512658 = queryNorm
             0.6658917 = fieldWeight in 2217, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.078125 = fieldNorm(doc=2217)
         0.079055876 = weight(abstract_txt:related in 2217) [ClassicSimilarity], result of:
           0.079055876 = score(doc=2217,freq=4.0), product of:
             0.12051839 = queryWeight, product of:
               2.2942615 = boost
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.012512658 = queryNorm
             0.65596527 = fieldWeight in 2217, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.078125 = fieldNorm(doc=2217)
         0.08425084 = weight(abstract_txt:method in 2217) [ClassicSimilarity], result of:
           0.08425084 = score(doc=2217,freq=3.0), product of:
             0.13839686 = queryWeight, product of:
               2.458552 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.012512658 = queryNorm
             0.6087626 = fieldWeight in 2217, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=2217)
         0.2488029 = weight(abstract_txt:twitter in 2217) [ClassicSimilarity], result of:
           0.2488029 = score(doc=2217,freq=2.0), product of:
             0.326095 = queryWeight, product of:
               3.7738822 = boost
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.012512658 = queryNorm
             0.7629767 = fieldWeight in 2217, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.078125 = fieldNorm(doc=2217)
         0.41037405 = weight(abstract_txt:tweets in 2217) [ClassicSimilarity], result of:
           0.41037405 = score(doc=2217,freq=2.0), product of:
             0.49037743 = queryWeight, product of:
               5.17412 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.012512658 = queryNorm
             0.83685344 = fieldWeight in 2217, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.078125 = fieldNorm(doc=2217)
       0.24 = coord(6/25)
   

4. Arakawa, Y.; Kameda, A.; Aizawa, A.; Suzuki, T.: Adding Twitter-specific features to stylistic features for classifying tweets by user type and number of retweets (2014) 0.19

   0.19154446 = sum of:
     0.19154446 = product of:
       0.7981019 = sum of:
         0.066159524 = weight(abstract_txt:tweet in 2307) [ClassicSimilarity], result of:
           0.066159524 = score(doc=2307,freq=1.0), product of:
             0.124193475 = queryWeight, product of:
               1.1644897 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.012512658 = queryNorm
             0.53271335 = fieldWeight in 2307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.0625 = fieldNorm(doc=2307)
         0.022786906 = weight(abstract_txt:learning in 2307) [ClassicSimilarity], result of:
           0.022786906 = score(doc=2307,freq=1.0), product of:
             0.07688426 = queryWeight, product of:
               1.2957463 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.012512658 = queryNorm
             0.29637933 = fieldWeight in 2307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=2307)
         0.024382759 = weight(abstract_txt:high in 2307) [ClassicSimilarity], result of:
           0.024382759 = score(doc=2307,freq=1.0), product of:
             0.08043328 = queryWeight, product of:
               1.3253151 = boost
               4.8502827 = idf(docFreq=944, maxDocs=44421)
               0.012512658 = queryNorm
             0.30314267 = fieldWeight in 2307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8502827 = idf(docFreq=944, maxDocs=44421)
               0.0625 = fieldNorm(doc=2307)
         0.038913794 = weight(abstract_txt:method in 2307) [ClassicSimilarity], result of:
           0.038913794 = score(doc=2307,freq=1.0), product of:
             0.13839686 = queryWeight, product of:
               2.458552 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.012512658 = queryNorm
             0.2811754 = fieldWeight in 2307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=2307)
         0.24377607 = weight(abstract_txt:twitter in 2307) [ClassicSimilarity], result of:
           0.24377607 = score(doc=2307,freq=3.0), product of:
             0.326095 = queryWeight, product of:
               3.7738822 = boost
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.012512658 = queryNorm
             0.74756145 = fieldWeight in 2307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.0625 = fieldNorm(doc=2307)
         0.40208283 = weight(abstract_txt:tweets in 2307) [ClassicSimilarity], result of:
           0.40208283 = score(doc=2307,freq=3.0), product of:
             0.49037743 = queryWeight, product of:
               5.17412 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.012512658 = queryNorm
             0.81994563 = fieldWeight in 2307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.0625 = fieldNorm(doc=2307)
       0.24 = coord(6/25)
   

5. Sedhai, S.; Sun, A.: ¬An analysis of 14 Million tweets on hashtag-oriented spamming* (2017) 0.17

   0.17436072 = sum of:
     0.17436072 = product of:
       1.0897546 = sum of:
         0.11459165 = weight(abstract_txt:tweet in 4683) [ClassicSimilarity], result of:
           0.11459165 = score(doc=4683,freq=3.0), product of:
             0.124193475 = queryWeight, product of:
               1.1644897 = boost
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.012512658 = queryNorm
             0.9226866 = fieldWeight in 4683, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.523414 = idf(docFreq=23, maxDocs=44421)
               0.0625 = fieldNorm(doc=4683)
         0.046257794 = weight(abstract_txt:keywords in 4683) [ClassicSimilarity], result of:
           0.046257794 = score(doc=4683,freq=1.0), product of:
             0.12326425 = queryWeight, product of:
               1.6406647 = boost
               6.004374 = idf(docFreq=297, maxDocs=44421)
               0.012512658 = queryNorm
             0.37527338 = fieldWeight in 4683, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.004374 = idf(docFreq=297, maxDocs=44421)
               0.0625 = fieldNorm(doc=4683)
         0.31471354 = weight(abstract_txt:twitter in 4683) [ClassicSimilarity], result of:
           0.31471354 = score(doc=4683,freq=5.0), product of:
             0.326095 = queryWeight, product of:
               3.7738822 = boost
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.012512658 = queryNorm
             0.96509767 = fieldWeight in 4683, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.905677 = idf(docFreq=120, maxDocs=44421)
               0.0625 = fieldNorm(doc=4683)
         0.6141916 = weight(abstract_txt:tweets in 4683) [ClassicSimilarity], result of:
           0.6141916 = score(doc=4683,freq=7.0), product of:
             0.49037743 = queryWeight, product of:
               5.17412 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.012512658 = queryNorm
             1.2524875 = fieldWeight in 4683, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.0625 = fieldNorm(doc=4683)
       0.16 = coord(4/25)