Document (#42508)

Editor

Hale, C.
Schmidt, V.

Author

Pekar, V.
Binner, J.
Najafi, H.

Title

Early detection of heterogeneous disaster events using social media

Source

Journal of the Association for Information Science and Technology. 71(2020) no.1, S.43-54

Year

2020

Abstract

This article addresses the problem of detecting crisis-related messages on social media, in order to improve the situational awareness of emergency services. Previous work focused on developing machine-learning classifiers restricted to specific disasters, such as storms or wildfires. We investigate for the first time methods to detect such messages where the type of the crisis is not known in advance, that is, the data are highly heterogeneous. Data heterogeneity causes significant difficulties for learning algorithms to generalize and accurately label incoming data. Our main contributions are as follows. First, we evaluate the extent of this problem in the context of disaster management, finding that the performance of traditional learners drops by up to 40% when trained and tested on heterogeneous data vis-á-vis homogeneous data. Then, in order to overcome data heterogeneity, we propose a new ensemble learning method, and found this to perform on a par with the Gradient Boosting and AdaBoost ensemble learners. The methods are studied on a benchmark data set comprising 26 disaster events and four classification problems: detection of relevant messages, informative messages, eyewitness reports, and topical classification of messages. Finally, in a case study, we evaluate the proposed methods on a real-world data set to assess its practical value.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24208.

Similar documents (content)

1. Rahmi, R.; Joho, H.; Shirai, T.: ¬An analysis of natural disaster-related information-seeking behavior using temporal stages (2019) 0.21

   0.21154648 = sum of:
     0.21154648 = product of:
       0.8814437 = sum of:
         0.017418837 = weight(abstract_txt:first in 298) [ClassicSimilarity], result of:
           0.017418837 = score(doc=298,freq=1.0), product of:
             0.066964805 = queryWeight, product of:
               4.1619086 = idf(docFreq=1880, maxDocs=44421)
               0.016089927 = queryNorm
             0.2601193 = fieldWeight in 298, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1619086 = idf(docFreq=1880, maxDocs=44421)
               0.0625 = fieldNorm(doc=298)
         0.01794183 = weight(abstract_txt:social in 298) [ClassicSimilarity], result of:
           0.01794183 = score(doc=298,freq=1.0), product of:
             0.06829858 = queryWeight, product of:
               1.0099096 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.016089927 = queryNorm
             0.26269698 = fieldWeight in 298, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.0625 = fieldNorm(doc=298)
         0.1271621 = weight(abstract_txt:disasters in 298) [ClassicSimilarity], result of:
           0.1271621 = score(doc=298,freq=2.0), product of:
             0.15875192 = queryWeight, product of:
               1.0887325 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.016089927 = queryNorm
             0.80101144 = fieldWeight in 298, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0625 = fieldNorm(doc=298)
         0.059619043 = weight(abstract_txt:events in 298) [ClassicSimilarity], result of:
           0.059619043 = score(doc=298,freq=1.0), product of:
             0.15208644 = queryWeight, product of:
               1.5070301 = boost
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.016089927 = queryNorm
             0.39200762 = fieldWeight in 298, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.0625 = fieldNorm(doc=298)
         0.6088198 = weight(abstract_txt:disaster in 298) [ClassicSimilarity], result of:
           0.6088198 = score(doc=298,freq=8.0), product of:
             0.4097259 = queryWeight, product of:
               3.0294864 = boost
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.016089927 = queryNorm
             1.4859197 = fieldWeight in 298, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.0625 = fieldNorm(doc=298)
         0.050482105 = weight(abstract_txt:data in 298) [ClassicSimilarity], result of:
           0.050482105 = score(doc=298,freq=2.0), product of:
             0.17150185 = queryWeight, product of:
               3.2006714 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.016089927 = queryNorm
             0.29435313 = fieldWeight in 298, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=298)
       0.24 = coord(6/25)
   

2. Paltoglou, G.: Sentiment-based event detection in Twitter (2016) 0.15

   0.14977188 = sum of:
     0.14977188 = product of:
       0.5348996 = sum of:
         0.02537358 = weight(abstract_txt:social in 4010) [ClassicSimilarity], result of:
           0.02537358 = score(doc=4010,freq=2.0), product of:
             0.06829858 = queryWeight, product of:
               1.0099096 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.016089927 = queryNorm
             0.37150964 = fieldWeight in 4010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.021427257 = weight(abstract_txt:problem in 4010) [ClassicSimilarity], result of:
           0.021427257 = score(doc=4010,freq=1.0), product of:
             0.07687968 = queryWeight, product of:
               1.0714761 = boost
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.016089927 = queryNorm
             0.2787116 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4593854 = idf(docFreq=1396, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.044693116 = weight(abstract_txt:media in 4010) [ClassicSimilarity], result of:
           0.044693116 = score(doc=4010,freq=2.0), product of:
             0.09961336 = queryWeight, product of:
               1.2196507 = boost
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.016089927 = queryNorm
             0.4486659 = fieldWeight in 4010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.10326321 = weight(abstract_txt:events in 4010) [ClassicSimilarity], result of:
           0.10326321 = score(doc=4010,freq=3.0), product of:
             0.15208644 = queryWeight, product of:
               1.5070301 = boost
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.016089927 = queryNorm
             0.6789771 = fieldWeight in 4010, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.10622659 = weight(abstract_txt:detection in 4010) [ClassicSimilarity], result of:
           0.10622659 = score(doc=4010,freq=2.0), product of:
             0.17741051 = queryWeight, product of:
               1.62767 = boost
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.016089927 = queryNorm
             0.59876156 = fieldWeight in 4010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.03569624 = weight(abstract_txt:data in 4010) [ClassicSimilarity], result of:
           0.03569624 = score(doc=4010,freq=1.0), product of:
             0.17150185 = queryWeight, product of:
               3.2006714 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.016089927 = queryNorm
             0.20813909 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
         0.1982196 = weight(abstract_txt:messages in 4010) [ClassicSimilarity], result of:
           0.1982196 = score(doc=4010,freq=1.0), product of:
             0.4598098 = queryWeight, product of:
               4.143199 = boost
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.016089927 = queryNorm
             0.4310904 = fieldWeight in 4010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.0625 = fieldNorm(doc=4010)
       0.28 = coord(7/25)
   

3. Weessies, K.W.: ¬The publishing dynamics of catastrophic events (2007) 0.13

   0.12509622 = sum of:
     0.12509622 = product of:
       0.7818514 = sum of:
         0.2513262 = weight(abstract_txt:disasters in 1283) [ClassicSimilarity], result of:
           0.2513262 = score(doc=1283,freq=5.0), product of:
             0.15875192 = queryWeight, product of:
               1.0887325 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.016089927 = queryNorm
             1.583138 = fieldWeight in 1283, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.078125 = fieldNorm(doc=1283)
         0.105392575 = weight(abstract_txt:events in 1283) [ClassicSimilarity], result of:
           0.105392575 = score(doc=1283,freq=2.0), product of:
             0.15208644 = queryWeight, product of:
               1.5070301 = boost
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.016089927 = queryNorm
             0.69297814 = fieldWeight in 1283, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.078125 = fieldNorm(doc=1283)
         0.3805124 = weight(abstract_txt:disaster in 1283) [ClassicSimilarity], result of:
           0.3805124 = score(doc=1283,freq=2.0), product of:
             0.4097259 = queryWeight, product of:
               3.0294864 = boost
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.016089927 = queryNorm
             0.92869985 = fieldWeight in 1283, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.078125 = fieldNorm(doc=1283)
         0.044620298 = weight(abstract_txt:data in 1283) [ClassicSimilarity], result of:
           0.044620298 = score(doc=1283,freq=1.0), product of:
             0.17150185 = queryWeight, product of:
               3.2006714 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.016089927 = queryNorm
             0.26017386 = fieldWeight in 1283, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.078125 = fieldNorm(doc=1283)
       0.16 = coord(4/25)
   

4. Du, H.; Hao, J.-X..; Kwok, R.; Wagner, C.: Can a lean medium enhance large-group communication? : Examining the impact of interactive mobile learning (2010) 0.11

   0.107302584 = sum of:
     0.107302584 = product of:
       0.5365129 = sum of:
         0.031716976 = weight(abstract_txt:social in 3) [ClassicSimilarity], result of:
           0.031716976 = score(doc=3,freq=2.0), product of:
             0.06829858 = queryWeight, product of:
               1.0099096 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.016089927 = queryNorm
             0.46438706 = fieldWeight in 3, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.078125 = fieldNorm(doc=3)
         0.039503507 = weight(abstract_txt:media in 3) [ClassicSimilarity], result of:
           0.039503507 = score(doc=3,freq=1.0), product of:
             0.09961336 = queryWeight, product of:
               1.2196507 = boost
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.016089927 = queryNorm
             0.39656836 = fieldWeight in 3, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.078125 = fieldNorm(doc=3)
         0.083677195 = weight(abstract_txt:learning in 3) [ClassicSimilarity], result of:
           0.083677195 = score(doc=3,freq=3.0), product of:
             0.1304033 = queryWeight, product of:
               1.7090966 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.016089927 = queryNorm
             0.64168006 = fieldWeight in 3, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.078125 = fieldNorm(doc=3)
         0.13384072 = weight(abstract_txt:learners in 3) [ClassicSimilarity], result of:
           0.13384072 = score(doc=3,freq=1.0), product of:
             0.22470842 = queryWeight, product of:
               1.831835 = boost
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.016089927 = queryNorm
             0.59561956 = fieldWeight in 3, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.62393 = idf(docFreq=58, maxDocs=44421)
               0.078125 = fieldNorm(doc=3)
         0.2477745 = weight(abstract_txt:messages in 3) [ClassicSimilarity], result of:
           0.2477745 = score(doc=3,freq=1.0), product of:
             0.4598098 = queryWeight, product of:
               4.143199 = boost
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.016089927 = queryNorm
             0.538863 = fieldWeight in 3, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.078125 = fieldNorm(doc=3)
       0.2 = coord(5/25)
   

5. Muresan, S.; Gonzalez-Ibanez, R.; Ghosh, D.; Wacholder, N.: Identification of nonliteral language in social media : a case study on sarcasm (2016) 0.10

   0.10230758 = sum of:
     0.10230758 = product of:
       0.4262816 = sum of:
         0.01794183 = weight(abstract_txt:social in 4155) [ClassicSimilarity], result of:
           0.01794183 = score(doc=4155,freq=1.0), product of:
             0.06829858 = queryWeight, product of:
               1.0099096 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.016089927 = queryNorm
             0.26269698 = fieldWeight in 4155, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.0625 = fieldNorm(doc=4155)
         0.031602807 = weight(abstract_txt:media in 4155) [ClassicSimilarity], result of:
           0.031602807 = score(doc=4155,freq=1.0), product of:
             0.09961336 = queryWeight, product of:
               1.2196507 = boost
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.016089927 = queryNorm
             0.3172547 = fieldWeight in 4155, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.076075 = idf(docFreq=753, maxDocs=44421)
               0.0625 = fieldNorm(doc=4155)
         0.036462065 = weight(abstract_txt:methods in 4155) [ClassicSimilarity], result of:
           0.036462065 = score(doc=4155,freq=2.0), product of:
             0.099559285 = queryWeight, product of:
               1.4933555 = boost
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.016089927 = queryNorm
             0.3662347 = fieldWeight in 4155, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1434727 = idf(docFreq=1915, maxDocs=44421)
               0.0625 = fieldNorm(doc=4155)
         0.07511355 = weight(abstract_txt:detection in 4155) [ClassicSimilarity], result of:
           0.07511355 = score(doc=4155,freq=1.0), product of:
             0.17741051 = queryWeight, product of:
               1.62767 = boost
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.016089927 = queryNorm
             0.42338836 = fieldWeight in 4155, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.0625 = fieldNorm(doc=4155)
         0.06694175 = weight(abstract_txt:learning in 4155) [ClassicSimilarity], result of:
           0.06694175 = score(doc=4155,freq=3.0), product of:
             0.1304033 = queryWeight, product of:
               1.7090966 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.016089927 = queryNorm
             0.51334405 = fieldWeight in 4155, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=4155)
         0.1982196 = weight(abstract_txt:messages in 4155) [ClassicSimilarity], result of:
           0.1982196 = score(doc=4155,freq=1.0), product of:
             0.4598098 = queryWeight, product of:
               4.143199 = boost
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.016089927 = queryNorm
             0.4310904 = fieldWeight in 4155, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8974466 = idf(docFreq=121, maxDocs=44421)
               0.0625 = fieldNorm(doc=4155)
       0.24 = coord(6/25)