Document (#42817)

Author

Zhang, Y.
Zhang, C.
Li, J.

Title

Joint modeling of characters, words, and conversation contexts for microblog keyphrase extraction

Source

Journal of the Association for Information Science and Technology. 71(2020) no.5, S.553-567

Year

2020

Abstract

Millions of messages are produced on microblog platforms every day, leading to the pressing need for automatic identification of key points from the massive texts. To absorb salient content from the vast bulk of microblog posts, this article focuses on the task of microblog keyphrase extraction. In previous work, most efforts treat messages as independent documents and might suffer from the data sparsity problem exhibited in short and informal microblog posts. On the contrary, we propose to enrich contexts via exploiting conversations initialized by target posts and formed by their replies, which are generally centered around relevant topics to the target posts and therefore helpful for keyphrase identification. Concretely, we present a neural keyphrase extraction framework, which has 2 modules: a conversation context encoder and a keyphrase tagger. The conversation context encoder captures indicative representation from their conversation contexts and feeds the representation into the keyphrase tagger, and the keyphrase tagger extracts salient words from target posts. The 2 modules were trained jointly to optimize the conversation context encoding and keyphrase extraction processes. In the conversation context encoder, we leverage hierarchical structures to capture the word-level indicative representation and message-level indicative representation hierarchically. In both of the modules, we apply character-level representations, which enables the model to explore morphological features and deal with the out-of-vocabulary problem caused by the informal language style of microblog messages. Extensive comparison results on real-life data sets indicate that our model outperforms state-of-the-art models from previous studies.

Content

https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24279.

Theme

Automatisches Indexieren
Computerlinguistik

Similar documents (author)

1. Zhang, M.; Zhang, Y.: Professional organizations in Twittersphere : an empirical study of U.S. library and information science professional organizations-related Tweets (2020) 4.53

   4.5277104 = sum of:
     4.5277104 = weight(author_txt:zhang in 775) [ClassicSimilarity], result of:
       4.5277104 = score(doc=775,freq=2.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.527711 = fieldWeight in 775, product of:
           1.4142135 = tf(freq=2.0), with freq of:
             2.0 = termFreq=2.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.5 = fieldNorm(doc=775)
   

2. Zhang, Y.; Zhang, C.: Enhancing keyphrase extraction from microblogs using human reading time (2021) 4.53

   4.5277104 = sum of:
     4.5277104 = weight(author_txt:zhang in 1238) [ClassicSimilarity], result of:
       4.5277104 = score(doc=1238,freq=2.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.527711 = fieldWeight in 1238, product of:
           1.4142135 = tf(freq=2.0), with freq of:
             2.0 = termFreq=2.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.5 = fieldNorm(doc=1238)
   

3. Zhang, J.: TOFIR: A tool of facilitating information retrieval : introduce a visual retrieval model (2001) 4.00

   4.0019684 = sum of:
     4.0019684 = weight(author_txt:zhang in 7710) [ClassicSimilarity], result of:
       4.0019684 = score(doc=7710,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.001969 = fieldWeight in 7710, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.625 = fieldNorm(doc=7710)
   

4. Zhang, A.: Multimedia file formats on the Internet : a beginner's guide for PC users (1995) 4.00

   4.0019684 = sum of:
     4.0019684 = weight(author_txt:zhang in 3280) [ClassicSimilarity], result of:
       4.0019684 = score(doc=3280,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.001969 = fieldWeight in 3280, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.625 = fieldNorm(doc=3280)
   

5. Zhang, J.: ¬A representational analysis of relational information displays (1996) 4.00

   4.0019684 = sum of:
     4.0019684 = weight(author_txt:zhang in 6471) [ClassicSimilarity], result of:
       4.0019684 = score(doc=6471,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.001969 = fieldWeight in 6471, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.625 = fieldNorm(doc=6471)
   

Similar documents (content)

1. Zhang, Y.; Zhang, C.: Enhancing keyphrase extraction from microblogs using human reading time (2021) 0.43

   0.43367577 = sum of:
     0.43367577 = product of:
       1.3552368 = sum of:
         0.015785737 = weight(abstract_txt:previous in 1238) [ClassicSimilarity], result of:
           0.015785737 = score(doc=1238,freq=1.0), product of:
             0.04841478 = queryWeight, product of:
               1.1685302 = boost
               5.216832 = idf(docFreq=654, maxDocs=44421)
               0.007942024 = queryNorm
             0.326052 = fieldWeight in 1238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.216832 = idf(docFreq=654, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.024156826 = weight(abstract_txt:words in 1238) [ClassicSimilarity], result of:
           0.024156826 = score(doc=1238,freq=2.0), product of:
             0.05102911 = queryWeight, product of:
               1.1996648 = boost
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.007942024 = queryNorm
             0.47339305 = fieldWeight in 1238, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.047709495 = weight(abstract_txt:salient in 1238) [ClassicSimilarity], result of:
           0.047709495 = score(doc=1238,freq=1.0), product of:
             0.10120562 = queryWeight, product of:
               1.6894808 = boost
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.007942024 = queryNorm
             0.47141153 = fieldWeight in 1238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5425844 = idf(docFreq=63, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.009911149 = weight(abstract_txt:from in 1238) [ClassicSimilarity], result of:
           0.009911149 = score(doc=1238,freq=2.0), product of:
             0.04063633 = queryWeight, product of:
               1.8542521 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.007942024 = queryNorm
             0.2438987 = fieldWeight in 1238, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.09144171 = weight(abstract_txt:extraction in 1238) [ClassicSimilarity], result of:
           0.09144171 = score(doc=1238,freq=3.0), product of:
             0.1364166 = queryWeight, product of:
               2.7739558 = boost
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.007942024 = queryNorm
             0.6703122 = fieldWeight in 1238, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.11853974 = weight(abstract_txt:posts in 1238) [ClassicSimilarity], result of:
           0.11853974 = score(doc=1238,freq=1.0), product of:
             0.25197497 = queryWeight, product of:
               4.21502 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.007942024 = queryNorm
             0.47044253 = fieldWeight in 1238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.36930677 = weight(abstract_txt:microblog in 1238) [ClassicSimilarity], result of:
           0.36930677 = score(doc=1238,freq=2.0), product of:
             0.4533393 = queryWeight, product of:
               6.1933165 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.007942024 = queryNorm
             0.8146366 = fieldWeight in 1238, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.6783853 = weight(abstract_txt:keyphrase in 1238) [ClassicSimilarity], result of:
           0.6783853 = score(doc=1238,freq=4.0), product of:
             0.59399897 = queryWeight, product of:
               8.186039 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.007942024 = queryNorm
             1.1420648 = fieldWeight in 1238, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
       0.32 = coord(8/25)
   

2. Chen, K.; Zhao, Y.; Song, N.; Han, Y.; Peng, J.; Wang, J.: You are not alone: : characterizing users' relationship-layer identities in online health communities (2024) 0.08

   0.081134096 = sum of:
     0.081134096 = product of:
       0.33805874 = sum of:
         0.039573554 = weight(abstract_txt:replies in 2300) [ClassicSimilarity], result of:
           0.039573554 = score(doc=2300,freq=1.0), product of:
             0.07091337 = queryWeight, product of:
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.007942024 = queryNorm
             0.5580549 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.015785737 = weight(abstract_txt:previous in 2300) [ClassicSimilarity], result of:
           0.015785737 = score(doc=2300,freq=1.0), product of:
             0.04841478 = queryWeight, product of:
               1.1685302 = boost
               5.216832 = idf(docFreq=654, maxDocs=44421)
               0.007942024 = queryNorm
             0.326052 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.216832 = idf(docFreq=654, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.0070082406 = weight(abstract_txt:from in 2300) [ClassicSimilarity], result of:
           0.0070082406 = score(doc=2300,freq=1.0), product of:
             0.04063633 = queryWeight, product of:
               1.8542521 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.007942024 = queryNorm
             0.17246243 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.0265818 = weight(abstract_txt:representation in 2300) [ClassicSimilarity], result of:
           0.0265818 = score(doc=2300,freq=1.0), product of:
             0.086337805 = queryWeight, product of:
               2.2068176 = boost
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.007942024 = queryNorm
             0.30788136 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.13056967 = weight(abstract_txt:encoder in 2300) [ClassicSimilarity], result of:
           0.13056967 = score(doc=2300,freq=1.0), product of:
             0.22666965 = queryWeight, product of:
               3.0966582 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.007942024 = queryNorm
             0.5760351 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
         0.11853974 = weight(abstract_txt:posts in 2300) [ClassicSimilarity], result of:
           0.11853974 = score(doc=2300,freq=1.0), product of:
             0.25197497 = queryWeight, product of:
               4.21502 = boost
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.007942024 = queryNorm
             0.47044253 = fieldWeight in 2300, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5270805 = idf(docFreq=64, maxDocs=44421)
               0.0625 = fieldNorm(doc=2300)
       0.24 = coord(6/25)
   

3. Martín-Moncunill, D.; García-Barriocanal, E.; Sicilia, M.-A.; Sánchez-Alonso, S.: Evaluating the practical applicability of thesaurus-based keyphrase extraction in the agricultural domain : insights from the VOA3R project (2015) 0.08

   0.08030028 = sum of:
     0.08030028 = product of:
       0.669169 = sum of:
         0.0070082406 = weight(abstract_txt:from in 3106) [ClassicSimilarity], result of:
           0.0070082406 = score(doc=3106,freq=1.0), product of:
             0.04063633 = queryWeight, product of:
               1.8542521 = boost
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.007942024 = queryNorm
             0.17246243 = fieldWeight in 3106, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.759399 = idf(docFreq=7646, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
         0.07466184 = weight(abstract_txt:extraction in 3106) [ClassicSimilarity], result of:
           0.07466184 = score(doc=3106,freq=2.0), product of:
             0.1364166 = queryWeight, product of:
               2.7739558 = boost
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.007942024 = queryNorm
             0.5473076 = fieldWeight in 3106, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
         0.5874989 = weight(abstract_txt:keyphrase in 3106) [ClassicSimilarity], result of:
           0.5874989 = score(doc=3106,freq=3.0), product of:
             0.59399897 = queryWeight, product of:
               8.186039 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.007942024 = queryNorm
             0.9890571 = fieldWeight in 3106, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
       0.12 = coord(3/25)
   

4. Toutanova, K.; Klein, D.; Manning, C.D.; Singer, Y.: Feature-rich Part-of-Speech Tagging with a cyclic dependency network (2003) 0.07

   0.07399812 = sum of:
     0.07399812 = product of:
       0.36999062 = sum of:
         0.023678605 = weight(abstract_txt:previous in 2059) [ClassicSimilarity], result of:
           0.023678605 = score(doc=2059,freq=1.0), product of:
             0.04841478 = queryWeight, product of:
               1.1685302 = boost
               5.216832 = idf(docFreq=654, maxDocs=44421)
               0.007942024 = queryNorm
             0.48907802 = fieldWeight in 2059, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.216832 = idf(docFreq=654, maxDocs=44421)
               0.09375 = fieldNorm(doc=2059)
         0.025622183 = weight(abstract_txt:words in 2059) [ClassicSimilarity], result of:
           0.025622183 = score(doc=2059,freq=1.0), product of:
             0.05102911 = queryWeight, product of:
               1.1996648 = boost
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.007942024 = queryNorm
             0.50210917 = fieldWeight in 2059, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.09375 = fieldNorm(doc=2059)
         0.047386322 = weight(abstract_txt:contexts in 2059) [ClassicSimilarity], result of:
           0.047386322 = score(doc=2059,freq=1.0), product of:
             0.08801154 = queryWeight, product of:
               1.9295961 = boost
               5.743043 = idf(docFreq=386, maxDocs=44421)
               0.007942024 = queryNorm
             0.5384103 = fieldWeight in 2059, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.743043 = idf(docFreq=386, maxDocs=44421)
               0.09375 = fieldNorm(doc=2059)
         0.039872702 = weight(abstract_txt:representation in 2059) [ClassicSimilarity], result of:
           0.039872702 = score(doc=2059,freq=1.0), product of:
             0.086337805 = queryWeight, product of:
               2.2068176 = boost
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.007942024 = queryNorm
             0.46182203 = fieldWeight in 2059, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9261017 = idf(docFreq=875, maxDocs=44421)
               0.09375 = fieldNorm(doc=2059)
         0.2334308 = weight(abstract_txt:tagger in 2059) [ClassicSimilarity], result of:
           0.2334308 = score(doc=2059,freq=2.0), product of:
             0.2022397 = queryWeight, product of:
               2.9250264 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.007942024 = queryNorm
             1.1542283 = fieldWeight in 2059, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.09375 = fieldNorm(doc=2059)
       0.2 = coord(5/25)
   

5. Tseng, Y.-H.; Lin, C.-J.; Lin, Y.-I.: Text mining techniques for patent analysis (2007) 0.07

   0.07247878 = sum of:
     0.07247878 = product of:
       0.45299238 = sum of:
         0.017081456 = weight(abstract_txt:words in 1935) [ClassicSimilarity], result of:
           0.017081456 = score(doc=1935,freq=1.0), product of:
             0.05102911 = queryWeight, product of:
               1.1996648 = boost
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.007942024 = queryNorm
             0.33473945 = fieldWeight in 1935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.355831 = idf(docFreq=569, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.022056412 = weight(abstract_txt:identification in 1935) [ClassicSimilarity], result of:
           0.022056412 = score(doc=1935,freq=1.0), product of:
             0.060509652 = queryWeight, product of:
               1.3063612 = boost
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.007942024 = queryNorm
             0.36451066 = fieldWeight in 1935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8321705 = idf(docFreq=353, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.07466184 = weight(abstract_txt:extraction in 1935) [ClassicSimilarity], result of:
           0.07466184 = score(doc=1935,freq=2.0), product of:
             0.1364166 = queryWeight, product of:
               2.7739558 = boost
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.007942024 = queryNorm
             0.5473076 = fieldWeight in 1935, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.192079 = idf(docFreq=246, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
         0.33919266 = weight(abstract_txt:keyphrase in 1935) [ClassicSimilarity], result of:
           0.33919266 = score(doc=1935,freq=1.0), product of:
             0.59399897 = queryWeight, product of:
               8.186039 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.007942024 = queryNorm
             0.5710324 = fieldWeight in 1935, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=1935)
       0.16 = coord(4/25)