Document (#41120)

Author

Ferreira, R.S.
Graça Pimentel, M. de
Cristo, M.

Title

¬A wikification prediction model based on the combination of latent, dyadic, and monadic features

Source

Journal of the Association for Information Science and Technology. 69(2018) no.3, S.380-394

Year

2018

Abstract

Considering repositories of web documents that are semantically linked and created in a collaborative fashion, as in the case of Wikipedia, a key problem faced by content providers is the placement of links in the articles. These links must support user navigation and provide a deeper semantic interpretation of the content. Current wikification methods exploit machine learning techniques to capture characteristics of the concepts and its associations. In previous work, we proposed a preliminary prediction model combining traditional predictors with a latent component which captures the concept graph topology by means of matrix factorization. In this work, we provide a detailed description of our method and a deeper comparison with a state-of-the-art wikification method using a sample of Wikipedia and report a gain up to 13% in F1 score. We also provide a comprehensive analysis of the model performance showing the importance of the latent predictor component and the attributes derived from the associations between the concepts. Moreover, we include an analysis that allows us to conclude that the model is resilient to ambiguity without including a disambiguation phase. We finally report the positive impact of selecting training samples from specific content quality classes.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23922/full.

Theme

Hypertext
Semantisches Umfeld in Indexierung u. Retrieval

Similar documents (author)

1. Ferreira Novellino, M.S. -> Salet Ferreira Novellino, M.: 0.84

   0.84054804 = sum of:
     0.84054804 = product of:
       2.521644 = sum of:
         2.521644 = weight(author_txt:ferreira in 5603) [ClassicSimilarity], result of:
           2.521644 = score(doc=5603,freq=2.0), product of:
             0.5287042 = queryWeight, product of:
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.058787912 = queryNorm
             4.7694798 = fieldWeight in 5603, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.375 = fieldNorm(doc=5603)
       0.33333334 = coord(1/3)
   

2. Ferreira, T. Duarte => Duarte Ferreira, T.: 0.84

   0.84054804 = sum of:
     0.84054804 = product of:
       2.521644 = sum of:
         2.521644 = weight(author_txt:ferreira in 38) [ClassicSimilarity], result of:
           2.521644 = score(doc=38,freq=2.0), product of:
             0.5287042 = queryWeight, product of:
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.058787912 = queryNorm
             4.7694798 = fieldWeight in 38, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.375 = fieldNorm(doc=38)
       0.33333334 = coord(1/3)
   

3. Pimentel, M. de Graça => Graça Pimentel, M. de: 0.80

   0.7995317 = sum of:
     0.7995317 = product of:
       2.398595 = sum of:
         2.398595 = weight(author_txt:graça in 170) [ClassicSimilarity], result of:
           2.398595 = score(doc=170,freq=2.0), product of:
             0.57745177 = queryWeight, product of:
               1.0450846 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.058787912 = queryNorm
             4.1537585 = fieldWeight in 170, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.3125 = fieldNorm(doc=170)
       0.33333334 = coord(1/3)
   

4. Graça Simões, M. da => Simões, M. da Graça: 0.80

   0.7995317 = sum of:
     0.7995317 = product of:
       2.398595 = sum of:
         2.398595 = weight(author_txt:graça in 700) [ClassicSimilarity], result of:
           2.398595 = score(doc=700,freq=2.0), product of:
             0.57745177 = queryWeight, product of:
               1.0450846 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.058787912 = queryNorm
             4.1537585 = fieldWeight in 700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.3125 = fieldNorm(doc=700)
       0.33333334 = coord(1/3)
   

5. Salet Ferreira Novellino, M.: Information transfer considering the production and use contexts : information retrieval languages (1998) 0.79

   0.79247636 = sum of:
     0.79247636 = product of:
       2.377429 = sum of:
         2.377429 = weight(author_txt:ferreira in 1147) [ClassicSimilarity], result of:
           2.377429 = score(doc=1147,freq=1.0), product of:
             0.5287042 = queryWeight, product of:
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.058787912 = queryNorm
             4.496709 = fieldWeight in 1147, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.993418 = idf(docFreq=14, maxDocs=44421)
               0.5 = fieldNorm(doc=1147)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Ding, C.H.Q.: ¬A probabilistic model for Latent Semantic Indexing (2005) 0.28

   0.28286067 = sum of:
     0.28286067 = product of:
       0.8839396 = sum of:
         0.020955026 = weight(abstract_txt:analysis in 4459) [ClassicSimilarity], result of:
           0.020955026 = score(doc=4459,freq=1.0), product of:
             0.07357329 = queryWeight, product of:
               1.018605 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.01981237 = queryNorm
             0.28481838 = fieldWeight in 4459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.078125 = fieldNorm(doc=4459)
         0.08523052 = weight(abstract_txt:disambiguation in 4459) [ClassicSimilarity], result of:
           0.08523052 = score(doc=4459,freq=1.0), product of:
             0.14879265 = queryWeight, product of:
               1.0242865 = boost
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.01981237 = queryNorm
             0.57281405 = fieldWeight in 4459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.078125 = fieldNorm(doc=4459)
         0.057610057 = weight(abstract_txt:concepts in 4459) [ClassicSimilarity], result of:
           0.057610057 = score(doc=4459,freq=2.0), product of:
             0.11459974 = queryWeight, product of:
               1.2712692 = boost
               4.549982 = idf(docFreq=1275, maxDocs=44421)
               0.01981237 = queryNorm
             0.5027067 = fieldWeight in 4459, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.549982 = idf(docFreq=1275, maxDocs=44421)
               0.078125 = fieldNorm(doc=4459)
         0.041952185 = weight(abstract_txt:provide in 4459) [ClassicSimilarity], result of:
           0.041952185 = score(doc=4459,freq=1.0), product of:
             0.13378114 = queryWeight, product of:
               1.6822431 = boost
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.01981237 = queryNorm
             0.3135882 = fieldWeight in 4459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.078125 = fieldNorm(doc=4459)
         0.12654276 = weight(abstract_txt:associations in 4459) [ClassicSimilarity], result of:
           0.12654276 = score(doc=4459,freq=1.0), product of:
             0.24397928 = queryWeight, product of:
               1.8549072 = boost
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.01981237 = queryNorm
             0.5186619 = fieldWeight in 4459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6388726 = idf(docFreq=157, maxDocs=44421)
               0.078125 = fieldNorm(doc=4459)
         0.16078709 = weight(abstract_txt:deeper in 4459) [ClassicSimilarity], result of:
           0.16078709 = score(doc=4459,freq=1.0), product of:
             0.28621706 = queryWeight, product of:
               2.0090625 = boost
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.01981237 = queryNorm
             0.56176627 = fieldWeight in 4459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.078125 = fieldNorm(doc=4459)
         0.07727854 = weight(abstract_txt:model in 4459) [ClassicSimilarity], result of:
           0.07727854 = score(doc=4459,freq=2.0), product of:
             0.17561732 = queryWeight, product of:
               2.225586 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.01981237 = queryNorm
             0.4400394 = fieldWeight in 4459, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.078125 = fieldNorm(doc=4459)
         0.31358346 = weight(abstract_txt:latent in 4459) [ClassicSimilarity], result of:
           0.31358346 = score(doc=4459,freq=2.0), product of:
             0.40592948 = queryWeight, product of:
               2.9303308 = boost
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.01981237 = queryNorm
             0.77250725 = fieldWeight in 4459, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.078125 = fieldNorm(doc=4459)
       0.32 = coord(8/25)
   

2. Sebastian, Y.: Literature-based discovery by learning heterogeneous bibliographic information networks (2017) 0.13

   0.1260434 = sum of:
     0.1260434 = product of:
       0.5251808 = sum of:
         0.059661366 = weight(abstract_txt:disambiguation in 1536) [ClassicSimilarity], result of:
           0.059661366 = score(doc=1536,freq=1.0), product of:
             0.14879265 = queryWeight, product of:
               1.0242865 = boost
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.01981237 = queryNorm
             0.40096983 = fieldWeight in 1536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1536)
         0.06751805 = weight(abstract_txt:method in 1536) [ClassicSimilarity], result of:
           0.06751805 = score(doc=1536,freq=6.0), product of:
             0.112036325 = queryWeight, product of:
               1.2569706 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.01981237 = queryNorm
             0.60264426 = fieldWeight in 1536, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1536)
         0.061542165 = weight(abstract_txt:links in 1536) [ClassicSimilarity], result of:
           0.061542165 = score(doc=1536,freq=2.0), product of:
             0.15190354 = queryWeight, product of:
               1.4636245 = boost
               5.238438 = idf(docFreq=640, maxDocs=44421)
               0.01981237 = queryNorm
             0.40513977 = fieldWeight in 1536, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.238438 = idf(docFreq=640, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1536)
         0.029366529 = weight(abstract_txt:provide in 1536) [ClassicSimilarity], result of:
           0.029366529 = score(doc=1536,freq=1.0), product of:
             0.13378114 = queryWeight, product of:
               1.6822431 = boost
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.01981237 = queryNorm
             0.21951173 = fieldWeight in 1536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.013929 = idf(docFreq=2180, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1536)
         0.038250927 = weight(abstract_txt:model in 1536) [ClassicSimilarity], result of:
           0.038250927 = score(doc=1536,freq=1.0), product of:
             0.17561732 = queryWeight, product of:
               2.225586 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.01981237 = queryNorm
             0.2178084 = fieldWeight in 1536, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1536)
         0.2688418 = weight(abstract_txt:latent in 1536) [ClassicSimilarity], result of:
           0.2688418 = score(doc=1536,freq=3.0), product of:
             0.40592948 = queryWeight, product of:
               2.9303308 = boost
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.01981237 = queryNorm
             0.662287 = fieldWeight in 1536, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1536)
       0.24 = coord(6/25)
   

3. Zielinski, K.; Nielek, R.; Wierzbicki, A.; Jatowt, A.: Computing controversy : formal model and algorithms for detecting controversy on Wikipedia and in search queries (2018) 0.11

   0.11090302 = sum of:
     0.11090302 = product of:
       0.3960822 = sum of:
         0.018826056 = weight(abstract_txt:work in 93) [ClassicSimilarity], result of:
           0.018826056 = score(doc=93,freq=1.0), product of:
             0.07948911 = queryWeight, product of:
               1.0587648 = boost
               3.7894108 = idf(docFreq=2729, maxDocs=44421)
               0.01981237 = queryNorm
             0.23683818 = fieldWeight in 93, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7894108 = idf(docFreq=2729, maxDocs=44421)
               0.0625 = fieldNorm(doc=93)
         0.054562822 = weight(abstract_txt:method in 93) [ClassicSimilarity], result of:
           0.054562822 = score(doc=93,freq=3.0), product of:
             0.112036325 = queryWeight, product of:
               1.2569706 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.01981237 = queryNorm
             0.4870101 = fieldWeight in 93, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=93)
         0.046088047 = weight(abstract_txt:concepts in 93) [ClassicSimilarity], result of:
           0.046088047 = score(doc=93,freq=2.0), product of:
             0.11459974 = queryWeight, product of:
               1.2712692 = boost
               4.549982 = idf(docFreq=1275, maxDocs=44421)
               0.01981237 = queryNorm
             0.40216538 = fieldWeight in 93, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.549982 = idf(docFreq=1275, maxDocs=44421)
               0.0625 = fieldNorm(doc=93)
         0.07527333 = weight(abstract_txt:component in 93) [ClassicSimilarity], result of:
           0.07527333 = score(doc=93,freq=1.0), product of:
             0.20024522 = queryWeight, product of:
               1.6804546 = boost
               6.014492 = idf(docFreq=294, maxDocs=44421)
               0.01981237 = queryNorm
             0.37590575 = fieldWeight in 93, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.014492 = idf(docFreq=294, maxDocs=44421)
               0.0625 = fieldNorm(doc=93)
         0.11972504 = weight(abstract_txt:wikipedia in 93) [ClassicSimilarity], result of:
           0.11972504 = score(doc=93,freq=2.0), product of:
             0.21656159 = queryWeight, product of:
               1.7475773 = boost
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.01981237 = queryNorm
             0.55284524 = fieldWeight in 93, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.0625 = fieldNorm(doc=93)
         0.037891544 = weight(abstract_txt:content in 93) [ClassicSimilarity], result of:
           0.037891544 = score(doc=93,freq=1.0), product of:
             0.145053 = queryWeight, product of:
               1.7516797 = boost
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.01981237 = queryNorm
             0.26122552 = fieldWeight in 93, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1796083 = idf(docFreq=1847, maxDocs=44421)
               0.0625 = fieldNorm(doc=93)
         0.043715347 = weight(abstract_txt:model in 93) [ClassicSimilarity], result of:
           0.043715347 = score(doc=93,freq=1.0), product of:
             0.17561732 = queryWeight, product of:
               2.225586 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.01981237 = queryNorm
             0.24892388 = fieldWeight in 93, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.0625 = fieldNorm(doc=93)
       0.28 = coord(7/25)
   

4. Zhao, G.; Wu, J.; Wang, D.; Li, T.: Entity disambiguation to Wikipedia using collective ranking (2016) 0.10

   0.101651035 = sum of:
     0.101651035 = product of:
       0.5082552 = sum of:
         0.1476236 = weight(abstract_txt:disambiguation in 4266) [ClassicSimilarity], result of:
           0.1476236 = score(doc=4266,freq=3.0), product of:
             0.14879265 = queryWeight, product of:
               1.0242865 = boost
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.01981237 = queryNorm
             0.99214303 = fieldWeight in 4266, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.078125 = fieldNorm(doc=4266)
         0.039377324 = weight(abstract_txt:method in 4266) [ClassicSimilarity], result of:
           0.039377324 = score(doc=4266,freq=1.0), product of:
             0.112036325 = queryWeight, product of:
               1.2569706 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.01981237 = queryNorm
             0.35146925 = fieldWeight in 4266, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=4266)
         0.105822995 = weight(abstract_txt:wikipedia in 4266) [ClassicSimilarity], result of:
           0.105822995 = score(doc=4266,freq=1.0), product of:
             0.21656159 = queryWeight, product of:
               1.7475773 = boost
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.01981237 = queryNorm
             0.4886508 = fieldWeight in 4266, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.078125 = fieldNorm(doc=4266)
         0.16078709 = weight(abstract_txt:prediction in 4266) [ClassicSimilarity], result of:
           0.16078709 = score(doc=4266,freq=1.0), product of:
             0.28621706 = queryWeight, product of:
               2.0090625 = boost
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.01981237 = queryNorm
             0.56176627 = fieldWeight in 4266, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.078125 = fieldNorm(doc=4266)
         0.05464418 = weight(abstract_txt:model in 4266) [ClassicSimilarity], result of:
           0.05464418 = score(doc=4266,freq=1.0), product of:
             0.17561732 = queryWeight, product of:
               2.225586 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.01981237 = queryNorm
             0.31115484 = fieldWeight in 4266, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.078125 = fieldNorm(doc=4266)
       0.2 = coord(5/25)
   

5. Li, C.; Sun, A.; Datta, A.: TSDW: Two-stage word sense disambiguation using Wikipedia (2013) 0.10

   0.10136926 = sum of:
     0.10136926 = product of:
       0.6335579 = sum of:
         0.18039902 = weight(abstract_txt:disambiguation in 1956) [ClassicSimilarity], result of:
           0.18039902 = score(doc=1956,freq=7.0), product of:
             0.14879265 = queryWeight, product of:
               1.0242865 = boost
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.01981237 = queryNorm
             1.2124188 = fieldWeight in 1956, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.33202 = idf(docFreq=78, maxDocs=44421)
               0.0625 = fieldNorm(doc=1956)
         0.10645256 = weight(abstract_txt:component in 1956) [ClassicSimilarity], result of:
           0.10645256 = score(doc=1956,freq=2.0), product of:
             0.20024522 = queryWeight, product of:
               1.6804546 = boost
               6.014492 = idf(docFreq=294, maxDocs=44421)
               0.01981237 = queryNorm
             0.531611 = fieldWeight in 1956, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.014492 = idf(docFreq=294, maxDocs=44421)
               0.0625 = fieldNorm(doc=1956)
         0.16931678 = weight(abstract_txt:wikipedia in 1956) [ClassicSimilarity], result of:
           0.16931678 = score(doc=1956,freq=4.0), product of:
             0.21656159 = queryWeight, product of:
               1.7475773 = boost
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.01981237 = queryNorm
             0.7818413 = fieldWeight in 1956, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.0625 = fieldNorm(doc=1956)
         0.17738959 = weight(abstract_txt:latent in 1956) [ClassicSimilarity], result of:
           0.17738959 = score(doc=1956,freq=1.0), product of:
             0.40592948 = queryWeight, product of:
               2.9303308 = boost
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.01981237 = queryNorm
             0.4369961 = fieldWeight in 1956, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9919376 = idf(docFreq=110, maxDocs=44421)
               0.0625 = fieldNorm(doc=1956)
       0.16 = coord(4/25)