Document (#42094)

Author

Zielinski, K.
Nielek, R.
Wierzbicki, A.
Jatowt, A.

Title

Computing controversy : formal model and algorithms for detecting controversy on Wikipedia and in search queries

Source

Information processing and management. 54(2018) no.1, S.14-36

Year

2018

Abstract

Controversy is a complex concept that has been attracting attention of scholars from diverse fields. In the era of Internet and social media, detecting controversy and controversial concepts by the means of automatic methods is especially important. Web searchers could be alerted when the contents they consume are controversial or when they attempt to acquire information on disputed topics. Presenting users with the indications and explanations of the controversy should offer them chance to see the "wider picture" rather than letting them obtain one-sided views. In this work we first introduce a formal model of controversy as the basis of computational approaches to detecting controversial concepts. Then we propose a classification based method for automatic detection of controversial articles and categories in Wikipedia. Next, we demonstrate how to use the obtained results for the estimation of the controversy level of search queries. The proposed method can be incorporated into search engines as a component responsible for detection of queries related to controversial topics. The method is independent of the search engine's retrieval and search results recommendation algorithms, and is therefore unaffected by a possible filter bubble. Our approach can be also applied in Wikipedia or other knowledge bases for supporting the detection of controversy and content maintenance. Finally, we believe that our results could be useful for social science researchers for understanding the complex nature of controversy and in fostering their studies.

Content

Vgl.: https://doi.org/10.1016/j.ipm.2017.08.005.

Theme

Informationsmittel
Internet

Field

Kommunikationswissenschaften

Object

Wikipedia

Similar documents (author)

1. Jatowt, A.; Yeung, C.M.A.; Tanaka, K.: Generic method for detecting focus time of documents (2015) 3.72

   3.7161405 = sum of:
     3.7161405 = weight(author_txt:jatowt in 3668) [ClassicSimilarity], result of:
       3.7161405 = fieldWeight in 3668, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.375 = fieldNorm(doc=3668)
   

2. Joho, H.; Jatowt, A.; Blanco, R.: Temporal information searching behaviour and strategies (2015) 3.72

   3.7161405 = sum of:
     3.7161405 = weight(author_txt:jatowt in 3674) [ClassicSimilarity], result of:
       3.7161405 = fieldWeight in 3674, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.375 = fieldNorm(doc=3674)
   

3. Chin, J.Y.; Bhowmick, S.S.; Jatowt, A.: On-demand recent personal tweets summarization on mobile devices (2019) 3.72

   3.7161405 = sum of:
     3.7161405 = weight(author_txt:jatowt in 246) [ClassicSimilarity], result of:
       3.7161405 = fieldWeight in 246, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.375 = fieldNorm(doc=246)
   

4. Lee, J.; Jatowt, A.; Kim, K.-S..: Discovering underlying sensations of human emotions based on social media (2021) 3.72

   3.7161405 = sum of:
     3.7161405 = weight(author_txt:jatowt in 1164) [ClassicSimilarity], result of:
       3.7161405 = fieldWeight in 1164, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.375 = fieldNorm(doc=1164)
   

Similar documents (content)

1. Hjørland, B.: Evaluation of an information source illustrated by a case study : effect of screening for breast cancer (2011) 0.12

   0.12238349 = sum of:
     0.12238349 = product of:
       1.0198624 = sum of:
         0.032097675 = weight(abstract_txt:method in 657) [ClassicSimilarity], result of:
           0.032097675 = score(doc=657,freq=1.0), product of:
             0.07610356 = queryWeight, product of:
               1.5984635 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.010582905 = queryNorm
             0.42176312 = fieldWeight in 657, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.09375 = fieldNorm(doc=657)
         0.12198946 = weight(abstract_txt:wikipedia in 657) [ClassicSimilarity], result of:
           0.12198946 = score(doc=657,freq=2.0), product of:
             0.14710501 = queryWeight, product of:
               2.2223577 = boost
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.010582905 = queryNorm
             0.82926786 = fieldWeight in 657, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.25473 = idf(docFreq=231, maxDocs=44421)
               0.09375 = fieldNorm(doc=657)
         0.86577535 = weight(abstract_txt:controversy in 657) [ClassicSimilarity], result of:
           0.86577535 = score(doc=657,freq=2.0), product of:
             0.7835316 = queryWeight, product of:
               8.883603 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.010582905 = queryNorm
             1.1049654 = fieldWeight in 657, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.09375 = fieldNorm(doc=657)
       0.12 = coord(3/25)
   

2. Plotnick, R.: Computers, systems theory, and the making of a wired hospital : a history of Technicon Medical Information System, 1964-1987 (2010) 0.09

   0.09252219 = sum of:
     0.09252219 = product of:
       0.5782637 = sum of:
         0.03005924 = weight(abstract_txt:could in 460) [ClassicSimilarity], result of:
           0.03005924 = score(doc=460,freq=2.0), product of:
             0.05703678 = queryWeight, product of:
               1.1298795 = boost
               4.7699957 = idf(docFreq=1023, maxDocs=44421)
               0.010582905 = queryNorm
             0.52701503 = fieldWeight in 460, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7699957 = idf(docFreq=1023, maxDocs=44421)
               0.078125 = fieldNorm(doc=460)
         0.025675332 = weight(abstract_txt:complex in 460) [ClassicSimilarity], result of:
           0.025675332 = score(doc=460,freq=1.0), product of:
             0.06469296 = queryWeight, product of:
               1.2033255 = boost
               5.080062 = idf(docFreq=750, maxDocs=44421)
               0.010582905 = queryNorm
             0.39687985 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.080062 = idf(docFreq=750, maxDocs=44421)
               0.078125 = fieldNorm(doc=460)
         0.012366048 = weight(abstract_txt:results in 460) [ClassicSimilarity], result of:
           0.012366048 = score(doc=460,freq=1.0), product of:
             0.045502022 = queryWeight, product of:
               1.2359918 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.010582905 = queryNorm
             0.2717692 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.078125 = fieldNorm(doc=460)
         0.51016307 = weight(abstract_txt:controversy in 460) [ClassicSimilarity], result of:
           0.51016307 = score(doc=460,freq=1.0), product of:
             0.7835316 = queryWeight, product of:
               8.883603 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.010582905 = queryNorm
             0.6511072 = fieldWeight in 460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.078125 = fieldNorm(doc=460)
       0.16 = coord(4/25)
   

3. Peters, B.: ¬The search engine democracy : metaphors and Muhammad (2007) 0.09

   0.08859366 = sum of:
     0.08859366 = product of:
       0.73828053 = sum of:
         0.021761907 = weight(abstract_txt:algorithms in 1384) [ClassicSimilarity], result of:
           0.021761907 = score(doc=1384,freq=1.0), product of:
             0.08144732 = queryWeight, product of:
               1.3501842 = boost
               5.7000527 = idf(docFreq=403, maxDocs=44421)
               0.010582905 = queryNorm
             0.26718998 = fieldWeight in 1384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7000527 = idf(docFreq=403, maxDocs=44421)
               0.046875 = fieldNorm(doc=1384)
         0.032062996 = weight(abstract_txt:search in 1384) [ClassicSimilarity], result of:
           0.032062996 = score(doc=1384,freq=5.0), product of:
             0.08370246 = queryWeight, product of:
               2.1641817 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.010582905 = queryNorm
             0.3830592 = fieldWeight in 1384, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.046875 = fieldNorm(doc=1384)
         0.68445563 = weight(abstract_txt:controversy in 1384) [ClassicSimilarity], result of:
           0.68445563 = score(doc=1384,freq=5.0), product of:
             0.7835316 = queryWeight, product of:
               8.883603 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.010582905 = queryNorm
             0.873552 = fieldWeight in 1384, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.046875 = fieldNorm(doc=1384)
       0.12 = coord(3/25)
   

4. Fonseca, F.: Whether or when : the question on the use of theories in data science (2021) 0.07

   0.07220847 = sum of:
     0.07220847 = product of:
       0.60173726 = sum of:
         0.009892838 = weight(abstract_txt:results in 1410) [ClassicSimilarity], result of:
           0.009892838 = score(doc=1410,freq=1.0), product of:
             0.045502022 = queryWeight, product of:
               1.2359918 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.010582905 = queryNorm
             0.21741535 = fieldWeight in 1410, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=1410)
         0.18371394 = weight(abstract_txt:controversial in 1410) [ClassicSimilarity], result of:
           0.18371394 = score(doc=1410,freq=1.0), product of:
             0.37832156 = queryWeight, product of:
               4.601031 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.010582905 = queryNorm
             0.48560262 = fieldWeight in 1410, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=1410)
         0.40813047 = weight(abstract_txt:controversy in 1410) [ClassicSimilarity], result of:
           0.40813047 = score(doc=1410,freq=1.0), product of:
             0.7835316 = queryWeight, product of:
               8.883603 = boost
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.010582905 = queryNorm
             0.52088577 = fieldWeight in 1410, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.334172 = idf(docFreq=28, maxDocs=44421)
               0.0625 = fieldNorm(doc=1410)
       0.12 = coord(3/25)
   

5. Buccio, E. Di; Melucci, M.; Moro, F.: Detecting verbose queries and improving information retrieval (2014) 0.07

   0.069131665 = sum of:
     0.069131665 = product of:
       0.2468988 = sum of:
         0.014758021 = weight(abstract_txt:concepts in 3695) [ClassicSimilarity], result of:
           0.014758021 = score(doc=3695,freq=1.0), product of:
             0.051896542 = queryWeight, product of:
               1.0777644 = boost
               4.549982 = idf(docFreq=1275, maxDocs=44421)
               0.010582905 = queryNorm
             0.28437388 = fieldWeight in 3695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.549982 = idf(docFreq=1275, maxDocs=44421)
               0.0625 = fieldNorm(doc=3695)
         0.020524127 = weight(abstract_txt:topics in 3695) [ClassicSimilarity], result of:
           0.020524127 = score(doc=3695,freq=1.0), product of:
             0.064659074 = queryWeight, product of:
               1.2030103 = boost
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.010582905 = queryNorm
             0.3174207 = fieldWeight in 3695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.078731 = idf(docFreq=751, maxDocs=44421)
               0.0625 = fieldNorm(doc=3695)
         0.013990585 = weight(abstract_txt:results in 3695) [ClassicSimilarity], result of:
           0.013990585 = score(doc=3695,freq=2.0), product of:
             0.045502022 = queryWeight, product of:
               1.2359918 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.010582905 = queryNorm
             0.30747172 = fieldWeight in 3695, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=3695)
         0.029015876 = weight(abstract_txt:algorithms in 3695) [ClassicSimilarity], result of:
           0.029015876 = score(doc=3695,freq=1.0), product of:
             0.08144732 = queryWeight, product of:
               1.3501842 = boost
               5.7000527 = idf(docFreq=403, maxDocs=44421)
               0.010582905 = queryNorm
             0.3562533 = fieldWeight in 3695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7000527 = idf(docFreq=403, maxDocs=44421)
               0.0625 = fieldNorm(doc=3695)
         0.07643363 = weight(abstract_txt:queries in 3695) [ClassicSimilarity], result of:
           0.07643363 = score(doc=3695,freq=6.0), product of:
             0.09786393 = queryWeight, product of:
               1.8126401 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.010582905 = queryNorm
             0.78101945 = fieldWeight in 3695, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=3695)
         0.019118678 = weight(abstract_txt:search in 3695) [ClassicSimilarity], result of:
           0.019118678 = score(doc=3695,freq=1.0), product of:
             0.08370246 = queryWeight, product of:
               2.1641817 = boost
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.010582905 = queryNorm
             0.22841237 = fieldWeight in 3695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.654598 = idf(docFreq=3123, maxDocs=44421)
               0.0625 = fieldNorm(doc=3695)
         0.07305787 = weight(abstract_txt:detection in 3695) [ClassicSimilarity], result of:
           0.07305787 = score(doc=3695,freq=1.0), product of:
             0.17255521 = queryWeight, product of:
               2.4069345 = boost
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.010582905 = queryNorm
             0.42338836 = fieldWeight in 3695, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.0625 = fieldNorm(doc=3695)
       0.28 = coord(7/25)