Document (#42977)

Author

Karlova-Bourbonus, N.

Title

Automatic detection of contradictions in texts

Imprint

Gießen : Fachbereiches 05 - Sprache, Literatur, Kultur der Justus-Liebig-Universität Gießen

Year

2018

Pages

258 S

Abstract

Natural language contradictions are of complex nature. As will be shown in Chapter 5, the realization of contradictions is not limited to the examples such as Socrates is a man and Socrates is not a man (under the condition that Socrates refers to the same object in the real world), which is discussed by Aristotle (Section 3.1.1). Empirical evidence (see Chapter 5 for more details) shows that only a few contradictions occurring in the real life are of that explicit (prototypical) kind. Rather, con-tradictions make use of a variety of natural language devices such as, e.g., paraphrasing, synonyms and antonyms, passive and active voice, diversity of negation expression, and figurative linguistic means such as idioms, irony, and metaphors. Additionally, the most so-phisticated kind of contradictions, the so-called implicit contradictions, can be found only when applying world knowledge and after conducting a sequence of logical operations such as e.g. in: (1.1) The first prize was given to the experienced grandmaster L. Stein who, in total, col-lected ten points (7 wins and 3 draws). Those familiar with the chess rules know that a chess player gets one point for winning and zero points for losing the game. In case of a draw, each player gets a half point. Built on this idea and by conducting some simple mathematical operations, we can infer that in the case of 7 wins and 3 draws (the second part of the sentence), a player can only collect 8.5 points and not 10 points. Hence, we observe that there is a contradiction between the first and the second parts of the sentence.
Implicit contradictions will only partially be the subject of the present study, aiming primarily at identifying the realization mechanism and cues (Chapter 5) as well as finding the parts of contradictions by applying the state of the art algorithms for natural language processing without conducting deep meaning processing. Further in focus are the explicit and implicit contradictions that can be detected by means of explicit linguistic, structural, lexical cues, and by conducting some additional processing operations (e.g., counting the sum in order to detect contradictions arising from numerical divergencies). One should note that an additional complexity in finding contradictions can arise in case parts of the contradictions occur on different levels of realization. Thus, a contradiction can be observed on the word- and phrase-level, such as in a married bachelor (for variations of contradictions on lexical level, see Ganeev 2004), on the sentence level - between parts of a sentence or between two or more sentences, or on the text level - between the portions of a text or between the whole texts such as a contradiction between the Bible and the Quran, for example. Only contradictions arising at the level of single sentences occurring in one or more texts, as well as parts of a sentence, will be considered for the purpose of this study. Though the focus of interest will be on single sentences, it will make use of text particularities such as coreference resolution without establishing the referents in the real world. Finally, another aspect to be considered is that parts of the contradictions are not neces-sarily to appear at the same time. They can be separated by many years and centuries with or without time expression making their recognition by human and detection by machine challenging. According to Aristotle's ontological version of the LNC (Section 3.1.1), how-ever, the same time reference is required in order for two statements to be judged as a contradiction. Taking this into account, we set the borders for the study by limiting the ana-lyzed textual data thematically (only nine world events) and temporally (three days after the reported event had happened) (Section 5.1). No sophisticated time processing will thus be conducted.

Content

Inaugural-Dissertation zur Erlangung des Doktorgrades der Philosophie des Fachbereiches 05 - Sprache, Literatur, Kultur der Justus-Liebig-Universität Gießen. Vgl. unter: https://core.ac.uk/download/pdf/196294796.pdf.

Theme

Computerlinguistik

Field

Sprachwissenschaft

Similar documents (content)

1. Hassan Ibrahim, N.; Allen, D.: Information sharing and trust during major incidents : findings from the oil industry (2012) 0.14

   0.14325999 = sum of:
     0.14325999 = product of:
       0.71629995 = sum of:
         0.012666285 = weight(abstract_txt:time in 1450) [ClassicSimilarity], result of:
           0.012666285 = score(doc=1450,freq=1.0), product of:
             0.048849106 = queryWeight, product of:
               4.1487055 = idf(docFreq=1905, maxDocs=44421)
               0.011774542 = queryNorm
             0.2592941 = fieldWeight in 1450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1487055 = idf(docFreq=1905, maxDocs=44421)
               0.0625 = fieldNorm(doc=1450)
         0.010996392 = weight(abstract_txt:between in 1450) [ClassicSimilarity], result of:
           0.010996392 = score(doc=1450,freq=1.0), product of:
             0.05088866 = queryWeight, product of:
               1.2500513 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.011774542 = queryNorm
             0.21608727 = fieldWeight in 1450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=1450)
         0.010558 = weight(abstract_txt:that in 1450) [ClassicSimilarity], result of:
           0.010558 = score(doc=1450,freq=4.0), product of:
             0.035715144 = queryWeight, product of:
               1.2825938 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011774542 = queryNorm
             0.2956169 = fieldWeight in 1450, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1450)
         0.012428324 = weight(abstract_txt:such in 1450) [ClassicSimilarity], result of:
           0.012428324 = score(doc=1450,freq=1.0), product of:
             0.05812704 = queryWeight, product of:
               1.4430448 = boost
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.011774542 = queryNorm
             0.21381313 = fieldWeight in 1450, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.0625 = fieldNorm(doc=1450)
         0.669651 = weight(abstract_txt:contradictions in 1450) [ClassicSimilarity], result of:
           0.669651 = score(doc=1450,freq=2.0), product of:
             0.8485092 = queryWeight, product of:
               8.070782 = boost
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.011774542 = queryNorm
             0.7892088 = fieldWeight in 1450, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.0625 = fieldNorm(doc=1450)
       0.2 = coord(5/25)
   

2. Heinrichs, J.: Language theory for the computer : monodimensional semantics or multidimensional semiotics? (1996) 0.12

   0.116976075 = sum of:
     0.116976075 = product of:
       0.58488035 = sum of:
         0.0074656336 = weight(abstract_txt:that in 5432) [ClassicSimilarity], result of:
           0.0074656336 = score(doc=5432,freq=2.0), product of:
             0.035715144 = queryWeight, product of:
               1.2825938 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011774542 = queryNorm
             0.20903271 = fieldWeight in 5432, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=5432)
         0.012428324 = weight(abstract_txt:such in 5432) [ClassicSimilarity], result of:
           0.012428324 = score(doc=5432,freq=1.0), product of:
             0.05812704 = queryWeight, product of:
               1.4430448 = boost
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.011774542 = queryNorm
             0.21381313 = fieldWeight in 5432, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.42101 = idf(docFreq=3945, maxDocs=44421)
               0.0625 = fieldNorm(doc=5432)
         0.020221472 = weight(abstract_txt:only in 5432) [ClassicSimilarity], result of:
           0.020221472 = score(doc=5432,freq=1.0), product of:
             0.07638288 = queryWeight, product of:
               1.5314941 = boost
               4.235812 = idf(docFreq=1746, maxDocs=44421)
               0.011774542 = queryNorm
             0.26473826 = fieldWeight in 5432, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.235812 = idf(docFreq=1746, maxDocs=44421)
               0.0625 = fieldNorm(doc=5432)
         0.0712502 = weight(abstract_txt:sentence in 5432) [ClassicSimilarity], result of:
           0.0712502 = score(doc=5432,freq=1.0), product of:
             0.16643749 = queryWeight, product of:
               2.0637271 = boost
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.011774542 = queryNorm
             0.42808983 = fieldWeight in 5432, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.0625 = fieldNorm(doc=5432)
         0.47351474 = weight(abstract_txt:contradictions in 5432) [ClassicSimilarity], result of:
           0.47351474 = score(doc=5432,freq=1.0), product of:
             0.8485092 = queryWeight, product of:
               8.070782 = boost
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.011774542 = queryNorm
             0.5580549 = fieldWeight in 5432, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.0625 = fieldNorm(doc=5432)
       0.2 = coord(5/25)
   

3. Twidale, M.B.; Nichols, D.M.: Collaborative information retrieval (2009) 0.08

   0.0849271 = sum of:
     0.0849271 = product of:
       0.3538629 = sum of:
         0.06418324 = weight(abstract_txt:explicit in 752) [ClassicSimilarity], result of:
           0.06418324 = score(doc=752,freq=1.0), product of:
             0.08248443 = queryWeight, product of:
               1.1253518 = boost
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.011774542 = queryNorm
             0.7781255 = fieldWeight in 752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.225004 = idf(docFreq=238, maxDocs=44421)
               0.125 = fieldNorm(doc=752)
         0.079936475 = weight(abstract_txt:implicit in 752) [ClassicSimilarity], result of:
           0.079936475 = score(doc=752,freq=1.0), product of:
             0.095481865 = queryWeight, product of:
               1.2107731 = boost
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.011774542 = queryNorm
             0.83719015 = fieldWeight in 752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.697521 = idf(docFreq=148, maxDocs=44421)
               0.125 = fieldNorm(doc=752)
         0.021992784 = weight(abstract_txt:between in 752) [ClassicSimilarity], result of:
           0.021992784 = score(doc=752,freq=1.0), product of:
             0.05088866 = queryWeight, product of:
               1.2500513 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.011774542 = queryNorm
             0.43217453 = fieldWeight in 752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.125 = fieldNorm(doc=752)
         0.010558 = weight(abstract_txt:that in 752) [ClassicSimilarity], result of:
           0.010558 = score(doc=752,freq=1.0), product of:
             0.035715144 = queryWeight, product of:
               1.2825938 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011774542 = queryNorm
             0.2956169 = fieldWeight in 752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.125 = fieldNorm(doc=752)
         0.055998173 = weight(abstract_txt:points in 752) [ClassicSimilarity], result of:
           0.055998173 = score(doc=752,freq=1.0), product of:
             0.08289335 = queryWeight, product of:
               1.3026614 = boost
               5.4043584 = idf(docFreq=542, maxDocs=44421)
               0.011774542 = queryNorm
             0.6755448 = fieldWeight in 752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4043584 = idf(docFreq=542, maxDocs=44421)
               0.125 = fieldNorm(doc=752)
         0.121194236 = weight(abstract_txt:realization in 752) [ClassicSimilarity], result of:
           0.121194236 = score(doc=752,freq=1.0), product of:
             0.12601209 = queryWeight, product of:
               1.3909401 = boost
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.011774542 = queryNorm
             0.9617668 = fieldWeight in 752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.125 = fieldNorm(doc=752)
       0.24 = coord(6/25)
   

4. Bando, L.L.; Scholer, F.; Turpin, A.: Query-biased summary generation assisted by query expansion : temporality (2015) 0.08

   0.07603726 = sum of:
     0.07603726 = product of:
       0.3168219 = sum of:
         0.012666285 = weight(abstract_txt:time in 2820) [ClassicSimilarity], result of:
           0.012666285 = score(doc=2820,freq=1.0), product of:
             0.048849106 = queryWeight, product of:
               4.1487055 = idf(docFreq=1905, maxDocs=44421)
               0.011774542 = queryNorm
             0.2592941 = fieldWeight in 2820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1487055 = idf(docFreq=1905, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.015551247 = weight(abstract_txt:between in 2820) [ClassicSimilarity], result of:
           0.015551247 = score(doc=2820,freq=2.0), product of:
             0.05088866 = queryWeight, product of:
               1.2500513 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.011774542 = queryNorm
             0.30559355 = fieldWeight in 2820, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.10207879 = weight(abstract_txt:sentences in 2820) [ClassicSimilarity], result of:
           0.10207879 = score(doc=2820,freq=5.0), product of:
             0.10433048 = queryWeight, product of:
               1.2656333 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.011774542 = queryNorm
             0.9784177 = fieldWeight in 2820, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.009143496 = weight(abstract_txt:that in 2820) [ClassicSimilarity], result of:
           0.009143496 = score(doc=2820,freq=3.0), product of:
             0.035715144 = queryWeight, product of:
               1.2825938 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011774542 = queryNorm
             0.25601172 = fieldWeight in 2820, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.034881677 = weight(abstract_txt:level in 2820) [ClassicSimilarity], result of:
           0.034881677 = score(doc=2820,freq=3.0), product of:
             0.07168335 = queryWeight, product of:
               1.3543653 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.011774542 = queryNorm
             0.48660782 = fieldWeight in 2820, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.1425004 = weight(abstract_txt:sentence in 2820) [ClassicSimilarity], result of:
           0.1425004 = score(doc=2820,freq=4.0), product of:
             0.16643749 = queryWeight, product of:
               2.0637271 = boost
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.011774542 = queryNorm
             0.85617965 = fieldWeight in 2820, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
       0.24 = coord(6/25)
   

5. Brito, M. de: Social affects engineering and ethics (2023) 0.07

   0.07499748 = sum of:
     0.07499748 = product of:
       0.624979 = sum of:
         0.026486816 = weight(abstract_txt:processing in 2137) [ClassicSimilarity], result of:
           0.026486816 = score(doc=2137,freq=1.0), product of:
             0.06883938 = queryWeight, product of:
               1.1871078 = boost
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.011774542 = queryNorm
             0.38476256 = fieldWeight in 2137, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.078125 = fieldNorm(doc=2137)
         0.0065987497 = weight(abstract_txt:that in 2137) [ClassicSimilarity], result of:
           0.0065987497 = score(doc=2137,freq=1.0), product of:
             0.035715144 = queryWeight, product of:
               1.2825938 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011774542 = queryNorm
             0.18476056 = fieldWeight in 2137, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=2137)
         0.59189343 = weight(abstract_txt:contradictions in 2137) [ClassicSimilarity], result of:
           0.59189343 = score(doc=2137,freq=1.0), product of:
             0.8485092 = queryWeight, product of:
               8.070782 = boost
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.011774542 = queryNorm
             0.69756866 = fieldWeight in 2137, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.928879 = idf(docFreq=15, maxDocs=44421)
               0.078125 = fieldNorm(doc=2137)
       0.12 = coord(3/25)