Document (#21251)

Author

Rey, J.

Title

Discourse markers : a challenge for natural language processing

Source

AI communications. 10(1997) nos.3/4, S.177-184

Year

1997

Abstract

Analyses the role-played by discourse markers in any communication process and the complex process involved in translating them. The analysis is conducted from a pragmatic standpoint and stresses the importance of context in determining the preference for 1 marker over another. Illustrates this process, presenting examples in both French and English. Makes suggestions on parameters, which should be taken into consideration for natural language processing applications

Theme

Computerlinguistik

Similar documents (content)

1. Hawes, T.; Lin, J.; Resnik, P.: Elements of a computational model for multi-party discourse : the turn-taking behavior of Supreme Court justices (2009) 0.18

   0.18218112 = sum of:
     0.18218112 = product of:
       0.9109056 = sum of:
         0.04938351 = weight(abstract_txt:language in 74) [ClassicSimilarity], result of:
           0.04938351 = score(doc=74,freq=1.0), product of:
             0.12629083 = queryWeight, product of:
               1.5231173 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.01987923 = queryNorm
             0.39103007 = fieldWeight in 74, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.09375 = fieldNorm(doc=74)
         0.08129682 = weight(abstract_txt:processing in 74) [ClassicSimilarity], result of:
           0.08129682 = score(doc=74,freq=1.0), product of:
             0.17607574 = queryWeight, product of:
               1.7984452 = boost
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.01987923 = queryNorm
             0.46171504 = fieldWeight in 74, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.09375 = fieldNorm(doc=74)
         0.08866492 = weight(abstract_txt:natural in 74) [ClassicSimilarity], result of:
           0.08866492 = score(doc=74,freq=1.0), product of:
             0.18655993 = queryWeight, product of:
               1.851214 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.01987923 = queryNorm
             0.4752624 = fieldWeight in 74, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.09375 = fieldNorm(doc=74)
         0.23453996 = weight(abstract_txt:discourse in 74) [ClassicSimilarity], result of:
           0.23453996 = score(doc=74,freq=2.0), product of:
             0.2832164 = queryWeight, product of:
               2.2809021 = boost
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.01987923 = queryNorm
             0.8281299 = fieldWeight in 74, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.09375 = fieldNorm(doc=74)
         0.4570204 = weight(abstract_txt:markers in 74) [ClassicSimilarity], result of:
           0.4570204 = score(doc=74,freq=1.0), product of:
             0.55668247 = queryWeight, product of:
               3.1977994 = boost
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.01987923 = queryNorm
             0.8209714 = fieldWeight in 74, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.757029 = idf(docFreq=18, maxDocs=44421)
               0.09375 = fieldNorm(doc=74)
       0.2 = coord(5/25)
   

2. Park, J.-r.: Evolution of concept networks and implications for knowledge representation (2007) 0.15

   0.1467549 = sum of:
     0.1467549 = product of:
       0.6114788 = sum of:
         0.07314756 = weight(abstract_txt:parameters in 1847) [ClassicSimilarity], result of:
           0.07314756 = score(doc=1847,freq=1.0), product of:
             0.1706742 = queryWeight, product of:
               1.2520348 = boost
               6.8572807 = idf(docFreq=126, maxDocs=44421)
               0.01987923 = queryNorm
             0.42858005 = fieldWeight in 1847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8572807 = idf(docFreq=126, maxDocs=44421)
               0.0625 = fieldNorm(doc=1847)
         0.15389863 = weight(abstract_txt:pragmatic in 1847) [ClassicSimilarity], result of:
           0.15389863 = score(doc=1847,freq=4.0), product of:
             0.17653784 = queryWeight, product of:
               1.2733605 = boost
               6.9740796 = idf(docFreq=112, maxDocs=44421)
               0.01987923 = queryNorm
             0.87175995 = fieldWeight in 1847, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.9740796 = idf(docFreq=112, maxDocs=44421)
               0.0625 = fieldNorm(doc=1847)
         0.032922342 = weight(abstract_txt:language in 1847) [ClassicSimilarity], result of:
           0.032922342 = score(doc=1847,freq=1.0), product of:
             0.12629083 = queryWeight, product of:
               1.5231173 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.01987923 = queryNorm
             0.26068673 = fieldWeight in 1847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=1847)
         0.05910995 = weight(abstract_txt:natural in 1847) [ClassicSimilarity], result of:
           0.05910995 = score(doc=1847,freq=1.0), product of:
             0.18655993 = queryWeight, product of:
               1.851214 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.01987923 = queryNorm
             0.3168416 = fieldWeight in 1847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.0625 = fieldNorm(doc=1847)
         0.04517348 = weight(abstract_txt:process in 1847) [ClassicSimilarity], result of:
           0.04517348 = score(doc=1847,freq=1.0), product of:
             0.17851065 = queryWeight, product of:
               2.2178142 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.01987923 = queryNorm
             0.25305763 = fieldWeight in 1847, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=1847)
         0.2472268 = weight(abstract_txt:discourse in 1847) [ClassicSimilarity], result of:
           0.2472268 = score(doc=1847,freq=5.0), product of:
             0.2832164 = queryWeight, product of:
               2.2809021 = boost
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.01987923 = queryNorm
             0.8729255 = fieldWeight in 1847, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.0625 = fieldNorm(doc=1847)
       0.24 = coord(6/25)
   

3. Teixera Lopes, C.; Ribeiro, C.: Measuring the value of health query translation : An analysis by user language proficiency (2013) 0.11

   0.10740632 = sum of:
     0.10740632 = product of:
       0.44752634 = sum of:
         0.03853353 = weight(abstract_txt:makes in 1739) [ClassicSimilarity], result of:
           0.03853353 = score(doc=1739,freq=1.0), product of:
             0.1113253 = queryWeight, product of:
               1.0111822 = boost
               5.5381527 = idf(docFreq=474, maxDocs=44421)
               0.01987923 = queryNorm
             0.34613454 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5381527 = idf(docFreq=474, maxDocs=44421)
               0.0625 = fieldNorm(doc=1739)
         0.11115518 = weight(abstract_txt:english in 1739) [ClassicSimilarity], result of:
           0.11115518 = score(doc=1739,freq=8.0), product of:
             0.11279534 = queryWeight, product of:
               1.0178366 = boost
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.01987923 = queryNorm
             0.985459 = fieldWeight in 1739, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.5745983 = idf(docFreq=457, maxDocs=44421)
               0.0625 = fieldNorm(doc=1739)
         0.048862074 = weight(abstract_txt:suggestions in 1739) [ClassicSimilarity], result of:
           0.048862074 = score(doc=1739,freq=1.0), product of:
             0.13042152 = queryWeight, product of:
               1.0944781 = boost
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.01987923 = queryNorm
             0.37464732 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.994357 = idf(docFreq=300, maxDocs=44421)
               0.0625 = fieldNorm(doc=1739)
         0.116697766 = weight(abstract_txt:translating in 1739) [ClassicSimilarity], result of:
           0.116697766 = score(doc=1739,freq=1.0), product of:
             0.23302884 = queryWeight, product of:
               1.4629763 = boost
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.01987923 = queryNorm
             0.5007868 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.0125885 = idf(docFreq=39, maxDocs=44421)
               0.0625 = fieldNorm(doc=1739)
         0.08710433 = weight(abstract_txt:language in 1739) [ClassicSimilarity], result of:
           0.08710433 = score(doc=1739,freq=7.0), product of:
             0.12629083 = queryWeight, product of:
               1.5231173 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.01987923 = queryNorm
             0.6897122 = fieldWeight in 1739, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.0625 = fieldNorm(doc=1739)
         0.04517348 = weight(abstract_txt:process in 1739) [ClassicSimilarity], result of:
           0.04517348 = score(doc=1739,freq=1.0), product of:
             0.17851065 = queryWeight, product of:
               2.2178142 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.01987923 = queryNorm
             0.25305763 = fieldWeight in 1739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.0625 = fieldNorm(doc=1739)
       0.24 = coord(6/25)
   

4. Sabah, G.: Knowledge representation and natural language understanding (1993) 0.10

   0.10379814 = sum of:
     0.10379814 = product of:
       0.5189907 = sum of:
         0.11542397 = weight(abstract_txt:pragmatic in 7024) [ClassicSimilarity], result of:
           0.11542397 = score(doc=7024,freq=1.0), product of:
             0.17653784 = queryWeight, product of:
               1.2733605 = boost
               6.9740796 = idf(docFreq=112, maxDocs=44421)
               0.01987923 = queryNorm
             0.65382 = fieldWeight in 7024, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9740796 = idf(docFreq=112, maxDocs=44421)
               0.09375 = fieldNorm(doc=7024)
         0.08129682 = weight(abstract_txt:processing in 7024) [ClassicSimilarity], result of:
           0.08129682 = score(doc=7024,freq=1.0), product of:
             0.17607574 = queryWeight, product of:
               1.7984452 = boost
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.01987923 = queryNorm
             0.46171504 = fieldWeight in 7024, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.09375 = fieldNorm(doc=7024)
         0.08866492 = weight(abstract_txt:natural in 7024) [ClassicSimilarity], result of:
           0.08866492 = score(doc=7024,freq=1.0), product of:
             0.18655993 = queryWeight, product of:
               1.851214 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.01987923 = queryNorm
             0.4752624 = fieldWeight in 7024, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.09375 = fieldNorm(doc=7024)
         0.06776023 = weight(abstract_txt:process in 7024) [ClassicSimilarity], result of:
           0.06776023 = score(doc=7024,freq=1.0), product of:
             0.17851065 = queryWeight, product of:
               2.2178142 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.01987923 = queryNorm
             0.37958646 = fieldWeight in 7024, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.09375 = fieldNorm(doc=7024)
         0.16584478 = weight(abstract_txt:discourse in 7024) [ClassicSimilarity], result of:
           0.16584478 = score(doc=7024,freq=1.0), product of:
             0.2832164 = queryWeight, product of:
               2.2809021 = boost
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.01987923 = queryNorm
             0.58557624 = fieldWeight in 7024, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2461467 = idf(docFreq=233, maxDocs=44421)
               0.09375 = fieldNorm(doc=7024)
       0.2 = coord(5/25)
   

5. Schubert, K.: Parameters for the design of an intermediate language for multilingual thesauri (1995) 0.10

   0.10270176 = sum of:
     0.10270176 = product of:
       0.427924 = sum of:
         0.046943657 = weight(abstract_txt:taken in 2160) [ClassicSimilarity], result of:
           0.046943657 = score(doc=2160,freq=1.0), product of:
             0.1094324 = queryWeight, product of:
               1.0025486 = boost
               5.4908676 = idf(docFreq=497, maxDocs=44421)
               0.01987923 = queryNorm
             0.42897403 = fieldWeight in 2160, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4908676 = idf(docFreq=497, maxDocs=44421)
               0.078125 = fieldNorm(doc=2160)
         0.06996769 = weight(abstract_txt:consideration in 2160) [ClassicSimilarity], result of:
           0.06996769 = score(doc=2160,freq=1.0), product of:
             0.14278843 = queryWeight, product of:
               1.1451937 = boost
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.01987923 = queryNorm
             0.49000952 = fieldWeight in 2160, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.272122 = idf(docFreq=227, maxDocs=44421)
               0.078125 = fieldNorm(doc=2160)
         0.082305856 = weight(abstract_txt:language in 2160) [ClassicSimilarity], result of:
           0.082305856 = score(doc=2160,freq=4.0), product of:
             0.12629083 = queryWeight, product of:
               1.5231173 = boost
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.01987923 = queryNorm
             0.6517168 = fieldWeight in 2160, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1709876 = idf(docFreq=1863, maxDocs=44421)
               0.078125 = fieldNorm(doc=2160)
         0.067747355 = weight(abstract_txt:processing in 2160) [ClassicSimilarity], result of:
           0.067747355 = score(doc=2160,freq=1.0), product of:
             0.17607574 = queryWeight, product of:
               1.7984452 = boost
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.01987923 = queryNorm
             0.38476256 = fieldWeight in 2160, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.078125 = fieldNorm(doc=2160)
         0.10449261 = weight(abstract_txt:natural in 2160) [ClassicSimilarity], result of:
           0.10449261 = score(doc=2160,freq=2.0), product of:
             0.18655993 = queryWeight, product of:
               1.851214 = boost
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.01987923 = queryNorm
             0.5601021 = fieldWeight in 2160, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.0694656 = idf(docFreq=758, maxDocs=44421)
               0.078125 = fieldNorm(doc=2160)
         0.05646685 = weight(abstract_txt:process in 2160) [ClassicSimilarity], result of:
           0.05646685 = score(doc=2160,freq=1.0), product of:
             0.17851065 = queryWeight, product of:
               2.2178142 = boost
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.01987923 = queryNorm
             0.31632203 = fieldWeight in 2160, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.048922 = idf(docFreq=2105, maxDocs=44421)
               0.078125 = fieldNorm(doc=2160)
       0.24 = coord(6/25)