Document (#13157)

Author

Pirkola, A.
Jarvelin, K.

Title

¬The effect of anaphor and ellipsis resolution on proximity searching in a text database

Source

Information processing and management. 32(1996) no.2, S.199-216

Year

1995

Abstract

So far, methods for ellipsis and anaphor resolution have been developed and the effects of anaphor resolution have been analyzed in the context of statistical information retrieval of scientific abstracts. No significant improvements has been observed. Analyzes the effects of ellipsis and anaphor resolution on proximity searching in a full text database. Anaphora and ellipsis are classified on the basis of the type of their correlates / antecedents rather than, as traditional, on the basis of their own linguistic type. The classification differentiates proper names and common nouns of basic words, compound words, and phrases. The study was carried out in a newspaper article database containing 55.000 full text articles. A set of 154 keyword pairs in different categories was created. Human resolution of keyword ellipsis and anaphora was performed to identify sentences and paragraphs which would match proximity searches after resolution. Findings indicate that ellipsis and anaphor resolution is most relevant for proper name phrases and only marginal in the other keyword categories. Therefore the recall effect of restricted resolution of proper name phrases only was analyzed for keyword pairs containing at least 1 proper name phrase. Findings indicate a recall increase of 38.2% in sentence searches, and 28.8% in paragraph searches when proper name ellipsis were resolved. The recall increase was 17.6% sentence searches, and 19.8% in paragraph searches when proper name anaphora were resolved. Some simple and computationally justifiable resolution method might be developed only for proper name phrases to support keyword based full text information retrieval. Discusses elements of such a method

Theme

Retrievalstudien
Volltextretrieval

Similar documents (author)

1. Pirkola, A.: Morphological typology of languages for IR (2001) 5.94

   5.9401517 = sum of:
     5.9401517 = weight(author_txt:pirkola in 5476) [ClassicSimilarity], result of:
       5.9401517 = fieldWeight in 5476, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.625 = fieldNorm(doc=5476)
   

2. Pirkola, A.: Constructing topic-specific search keyphrase suggestion tools for Web information retrieval (2010) 5.94

   5.9401517 = sum of:
     5.9401517 = weight(author_txt:pirkola in 665) [ClassicSimilarity], result of:
       5.9401517 = fieldWeight in 665, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.625 = fieldNorm(doc=665)
   

3. Pirkola, A.; Järvelin, K.: Employing the resolution power of search keys (2001) 4.75

   4.7521214 = sum of:
     4.7521214 = weight(author_txt:pirkola in 6907) [ClassicSimilarity], result of:
       4.7521214 = fieldWeight in 6907, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.5 = fieldNorm(doc=6907)
   

4. Pirkola, A.; Puolamäki, D.; Järvelin, K.: Applying query structuring in cross-language retrieval (2003) 3.56

   3.5640912 = sum of:
     3.5640912 = weight(author_txt:pirkola in 2074) [ClassicSimilarity], result of:
       3.5640912 = fieldWeight in 2074, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.375 = fieldNorm(doc=2074)
   

5. Pirkola, A.; Hedlund, T.; Keskustalo, H.; Järvelin, K.: Dictionary-based cross-language information retrieval : problems, methods, and research findings (2001) 2.97

   2.9700758 = sum of:
     2.9700758 = weight(author_txt:pirkola in 4908) [ClassicSimilarity], result of:
       2.9700758 = fieldWeight in 4908, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.504243 = idf(docFreq=8, maxDocs=44421)
         0.3125 = fieldNorm(doc=4908)
   

Similar documents (content)

1. Steinberger, J.; Poesio, M.; Kabadjov, M.A.; Jezek, K.: Two uses of anaphora resolution in summarization (2007) 0.35

   0.34527332 = sum of:
     0.34527332 = product of:
       2.1579583 = sum of:
         0.061895173 = weight(abstract_txt:sentence in 1949) [ClassicSimilarity], result of:
           0.061895173 = score(doc=1949,freq=1.0), product of:
             0.11566764 = queryWeight, product of:
               1.291241 = boost
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.013078251 = queryNorm
             0.53511226 = fieldWeight in 1949, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.078125 = fieldNorm(doc=1949)
         1.3496066 = weight(title_txt:anaphora in 1949) [ClassicSimilarity], result of:
           1.3496066 = score(doc=1949,freq=1.0), product of:
             0.3631743 = queryWeight, product of:
               2.8022351 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.013078251 = queryNorm
             3.7161405 = fieldWeight in 1949, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.375 = fieldNorm(doc=1949)
         0.18829215 = weight(abstract_txt:proper in 1949) [ClassicSimilarity], result of:
           0.18829215 = score(doc=1949,freq=1.0), product of:
             0.36870995 = queryWeight, product of:
               4.312984 = boost
               6.5366817 = idf(docFreq=174, maxDocs=44421)
               0.013078251 = queryNorm
             0.51067823 = fieldWeight in 1949, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5366817 = idf(docFreq=174, maxDocs=44421)
               0.078125 = fieldNorm(doc=1949)
         0.5581644 = weight(abstract_txt:resolution in 1949) [ClassicSimilarity], result of:
           0.5581644 = score(doc=1949,freq=3.0), product of:
             0.5736485 = queryWeight, product of:
               6.1000104 = boost
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.013078251 = queryNorm
             0.9730077 = fieldWeight in 1949, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.078125 = fieldNorm(doc=1949)
       0.16 = coord(4/25)
   

2. Colavizza, G.; Boyack, K.W.; Eck, N.J. van; Waltman, L.: ¬The closer the better : similarity of publication pairs at different cocitation levels (2018) 0.17

   0.16613185 = sum of:
     0.16613185 = product of:
       0.59332806 = sum of:
         0.029418666 = weight(abstract_txt:indicate in 214) [ClassicSimilarity], result of:
           0.029418666 = score(doc=214,freq=1.0), product of:
             0.07044595 = queryWeight, product of:
               1.0076957 = boost
               5.34536 = idf(docFreq=575, maxDocs=44421)
               0.013078251 = queryNorm
             0.41760623 = fieldWeight in 214, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.34536 = idf(docFreq=575, maxDocs=44421)
               0.078125 = fieldNorm(doc=214)
         0.033969756 = weight(abstract_txt:increase in 214) [ClassicSimilarity], result of:
           0.033969756 = score(doc=214,freq=1.0), product of:
             0.0775358 = queryWeight, product of:
               1.0571887 = boost
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.013078251 = queryNorm
             0.43811703 = fieldWeight in 214, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.078125 = fieldNorm(doc=214)
         0.06026617 = weight(abstract_txt:pairs in 214) [ClassicSimilarity], result of:
           0.06026617 = score(doc=214,freq=1.0), product of:
             0.113629155 = queryWeight, product of:
               1.2798123 = boost
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.013078251 = queryNorm
             0.53037596 = fieldWeight in 214, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.078125 = fieldNorm(doc=214)
         0.087533005 = weight(abstract_txt:sentence in 214) [ClassicSimilarity], result of:
           0.087533005 = score(doc=214,freq=2.0), product of:
             0.11566764 = queryWeight, product of:
               1.291241 = boost
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.013078251 = queryNorm
             0.7567631 = fieldWeight in 214, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.078125 = fieldNorm(doc=214)
         0.025418546 = weight(abstract_txt:text in 214) [ClassicSimilarity], result of:
           0.025418546 = score(doc=214,freq=1.0), product of:
             0.08051643 = queryWeight, product of:
               1.5235567 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.013078251 = queryNorm
             0.3156939 = fieldWeight in 214, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=214)
         0.24830411 = weight(abstract_txt:paragraph in 214) [ClassicSimilarity], result of:
           0.24830411 = score(doc=214,freq=3.0), product of:
             0.20248346 = queryWeight, product of:
               1.708426 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.013078251 = queryNorm
             1.2262933 = fieldWeight in 214, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.078125 = fieldNorm(doc=214)
         0.108417824 = weight(abstract_txt:proximity in 214) [ClassicSimilarity], result of:
           0.108417824 = score(doc=214,freq=1.0), product of:
             0.19239992 = queryWeight, product of:
               2.0396209 = boost
               7.212831 = idf(docFreq=88, maxDocs=44421)
               0.013078251 = queryNorm
             0.56350243 = fieldWeight in 214, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.212831 = idf(docFreq=88, maxDocs=44421)
               0.078125 = fieldNorm(doc=214)
       0.28 = coord(7/25)
   

3. Boyack, K.W.; Small, H.; Klavans, R.: Improving the accuracy of co-citation clustering using full text (2013) 0.15

   0.1475769 = sum of:
     0.1475769 = product of:
       0.46117783 = sum of:
         0.03065476 = weight(abstract_txt:effect in 2036) [ClassicSimilarity], result of:
           0.03065476 = score(doc=2036,freq=1.0), product of:
             0.07240568 = queryWeight, product of:
               1.0216161 = boost
               5.419201 = idf(docFreq=534, maxDocs=44421)
               0.013078251 = queryNorm
             0.42337507 = fieldWeight in 2036, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.419201 = idf(docFreq=534, maxDocs=44421)
               0.078125 = fieldNorm(doc=2036)
         0.013642917 = weight(abstract_txt:been in 2036) [ClassicSimilarity], result of:
           0.013642917 = score(doc=2036,freq=1.0), product of:
             0.04831433 = queryWeight, product of:
               1.0220803 = boost
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.013078251 = queryNorm
             0.2823783 = fieldWeight in 2036, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.078125 = fieldNorm(doc=2036)
         0.033969756 = weight(abstract_txt:increase in 2036) [ClassicSimilarity], result of:
           0.033969756 = score(doc=2036,freq=1.0), product of:
             0.0775358 = queryWeight, product of:
               1.0571887 = boost
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.013078251 = queryNorm
             0.43811703 = fieldWeight in 2036, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6078978 = idf(docFreq=442, maxDocs=44421)
               0.078125 = fieldNorm(doc=2036)
         0.03105335 = weight(abstract_txt:only in 2036) [ClassicSimilarity], result of:
           0.03105335 = score(doc=2036,freq=2.0), product of:
             0.06635394 = queryWeight, product of:
               1.1977892 = boost
               4.235812 = idf(docFreq=1746, maxDocs=44421)
               0.013078251 = queryNorm
             0.46799555 = fieldWeight in 2036, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.235812 = idf(docFreq=1746, maxDocs=44421)
               0.078125 = fieldNorm(doc=2036)
         0.06026617 = weight(abstract_txt:pairs in 2036) [ClassicSimilarity], result of:
           0.06026617 = score(doc=2036,freq=1.0), product of:
             0.113629155 = queryWeight, product of:
               1.2798123 = boost
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.013078251 = queryNorm
             0.53037596 = fieldWeight in 2036, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7888126 = idf(docFreq=135, maxDocs=44421)
               0.078125 = fieldNorm(doc=2036)
         0.059779502 = weight(abstract_txt:full in 2036) [ClassicSimilarity], result of:
           0.059779502 = score(doc=2036,freq=3.0), product of:
             0.08970133 = queryWeight, product of:
               1.3926643 = boost
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.013078251 = queryNorm
             0.66642827 = fieldWeight in 2036, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9249606 = idf(docFreq=876, maxDocs=44421)
               0.078125 = fieldNorm(doc=2036)
         0.04402621 = weight(abstract_txt:text in 2036) [ClassicSimilarity], result of:
           0.04402621 = score(doc=2036,freq=3.0), product of:
             0.08051643 = queryWeight, product of:
               1.5235567 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.013078251 = queryNorm
             0.5467979 = fieldWeight in 2036, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.078125 = fieldNorm(doc=2036)
         0.18778516 = weight(abstract_txt:proximity in 2036) [ClassicSimilarity], result of:
           0.18778516 = score(doc=2036,freq=3.0), product of:
             0.19239992 = queryWeight, product of:
               2.0396209 = boost
               7.212831 = idf(docFreq=88, maxDocs=44421)
               0.013078251 = queryNorm
             0.9760148 = fieldWeight in 2036, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.212831 = idf(docFreq=88, maxDocs=44421)
               0.078125 = fieldNorm(doc=2036)
       0.32 = coord(8/25)
   

4. Bonzi, S.: Representation of concepts in text : a comparison of within-document frequency, anaphora, and synonymy (1991) 0.14

   0.13807382 = sum of:
     0.13807382 = product of:
       1.1506152 = sum of:
         0.030502256 = weight(abstract_txt:text in 4932) [ClassicSimilarity], result of:
           0.030502256 = score(doc=4932,freq=1.0), product of:
             0.08051643 = queryWeight, product of:
               1.5235567 = boost
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.013078251 = queryNorm
             0.3788327 = fieldWeight in 4932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.040882 = idf(docFreq=2122, maxDocs=44421)
               0.09375 = fieldNorm(doc=4932)
         0.8997378 = weight(title_txt:anaphora in 4932) [ClassicSimilarity], result of:
           0.8997378 = score(doc=4932,freq=1.0), product of:
             0.3631743 = queryWeight, product of:
               2.8022351 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.013078251 = queryNorm
             2.477427 = fieldWeight in 4932, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.25 = fieldNorm(doc=4932)
         0.22037521 = weight(abstract_txt:keyword in 4932) [ClassicSimilarity], result of:
           0.22037521 = score(doc=4932,freq=3.0), product of:
             0.2247508 = queryWeight, product of:
               2.8459158 = boost
               6.038507 = idf(docFreq=287, maxDocs=44421)
               0.013078251 = queryNorm
             0.98053133 = fieldWeight in 4932, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.038507 = idf(docFreq=287, maxDocs=44421)
               0.09375 = fieldNorm(doc=4932)
       0.12 = coord(3/25)
   

5. Wu, D.-S.; Liang, T.: Chinese pronominal anaphora resolution using lexical knowledge and entropy-based weight (2008) 0.12

   0.115729995 = sum of:
     0.115729995 = product of:
       1.446625 = sum of:
         0.8997378 = weight(title_txt:anaphora in 3367) [ClassicSimilarity], result of:
           0.8997378 = score(doc=3367,freq=1.0), product of:
             0.3631743 = queryWeight, product of:
               2.8022351 = boost
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.013078251 = queryNorm
             2.477427 = fieldWeight in 3367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.909708 = idf(docFreq=5, maxDocs=44421)
               0.25 = fieldNorm(doc=3367)
         0.54688716 = weight(abstract_txt:resolution in 3367) [ClassicSimilarity], result of:
           0.54688716 = score(doc=3367,freq=2.0), product of:
             0.5736485 = queryWeight, product of:
               6.1000104 = boost
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.013078251 = queryNorm
             0.9533489 = fieldWeight in 3367, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.09375 = fieldNorm(doc=3367)
       0.08 = coord(2/25)