Document (#32933)

Author

Sparck Jones, K.

Title

Automatic summarising : the state of the art

Source

Information processing and management. 43(2007) no.6, S.1449-1481

Year

2007

Abstract

This paper reviews research on automatic summarising in the last decade. This work has grown, stimulated by technology and by evaluation programmes. The paper uses several frameworks to organise the review, for summarising itself, for the factors affecting summarising, for systems, and for evaluation. The review examines the evaluation strategies applied to summarising, the issues they raise, and the major programmes. It considers the input, purpose and output factors investigated in recent summarising research, and discusses the classes of strategy, extractive and non-extractive, that have been explored, illustrating the range of systems built. The conclusions drawn are that automatic summarisation has made valuable progress, with useful applications, better evaluation, and more task understanding. But summarising systems are still poorly motivated in relation to the factors affecting them, and evaluation needs taking much further to engage with the purposes summaries are intended to serve and the contexts in which they are used.

Theme

Automatisches Abstracting

Similar documents (author)

1. Sparck Jones, K.: Fashionable trends and feasible strategies in information management (1988) 5.31

   5.3145585 = sum of:
     5.3145585 = sum of:
       2.0560415 = weight(author_txt:jones in 816) [ClassicSimilarity], result of:
         2.0560415 = score(doc=816,freq=1.0), product of:
           0.5925794 = queryWeight, product of:
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.08539477 = queryNorm
           3.469647 = fieldWeight in 816, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.5 = fieldNorm(doc=816)
       3.258517 = weight(author_txt:sparck in 816) [ClassicSimilarity], result of:
         3.258517 = score(doc=816,freq=1.0), product of:
           0.80551195 = queryWeight, product of:
             1.1659038 = boost
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.08539477 = queryNorm
           4.0452747 = fieldWeight in 816, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.5 = fieldNorm(doc=816)
   

2. Sparck Jones, K.: Automatic classification (1976) 5.31

   5.3145585 = sum of:
     5.3145585 = sum of:
       2.0560415 = weight(author_txt:jones in 2907) [ClassicSimilarity], result of:
         2.0560415 = score(doc=2907,freq=1.0), product of:
           0.5925794 = queryWeight, product of:
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.08539477 = queryNorm
           3.469647 = fieldWeight in 2907, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.5 = fieldNorm(doc=2907)
       3.258517 = weight(author_txt:sparck in 2907) [ClassicSimilarity], result of:
         3.258517 = score(doc=2907,freq=1.0), product of:
           0.80551195 = queryWeight, product of:
             1.1659038 = boost
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.08539477 = queryNorm
           4.0452747 = fieldWeight in 2907, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.5 = fieldNorm(doc=2907)
   

3. Sparck Jones, K.: ¬The role of artificial intelligence in information retrieval (1991) 5.31

   5.3145585 = sum of:
     5.3145585 = sum of:
       2.0560415 = weight(author_txt:jones in 4810) [ClassicSimilarity], result of:
         2.0560415 = score(doc=4810,freq=1.0), product of:
           0.5925794 = queryWeight, product of:
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.08539477 = queryNorm
           3.469647 = fieldWeight in 4810, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.5 = fieldNorm(doc=4810)
       3.258517 = weight(author_txt:sparck in 4810) [ClassicSimilarity], result of:
         3.258517 = score(doc=4810,freq=1.0), product of:
           0.80551195 = queryWeight, product of:
             1.1659038 = boost
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.08539477 = queryNorm
           4.0452747 = fieldWeight in 4810, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.5 = fieldNorm(doc=4810)
   

4. Sparck Jones, K.: Automatic keyword classification for information retrieval (1971) 5.31

   5.3145585 = sum of:
     5.3145585 = sum of:
       2.0560415 = weight(author_txt:jones in 5175) [ClassicSimilarity], result of:
         2.0560415 = score(doc=5175,freq=1.0), product of:
           0.5925794 = queryWeight, product of:
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.08539477 = queryNorm
           3.469647 = fieldWeight in 5175, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.5 = fieldNorm(doc=5175)
       3.258517 = weight(author_txt:sparck in 5175) [ClassicSimilarity], result of:
         3.258517 = score(doc=5175,freq=1.0), product of:
           0.80551195 = queryWeight, product of:
             1.1659038 = boost
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.08539477 = queryNorm
           4.0452747 = fieldWeight in 5175, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.5 = fieldNorm(doc=5175)
   

5. Sparck Jones, K.: ¬A statistical interpretation of term specifity and its application in retrieval (1972) 5.31

   5.3145585 = sum of:
     5.3145585 = sum of:
       2.0560415 = weight(author_txt:jones in 5186) [ClassicSimilarity], result of:
         2.0560415 = score(doc=5186,freq=1.0), product of:
           0.5925794 = queryWeight, product of:
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.08539477 = queryNorm
           3.469647 = fieldWeight in 5186, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             6.939294 = idf(docFreq=116, maxDocs=44421)
             0.5 = fieldNorm(doc=5186)
       3.258517 = weight(author_txt:sparck in 5186) [ClassicSimilarity], result of:
         3.258517 = score(doc=5186,freq=1.0), product of:
           0.80551195 = queryWeight, product of:
             1.1659038 = boost
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.08539477 = queryNorm
           4.0452747 = fieldWeight in 5186, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.090549 = idf(docFreq=36, maxDocs=44421)
             0.5 = fieldNorm(doc=5186)
   

Similar documents (content)

1. Endres-Niggemeyer, B.: Summarising text for intelligent communication : results of the Dagstuhl seminar (1994) 0.27

   0.26935443 = sum of:
     0.26935443 = product of:
       1.6834652 = sum of:
         0.009862901 = weight(abstract_txt:research in 481) [ClassicSimilarity], result of:
           0.009862901 = score(doc=481,freq=2.0), product of:
             0.028253354 = queryWeight, product of:
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.008942118 = queryNorm
             0.34908777 = fieldWeight in 481, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.078125 = fieldNorm(doc=481)
         0.08655209 = weight(abstract_txt:summarisation in 481) [ClassicSimilarity], result of:
           0.08655209 = score(doc=481,freq=1.0), product of:
             0.12020392 = queryWeight, product of:
               1.4585097 = boost
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.008942118 = queryNorm
             0.72004384 = fieldWeight in 481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.216561 = idf(docFreq=11, maxDocs=44421)
               0.078125 = fieldNorm(doc=481)
         0.013164491 = weight(abstract_txt:systems in 481) [ClassicSimilarity], result of:
           0.013164491 = score(doc=481,freq=1.0), product of:
             0.049398076 = queryWeight, product of:
               1.6194429 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.008942118 = queryNorm
             0.26649806 = fieldWeight in 481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.078125 = fieldNorm(doc=481)
         1.5738858 = weight(abstract_txt:summarising in 481) [ClassicSimilarity], result of:
           1.5738858 = score(doc=481,freq=6.0), product of:
             0.87504685 = queryWeight, product of:
               10.411533 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.008942118 = queryNorm
             1.7986304 = fieldWeight in 481, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.078125 = fieldNorm(doc=481)
       0.16 = coord(4/25)
   

2. Macgregor, G.; McCulloch, E.: Collaborative tagging as a knowledge organisation and resource discovery tool (2006) 0.13

   0.12716109 = sum of:
     0.12716109 = product of:
       0.52983785 = sum of:
         0.008455675 = weight(abstract_txt:research in 889) [ClassicSimilarity], result of:
           0.008455675 = score(doc=889,freq=3.0), product of:
             0.028253354 = queryWeight, product of:
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.008942118 = queryNorm
             0.2992804 = fieldWeight in 889, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=889)
         0.024533924 = weight(abstract_txt:engage in 889) [ClassicSimilarity], result of:
           0.024533924 = score(doc=889,freq=1.0), product of:
             0.06579298 = queryWeight, product of:
               1.0790455 = boost
               6.8186655 = idf(docFreq=131, maxDocs=44421)
               0.008942118 = queryNorm
             0.37289578 = fieldWeight in 889, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8186655 = idf(docFreq=131, maxDocs=44421)
               0.0546875 = fieldNorm(doc=889)
         0.011119723 = weight(abstract_txt:paper in 889) [ClassicSimilarity], result of:
           0.011119723 = score(doc=889,freq=3.0), product of:
             0.033913072 = queryWeight, product of:
               1.0955913 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.008942118 = queryNorm
             0.327889 = fieldWeight in 889, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0546875 = fieldNorm(doc=889)
         0.0175229 = weight(abstract_txt:review in 889) [ClassicSimilarity], result of:
           0.0175229 = score(doc=889,freq=1.0), product of:
             0.06623419 = queryWeight, product of:
               1.531109 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.008942118 = queryNorm
             0.26455975 = fieldWeight in 889, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0546875 = fieldNorm(doc=889)
         0.018430287 = weight(abstract_txt:systems in 889) [ClassicSimilarity], result of:
           0.018430287 = score(doc=889,freq=4.0), product of:
             0.049398076 = queryWeight, product of:
               1.6194429 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.008942118 = queryNorm
             0.37309727 = fieldWeight in 889, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0546875 = fieldNorm(doc=889)
         0.44977534 = weight(abstract_txt:summarising in 889) [ClassicSimilarity], result of:
           0.44977534 = score(doc=889,freq=1.0), product of:
             0.87504685 = queryWeight, product of:
               10.411533 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.008942118 = queryNorm
             0.5140014 = fieldWeight in 889, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.0546875 = fieldNorm(doc=889)
       0.24 = coord(6/25)
   

3. Liang, S.-F.; Devlin, S.; Tait, J.: Investigating sentence weighting components for automatic summarisation (2007) 0.09

   0.086215526 = sum of:
     0.086215526 = product of:
       0.7184627 = sum of:
         0.009171394 = weight(abstract_txt:paper in 1899) [ClassicSimilarity], result of:
           0.009171394 = score(doc=1899,freq=1.0), product of:
             0.033913072 = queryWeight, product of:
               1.0955913 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.008942118 = queryNorm
             0.2704383 = fieldWeight in 1899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.078125 = fieldNorm(doc=1899)
         0.066755116 = weight(abstract_txt:summaries in 1899) [ClassicSimilarity], result of:
           0.066755116 = score(doc=1899,freq=3.0), product of:
             0.070094325 = queryWeight, product of:
               1.1137595 = boost
               7.0380287 = idf(docFreq=105, maxDocs=44421)
               0.008942118 = queryNorm
             0.95236117 = fieldWeight in 1899, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0380287 = idf(docFreq=105, maxDocs=44421)
               0.078125 = fieldNorm(doc=1899)
         0.64253616 = weight(abstract_txt:summarising in 1899) [ClassicSimilarity], result of:
           0.64253616 = score(doc=1899,freq=1.0), product of:
             0.87504685 = queryWeight, product of:
               10.411533 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.008942118 = queryNorm
             0.73428774 = fieldWeight in 1899, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.078125 = fieldNorm(doc=1899)
       0.12 = coord(3/25)
   

4. Vanderwende, L.; Suzuki, H.; Brockett, J.M.; Nenkova, A.: Beyond SumBasic : task-focused summarization with sentence simplification and lexical expansion (2007) 0.08

   0.081494175 = sum of:
     0.081494175 = product of:
       0.33955908 = sum of:
         0.0073371152 = weight(abstract_txt:paper in 1948) [ClassicSimilarity], result of:
           0.0073371152 = score(doc=1948,freq=1.0), product of:
             0.033913072 = queryWeight, product of:
               1.0955913 = boost
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.008942118 = queryNorm
             0.21635064 = fieldWeight in 1948, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4616103 = idf(docFreq=3788, maxDocs=44421)
               0.0625 = fieldNorm(doc=1948)
         0.05340409 = weight(abstract_txt:summaries in 1948) [ClassicSimilarity], result of:
           0.05340409 = score(doc=1948,freq=3.0), product of:
             0.070094325 = queryWeight, product of:
               1.1137595 = boost
               7.0380287 = idf(docFreq=105, maxDocs=44421)
               0.008942118 = queryNorm
             0.7618889 = fieldWeight in 1948, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0380287 = idf(docFreq=105, maxDocs=44421)
               0.0625 = fieldNorm(doc=1948)
         0.014893921 = weight(abstract_txt:systems in 1948) [ClassicSimilarity], result of:
           0.014893921 = score(doc=1948,freq=2.0), product of:
             0.049398076 = queryWeight, product of:
               1.6194429 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.008942118 = queryNorm
             0.30150813 = fieldWeight in 1948, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.0625 = fieldNorm(doc=1948)
         0.052629 = weight(abstract_txt:automatic in 1948) [ClassicSimilarity], result of:
           0.052629 = score(doc=1948,freq=2.0), product of:
             0.11460074 = queryWeight, product of:
               2.466632 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.008942118 = queryNorm
             0.45923787 = fieldWeight in 1948, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=1948)
         0.14244264 = weight(abstract_txt:extractive in 1948) [ClassicSimilarity], result of:
           0.14244264 = score(doc=1948,freq=1.0), product of:
             0.24496852 = queryWeight, product of:
               2.9445581 = boost
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.008942118 = queryNorm
             0.5814733 = fieldWeight in 1948, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.0625 = fieldNorm(doc=1948)
         0.06885229 = weight(abstract_txt:evaluation in 1948) [ClassicSimilarity], result of:
           0.06885229 = score(doc=1948,freq=3.0), product of:
             0.1419827 = queryWeight, product of:
               3.5444815 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.008942118 = queryNorm
             0.48493436 = fieldWeight in 1948, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=1948)
       0.24 = coord(6/25)
   

5. Hirao, T.; Okumura, M.; Yasuda, N.; Isozaki, H.: Supervised automatic evaluation for summarization with voted regression model (2007) 0.07

   0.0667597 = sum of:
     0.0667597 = product of:
       0.33379847 = sum of:
         0.054505326 = weight(abstract_txt:summaries in 1942) [ClassicSimilarity], result of:
           0.054505326 = score(doc=1942,freq=2.0), product of:
             0.070094325 = queryWeight, product of:
               1.1137595 = boost
               7.0380287 = idf(docFreq=105, maxDocs=44421)
               0.008942118 = queryNorm
             0.7775997 = fieldWeight in 1942, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0380287 = idf(docFreq=105, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.011639364 = weight(abstract_txt:they in 1942) [ClassicSimilarity], result of:
           0.011639364 = score(doc=1942,freq=1.0), product of:
             0.039752375 = queryWeight, product of:
               1.1861689 = boost
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.008942118 = queryNorm
             0.2927967 = fieldWeight in 1942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.013164491 = weight(abstract_txt:systems in 1942) [ClassicSimilarity], result of:
           0.013164491 = score(doc=1942,freq=1.0), product of:
             0.049398076 = queryWeight, product of:
               1.6194429 = boost
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.008942118 = queryNorm
             0.26649806 = fieldWeight in 1942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.411175 = idf(docFreq=3984, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.11394514 = weight(abstract_txt:automatic in 1942) [ClassicSimilarity], result of:
           0.11394514 = score(doc=1942,freq=6.0), product of:
             0.11460074 = queryWeight, product of:
               2.466632 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.008942118 = queryNorm
             0.99427927 = fieldWeight in 1942, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
         0.14054415 = weight(abstract_txt:evaluation in 1942) [ClassicSimilarity], result of:
           0.14054415 = score(doc=1942,freq=8.0), product of:
             0.1419827 = queryWeight, product of:
               3.5444815 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.008942118 = queryNorm
             0.9898681 = fieldWeight in 1942, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=1942)
       0.2 = coord(5/25)