Document (#32949)

Author

Vanderwende, L.
Suzuki, H.
Brockett, J.M.
Nenkova, A.

Title

Beyond SumBasic : task-focused summarization with sentence simplification and lexical expansion

Source

Information processing and management. 43(2007) no.6, S.1606-1618

Year

2007

Abstract

In recent years, there has been increased interest in topic-focused multi-document summarization. In this task, automatic summaries are produced in response to a specific information request, or topic, stated by the user. The system we have designed to accomplish this task comprises four main components: a generic extractive summarization system, a topic-focusing component, sentence simplification, and lexical expansion of topic words. This paper details each of these components, together with experiments designed to quantify their individual contributions. We include an analysis of our results on two large datasets commonly used to evaluate task-focused summarization, the DUC2005 and DUC2006 datasets, using automatic metrics. Additionally, we include an analysis of our results on the DUC2006 task according to human evaluation metrics. In the human evaluation of system summaries compared to human summaries, i.e., the Pyramid method, our system ranked first out of 22 systems in terms of overall mean Pyramid score; and in the human evaluation of summary responsiveness to the topic, our system ranked third out of 35 systems.

Theme

Automatisches Abstracting

Similar documents (author)

1. Suzuki, Y.: Partial information and its information structure (1995) 6.19

   6.190705 = sum of:
     6.190705 = weight(author_txt:suzuki in 6584) [ClassicSimilarity], result of:
       6.190705 = fieldWeight in 6584, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.905128 = idf(docFreq=5, maxDocs=44218)
         0.625 = fieldNorm(doc=6584)
   

2. Suzuki, T.: Extracting speaker-specific functional expressions from political speeches using random forests in order to investigate speakers' political styles (2009) 6.19

   6.190705 = sum of:
     6.190705 = weight(author_txt:suzuki in 2949) [ClassicSimilarity], result of:
       6.190705 = fieldWeight in 2949, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.905128 = idf(docFreq=5, maxDocs=44218)
         0.625 = fieldNorm(doc=2949)
   

3. Kawamura, S.; Otake, Y.-H.; Suzuki, T.: ¬The structure of the hyperlink network formed by the Web pages of Japanese public libraries (2009) 3.71

   3.7144227 = sum of:
     3.7144227 = weight(author_txt:suzuki in 2845) [ClassicSimilarity], result of:
       3.7144227 = fieldWeight in 2845, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.905128 = idf(docFreq=5, maxDocs=44218)
         0.375 = fieldNorm(doc=2845)
   

4. Arakawa, Y.; Kameda, A.; Aizawa, A.; Suzuki, T.: Adding Twitter-specific features to stylistic features for classifying tweets by user type and number of retweets (2014) 3.10

   3.0953524 = sum of:
     3.0953524 = weight(author_txt:suzuki in 1307) [ClassicSimilarity], result of:
       3.0953524 = fieldWeight in 1307, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.905128 = idf(docFreq=5, maxDocs=44218)
         0.3125 = fieldNorm(doc=1307)
   

Similar documents (content)

1. Dunlavy, D.M.; O'Leary, D.P.; Conroy, J.M.; Schlesinger, J.D.: QCS: A system for querying, clustering and summarizing documents (2007) 0.38

   0.3798151 = sum of:
     0.3798151 = product of:
       0.86321616 = sum of:
         0.0108513115 = weight(abstract_txt:analysis in 947) [ClassicSimilarity], result of:
           0.0108513115 = score(doc=947,freq=1.0), product of:
             0.054309987 = queryWeight, product of:
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.01486501 = queryNorm
             0.19980325 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.03801405 = weight(abstract_txt:designed in 947) [ClassicSimilarity], result of:
           0.03801405 = score(doc=947,freq=2.0), product of:
             0.09942852 = queryWeight, product of:
               1.3530556 = boost
               4.9434495 = idf(docFreq=856, maxDocs=44218)
               0.01486501 = queryNorm
             0.3823254 = fieldWeight in 947, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9434495 = idf(docFreq=856, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.031206518 = weight(abstract_txt:automatic in 947) [ClassicSimilarity], result of:
           0.031206518 = score(doc=947,freq=1.0), product of:
             0.10983019 = queryWeight, product of:
               1.4220701 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.01486501 = queryNorm
             0.28413424 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.06723333 = weight(abstract_txt:components in 947) [ClassicSimilarity], result of:
           0.06723333 = score(doc=947,freq=3.0), product of:
             0.12703037 = queryWeight, product of:
               1.5293748 = boost
               5.58764 = idf(docFreq=449, maxDocs=44218)
               0.01486501 = queryNorm
             0.52926975 = fieldWeight in 947, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.58764 = idf(docFreq=449, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.04261307 = weight(abstract_txt:evaluation in 947) [ClassicSimilarity], result of:
           0.04261307 = score(doc=947,freq=2.0), product of:
             0.122821346 = queryWeight, product of:
               1.841801 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01486501 = queryNorm
             0.34695166 = fieldWeight in 947, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.07135623 = weight(abstract_txt:sentence in 947) [ClassicSimilarity], result of:
           0.07135623 = score(doc=947,freq=1.0), product of:
             0.19062482 = queryWeight, product of:
               1.8734835 = boost
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.01486501 = queryNorm
             0.3743281 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.058788333 = weight(abstract_txt:focused in 947) [ClassicSimilarity], result of:
           0.058788333 = score(doc=947,freq=1.0), product of:
             0.1917709 = queryWeight, product of:
               2.3014266 = boost
               5.6055775 = idf(docFreq=441, maxDocs=44218)
               0.01486501 = queryNorm
             0.30655503 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6055775 = idf(docFreq=441, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.052256014 = weight(abstract_txt:system in 947) [ClassicSimilarity], result of:
           0.052256014 = score(doc=947,freq=6.0), product of:
             0.115676545 = queryWeight, product of:
               2.307559 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.01486501 = queryNorm
             0.45174253 = fieldWeight in 947, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.065897375 = weight(abstract_txt:task in 947) [ClassicSimilarity], result of:
           0.065897375 = score(doc=947,freq=1.0), product of:
             0.24534862 = queryWeight, product of:
               3.36064 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01486501 = queryNorm
             0.2685867 = fieldWeight in 947, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.10205296 = weight(abstract_txt:topic in 947) [ClassicSimilarity], result of:
           0.10205296 = score(doc=947,freq=2.0), product of:
             0.26066253 = queryWeight, product of:
               3.4639328 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.01486501 = queryNorm
             0.39151374 = fieldWeight in 947, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
         0.322947 = weight(abstract_txt:summarization in 947) [ClassicSimilarity], result of:
           0.322947 = score(doc=947,freq=4.0), product of:
             0.41397014 = queryWeight, product of:
               3.9044483 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.01486501 = queryNorm
             0.78012145 = fieldWeight in 947, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.0546875 = fieldNorm(doc=947)
       0.44 = coord(11/25)
   

2. Finegan-Dollak, C.; Radev, D.R.: Sentence simplification, compression, and disaggregation for summarization of sophisticated documents (2016) 0.31

   0.30549896 = sum of:
     0.30549896 = product of:
       0.95468426 = sum of:
         0.012401499 = weight(abstract_txt:analysis in 3122) [ClassicSimilarity], result of:
           0.012401499 = score(doc=3122,freq=1.0), product of:
             0.054309987 = queryWeight, product of:
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.01486501 = queryNorm
             0.22834657 = fieldWeight in 3122, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=3122)
         0.17707981 = weight(abstract_txt:extractive in 3122) [ClassicSimilarity], result of:
           0.17707981 = score(doc=3122,freq=3.0), product of:
             0.1759108 = queryWeight, product of:
               1.2725985 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.01486501 = queryNorm
             1.0066454 = fieldWeight in 3122, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.0625 = fieldNorm(doc=3122)
         0.030719992 = weight(abstract_txt:designed in 3122) [ClassicSimilarity], result of:
           0.030719992 = score(doc=3122,freq=1.0), product of:
             0.09942852 = queryWeight, product of:
               1.3530556 = boost
               4.9434495 = idf(docFreq=856, maxDocs=44218)
               0.01486501 = queryNorm
             0.3089656 = fieldWeight in 3122, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9434495 = idf(docFreq=856, maxDocs=44218)
               0.0625 = fieldNorm(doc=3122)
         0.03443656 = weight(abstract_txt:evaluation in 3122) [ClassicSimilarity], result of:
           0.03443656 = score(doc=3122,freq=1.0), product of:
             0.122821346 = queryWeight, product of:
               1.841801 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01486501 = queryNorm
             0.2803793 = fieldWeight in 3122, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3122)
         0.14124869 = weight(abstract_txt:sentence in 3122) [ClassicSimilarity], result of:
           0.14124869 = score(doc=3122,freq=3.0), product of:
             0.19062482 = queryWeight, product of:
               1.8734835 = boost
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.01486501 = queryNorm
             0.74097747 = fieldWeight in 3122, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.0625 = fieldNorm(doc=3122)
         0.27639145 = weight(abstract_txt:simplification in 3122) [ClassicSimilarity], result of:
           0.27639145 = score(doc=3122,freq=3.0), product of:
             0.29822192 = queryWeight, product of:
               2.343311 = boost
               8.561393 = idf(docFreq=22, maxDocs=44218)
               0.01486501 = queryNorm
             0.9267979 = fieldWeight in 3122, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.561393 = idf(docFreq=22, maxDocs=44218)
               0.0625 = fieldNorm(doc=3122)
         0.052533485 = weight(abstract_txt:human in 3122) [ClassicSimilarity], result of:
           0.052533485 = score(doc=3122,freq=1.0), product of:
             0.17914212 = queryWeight, product of:
               2.5684671 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.01486501 = queryNorm
             0.29325032 = fieldWeight in 3122, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0625 = fieldNorm(doc=3122)
         0.22987276 = weight(abstract_txt:summaries in 3122) [ClassicSimilarity], result of:
           0.22987276 = score(doc=3122,freq=3.0), product of:
             0.30191076 = queryWeight, product of:
               2.8876536 = boost
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.01486501 = queryNorm
             0.7613931 = fieldWeight in 3122, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.0625 = fieldNorm(doc=3122)
       0.32 = coord(8/25)
   

3. Ou, S.; Khoo, C.S.G.; Goh, D.H.: Multi-document summarization of news articles using an event-based framework (2006) 0.28

   0.28002563 = sum of:
     0.28002563 = product of:
       0.8750801 = sum of:
         0.012401499 = weight(abstract_txt:analysis in 657) [ClassicSimilarity], result of:
           0.012401499 = score(doc=657,freq=1.0), product of:
             0.054309987 = queryWeight, product of:
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.01486501 = queryNorm
             0.22834657 = fieldWeight in 657, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0625 = fieldNorm(doc=657)
         0.035664592 = weight(abstract_txt:automatic in 657) [ClassicSimilarity], result of:
           0.035664592 = score(doc=657,freq=1.0), product of:
             0.10983019 = queryWeight, product of:
               1.4220701 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.01486501 = queryNorm
             0.32472485 = fieldWeight in 657, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0625 = fieldNorm(doc=657)
         0.048700653 = weight(abstract_txt:evaluation in 657) [ClassicSimilarity], result of:
           0.048700653 = score(doc=657,freq=2.0), product of:
             0.122821346 = queryWeight, product of:
               1.841801 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01486501 = queryNorm
             0.3965162 = fieldWeight in 657, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=657)
         0.11532907 = weight(abstract_txt:sentence in 657) [ClassicSimilarity], result of:
           0.11532907 = score(doc=657,freq=2.0), product of:
             0.19062482 = queryWeight, product of:
               1.8734835 = boost
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.01486501 = queryNorm
             0.60500556 = fieldWeight in 657, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.0625 = fieldNorm(doc=657)
         0.024381062 = weight(abstract_txt:system in 657) [ClassicSimilarity], result of:
           0.024381062 = score(doc=657,freq=1.0), product of:
             0.115676545 = queryWeight, product of:
               2.307559 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.01486501 = queryNorm
             0.21076928 = fieldWeight in 657, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=657)
         0.052533485 = weight(abstract_txt:human in 657) [ClassicSimilarity], result of:
           0.052533485 = score(doc=657,freq=1.0), product of:
             0.17914212 = queryWeight, product of:
               2.5684671 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.01486501 = queryNorm
             0.29325032 = fieldWeight in 657, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0625 = fieldNorm(doc=657)
         0.3250892 = weight(abstract_txt:summaries in 657) [ClassicSimilarity], result of:
           0.3250892 = score(doc=657,freq=6.0), product of:
             0.30191076 = queryWeight, product of:
               2.8876536 = boost
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.01486501 = queryNorm
             1.0767725 = fieldWeight in 657, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.0625 = fieldNorm(doc=657)
         0.26098058 = weight(abstract_txt:summarization in 657) [ClassicSimilarity], result of:
           0.26098058 = score(doc=657,freq=2.0), product of:
             0.41397014 = queryWeight, product of:
               3.9044483 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.01486501 = queryNorm
             0.6304333 = fieldWeight in 657, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.0625 = fieldNorm(doc=657)
       0.32 = coord(8/25)
   

4. Kar, M.; Nunes, S.; Ribeiro, C.: Summarization of changes in dynamic text collections using Latent Dirichlet Allocation model (2015) 0.27

   0.2704448 = sum of:
     0.2704448 = product of:
       0.84514004 = sum of:
         0.07667781 = weight(abstract_txt:extractive in 2676) [ClassicSimilarity], result of:
           0.07667781 = score(doc=2676,freq=1.0), product of:
             0.1759108 = queryWeight, product of:
               1.2725985 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.01486501 = queryNorm
             0.43589026 = fieldWeight in 2676, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.037828013 = weight(abstract_txt:automatic in 2676) [ClassicSimilarity], result of:
           0.037828013 = score(doc=2676,freq=2.0), product of:
             0.10983019 = queryWeight, product of:
               1.4220701 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.01486501 = queryNorm
             0.3444227 = fieldWeight in 2676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.055531085 = weight(abstract_txt:metrics in 2676) [ClassicSimilarity], result of:
           0.055531085 = score(doc=2676,freq=1.0), product of:
             0.1787366 = queryWeight, product of:
               1.8141237 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.01486501 = queryNorm
             0.3106867 = fieldWeight in 2676, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.02586002 = weight(abstract_txt:system in 2676) [ClassicSimilarity], result of:
           0.02586002 = score(doc=2676,freq=2.0), product of:
             0.115676545 = queryWeight, product of:
               2.307559 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.01486501 = queryNorm
             0.22355458 = fieldWeight in 2676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.17240457 = weight(abstract_txt:summaries in 2676) [ClassicSimilarity], result of:
           0.17240457 = score(doc=2676,freq=3.0), product of:
             0.30191076 = queryWeight, product of:
               2.8876536 = boost
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.01486501 = queryNorm
             0.5710448 = fieldWeight in 2676, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.07987968 = weight(abstract_txt:task in 2676) [ClassicSimilarity], result of:
           0.07987968 = score(doc=2676,freq=2.0), product of:
             0.24534862 = queryWeight, product of:
               3.36064 = boost
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.01486501 = queryNorm
             0.32557625 = fieldWeight in 2676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9112997 = idf(docFreq=884, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.087473966 = weight(abstract_txt:topic in 2676) [ClassicSimilarity], result of:
           0.087473966 = score(doc=2676,freq=2.0), product of:
             0.26066253 = queryWeight, product of:
               3.4639328 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.01486501 = queryNorm
             0.3355832 = fieldWeight in 2676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.3094849 = weight(abstract_txt:summarization in 2676) [ClassicSimilarity], result of:
           0.3094849 = score(doc=2676,freq=5.0), product of:
             0.41397014 = queryWeight, product of:
               3.9044483 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.01486501 = queryNorm
             0.747602 = fieldWeight in 2676, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
       0.32 = coord(8/25)
   

5. Hirao, T.; Okumura, M.; Yasuda, N.; Isozaki, H.: Supervised automatic evaluation for summarization with voted regression model (2007) 0.22

   0.21963206 = sum of:
     0.21963206 = product of:
       0.9151336 = sum of:
         0.10920007 = weight(abstract_txt:automatic in 942) [ClassicSimilarity], result of:
           0.10920007 = score(doc=942,freq=6.0), product of:
             0.10983019 = queryWeight, product of:
               1.4220701 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.01486501 = queryNorm
             0.99426275 = fieldWeight in 942, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.121751636 = weight(abstract_txt:evaluation in 942) [ClassicSimilarity], result of:
           0.121751636 = score(doc=942,freq=8.0), product of:
             0.122821346 = queryWeight, product of:
               1.841801 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.01486501 = queryNorm
             0.9912905 = fieldWeight in 942, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.030476326 = weight(abstract_txt:system in 942) [ClassicSimilarity], result of:
           0.030476326 = score(doc=942,freq=1.0), product of:
             0.115676545 = queryWeight, product of:
               2.307559 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.01486501 = queryNorm
             0.2634616 = fieldWeight in 942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.09286696 = weight(abstract_txt:human in 942) [ClassicSimilarity], result of:
           0.09286696 = score(doc=942,freq=2.0), product of:
             0.17914212 = queryWeight, product of:
               2.5684671 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.01486501 = queryNorm
             0.5183982 = fieldWeight in 942, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.2346129 = weight(abstract_txt:summaries in 942) [ClassicSimilarity], result of:
           0.2346129 = score(doc=942,freq=2.0), product of:
             0.30191076 = queryWeight, product of:
               2.8876536 = boost
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.01486501 = queryNorm
             0.7770935 = fieldWeight in 942, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.033448 = idf(docFreq=105, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.32622573 = weight(abstract_txt:summarization in 942) [ClassicSimilarity], result of:
           0.32622573 = score(doc=942,freq=2.0), product of:
             0.41397014 = queryWeight, product of:
               3.9044483 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.01486501 = queryNorm
             0.78804165 = fieldWeight in 942, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
       0.24 = coord(6/25)