Document (#32948)

Author

Dunlavy, D.M.
O'Leary, D.P.
Conroy, J.M.
Schlesinger, J.D.

Title

QCS: A system for querying, clustering and summarizing documents

Source

Information processing and management. 43(2007) no.6, S.1588-1605

Year

2007

Abstract

Information retrieval systems consist of many complicated components. Research and development of such systems is often hampered by the difficulty in evaluating how each particular component would behave across multiple systems. We present a novel integrated information retrieval system-the Query, Cluster, Summarize (QCS) system-which is portable, modular, and permits experimentation with different instantiations of each of the constituent text analysis components. Most importantly, the combination of the three types of methods in the QCS design improves retrievals by providing users more focused information organized by topic. We demonstrate the improved performance by a series of experiments using standard test sets from the Document Understanding Conferences (DUC) as measured by the best known automatic metric for summarization system evaluation, ROUGE. Although the DUC data and evaluations were originally designed to test multidocument summarization, we developed a framework to extend it to the task of evaluation for each of the three components: query, clustering, and summarization. Under this framework, we then demonstrate that the QCS system (end-to-end) achieves performance as good as or better than the best summarization engines. Given a query, QCS retrieves relevant documents, separates the retrieved documents into topic clusters, and creates a single summary for each cluster. In the current implementation, Latent Semantic Indexing is used for retrieval, generalized spherical k-means is used for the document clustering, and a method coupling sentence "trimming" and a hidden Markov model, followed by a pivoted QR decomposition, is used to create a single extract summary for each cluster. The user interface is designed to provide access to detailed information in a compact and useful format. Our system demonstrates the feasibility of assembling an effective IR system from existing software libraries, the usefulness of the modularity of the design, and the value of this particular combination of modules.

Theme

Automatisches Abstracting

Similar documents (author)

1. O'Leary, M.: FirstSearch takes the lead (1992) 5.47

   5.47028 = sum of:
     5.47028 = weight(author_txt:o'leary in 3121) [ClassicSimilarity], result of:
       5.47028 = fieldWeight in 3121, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.752448 = idf(docFreq=18, maxDocs=44218)
         0.625 = fieldNorm(doc=3121)
   

2. O'Leary, M.: DIALOG Select : DIALOG for knowledge worker-on the Web (1997) 5.47

   5.47028 = sum of:
     5.47028 = weight(author_txt:o'leary in 6489) [ClassicSimilarity], result of:
       5.47028 = fieldWeight in 6489, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.752448 = idf(docFreq=18, maxDocs=44218)
         0.625 = fieldNorm(doc=6489)
   

3. O'Leary, M.: DIALOG TARGET's new age searching (1993) 5.47

   5.47028 = sum of:
     5.47028 = weight(author_txt:o'leary in 7951) [ClassicSimilarity], result of:
       5.47028 = fieldWeight in 7951, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.752448 = idf(docFreq=18, maxDocs=44218)
         0.625 = fieldNorm(doc=7951)
   

4. O'Leary, M.: Images on CompuServe : the best of 'Bettmann' online (1995) 5.47

   5.47028 = sum of:
     5.47028 = weight(author_txt:o'leary in 1947) [ClassicSimilarity], result of:
       5.47028 = fieldWeight in 1947, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.752448 = idf(docFreq=18, maxDocs=44218)
         0.625 = fieldNorm(doc=1947)
   

5. O'Leary, D.E.: Using AI in knowledge management : knowledge bases and ontologies (1998) 5.47

   5.47028 = sum of:
     5.47028 = weight(author_txt:o'leary in 2575) [ClassicSimilarity], result of:
       5.47028 = fieldWeight in 2575, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.752448 = idf(docFreq=18, maxDocs=44218)
         0.625 = fieldNorm(doc=2575)
   

Similar documents (content)

1. Ouyang, Y.; Li, W.; Li, S.; Lu, Q.: Intertopic information mining for query-based summarization (2010) 0.46

   0.45833752 = sum of:
     0.45833752 = product of:
       0.95486987 = sum of:
         0.028988639 = weight(abstract_txt:evaluation in 3459) [ClassicSimilarity], result of:
           0.028988639 = score(doc=3459,freq=1.0), product of:
             0.1033908 = queryWeight, product of:
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.023047082 = queryNorm
             0.2803793 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.03026375 = weight(abstract_txt:framework in 3459) [ClassicSimilarity], result of:
           0.03026375 = score(doc=3459,freq=1.0), product of:
             0.10640086 = queryWeight, product of:
               1.0144523 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.023047082 = queryNorm
             0.28443143 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.024108188 = weight(abstract_txt:information in 3459) [ClassicSimilarity], result of:
           0.024108188 = score(doc=3459,freq=7.0), product of:
             0.060221333 = queryWeight, product of:
               1.0793176 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.023047082 = queryNorm
             0.40032637 = fieldWeight in 3459, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.040523887 = weight(abstract_txt:best in 3459) [ClassicSimilarity], result of:
           0.040523887 = score(doc=3459,freq=1.0), product of:
             0.12926196 = queryWeight, product of:
               1.1181355 = boost
               5.0160327 = idf(docFreq=796, maxDocs=44218)
               0.023047082 = queryNorm
             0.31350204 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0160327 = idf(docFreq=796, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.018258596 = weight(abstract_txt:used in 3459) [ClassicSimilarity], result of:
           0.018258596 = score(doc=3459,freq=1.0), product of:
             0.08696383 = queryWeight, product of:
               1.1232438 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.023047082 = queryNorm
             0.2099562 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.08330898 = weight(abstract_txt:topic in 3459) [ClassicSimilarity], result of:
           0.08330898 = score(doc=3459,freq=4.0), product of:
             0.13165516 = queryWeight, product of:
               1.1284388 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.023047082 = queryNorm
             0.63278174 = fieldWeight in 3459, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.019129423 = weight(abstract_txt:systems in 3459) [ClassicSimilarity], result of:
           0.019129423 = score(doc=3459,freq=1.0), product of:
             0.08970741 = queryWeight, product of:
               1.1408246 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.023047082 = queryNorm
             0.2132424 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.03371513 = weight(abstract_txt:documents in 3459) [ClassicSimilarity], result of:
           0.03371513 = score(doc=3459,freq=1.0), product of:
             0.13089116 = queryWeight, product of:
               1.3780338 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.023047082 = queryNorm
             0.2575814 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.05174094 = weight(abstract_txt:query in 3459) [ClassicSimilarity], result of:
           0.05174094 = score(doc=3459,freq=1.0), product of:
             0.17414725 = queryWeight, product of:
               1.589509 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.023047082 = queryNorm
             0.2971103 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.11569283 = weight(abstract_txt:clustering in 3459) [ClassicSimilarity], result of:
           0.11569283 = score(doc=3459,freq=1.0), product of:
             0.29778174 = queryWeight, product of:
               2.0785177 = boost
               6.2162485 = idf(docFreq=239, maxDocs=44218)
               0.023047082 = queryNorm
             0.38851553 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2162485 = idf(docFreq=239, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.043100264 = weight(abstract_txt:system in 3459) [ClassicSimilarity], result of:
           0.043100264 = score(doc=3459,freq=1.0), product of:
             0.20449026 = queryWeight, product of:
               2.6310518 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.023047082 = queryNorm
             0.21076928 = fieldWeight in 3459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
         0.4660392 = weight(abstract_txt:summarization in 3459) [ClassicSimilarity], result of:
           0.4660392 = score(doc=3459,freq=4.0), product of:
             0.522719 = queryWeight, product of:
               3.1798615 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.023047082 = queryNorm
             0.89156735 = fieldWeight in 3459, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.0625 = fieldNorm(doc=3459)
       0.48 = coord(12/25)
   

2. Vanderwende, L.; Suzuki, H.; Brockett, J.M.; Nenkova, A.: Beyond SumBasic : task-focused summarization with sentence simplification and lexical expansion (2007) 0.45

   0.44639617 = sum of:
     0.44639617 = product of:
       1.0145367 = sum of:
         0.050209794 = weight(abstract_txt:evaluation in 948) [ClassicSimilarity], result of:
           0.050209794 = score(doc=948,freq=3.0), product of:
             0.1033908 = queryWeight, product of:
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.023047082 = queryNorm
             0.48563117 = fieldWeight in 948, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.009112039 = weight(abstract_txt:information in 948) [ClassicSimilarity], result of:
           0.009112039 = score(doc=948,freq=1.0), product of:
             0.060221333 = queryWeight, product of:
               1.0793176 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.023047082 = queryNorm
             0.15130915 = fieldWeight in 948, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.054857414 = weight(abstract_txt:designed in 948) [ClassicSimilarity], result of:
           0.054857414 = score(doc=948,freq=2.0), product of:
             0.12554812 = queryWeight, product of:
               1.1019558 = boost
               4.9434495 = idf(docFreq=856, maxDocs=44218)
               0.023047082 = queryNorm
             0.43694332 = fieldWeight in 948, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9434495 = idf(docFreq=856, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.018258596 = weight(abstract_txt:used in 948) [ClassicSimilarity], result of:
           0.018258596 = score(doc=948,freq=1.0), product of:
             0.08696383 = queryWeight, product of:
               1.1232438 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.023047082 = queryNorm
             0.2099562 = fieldWeight in 948, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.09314227 = weight(abstract_txt:topic in 948) [ClassicSimilarity], result of:
           0.09314227 = score(doc=948,freq=5.0), product of:
             0.13165516 = queryWeight, product of:
               1.1284388 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.023047082 = queryNorm
             0.7074715 = fieldWeight in 948, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.027053092 = weight(abstract_txt:systems in 948) [ClassicSimilarity], result of:
           0.027053092 = score(doc=948,freq=2.0), product of:
             0.08970741 = queryWeight, product of:
               1.1408246 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.023047082 = queryNorm
             0.3015703 = fieldWeight in 948, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.08701066 = weight(abstract_txt:summary in 948) [ClassicSimilarity], result of:
           0.08701066 = score(doc=948,freq=1.0), product of:
             0.21513528 = queryWeight, product of:
               1.4424969 = boost
               6.4711404 = idf(docFreq=185, maxDocs=44218)
               0.023047082 = queryNorm
             0.40444627 = fieldWeight in 948, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4711404 = idf(docFreq=185, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.11882874 = weight(abstract_txt:components in 948) [ClassicSimilarity], result of:
           0.11882874 = score(doc=948,freq=2.0), product of:
             0.24060138 = queryWeight, product of:
               1.8683307 = boost
               5.58764 = idf(docFreq=449, maxDocs=44218)
               0.023047082 = queryNorm
             0.49388224 = fieldWeight in 948, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.58764 = idf(docFreq=449, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.05608721 = weight(abstract_txt:each in 948) [ClassicSimilarity], result of:
           0.05608721 = score(doc=948,freq=1.0), product of:
             0.21788093 = queryWeight, product of:
               2.295296 = boost
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.023047082 = queryNorm
             0.25742137 = fieldWeight in 948, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.09637512 = weight(abstract_txt:system in 948) [ClassicSimilarity], result of:
           0.09637512 = score(doc=948,freq=5.0), product of:
             0.20449026 = queryWeight, product of:
               2.6310518 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.023047082 = queryNorm
             0.47129443 = fieldWeight in 948, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
         0.4036018 = weight(abstract_txt:summarization in 948) [ClassicSimilarity], result of:
           0.4036018 = score(doc=948,freq=3.0), product of:
             0.522719 = queryWeight, product of:
               3.1798615 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.023047082 = queryNorm
             0.77211994 = fieldWeight in 948, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.0625 = fieldNorm(doc=948)
       0.44 = coord(11/25)
   

3. Kar, M.; Nunes, S.; Ribeiro, C.: Summarization of changes in dynamic text collections using Latent Dirichlet Allocation model (2015) 0.38

   0.3819112 = sum of:
     0.3819112 = product of:
       0.95477796 = sum of:
         0.1265461 = weight(abstract_txt:rouge in 2676) [ClassicSimilarity], result of:
           0.1265461 = score(doc=2676,freq=2.0), product of:
             0.21075037 = queryWeight, product of:
               1.0095509 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.023047082 = queryNorm
             0.6004549 = fieldWeight in 2676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.0118368855 = weight(abstract_txt:information in 2676) [ClassicSimilarity], result of:
           0.0118368855 = score(doc=2676,freq=3.0), product of:
             0.060221333 = queryWeight, product of:
               1.0793176 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.023047082 = queryNorm
             0.19655634 = fieldWeight in 2676, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.02371861 = weight(abstract_txt:used in 2676) [ClassicSimilarity], result of:
           0.02371861 = score(doc=2676,freq=3.0), product of:
             0.08696383 = queryWeight, product of:
               1.1232438 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.023047082 = queryNorm
             0.27274108 = fieldWeight in 2676, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.04418126 = weight(abstract_txt:topic in 2676) [ClassicSimilarity], result of:
           0.04418126 = score(doc=2676,freq=2.0), product of:
             0.13165516 = queryWeight, product of:
               1.1284388 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.023047082 = queryNorm
             0.3355832 = fieldWeight in 2676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.021439478 = weight(abstract_txt:retrieval in 2676) [ClassicSimilarity], result of:
           0.021439478 = score(doc=2676,freq=2.0), product of:
             0.09306486 = queryWeight, product of:
               1.161977 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.023047082 = queryNorm
             0.23037136 = fieldWeight in 2676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.050572693 = weight(abstract_txt:documents in 2676) [ClassicSimilarity], result of:
           0.050572693 = score(doc=2676,freq=4.0), product of:
             0.13089116 = queryWeight, product of:
               1.3780338 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.023047082 = queryNorm
             0.38637212 = fieldWeight in 2676, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.14592132 = weight(abstract_txt:summary in 2676) [ClassicSimilarity], result of:
           0.14592132 = score(doc=2676,freq=5.0), product of:
             0.21513528 = queryWeight, product of:
               1.4424969 = boost
               6.4711404 = idf(docFreq=185, maxDocs=44218)
               0.023047082 = queryNorm
             0.678277 = fieldWeight in 2676, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.4711404 = idf(docFreq=185, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.094061114 = weight(abstract_txt:each in 2676) [ClassicSimilarity], result of:
           0.094061114 = score(doc=2676,freq=5.0), product of:
             0.21788093 = queryWeight, product of:
               2.295296 = boost
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.023047082 = queryNorm
             0.43170878 = fieldWeight in 2676, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.045714736 = weight(abstract_txt:system in 2676) [ClassicSimilarity], result of:
           0.045714736 = score(doc=2676,freq=2.0), product of:
             0.20449026 = queryWeight, product of:
               2.6310518 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.023047082 = queryNorm
             0.22355458 = fieldWeight in 2676, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
         0.39078578 = weight(abstract_txt:summarization in 2676) [ClassicSimilarity], result of:
           0.39078578 = score(doc=2676,freq=5.0), product of:
             0.522719 = queryWeight, product of:
               3.1798615 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.023047082 = queryNorm
             0.747602 = fieldWeight in 2676, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.046875 = fieldNorm(doc=2676)
       0.4 = coord(10/25)
   

4. Pons-Porrata, A.; Berlanga-Llavori, R.; Ruiz-Shulcloper, J.: Topic discovery based on text mining techniques (2007) 0.34

   0.33610016 = sum of:
     0.33610016 = product of:
       1.050313 = sum of:
         0.11642783 = weight(abstract_txt:topic in 916) [ClassicSimilarity], result of:
           0.11642783 = score(doc=916,freq=5.0), product of:
             0.13165516 = queryWeight, product of:
               1.1284388 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.023047082 = queryNorm
             0.88433933 = fieldWeight in 916, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.078125 = fieldNorm(doc=916)
         0.06268073 = weight(abstract_txt:demonstrate in 916) [ClassicSimilarity], result of:
           0.06268073 = score(doc=916,freq=1.0), product of:
             0.14898619 = queryWeight, product of:
               1.2004168 = boost
               5.3851523 = idf(docFreq=550, maxDocs=44218)
               0.023047082 = queryNorm
             0.42071503 = fieldWeight in 916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3851523 = idf(docFreq=550, maxDocs=44218)
               0.078125 = fieldNorm(doc=916)
         0.05960049 = weight(abstract_txt:documents in 916) [ClassicSimilarity], result of:
           0.05960049 = score(doc=916,freq=2.0), product of:
             0.13089116 = queryWeight, product of:
               1.3780338 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.023047082 = queryNorm
             0.4553439 = fieldWeight in 916, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=916)
         0.10876332 = weight(abstract_txt:summary in 916) [ClassicSimilarity], result of:
           0.10876332 = score(doc=916,freq=1.0), product of:
             0.21513528 = queryWeight, product of:
               1.4424969 = boost
               6.4711404 = idf(docFreq=185, maxDocs=44218)
               0.023047082 = queryNorm
             0.50555784 = fieldWeight in 916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4711404 = idf(docFreq=185, maxDocs=44218)
               0.078125 = fieldNorm(doc=916)
         0.14461604 = weight(abstract_txt:clustering in 916) [ClassicSimilarity], result of:
           0.14461604 = score(doc=916,freq=1.0), product of:
             0.29778174 = queryWeight, product of:
               2.0785177 = boost
               6.2162485 = idf(docFreq=239, maxDocs=44218)
               0.023047082 = queryNorm
             0.4856444 = fieldWeight in 916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2162485 = idf(docFreq=239, maxDocs=44218)
               0.078125 = fieldNorm(doc=916)
         0.07010901 = weight(abstract_txt:each in 916) [ClassicSimilarity], result of:
           0.07010901 = score(doc=916,freq=1.0), product of:
             0.21788093 = queryWeight, product of:
               2.295296 = boost
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.023047082 = queryNorm
             0.32177672 = fieldWeight in 916, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.078125 = fieldNorm(doc=916)
         0.07619123 = weight(abstract_txt:system in 916) [ClassicSimilarity], result of:
           0.07619123 = score(doc=916,freq=2.0), product of:
             0.20449026 = queryWeight, product of:
               2.6310518 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.023047082 = queryNorm
             0.372591 = fieldWeight in 916, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=916)
         0.41192436 = weight(abstract_txt:summarization in 916) [ClassicSimilarity], result of:
           0.41192436 = score(doc=916,freq=2.0), product of:
             0.522719 = queryWeight, product of:
               3.1798615 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.023047082 = queryNorm
             0.78804165 = fieldWeight in 916, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.078125 = fieldNorm(doc=916)
       0.32 = coord(8/25)
   

5. Cai, X.; Li, W.: Enhancing sentence-level clustering with integrated and interactive frameworks for theme-based summarization (2011) 0.34

   0.3353761 = sum of:
     0.3353761 = product of:
       1.0480504 = sum of:
         0.040996127 = weight(abstract_txt:evaluation in 4770) [ClassicSimilarity], result of:
           0.040996127 = score(doc=4770,freq=2.0), product of:
             0.1033908 = queryWeight, product of:
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.023047082 = queryNorm
             0.3965162 = fieldWeight in 4770, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=4770)
         0.03026375 = weight(abstract_txt:framework in 4770) [ClassicSimilarity], result of:
           0.03026375 = score(doc=4770,freq=1.0), product of:
             0.10640086 = queryWeight, product of:
               1.0144523 = boost
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.023047082 = queryNorm
             0.28443143 = fieldWeight in 4770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.550903 = idf(docFreq=1268, maxDocs=44218)
               0.0625 = fieldNorm(doc=4770)
         0.009112039 = weight(abstract_txt:information in 4770) [ClassicSimilarity], result of:
           0.009112039 = score(doc=4770,freq=1.0), product of:
             0.060221333 = queryWeight, product of:
               1.0793176 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.023047082 = queryNorm
             0.15130915 = fieldWeight in 4770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=4770)
         0.018258596 = weight(abstract_txt:used in 4770) [ClassicSimilarity], result of:
           0.018258596 = score(doc=4770,freq=1.0), product of:
             0.08696383 = queryWeight, product of:
               1.1232438 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.023047082 = queryNorm
             0.2099562 = fieldWeight in 4770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=4770)
         0.04165449 = weight(abstract_txt:topic in 4770) [ClassicSimilarity], result of:
           0.04165449 = score(doc=4770,freq=1.0), product of:
             0.13165516 = queryWeight, product of:
               1.1284388 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.023047082 = queryNorm
             0.31639087 = fieldWeight in 4770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.0625 = fieldNorm(doc=4770)
         0.44807643 = weight(abstract_txt:clustering in 4770) [ClassicSimilarity], result of:
           0.44807643 = score(doc=4770,freq=15.0), product of:
             0.29778174 = queryWeight, product of:
               2.0785177 = boost
               6.2162485 = idf(docFreq=239, maxDocs=44218)
               0.023047082 = queryNorm
             1.5047143 = fieldWeight in 4770, product of:
               3.8729835 = tf(freq=15.0), with freq of:
                 15.0 = termFreq=15.0
               6.2162485 = idf(docFreq=239, maxDocs=44218)
               0.0625 = fieldNorm(doc=4770)
         0.05608721 = weight(abstract_txt:each in 4770) [ClassicSimilarity], result of:
           0.05608721 = score(doc=4770,freq=1.0), product of:
             0.21788093 = queryWeight, product of:
               2.295296 = boost
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.023047082 = queryNorm
             0.25742137 = fieldWeight in 4770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.118742 = idf(docFreq=1954, maxDocs=44218)
               0.0625 = fieldNorm(doc=4770)
         0.4036018 = weight(abstract_txt:summarization in 4770) [ClassicSimilarity], result of:
           0.4036018 = score(doc=4770,freq=3.0), product of:
             0.522719 = queryWeight, product of:
               3.1798615 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.023047082 = queryNorm
             0.77211994 = fieldWeight in 4770, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.0625 = fieldNorm(doc=4770)
       0.32 = coord(8/25)