Document (#25602)

Author

Jones, S.
Paynter, G.W.

Title

Automatic extractionof document keyphrases for use in digital libraries : evaluations and applications

Source

Journal of the American Society for Information Science and technology. 53(2002) no.8, S.653-677

Year

2002

Abstract

This article describes an evaluation of the Kea automatic keyphrase extraction algorithm. Document keyphrases are conventionally used as concise descriptors of document content, and are increasingly used in novel ways, including document clustering, searching and browsing interfaces, and retrieval engines. However, it is costly and time consuming to manually assign keyphrases to documents, motivating the development of tools that automatically perform this function. Previous studies have evaluated Kea's performance by measuring its ability to identify author keywords and keyphrases, but this methodology has a number of well-known limitations. The results presented in this article are based on evaluations by human assessors of the quality and appropriateness of Kea keyphrases. The results indicate that, in general, Kea produces keyphrases that are rated positively by human assessors. However, typical Kea settings can degrade performance, particularly those relating to keyphrase length and domain specificity. We found that for some settings, Kea's performance is better than that of similar systems, and that Kea's ranking of extracted keyphrases is effective. We also determined that author-specified keyphrases appear to exhibit an inherent ranking, and that they are rated highly and therefore suitable for use in training and evaluation of automatic keyphrasing systems.

Theme

Automatisches Indexieren
Automatisches Abstracting

Similar documents (author)

1. Jones, M.H.: Year's work in cataloging and classification : 1978 (1979) 4.34

   4.3370585 = sum of:
     4.3370585 = weight(author_txt:jones in 307) [ClassicSimilarity], result of:
       4.3370585 = fieldWeight in 307, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.939294 = idf(docFreq=116, maxDocs=44421)
         0.625 = fieldNorm(doc=307)
   

2. Jones, K.P.: Natural-language processing and automatic indexing : a reply (1990) 4.34

   4.3370585 = sum of:
     4.3370585 = weight(author_txt:jones in 393) [ClassicSimilarity], result of:
       4.3370585 = fieldWeight in 393, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.939294 = idf(docFreq=116, maxDocs=44421)
         0.625 = fieldNorm(doc=393)
   

3. Jones, R.M.: Online catalogue research in Europe (1989) 4.34

   4.3370585 = sum of:
     4.3370585 = weight(author_txt:jones in 795) [ClassicSimilarity], result of:
       4.3370585 = fieldWeight in 795, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.939294 = idf(docFreq=116, maxDocs=44421)
         0.625 = fieldNorm(doc=795)
   

4. Jones, R.L.: Automatic document content analysis : the AIDA project (1992) 4.34

   4.3370585 = sum of:
     4.3370585 = weight(author_txt:jones in 2606) [ClassicSimilarity], result of:
       4.3370585 = fieldWeight in 2606, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.939294 = idf(docFreq=116, maxDocs=44421)
         0.625 = fieldNorm(doc=2606)
   

5. Jones, K.P.: How do we index? : a report of some Aslib Information Group activity (1983) 4.34

   4.3370585 = sum of:
     4.3370585 = weight(author_txt:jones in 2735) [ClassicSimilarity], result of:
       4.3370585 = fieldWeight in 2735, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.939294 = idf(docFreq=116, maxDocs=44421)
         0.625 = fieldNorm(doc=2735)
   

Similar documents (content)

1. Wu, Y.-f.B.; Li, Q.; Bot, R.S.; Chen, X.: Finding nuggets in documents : a machine learning approach (2006) 0.79

   0.79046965 = sum of:
     0.79046965 = product of:
       1.7965219 = sum of:
         0.035770625 = weight(abstract_txt:costly in 290) [ClassicSimilarity], result of:
           0.035770625 = score(doc=290,freq=1.0), product of:
             0.07402884 = queryWeight, product of:
               1.0373279 = boost
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.009230801 = queryNorm
             0.4831985 = fieldWeight in 290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.038090277 = weight(abstract_txt:concise in 290) [ClassicSimilarity], result of:
           0.038090277 = score(doc=290,freq=1.0), product of:
             0.07719563 = queryWeight, product of:
               1.0592828 = boost
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.009230801 = queryNorm
             0.4934253 = fieldWeight in 290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.894805 = idf(docFreq=44, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.01391704 = weight(abstract_txt:evaluation in 290) [ClassicSimilarity], result of:
           0.01391704 = score(doc=290,freq=1.0), product of:
             0.0497078 = queryWeight, product of:
               1.2021061 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.009230801 = queryNorm
             0.279977 = fieldWeight in 290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.01588228 = weight(abstract_txt:human in 290) [ClassicSimilarity], result of:
           0.01588228 = score(doc=290,freq=1.0), product of:
             0.05428358 = queryWeight, product of:
               1.2562174 = boost
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.009230801 = queryNorm
             0.2925798 = fieldWeight in 290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.006100688 = weight(abstract_txt:this in 290) [ClassicSimilarity], result of:
           0.006100688 = score(doc=290,freq=2.0), product of:
             0.028684404 = queryWeight, product of:
               1.2914228 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.009230801 = queryNorm
             0.21268311 = fieldWeight in 290, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.022896502 = weight(abstract_txt:performance in 290) [ClassicSimilarity], result of:
           0.022896502 = score(doc=290,freq=1.0), product of:
             0.07929938 = queryWeight, product of:
               1.8595638 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.009230801 = queryNorm
             0.28873494 = fieldWeight in 290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.032571606 = weight(abstract_txt:automatic in 290) [ClassicSimilarity], result of:
           0.032571606 = score(doc=290,freq=1.0), product of:
             0.10030359 = queryWeight, product of:
               2.091387 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.009230801 = queryNorm
             0.32473022 = fieldWeight in 290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.054823462 = weight(abstract_txt:document in 290) [ClassicSimilarity], result of:
           0.054823462 = score(doc=290,freq=5.0), product of:
             0.091353305 = queryWeight, product of:
               2.3046644 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.009230801 = queryNorm
             0.6001257 = fieldWeight in 290, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.20451385 = weight(abstract_txt:keyphrase in 290) [ClassicSimilarity], result of:
           0.20451385 = score(doc=290,freq=3.0), product of:
             0.20677657 = queryWeight, product of:
               2.4517784 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.009230801 = queryNorm
             0.9890571 = fieldWeight in 290, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         0.011583841 = weight(abstract_txt:that in 290) [ClassicSimilarity], result of:
           0.011583841 = score(doc=290,freq=2.0), product of:
             0.055416405 = queryWeight, product of:
               2.5385149 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.009230801 = queryNorm
             0.20903271 = fieldWeight in 290, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
         1.3603717 = weight(abstract_txt:keyphrases in 290) [ClassicSimilarity], result of:
           1.3603717 = score(doc=290,freq=7.0), product of:
             0.87529075 = queryWeight, product of:
               10.088735 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.009230801 = queryNorm
             1.5541941 = fieldWeight in 290, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.0625 = fieldNorm(doc=290)
       0.44 = coord(11/25)
   

2. Martín-Moncunill, D.; García-Barriocanal, E.; Sicilia, M.-A.; Sánchez-Alonso, S.: Evaluating the practical applicability of thesaurus-based keyphrase extraction in the agricultural domain : insights from the VOA3R project (2015) 0.38

   0.37567416 = sum of:
     0.37567416 = product of:
       1.3416934 = sum of:
         0.02783408 = weight(abstract_txt:evaluation in 3106) [ClassicSimilarity], result of:
           0.02783408 = score(doc=3106,freq=4.0), product of:
             0.0497078 = queryWeight, product of:
               1.2021061 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.009230801 = queryNorm
             0.559954 = fieldWeight in 3106, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
         0.01588228 = weight(abstract_txt:human in 3106) [ClassicSimilarity], result of:
           0.01588228 = score(doc=3106,freq=1.0), product of:
             0.05428358 = queryWeight, product of:
               1.2562174 = boost
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.009230801 = queryNorm
             0.2925798 = fieldWeight in 3106, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
         0.007471787 = weight(abstract_txt:this in 3106) [ClassicSimilarity], result of:
           0.007471787 = score(doc=3106,freq=3.0), product of:
             0.028684404 = queryWeight, product of:
               1.2914228 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.009230801 = queryNorm
             0.26048255 = fieldWeight in 3106, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
         0.046063207 = weight(abstract_txt:automatic in 3106) [ClassicSimilarity], result of:
           0.046063207 = score(doc=3106,freq=2.0), product of:
             0.10030359 = queryWeight, product of:
               2.091387 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.009230801 = queryNorm
             0.45923787 = fieldWeight in 3106, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
         0.20451385 = weight(abstract_txt:keyphrase in 3106) [ClassicSimilarity], result of:
           0.20451385 = score(doc=3106,freq=3.0), product of:
             0.20677657 = queryWeight, product of:
               2.4517784 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.009230801 = queryNorm
             0.9890571 = fieldWeight in 3106, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
         0.011583841 = weight(abstract_txt:that in 3106) [ClassicSimilarity], result of:
           0.011583841 = score(doc=3106,freq=2.0), product of:
             0.055416405 = queryWeight, product of:
               2.5385149 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.009230801 = queryNorm
             0.20903271 = fieldWeight in 3106, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
         1.0283444 = weight(abstract_txt:keyphrases in 3106) [ClassicSimilarity], result of:
           1.0283444 = score(doc=3106,freq=4.0), product of:
             0.87529075 = queryWeight, product of:
               10.088735 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.009230801 = queryNorm
             1.1748604 = fieldWeight in 3106, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.0625 = fieldNorm(doc=3106)
       0.28 = coord(7/25)
   

3. Martinez-Romo, J.; Araujo, L.; Fernandez, A.D.: SemGraph : extracting keyphrases following a novel semantic graph-based approach (2016) 0.33

   0.32788637 = sum of:
     0.32788637 = product of:
       1.3661933 = sum of:
         0.01061348 = weight(abstract_txt:article in 3832) [ClassicSimilarity], result of:
           0.01061348 = score(doc=3832,freq=1.0), product of:
             0.035756785 = queryWeight, product of:
               1.019553 = boost
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.009230801 = queryNorm
             0.29682422 = fieldWeight in 3832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.078125 = fieldNorm(doc=3832)
         0.017396301 = weight(abstract_txt:evaluation in 3832) [ClassicSimilarity], result of:
           0.017396301 = score(doc=3832,freq=1.0), product of:
             0.0497078 = queryWeight, product of:
               1.2021061 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.009230801 = queryNorm
             0.34997123 = fieldWeight in 3832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3832)
         0.00762586 = weight(abstract_txt:this in 3832) [ClassicSimilarity], result of:
           0.00762586 = score(doc=3832,freq=2.0), product of:
             0.028684404 = queryWeight, product of:
               1.2914228 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.009230801 = queryNorm
             0.26585388 = fieldWeight in 3832, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=3832)
         0.030647248 = weight(abstract_txt:document in 3832) [ClassicSimilarity], result of:
           0.030647248 = score(doc=3832,freq=1.0), product of:
             0.091353305 = queryWeight, product of:
               2.3046644 = boost
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.009230801 = queryNorm
             0.33548045 = fieldWeight in 3832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.29415 = idf(docFreq=1647, maxDocs=44421)
               0.078125 = fieldNorm(doc=3832)
         0.014479803 = weight(abstract_txt:that in 3832) [ClassicSimilarity], result of:
           0.014479803 = score(doc=3832,freq=2.0), product of:
             0.055416405 = queryWeight, product of:
               2.5385149 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.009230801 = queryNorm
             0.2612909 = fieldWeight in 3832, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=3832)
         1.2854306 = weight(abstract_txt:keyphrases in 3832) [ClassicSimilarity], result of:
           1.2854306 = score(doc=3832,freq=4.0), product of:
             0.87529075 = queryWeight, product of:
               10.088735 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.009230801 = queryNorm
             1.4685755 = fieldWeight in 3832, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.078125 = fieldNorm(doc=3832)
       0.24 = coord(6/25)
   

4. Zhang, Y.; Zhang, C.: Enhancing keyphrase extraction from microblogs using human reading time (2021) 0.27

   0.27184784 = sum of:
     0.27184784 = product of:
       0.8495245 = sum of:
         0.008490784 = weight(abstract_txt:article in 1238) [ClassicSimilarity], result of:
           0.008490784 = score(doc=1238,freq=1.0), product of:
             0.035756785 = queryWeight, product of:
               1.019553 = boost
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.009230801 = queryNorm
             0.23745938 = fieldWeight in 1238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.79935 = idf(docFreq=2702, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.011500503 = weight(abstract_txt:however in 1238) [ClassicSimilarity], result of:
           0.011500503 = score(doc=1238,freq=1.0), product of:
             0.043772817 = queryWeight, product of:
               1.1280615 = boost
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.009230801 = queryNorm
             0.2627316 = fieldWeight in 1238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.042020563 = weight(abstract_txt:human in 1238) [ClassicSimilarity], result of:
           0.042020563 = score(doc=1238,freq=7.0), product of:
             0.05428358 = queryWeight, product of:
               1.2562174 = boost
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.009230801 = queryNorm
             0.7740934 = fieldWeight in 1238, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.681277 = idf(docFreq=1118, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.006100688 = weight(abstract_txt:this in 1238) [ClassicSimilarity], result of:
           0.006100688 = score(doc=1238,freq=2.0), product of:
             0.028684404 = queryWeight, product of:
               1.2914228 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.009230801 = queryNorm
             0.21268311 = fieldWeight in 1238, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.022896502 = weight(abstract_txt:performance in 1238) [ClassicSimilarity], result of:
           0.022896502 = score(doc=1238,freq=1.0), product of:
             0.07929938 = queryWeight, product of:
               1.8595638 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.009230801 = queryNorm
             0.28873494 = fieldWeight in 1238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.23615225 = weight(abstract_txt:keyphrase in 1238) [ClassicSimilarity], result of:
           0.23615225 = score(doc=1238,freq=4.0), product of:
             0.20677657 = queryWeight, product of:
               2.4517784 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.009230801 = queryNorm
             1.1420648 = fieldWeight in 1238, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.008191013 = weight(abstract_txt:that in 1238) [ClassicSimilarity], result of:
           0.008191013 = score(doc=1238,freq=1.0), product of:
             0.055416405 = queryWeight, product of:
               2.5385149 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.009230801 = queryNorm
             0.14780845 = fieldWeight in 1238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
         0.5141722 = weight(abstract_txt:keyphrases in 1238) [ClassicSimilarity], result of:
           0.5141722 = score(doc=1238,freq=1.0), product of:
             0.87529075 = queryWeight, product of:
               10.088735 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.009230801 = queryNorm
             0.5874302 = fieldWeight in 1238, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.0625 = fieldNorm(doc=1238)
       0.32 = coord(8/25)
   

5. Jiang, Y.; Meng, R.; Huang, Y.; Lu, W.; Liu, J.: Generating keyphrases for readers : a controllable keyphrase generation framework (2023) 0.27

   0.26892677 = sum of:
     0.26892677 = product of:
       1.3446338 = sum of:
         0.011500503 = weight(abstract_txt:however in 2014) [ClassicSimilarity], result of:
           0.011500503 = score(doc=2014,freq=1.0), product of:
             0.043772817 = queryWeight, product of:
               1.1280615 = boost
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.009230801 = queryNorm
             0.2627316 = fieldWeight in 2014, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.0625 = fieldNorm(doc=2014)
         0.032571606 = weight(abstract_txt:automatic in 2014) [ClassicSimilarity], result of:
           0.032571606 = score(doc=2014,freq=1.0), product of:
             0.10030359 = queryWeight, product of:
               2.091387 = boost
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.009230801 = queryNorm
             0.32473022 = fieldWeight in 2014, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1956835 = idf(docFreq=668, maxDocs=44421)
               0.0625 = fieldNorm(doc=2014)
         0.26402625 = weight(abstract_txt:keyphrase in 2014) [ClassicSimilarity], result of:
           0.26402625 = score(doc=2014,freq=5.0), product of:
             0.20677657 = queryWeight, product of:
               2.4517784 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.009230801 = queryNorm
             1.2768673 = fieldWeight in 2014, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=2014)
         0.008191013 = weight(abstract_txt:that in 2014) [ClassicSimilarity], result of:
           0.008191013 = score(doc=2014,freq=1.0), product of:
             0.055416405 = queryWeight, product of:
               2.5385149 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.009230801 = queryNorm
             0.14780845 = fieldWeight in 2014, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2014)
         1.0283444 = weight(abstract_txt:keyphrases in 2014) [ClassicSimilarity], result of:
           1.0283444 = score(doc=2014,freq=4.0), product of:
             0.87529075 = queryWeight, product of:
               10.088735 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.009230801 = queryNorm
             1.1748604 = fieldWeight in 2014, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.0625 = fieldNorm(doc=2014)
       0.2 = coord(5/25)