Document (#34211)

Author

Otterbacher, J.
Radev, D.

Title

Exploring fact-focused relevance and novelty detection

Source

Journal of documentation. 64(2008) no.4, S.496-510

Year

2008

Abstract

Purpose - Automated sentence-level relevance and novelty detection would be of direct benefit to many information retrieval systems. However, the low level of agreement between human judges performing the task is an issue of concern. In previous approaches, annotators were asked to identify sentences in a document set that are relevant to a given topic, and then to eliminate sentences that do not provide novel information. This paper aims to explore a new approach in which relevance and novelty judgments are made within the context of specific, factual information needs, rather than with respect to a broad topic. Design/methodology/approach - An experiment is conducted in which annotators perform the novelty detection task in both the topic-focused and fact-focused settings. Findings - Higher levels of agreement between judges are found on the task of identifying relevant sentences in the fact-focused approach. However, the new approach does not improve agreement on novelty judgments. Originality/value - The analysis confirms the intuition that making sentence-level relevance judgments is likely to be the more difficult of the two tasks in the novelty detection framework.

Similar documents (author)

1. Finegan-Dollak, C.; Radev, D.R.: Sentence simplification, compression, and disaggregation for summarization of sophisticated documents (2016) 4.00

   3.9972267 = sum of:
     3.9972267 = weight(author_txt:radev in 4122) [ClassicSimilarity], result of:
       3.9972267 = fieldWeight in 4122, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.4375 = fieldNorm(doc=4122)
   

2. Radev, D.R.; Libner, K.; Fan, W.: Getting answers to natural language questions on the Web (2002) 3.43

   3.4261944 = sum of:
     3.4261944 = weight(author_txt:radev in 204) [ClassicSimilarity], result of:
       3.4261944 = fieldWeight in 204, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.375 = fieldNorm(doc=204)
   

3. Otterbacher, J.; Radev, D.; Kareem, O.: Hierarchical summarization for delivering information to mobile devices (2008) 3.43

   3.4261944 = sum of:
     3.4261944 = weight(author_txt:radev in 3071) [ClassicSimilarity], result of:
       3.4261944 = fieldWeight in 3071, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.375 = fieldNorm(doc=3071)
   

4. Otterbacher, J.; Erkan, G.; Radev, D.R.: Biased LexRank : passage retrieval using random walks with question-based priors (2009) 3.43

   3.4261944 = sum of:
     3.4261944 = weight(author_txt:radev in 3450) [ClassicSimilarity], result of:
       3.4261944 = fieldWeight in 3450, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.375 = fieldNorm(doc=3450)
   

5. Lam, W.; Chan, K.; Radev, D.; Saggion, H.; Teufel, S.: Context-based generic cross-lingual retrieval of documents and automated summaries (2005) 2.86

   2.8551621 = sum of:
     2.8551621 = weight(author_txt:radev in 2965) [ClassicSimilarity], result of:
       2.8551621 = fieldWeight in 2965, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.1365185 = idf(docFreq=12, maxDocs=44421)
         0.3125 = fieldNorm(doc=2965)
   

Similar documents (content)

1. Xiaoyan Li, X.; Croft, W.B.: ¬An information-pattern-based approach to novelty detection (2008) 0.44

   0.43697515 = sum of:
     0.43697515 = product of:
       1.5606256 = sum of:
         0.0051685655 = weight(abstract_txt:that in 3080) [ClassicSimilarity], result of:
           0.0051685655 = score(doc=3080,freq=1.0), product of:
             0.027974399 = queryWeight, product of:
               1.0550314 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01121182 = queryNorm
             0.18476056 = fieldWeight in 3080, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=3080)
         0.013546947 = weight(abstract_txt:information in 3080) [ClassicSimilarity], result of:
           0.013546947 = score(doc=3080,freq=6.0), product of:
             0.029265635 = queryWeight, product of:
               1.0791057 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01121182 = queryNorm
             0.46289608 = fieldWeight in 3080, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=3080)
         0.06147354 = weight(abstract_txt:level in 3080) [ClassicSimilarity], result of:
           0.06147354 = score(doc=3080,freq=3.0), product of:
             0.101064615 = queryWeight, product of:
               2.0053241 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.01121182 = queryNorm
             0.6082598 = fieldWeight in 3080, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.078125 = fieldNorm(doc=3080)
         0.16742322 = weight(abstract_txt:sentence in 3080) [ClassicSimilarity], result of:
           0.16742322 = score(doc=3080,freq=4.0), product of:
             0.15643747 = queryWeight, product of:
               2.037088 = boost
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.01121182 = queryNorm
             1.0702245 = fieldWeight in 3080, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.078125 = fieldNorm(doc=3080)
         0.047252517 = weight(abstract_txt:approach in 3080) [ClassicSimilarity], result of:
           0.047252517 = score(doc=3080,freq=3.0), product of:
             0.09334044 = queryWeight, product of:
               2.225304 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.01121182 = queryNorm
             0.5062384 = fieldWeight in 3080, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=3080)
         0.3239349 = weight(abstract_txt:detection in 3080) [ClassicSimilarity], result of:
           0.3239349 = score(doc=3080,freq=4.0), product of:
             0.30604044 = queryWeight, product of:
               4.029432 = boost
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.01121182 = queryNorm
             1.058471 = fieldWeight in 3080, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.078125 = fieldNorm(doc=3080)
         0.94182587 = weight(abstract_txt:novelty in 3080) [ClassicSimilarity], result of:
           0.94182587 = score(doc=3080,freq=7.0), product of:
             0.59220463 = queryWeight, product of:
               6.864927 = boost
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.01121182 = queryNorm
             1.5903723 = fieldWeight in 3080, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.078125 = fieldNorm(doc=3080)
       0.28 = coord(7/25)
   

2. Bando, L.L.; Scholer, F.; Turpin, A.: Query-biased summary generation assisted by query expansion : temporality (2015) 0.33

   0.3340099 = sum of:
     0.3340099 = product of:
       0.8350247 = sum of:
         0.012180735 = weight(abstract_txt:between in 2820) [ClassicSimilarity], result of:
           0.012180735 = score(doc=2820,freq=2.0), product of:
             0.03985927 = queryWeight, product of:
               1.0282626 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.01121182 = queryNorm
             0.30559355 = fieldWeight in 2820, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.007161774 = weight(abstract_txt:that in 2820) [ClassicSimilarity], result of:
           0.007161774 = score(doc=2820,freq=3.0), product of:
             0.027974399 = queryWeight, product of:
               1.0550314 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01121182 = queryNorm
             0.25601172 = fieldWeight in 2820, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.015481319 = weight(abstract_txt:however in 2820) [ClassicSimilarity], result of:
           0.015481319 = score(doc=2820,freq=1.0), product of:
             0.058924463 = queryWeight, product of:
               1.2502222 = boost
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.01121182 = queryNorm
             0.2627316 = fieldWeight in 2820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.02068351 = weight(abstract_txt:relevant in 2820) [ClassicSimilarity], result of:
           0.02068351 = score(doc=2820,freq=1.0), product of:
             0.07147813 = queryWeight, product of:
               1.3769747 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.01121182 = queryNorm
             0.2893684 = fieldWeight in 2820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.04917883 = weight(abstract_txt:level in 2820) [ClassicSimilarity], result of:
           0.04917883 = score(doc=2820,freq=3.0), product of:
             0.101064615 = queryWeight, product of:
               2.0053241 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.01121182 = queryNorm
             0.48660782 = fieldWeight in 2820, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.13393858 = weight(abstract_txt:sentence in 2820) [ClassicSimilarity], result of:
           0.13393858 = score(doc=2820,freq=4.0), product of:
             0.15643747 = queryWeight, product of:
               2.037088 = boost
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.01121182 = queryNorm
             0.85617965 = fieldWeight in 2820, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.849437 = idf(docFreq=127, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.021825003 = weight(abstract_txt:approach in 2820) [ClassicSimilarity], result of:
           0.021825003 = score(doc=2820,freq=1.0), product of:
             0.09334044 = queryWeight, product of:
               2.225304 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.01121182 = queryNorm
             0.2338215 = fieldWeight in 2820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.049929604 = weight(abstract_txt:relevance in 2820) [ClassicSimilarity], result of:
           0.049929604 = score(doc=2820,freq=1.0), product of:
             0.16205873 = queryWeight, product of:
               2.9321797 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.01121182 = queryNorm
             0.30809575 = fieldWeight in 2820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.23986402 = weight(abstract_txt:sentences in 2820) [ClassicSimilarity], result of:
           0.23986402 = score(doc=2820,freq=5.0), product of:
             0.24515504 = queryWeight, product of:
               3.1232405 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.01121182 = queryNorm
             0.9784177 = fieldWeight in 2820, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
         0.28478137 = weight(abstract_txt:novelty in 2820) [ClassicSimilarity], result of:
           0.28478137 = score(doc=2820,freq=1.0), product of:
             0.59220463 = queryWeight, product of:
               6.864927 = boost
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.01121182 = queryNorm
             0.4808834 = fieldWeight in 2820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.0625 = fieldNorm(doc=2820)
       0.4 = coord(10/25)
   

3. Sweeney, S.; Crestani, F.; Losada, D.E.: 'Show me more' : incremental length summarisation using novelty detection (2008) 0.24

   0.23506366 = sum of:
     0.23506366 = product of:
       0.83951306 = sum of:
         0.010939791 = weight(abstract_txt:that in 3054) [ClassicSimilarity], result of:
           0.010939791 = score(doc=3054,freq=7.0), product of:
             0.027974399 = queryWeight, product of:
               1.0550314 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01121182 = queryNorm
             0.39106438 = fieldWeight in 3054, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3054)
         0.009893292 = weight(abstract_txt:information in 3054) [ClassicSimilarity], result of:
           0.009893292 = score(doc=3054,freq=5.0), product of:
             0.029265635 = queryWeight, product of:
               1.0791057 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01121182 = queryNorm
             0.3380515 = fieldWeight in 3054, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=3054)
         0.02189389 = weight(abstract_txt:however in 3054) [ClassicSimilarity], result of:
           0.02189389 = score(doc=3054,freq=2.0), product of:
             0.058924463 = queryWeight, product of:
               1.2502222 = boost
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.01121182 = queryNorm
             0.3715586 = fieldWeight in 3054, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.0625 = fieldNorm(doc=3054)
         0.049929604 = weight(abstract_txt:relevance in 3054) [ClassicSimilarity], result of:
           0.049929604 = score(doc=3054,freq=1.0), product of:
             0.16205873 = queryWeight, product of:
               2.9321797 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.01121182 = queryNorm
             0.30809575 = fieldWeight in 3054, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.0625 = fieldNorm(doc=3054)
         0.2145409 = weight(abstract_txt:sentences in 3054) [ClassicSimilarity], result of:
           0.2145409 = score(doc=3054,freq=4.0), product of:
             0.24515504 = queryWeight, product of:
               3.1232405 = boost
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.01121182 = queryNorm
             0.8751234 = fieldWeight in 3054, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.000987 = idf(docFreq=109, maxDocs=44421)
               0.0625 = fieldNorm(doc=3054)
         0.12957396 = weight(abstract_txt:detection in 3054) [ClassicSimilarity], result of:
           0.12957396 = score(doc=3054,freq=1.0), product of:
             0.30604044 = queryWeight, product of:
               4.029432 = boost
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.01121182 = queryNorm
             0.42338836 = fieldWeight in 3054, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.0625 = fieldNorm(doc=3054)
         0.40274164 = weight(abstract_txt:novelty in 3054) [ClassicSimilarity], result of:
           0.40274164 = score(doc=3054,freq=2.0), product of:
             0.59220463 = queryWeight, product of:
               6.864927 = boost
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.01121182 = queryNorm
             0.6800718 = fieldWeight in 3054, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.0625 = fieldNorm(doc=3054)
       0.28 = coord(7/25)
   

4. Aksoy, C.; Can, F.; Kocberber, S.: Novelty detection for topic tracking (2012) 0.23

   0.22700603 = sum of:
     0.22700603 = product of:
       0.8107358 = sum of:
         0.007161774 = weight(abstract_txt:that in 1051) [ClassicSimilarity], result of:
           0.007161774 = score(doc=1051,freq=3.0), product of:
             0.027974399 = queryWeight, product of:
               1.0550314 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.01121182 = queryNorm
             0.25601172 = fieldWeight in 1051, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1051)
         0.0044244146 = weight(abstract_txt:information in 1051) [ClassicSimilarity], result of:
           0.0044244146 = score(doc=1051,freq=1.0), product of:
             0.029265635 = queryWeight, product of:
               1.0791057 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01121182 = queryNorm
             0.15118122 = fieldWeight in 1051, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.0625 = fieldNorm(doc=1051)
         0.02189389 = weight(abstract_txt:however in 1051) [ClassicSimilarity], result of:
           0.02189389 = score(doc=1051,freq=2.0), product of:
             0.058924463 = queryWeight, product of:
               1.2502222 = boost
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.01121182 = queryNorm
             0.3715586 = fieldWeight in 1051, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.203706 = idf(docFreq=1803, maxDocs=44421)
               0.0625 = fieldNorm(doc=1051)
         0.030865213 = weight(abstract_txt:approach in 1051) [ClassicSimilarity], result of:
           0.030865213 = score(doc=1051,freq=2.0), product of:
             0.09334044 = queryWeight, product of:
               2.225304 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.01121182 = queryNorm
             0.33067352 = fieldWeight in 1051, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=1051)
         0.069889456 = weight(abstract_txt:topic in 1051) [ClassicSimilarity], result of:
           0.069889456 = score(doc=1051,freq=3.0), product of:
             0.12774819 = queryWeight, product of:
               2.254563 = boost
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.01121182 = queryNorm
             0.5470876 = fieldWeight in 1051, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.053779 = idf(docFreq=770, maxDocs=44421)
               0.0625 = fieldNorm(doc=1051)
         0.18324524 = weight(abstract_txt:detection in 1051) [ClassicSimilarity], result of:
           0.18324524 = score(doc=1051,freq=2.0), product of:
             0.30604044 = queryWeight, product of:
               4.029432 = boost
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.01121182 = queryNorm
             0.59876156 = fieldWeight in 1051, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.774214 = idf(docFreq=137, maxDocs=44421)
               0.0625 = fieldNorm(doc=1051)
         0.4932558 = weight(abstract_txt:novelty in 1051) [ClassicSimilarity], result of:
           0.4932558 = score(doc=1051,freq=3.0), product of:
             0.59220463 = queryWeight, product of:
               6.864927 = boost
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.01121182 = queryNorm
             0.8329145 = fieldWeight in 1051, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.0625 = fieldNorm(doc=1051)
       0.28 = coord(7/25)
   

5. Xu, Y.C..; Chen, Z.: Relevance judgment : what do information users consider beyond topicality? (2006) 0.16

   0.16486013 = sum of:
     0.16486013 = product of:
       0.82430065 = sum of:
         0.0066366214 = weight(abstract_txt:information in 73) [ClassicSimilarity], result of:
           0.0066366214 = score(doc=73,freq=1.0), product of:
             0.029265635 = queryWeight, product of:
               1.0791057 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.01121182 = queryNorm
             0.22677183 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.09375 = fieldNorm(doc=73)
         0.031025266 = weight(abstract_txt:relevant in 73) [ClassicSimilarity], result of:
           0.031025266 = score(doc=73,freq=1.0), product of:
             0.07147813 = queryWeight, product of:
               1.3769747 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.01121182 = queryNorm
             0.4340526 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.09375 = fieldNorm(doc=73)
         0.0327375 = weight(abstract_txt:approach in 73) [ClassicSimilarity], result of:
           0.0327375 = score(doc=73,freq=1.0), product of:
             0.09334044 = queryWeight, product of:
               2.225304 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.01121182 = queryNorm
             0.35073224 = fieldWeight in 73, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.09375 = fieldNorm(doc=73)
         0.14978881 = weight(abstract_txt:relevance in 73) [ClassicSimilarity], result of:
           0.14978881 = score(doc=73,freq=4.0), product of:
             0.16205873 = queryWeight, product of:
               2.9321797 = boost
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.01121182 = queryNorm
             0.92428726 = fieldWeight in 73, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.929532 = idf(docFreq=872, maxDocs=44421)
               0.09375 = fieldNorm(doc=73)
         0.60411245 = weight(abstract_txt:novelty in 73) [ClassicSimilarity], result of:
           0.60411245 = score(doc=73,freq=2.0), product of:
             0.59220463 = queryWeight, product of:
               6.864927 = boost
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.01121182 = queryNorm
             1.0201076 = fieldWeight in 73, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.694134 = idf(docFreq=54, maxDocs=44421)
               0.09375 = fieldNorm(doc=73)
       0.2 = coord(5/25)