Document (#19153)

Author

Bartell, B.T.
Cottrell, G.W.
Belew, R.K.

Title

Optimizing similarity using multi-query relevance feedback

Source

Journal of the American Society for Information Science. 49(1998) no.8, S.742-761

Year

1998

Abstract

We propose a novel method for automatically adjusting paprameters in ranked-output text retrieval systems to improve retrieval performance. A renaked-output text retrieval system implements a ranking function which orders documents, placing documents estimated to be more relevant to the user's query before less relevant ones. The systems adjusts its parameters to maximize the match between the systems's document ordering and a target ordering. The target ordering is typically given by user feedback on a set of sample queries, but is more generally any document preference relation. We demonstrate the utility of the approach by using it to estimate a similarity measure (scoring the relevance of documents to queries) in a vector space model of information retrieval. Experimental results using several collections indicate that the approach automatically finds a simimilarity measure which performs equivalently to or better that all 'classic' similarity measures studied. It also performs within 1% of an estimated optimal measure (found by exhaustive sampling of the similarity measures). The method is compared to two alternative methods: a perceptron learning rule motivated by Wong and Yao's (1990) Query Formulation method, and a Least Squared learning rule, motivated by Fuhr and Buckley's (1991) Probabilisitc Learning approach. Though both alternatives have useful characteristics, we demonstrate empirically that neither can be used to estimate the parameters of the optimal similarity measure

Similar documents (content)

1. Vechtomova, O.; Robertson, S.E.: ¬A domain-independent approach to finding related entities (2012) 0.31

   0.31118694 = sum of:
     0.31118694 = product of:
       0.77796733 = sum of:
         0.021945456 = weight(abstract_txt:using in 3733) [ClassicSimilarity], result of:
           0.021945456 = score(doc=3733,freq=1.0), product of:
             0.081259 = queryWeight, product of:
               1.0465103 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.022461813 = queryNorm
             0.27006802 = fieldWeight in 3733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.054842647 = weight(abstract_txt:demonstrate in 3733) [ClassicSimilarity], result of:
           0.054842647 = score(doc=3733,freq=1.0), product of:
             0.13072447 = queryWeight, product of:
               1.0837787 = boost
               5.3699656 = idf(docFreq=561, maxDocs=44421)
               0.022461813 = queryNorm
             0.41952854 = fieldWeight in 3733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3699656 = idf(docFreq=561, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.027816884 = weight(abstract_txt:approach in 3733) [ClassicSimilarity], result of:
           0.027816884 = score(doc=3733,freq=1.0), product of:
             0.09517306 = queryWeight, product of:
               1.1325693 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.022461813 = queryNorm
             0.29227686 = fieldWeight in 3733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.03724234 = weight(abstract_txt:documents in 3733) [ClassicSimilarity], result of:
           0.03724234 = score(doc=3733,freq=1.0), product of:
             0.11561115 = queryWeight, product of:
               1.2482675 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.022461813 = queryNorm
             0.32213452 = fieldWeight in 3733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.14214323 = weight(abstract_txt:target in 3733) [ClassicSimilarity], result of:
           0.14214323 = score(doc=3733,freq=2.0), product of:
             0.1957727 = queryWeight, product of:
               1.3262892 = boost
               6.571569 = idf(docFreq=168, maxDocs=44421)
               0.022461813 = queryNorm
             0.72606266 = fieldWeight in 3733, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.571569 = idf(docFreq=168, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.048371237 = weight(abstract_txt:method in 3733) [ClassicSimilarity], result of:
           0.048371237 = score(doc=3733,freq=1.0), product of:
             0.1376258 = queryWeight, product of:
               1.3619392 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.022461813 = queryNorm
             0.35146925 = fieldWeight in 3733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.0297619 = weight(abstract_txt:retrieval in 3733) [ClassicSimilarity], result of:
           0.0297619 = score(doc=3733,freq=1.0), product of:
             0.109579265 = queryWeight, product of:
               1.4032704 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.022461813 = queryNorm
             0.27160156 = fieldWeight in 3733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.12767108 = weight(abstract_txt:query in 3733) [ClassicSimilarity], result of:
           0.12767108 = score(doc=3733,freq=5.0), product of:
             0.15371399 = queryWeight, product of:
               1.4393437 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.022461813 = queryNorm
             0.8305755 = fieldWeight in 3733, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.11379212 = weight(abstract_txt:measure in 3733) [ClassicSimilarity], result of:
           0.11379212 = score(doc=3733,freq=1.0), product of:
             0.26793498 = queryWeight, product of:
               2.1942792 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.022461813 = queryNorm
             0.4247005 = fieldWeight in 3733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
         0.17438039 = weight(abstract_txt:similarity in 3733) [ClassicSimilarity], result of:
           0.17438039 = score(doc=3733,freq=1.0), product of:
             0.38363928 = queryWeight, product of:
               2.9355786 = boost
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.022461813 = queryNorm
             0.4545426 = fieldWeight in 3733, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.078125 = fieldNorm(doc=3733)
       0.4 = coord(10/25)
   

2. Vechtomova, O.: ¬A method for automatic extraction of multiword units representing business aspects from user reviews (2014) 0.26

   0.26398453 = sum of:
     0.26398453 = product of:
       0.82495165 = sum of:
         0.021945456 = weight(abstract_txt:using in 2304) [ClassicSimilarity], result of:
           0.021945456 = score(doc=2304,freq=1.0), product of:
             0.081259 = queryWeight, product of:
               1.0465103 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.022461813 = queryNorm
             0.27006802 = fieldWeight in 2304, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.078125 = fieldNorm(doc=2304)
         0.056540668 = weight(abstract_txt:measures in 2304) [ClassicSimilarity], result of:
           0.056540668 = score(doc=2304,freq=1.0), product of:
             0.13340904 = queryWeight, product of:
               1.0948504 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.022461813 = queryNorm
             0.4238144 = fieldWeight in 2304, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=2304)
         0.027816884 = weight(abstract_txt:approach in 2304) [ClassicSimilarity], result of:
           0.027816884 = score(doc=2304,freq=1.0), product of:
             0.09517306 = queryWeight, product of:
               1.1325693 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.022461813 = queryNorm
             0.29227686 = fieldWeight in 2304, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=2304)
         0.14214323 = weight(abstract_txt:target in 2304) [ClassicSimilarity], result of:
           0.14214323 = score(doc=2304,freq=2.0), product of:
             0.1957727 = queryWeight, product of:
               1.3262892 = boost
               6.571569 = idf(docFreq=168, maxDocs=44421)
               0.022461813 = queryNorm
             0.72606266 = fieldWeight in 2304, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.571569 = idf(docFreq=168, maxDocs=44421)
               0.078125 = fieldNorm(doc=2304)
         0.08378144 = weight(abstract_txt:method in 2304) [ClassicSimilarity], result of:
           0.08378144 = score(doc=2304,freq=3.0), product of:
             0.1376258 = queryWeight, product of:
               1.3619392 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.022461813 = queryNorm
             0.6087626 = fieldWeight in 2304, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=2304)
         0.0297619 = weight(abstract_txt:retrieval in 2304) [ClassicSimilarity], result of:
           0.0297619 = score(doc=2304,freq=1.0), product of:
             0.109579265 = queryWeight, product of:
               1.4032704 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.022461813 = queryNorm
             0.27160156 = fieldWeight in 2304, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=2304)
         0.16092634 = weight(abstract_txt:measure in 2304) [ClassicSimilarity], result of:
           0.16092634 = score(doc=2304,freq=2.0), product of:
             0.26793498 = queryWeight, product of:
               2.1942792 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.022461813 = queryNorm
             0.6006172 = fieldWeight in 2304, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=2304)
         0.3020357 = weight(abstract_txt:similarity in 2304) [ClassicSimilarity], result of:
           0.3020357 = score(doc=2304,freq=3.0), product of:
             0.38363928 = queryWeight, product of:
               2.9355786 = boost
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.022461813 = queryNorm
             0.7872909 = fieldWeight in 2304, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.078125 = fieldNorm(doc=2304)
       0.32 = coord(8/25)
   

3. Mehtre, B.M.; Kankanhalli, M.S.; Lee, W.F.: Shape measures for content based image retrieval : a comparison (1997) 0.26

   0.26212558 = sum of:
     0.26212558 = product of:
       0.81914246 = sum of:
         0.079802915 = weight(abstract_txt:queries in 4472) [ClassicSimilarity], result of:
           0.079802915 = score(doc=4472,freq=2.0), product of:
             0.117984876 = queryWeight, product of:
               1.0296161 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.022461813 = queryNorm
             0.6763826 = fieldWeight in 4472, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.09375 = fieldNorm(doc=4472)
         0.026334548 = weight(abstract_txt:using in 4472) [ClassicSimilarity], result of:
           0.026334548 = score(doc=4472,freq=1.0), product of:
             0.081259 = queryWeight, product of:
               1.0465103 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.022461813 = queryNorm
             0.32408163 = fieldWeight in 4472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.09375 = fieldNorm(doc=4472)
         0.117517576 = weight(abstract_txt:measures in 4472) [ClassicSimilarity], result of:
           0.117517576 = score(doc=4472,freq=3.0), product of:
             0.13340904 = queryWeight, product of:
               1.0948504 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.022461813 = queryNorm
             0.88088167 = fieldWeight in 4472, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.09375 = fieldNorm(doc=4472)
         0.071539335 = weight(abstract_txt:automatically in 4472) [ClassicSimilarity], result of:
           0.071539335 = score(doc=4472,freq=1.0), product of:
             0.13820392 = queryWeight, product of:
               1.1143519 = boost
               5.521451 = idf(docFreq=482, maxDocs=44421)
               0.022461813 = queryNorm
             0.51763606 = fieldWeight in 4472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.521451 = idf(docFreq=482, maxDocs=44421)
               0.09375 = fieldNorm(doc=4472)
         0.08807069 = weight(abstract_txt:output in 4472) [ClassicSimilarity], result of:
           0.08807069 = score(doc=4472,freq=1.0), product of:
             0.15874915 = queryWeight, product of:
               1.1943122 = boost
               5.9176426 = idf(docFreq=324, maxDocs=44421)
               0.022461813 = queryNorm
             0.554779 = fieldWeight in 4472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9176426 = idf(docFreq=324, maxDocs=44421)
               0.09375 = fieldNorm(doc=4472)
         0.07142856 = weight(abstract_txt:retrieval in 4472) [ClassicSimilarity], result of:
           0.07142856 = score(doc=4472,freq=4.0), product of:
             0.109579265 = queryWeight, product of:
               1.4032704 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.022461813 = queryNorm
             0.6518438 = fieldWeight in 4472, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=4472)
         0.06851549 = weight(abstract_txt:query in 4472) [ClassicSimilarity], result of:
           0.06851549 = score(doc=4472,freq=1.0), product of:
             0.15371399 = queryWeight, product of:
               1.4393437 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.022461813 = queryNorm
             0.4457336 = fieldWeight in 4472, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.09375 = fieldNorm(doc=4472)
         0.29593334 = weight(abstract_txt:similarity in 4472) [ClassicSimilarity], result of:
           0.29593334 = score(doc=4472,freq=2.0), product of:
             0.38363928 = queryWeight, product of:
               2.9355786 = boost
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.022461813 = queryNorm
             0.77138436 = fieldWeight in 4472, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.09375 = fieldNorm(doc=4472)
       0.32 = coord(8/25)
   

4. Huang, L.; Milne, D.; Frank, E.; Witten, I.H.: Learning a concept-based document similarity measure (2012) 0.25

   0.24966338 = sum of:
     0.24966338 = product of:
       0.7801981 = sum of:
         0.021945456 = weight(abstract_txt:using in 1372) [ClassicSimilarity], result of:
           0.021945456 = score(doc=1372,freq=1.0), product of:
             0.081259 = queryWeight, product of:
               1.0465103 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.022461813 = queryNorm
             0.27006802 = fieldWeight in 1372, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.078125 = fieldNorm(doc=1372)
         0.07996058 = weight(abstract_txt:measures in 1372) [ClassicSimilarity], result of:
           0.07996058 = score(doc=1372,freq=2.0), product of:
             0.13340904 = queryWeight, product of:
               1.0948504 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.022461813 = queryNorm
             0.59936404 = fieldWeight in 1372, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=1372)
         0.052668624 = weight(abstract_txt:documents in 1372) [ClassicSimilarity], result of:
           0.052668624 = score(doc=1372,freq=2.0), product of:
             0.11561115 = queryWeight, product of:
               1.2482675 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.022461813 = queryNorm
             0.455567 = fieldWeight in 1372, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=1372)
         0.0297619 = weight(abstract_txt:retrieval in 1372) [ClassicSimilarity], result of:
           0.0297619 = score(doc=1372,freq=1.0), product of:
             0.109579265 = queryWeight, product of:
               1.4032704 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.022461813 = queryNorm
             0.27160156 = fieldWeight in 1372, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.078125 = fieldNorm(doc=1372)
         0.056649864 = weight(abstract_txt:learning in 1372) [ClassicSimilarity], result of:
           0.056649864 = score(doc=1372,freq=1.0), product of:
             0.15291178 = queryWeight, product of:
               1.4355829 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.022461813 = queryNorm
             0.37047416 = fieldWeight in 1372, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.078125 = fieldNorm(doc=1372)
         0.13167424 = weight(abstract_txt:estimate in 1372) [ClassicSimilarity], result of:
           0.13167424 = score(doc=1372,freq=1.0), product of:
             0.23439328 = queryWeight, product of:
               1.451225 = boost
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.022461813 = queryNorm
             0.56176627 = fieldWeight in 1372, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.078125 = fieldNorm(doc=1372)
         0.16092634 = weight(abstract_txt:measure in 1372) [ClassicSimilarity], result of:
           0.16092634 = score(doc=1372,freq=2.0), product of:
             0.26793498 = queryWeight, product of:
               2.1942792 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.022461813 = queryNorm
             0.6006172 = fieldWeight in 1372, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.078125 = fieldNorm(doc=1372)
         0.24661112 = weight(abstract_txt:similarity in 1372) [ClassicSimilarity], result of:
           0.24661112 = score(doc=1372,freq=2.0), product of:
             0.38363928 = queryWeight, product of:
               2.9355786 = boost
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.022461813 = queryNorm
             0.6428203 = fieldWeight in 1372, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8181453 = idf(docFreq=358, maxDocs=44421)
               0.078125 = fieldNorm(doc=1372)
       0.32 = coord(8/25)
   

5. Bodoff, D.; Wu, B.; Wong, K.Y.M.: Relevance data for language models using maximum likelihood (2003) 0.25

   0.24805062 = sum of:
     0.24805062 = product of:
       0.68902946 = sum of:
         0.05642919 = weight(abstract_txt:queries in 2822) [ClassicSimilarity], result of:
           0.05642919 = score(doc=2822,freq=1.0), product of:
             0.117984876 = queryWeight, product of:
               1.0296161 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.022461813 = queryNorm
             0.47827476 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
         0.026334548 = weight(abstract_txt:using in 2822) [ClassicSimilarity], result of:
           0.026334548 = score(doc=2822,freq=1.0), product of:
             0.081259 = queryWeight, product of:
               1.0465103 = boost
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.022461813 = queryNorm
             0.32408163 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4568708 = idf(docFreq=3806, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
         0.03338026 = weight(abstract_txt:approach in 2822) [ClassicSimilarity], result of:
           0.03338026 = score(doc=2822,freq=1.0), product of:
             0.09517306 = queryWeight, product of:
               1.1325693 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.022461813 = queryNorm
             0.35073224 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
         0.044690814 = weight(abstract_txt:documents in 2822) [ClassicSimilarity], result of:
           0.044690814 = score(doc=2822,freq=1.0), product of:
             0.11561115 = queryWeight, product of:
               1.2482675 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.022461813 = queryNorm
             0.38656145 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
         0.100537725 = weight(abstract_txt:method in 2822) [ClassicSimilarity], result of:
           0.100537725 = score(doc=2822,freq=3.0), product of:
             0.1376258 = queryWeight, product of:
               1.3619392 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.022461813 = queryNorm
             0.7305151 = fieldWeight in 2822, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
         0.137038 = weight(abstract_txt:parameters in 2822) [ClassicSimilarity], result of:
           0.137038 = score(doc=2822,freq=1.0), product of:
             0.21316594 = queryWeight, product of:
               1.3839521 = boost
               6.8572807 = idf(docFreq=126, maxDocs=44421)
               0.022461813 = queryNorm
             0.64287007 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8572807 = idf(docFreq=126, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
         0.03571428 = weight(abstract_txt:retrieval in 2822) [ClassicSimilarity], result of:
           0.03571428 = score(doc=2822,freq=1.0), product of:
             0.109579265 = queryWeight, product of:
               1.4032704 = boost
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.022461813 = queryNorm
             0.3259219 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4765 = idf(docFreq=3732, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
         0.09689553 = weight(abstract_txt:query in 2822) [ClassicSimilarity], result of:
           0.09689553 = score(doc=2822,freq=2.0), product of:
             0.15371399 = queryWeight, product of:
               1.4393437 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.022461813 = queryNorm
             0.6303625 = fieldWeight in 2822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
         0.15800908 = weight(abstract_txt:estimate in 2822) [ClassicSimilarity], result of:
           0.15800908 = score(doc=2822,freq=1.0), product of:
             0.23439328 = queryWeight, product of:
               1.451225 = boost
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.022461813 = queryNorm
             0.6741195 = fieldWeight in 2822, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.190608 = idf(docFreq=90, maxDocs=44421)
               0.09375 = fieldNorm(doc=2822)
       0.36 = coord(9/25)