Document (#27573)

Author

Crouch, C.J.
Crouch, D.B.
Chen, Q.
Holtz, S.J.

Title

Improving the retrieval effectiveness of very short queries

Source

Information processing and management. 38(2002) no.1, S.1-36

Year

2002

Abstract

This paper describes an automatic approach designed to improve the retrieval effectiveness of very short queries such as those used in web searching. The method is based on the observation that stemming, which is designed to maximize recall, often results in depressed precision. Our approach is based on pseudo-feedback and attempts to increase the number of relevant documents in the pseudo-relevant set by reranking those documents based on the presence of unstemmed query terms in the document text. The original experiments underlying this work were carried out using Smart 11.0 and the lnc.ltc weighting scheme on three sets of documents from the TREC collection with corresponding TREC (title only) topics as queries. (The average length of these queries after stoplisting ranges from 2.4 to 4.5 terms.) Results, evaluated in terms of P@20 and non-interpolated average precision, showed clearly that pseudo-feedback (PF) based on this approach was effective in increasing the number of relevant documents in the top ranks. Subsequent experiments, performed on the same data sets using Smart 13.0 and the improved Lnu.ltu weighting scheme, indicate that these results hold up even over the much higher baseline provided by the new weights. Query drift analysis presents a more detailed picture of the improvements produced by this process.

Theme

Retrievalalgorithmen

Object

TREC

Similar documents (author)

1. Chen, Y.N.; Chen, S.J.: ¬A metadata practice of the OFLA FRBR model : a case study for the National Palace Museum in Taipai (2004) 4.34

   4.3394766 = sum of:
     4.3394766 = weight(author_txt:chen in 4384) [ClassicSimilarity], result of:
       4.3394766 = score(doc=4384,freq=2.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         4.339477 = fieldWeight in 4384, product of:
           1.4142135 = tf(freq=2.0), with freq of:
             2.0 = termFreq=2.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.5 = fieldNorm(doc=4384)
   

2. Chen, C.C.; Chen, H.H.; Chen, K.H.: ¬The design of the XML/Metadata management system (2000) 3.99

   3.9860637 = sum of:
     3.9860637 = weight(author_txt:chen in 5633) [ClassicSimilarity], result of:
       3.9860637 = score(doc=5633,freq=3.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         3.986064 = fieldWeight in 5633, product of:
           1.7320508 = tf(freq=3.0), with freq of:
             3.0 = termFreq=3.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.375 = fieldNorm(doc=5633)
   

3. Chen, W.Y.: Observations on cataloguing and classification (1991) 3.84

   3.8355918 = sum of:
     3.8355918 = weight(author_txt:chen in 4183) [ClassicSimilarity], result of:
       3.8355918 = score(doc=4183,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         3.835592 = fieldWeight in 4183, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.625 = fieldNorm(doc=4183)
   

4. Chen, H.: Knowledge-based document retrieval : framework and design (1992) 3.84

   3.8355918 = sum of:
     3.8355918 = weight(author_txt:chen in 5282) [ClassicSimilarity], result of:
       3.8355918 = score(doc=5282,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         3.835592 = fieldWeight in 5282, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.625 = fieldNorm(doc=5282)
   

5. Chen, P.S.: On inference rules of logic-based information retrieval systems (1994) 3.84

   3.8355918 = sum of:
     3.8355918 = weight(author_txt:chen in 6730) [ClassicSimilarity], result of:
       3.8355918 = score(doc=6730,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.16294746 = queryNorm
         3.835592 = fieldWeight in 6730, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.136947 = idf(docFreq=260, maxDocs=44421)
           0.625 = fieldNorm(doc=6730)
   

Similar documents (content)

1. Karisani, P.; Rahgozar, M.; Oroumchian, F.: Transforming LSA space dimensions into a rubric for an automatic assessment and feedback system (2016) 0.63

   0.6258952 = sum of:
     0.6258952 = product of:
       1.3039484 = sum of:
         0.09878647 = weight(abstract_txt:query in 3970) [ClassicSimilarity], result of:
           0.09878647 = score(doc=3970,freq=8.0), product of:
             0.117535315 = queryWeight, product of:
               1.0220788 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.024186883 = queryNorm
             0.8404833 = fieldWeight in 3970, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.012805575 = weight(abstract_txt:this in 3970) [ClassicSimilarity], result of:
           0.012805575 = score(doc=3970,freq=2.0), product of:
             0.060209647 = queryWeight, product of:
               1.0345422 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.024186883 = queryNorm
             0.21268311 = fieldWeight in 3970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.029018633 = weight(abstract_txt:results in 3970) [ClassicSimilarity], result of:
           0.029018633 = score(doc=3970,freq=2.0), product of:
             0.09437822 = queryWeight, product of:
               1.1217128 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024186883 = queryNorm
             0.30747172 = fieldWeight in 3970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.06336687 = weight(abstract_txt:short in 3970) [ClassicSimilarity], result of:
           0.06336687 = score(doc=3970,freq=1.0), product of:
             0.1748403 = queryWeight, product of:
               1.2465823 = boost
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.024186883 = queryNorm
             0.36242715 = fieldWeight in 3970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.117932126 = weight(abstract_txt:feedback in 3970) [ClassicSimilarity], result of:
           0.117932126 = score(doc=3970,freq=3.0), product of:
             0.18342043 = queryWeight, product of:
               1.2768034 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.024186883 = queryNorm
             0.64296067 = fieldWeight in 3970, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.064461745 = weight(abstract_txt:terms in 3970) [ClassicSimilarity], result of:
           0.064461745 = score(doc=3970,freq=4.0), product of:
             0.12752984 = queryWeight, product of:
               1.3039223 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.024186883 = queryNorm
             0.505464 = fieldWeight in 3970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.020960944 = weight(abstract_txt:based in 3970) [ClassicSimilarity], result of:
           0.020960944 = score(doc=3970,freq=1.0), product of:
             0.10536198 = queryWeight, product of:
               1.3685389 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.024186883 = queryNorm
             0.1989422 = fieldWeight in 3970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.06841631 = weight(abstract_txt:relevant in 3970) [ClassicSimilarity], result of:
           0.06841631 = score(doc=3970,freq=2.0), product of:
             0.16718356 = queryWeight, product of:
               1.4929408 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.024186883 = queryNorm
             0.40922868 = fieldWeight in 3970, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.22046053 = weight(abstract_txt:weighting in 3970) [ClassicSimilarity], result of:
           0.22046053 = score(doc=3970,freq=4.0), product of:
             0.25289133 = queryWeight, product of:
               1.4992261 = boost
               6.9740796 = idf(docFreq=112, maxDocs=44421)
               0.024186883 = queryNorm
             0.87175995 = fieldWeight in 3970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.9740796 = idf(docFreq=112, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.09112591 = weight(abstract_txt:documents in 3970) [ClassicSimilarity], result of:
           0.09112591 = score(doc=3970,freq=4.0), product of:
             0.17680097 = queryWeight, product of:
               1.7727908 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.024186883 = queryNorm
             0.51541525 = fieldWeight in 3970, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.086295605 = weight(abstract_txt:queries in 3970) [ClassicSimilarity], result of:
           0.086295605 = score(doc=3970,freq=1.0), product of:
             0.27064654 = queryWeight, product of:
               2.1933928 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.024186883 = queryNorm
             0.31884983 = fieldWeight in 3970, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
         0.43031764 = weight(abstract_txt:pseudo in 3970) [ClassicSimilarity], result of:
           0.43031764 = score(doc=3970,freq=3.0), product of:
             0.497641 = queryWeight, product of:
               2.5757508 = boost
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.024186883 = queryNorm
             0.86471504 = fieldWeight in 3970, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.0625 = fieldNorm(doc=3970)
       0.48 = coord(12/25)
   

2. Yang, L.; Ji, D.; Leong, M.: Document reranking by term distribution and maximal marginal relevance for chinese information retrieval (2007) 0.49

   0.48552492 = sum of:
     0.48552492 = product of:
       1.0115103 = sum of:
         0.23130469 = weight(abstract_txt:reranking in 1907) [ClassicSimilarity], result of:
           0.23130469 = score(doc=1907,freq=2.0), product of:
             0.22502442 = queryWeight, product of:
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.024186883 = queryNorm
             1.0279093 = fieldWeight in 1907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.303573 = idf(docFreq=10, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.011318636 = weight(abstract_txt:this in 1907) [ClassicSimilarity], result of:
           0.011318636 = score(doc=1907,freq=1.0), product of:
             0.060209647 = queryWeight, product of:
               1.0345422 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.024186883 = queryNorm
             0.18798709 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.048456915 = weight(abstract_txt:very in 1907) [ClassicSimilarity], result of:
           0.048456915 = score(doc=1907,freq=1.0), product of:
             0.12599806 = queryWeight, product of:
               1.0582349 = boost
               4.922683 = idf(docFreq=878, maxDocs=44421)
               0.024186883 = queryNorm
             0.3845846 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.922683 = idf(docFreq=878, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.094893545 = weight(abstract_txt:scheme in 1907) [ClassicSimilarity], result of:
           0.094893545 = score(doc=1907,freq=2.0), product of:
             0.15653369 = queryWeight, product of:
               1.1795167 = boost
               5.4868593 = idf(docFreq=499, maxDocs=44421)
               0.024186883 = queryNorm
             0.60621804 = fieldWeight in 1907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4868593 = idf(docFreq=499, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.06845399 = weight(abstract_txt:precision in 1907) [ClassicSimilarity], result of:
           0.06845399 = score(doc=1907,freq=1.0), product of:
             0.15863264 = queryWeight, product of:
               1.1873983 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.024186883 = queryNorm
             0.43152526 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.0835277 = weight(abstract_txt:average in 1907) [ClassicSimilarity], result of:
           0.0835277 = score(doc=1907,freq=1.0), product of:
             0.18113972 = queryWeight, product of:
               1.2688404 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.024186883 = queryNorm
             0.46112302 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.08511019 = weight(abstract_txt:feedback in 1907) [ClassicSimilarity], result of:
           0.08511019 = score(doc=1907,freq=1.0), product of:
             0.18342043 = queryWeight, product of:
               1.2768034 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.024186883 = queryNorm
             0.4640169 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.040288594 = weight(abstract_txt:terms in 1907) [ClassicSimilarity], result of:
           0.040288594 = score(doc=1907,freq=1.0), product of:
             0.12752984 = queryWeight, product of:
               1.3039223 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.024186883 = queryNorm
             0.31591502 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.026201181 = weight(abstract_txt:based in 1907) [ClassicSimilarity], result of:
           0.026201181 = score(doc=1907,freq=1.0), product of:
             0.10536198 = queryWeight, product of:
               1.3685389 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.024186883 = queryNorm
             0.24867775 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.085520394 = weight(abstract_txt:relevant in 1907) [ClassicSimilarity], result of:
           0.085520394 = score(doc=1907,freq=2.0), product of:
             0.16718356 = queryWeight, product of:
               1.4929408 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.024186883 = queryNorm
             0.5115359 = fieldWeight in 1907, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.13778783 = weight(abstract_txt:weighting in 1907) [ClassicSimilarity], result of:
           0.13778783 = score(doc=1907,freq=1.0), product of:
             0.25289133 = queryWeight, product of:
               1.4992261 = boost
               6.9740796 = idf(docFreq=112, maxDocs=44421)
               0.024186883 = queryNorm
             0.54485 = fieldWeight in 1907, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9740796 = idf(docFreq=112, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
         0.09864669 = weight(abstract_txt:documents in 1907) [ClassicSimilarity], result of:
           0.09864669 = score(doc=1907,freq=3.0), product of:
             0.17680097 = queryWeight, product of:
               1.7727908 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.024186883 = queryNorm
             0.55795336 = fieldWeight in 1907, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.078125 = fieldNorm(doc=1907)
       0.48 = coord(12/25)
   

3. Pan, M.; Huang, J.X.; He, T.; Mao, Z.; Ying, Z.; Tu, X.: ¬A simple kernel co-occurrence-based enhancement for pseudo-relevance feedback (2020) 0.47

   0.46878558 = sum of:
     0.46878558 = product of:
       0.9015108 = sum of:
         0.06985258 = weight(abstract_txt:query in 678) [ClassicSimilarity], result of:
           0.06985258 = score(doc=678,freq=4.0), product of:
             0.117535315 = queryWeight, product of:
               1.0220788 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.024186883 = queryNorm
             0.5943115 = fieldWeight in 678, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.009054909 = weight(abstract_txt:this in 678) [ClassicSimilarity], result of:
           0.009054909 = score(doc=678,freq=1.0), product of:
             0.060209647 = queryWeight, product of:
               1.0345422 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.024186883 = queryNorm
             0.15038967 = fieldWeight in 678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.07833818 = weight(abstract_txt:sets in 678) [ClassicSimilarity], result of:
           0.07833818 = score(doc=678,freq=3.0), product of:
             0.1396396 = queryWeight, product of:
               1.1140494 = boost
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.024186883 = queryNorm
             0.5610026 = fieldWeight in 678, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.18232 = idf(docFreq=677, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.029018633 = weight(abstract_txt:results in 678) [ClassicSimilarity], result of:
           0.029018633 = score(doc=678,freq=2.0), product of:
             0.09437822 = queryWeight, product of:
               1.1217128 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024186883 = queryNorm
             0.30747172 = fieldWeight in 678, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.04906091 = weight(abstract_txt:experiments in 678) [ClassicSimilarity], result of:
           0.04906091 = score(doc=678,freq=1.0), product of:
             0.14742024 = queryWeight, product of:
               1.1446658 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.024186883 = queryNorm
             0.3327963 = fieldWeight in 678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.05476319 = weight(abstract_txt:precision in 678) [ClassicSimilarity], result of:
           0.05476319 = score(doc=678,freq=1.0), product of:
             0.15863264 = queryWeight, product of:
               1.1873983 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.024186883 = queryNorm
             0.3452202 = fieldWeight in 678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.06682216 = weight(abstract_txt:average in 678) [ClassicSimilarity], result of:
           0.06682216 = score(doc=678,freq=1.0), product of:
             0.18113972 = queryWeight, product of:
               1.2688404 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.024186883 = queryNorm
             0.36889842 = fieldWeight in 678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.068088144 = weight(abstract_txt:feedback in 678) [ClassicSimilarity], result of:
           0.068088144 = score(doc=678,freq=1.0), product of:
             0.18342043 = queryWeight, product of:
               1.2768034 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.024186883 = queryNorm
             0.37121353 = fieldWeight in 678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.0789492 = weight(abstract_txt:terms in 678) [ClassicSimilarity], result of:
           0.0789492 = score(doc=678,freq=6.0), product of:
             0.12752984 = queryWeight, product of:
               1.3039223 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.024186883 = queryNorm
             0.6190645 = fieldWeight in 678, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.03630542 = weight(abstract_txt:based in 678) [ClassicSimilarity], result of:
           0.03630542 = score(doc=678,freq=3.0), product of:
             0.10536198 = queryWeight, product of:
               1.3685389 = boost
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.024186883 = queryNorm
             0.344578 = fieldWeight in 678, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1830752 = idf(docFreq=5005, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.048377637 = weight(abstract_txt:relevant in 678) [ClassicSimilarity], result of:
           0.048377637 = score(doc=678,freq=1.0), product of:
             0.16718356 = queryWeight, product of:
               1.4929408 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.024186883 = queryNorm
             0.2893684 = fieldWeight in 678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.06443575 = weight(abstract_txt:documents in 678) [ClassicSimilarity], result of:
           0.06443575 = score(doc=678,freq=2.0), product of:
             0.17680097 = queryWeight, product of:
               1.7727908 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.024186883 = queryNorm
             0.3644536 = fieldWeight in 678, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
         0.24844402 = weight(abstract_txt:pseudo in 678) [ClassicSimilarity], result of:
           0.24844402 = score(doc=678,freq=1.0), product of:
             0.497641 = queryWeight, product of:
               2.5757508 = boost
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.024186883 = queryNorm
             0.49924347 = fieldWeight in 678, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.0625 = fieldNorm(doc=678)
       0.52 = coord(13/25)
   

4. Wong, W.S.; Luk, R.W.P.; Leong, H.V.; Ho, K.S.; Lee, D.L.: Re-examining the effects of adding relevance information in a relevance feedback environment (2008) 0.45

   0.44898817 = sum of:
     0.44898817 = product of:
       0.935392 = sum of:
         0.049393237 = weight(abstract_txt:query in 3084) [ClassicSimilarity], result of:
           0.049393237 = score(doc=3084,freq=2.0), product of:
             0.117535315 = queryWeight, product of:
               1.0220788 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.024186883 = queryNorm
             0.42024165 = fieldWeight in 3084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.015683562 = weight(abstract_txt:this in 3084) [ClassicSimilarity], result of:
           0.015683562 = score(doc=3084,freq=3.0), product of:
             0.060209647 = queryWeight, product of:
               1.0345422 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.024186883 = queryNorm
             0.26048255 = fieldWeight in 3084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.0744959 = weight(abstract_txt:effectiveness in 3084) [ClassicSimilarity], result of:
           0.0744959 = score(doc=3084,freq=3.0), product of:
             0.13503547 = queryWeight, product of:
               1.0955296 = boost
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.024186883 = queryNorm
             0.5516765 = fieldWeight in 3084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.0961695 = idf(docFreq=738, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.084975995 = weight(abstract_txt:experiments in 3084) [ClassicSimilarity], result of:
           0.084975995 = score(doc=3084,freq=3.0), product of:
             0.14742024 = queryWeight, product of:
               1.1446658 = boost
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.024186883 = queryNorm
             0.5764201 = fieldWeight in 3084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.324741 = idf(docFreq=587, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.05476319 = weight(abstract_txt:precision in 3084) [ClassicSimilarity], result of:
           0.05476319 = score(doc=3084,freq=1.0), product of:
             0.15863264 = queryWeight, product of:
               1.1873983 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.024186883 = queryNorm
             0.3452202 = fieldWeight in 3084, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.0945008 = weight(abstract_txt:average in 3084) [ClassicSimilarity], result of:
           0.0945008 = score(doc=3084,freq=2.0), product of:
             0.18113972 = queryWeight, product of:
               1.2688404 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.024186883 = queryNorm
             0.52170116 = fieldWeight in 3084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.117932126 = weight(abstract_txt:feedback in 3084) [ClassicSimilarity], result of:
           0.117932126 = score(doc=3084,freq=3.0), product of:
             0.18342043 = queryWeight, product of:
               1.2768034 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.024186883 = queryNorm
             0.64296067 = fieldWeight in 3084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.05582551 = weight(abstract_txt:terms in 3084) [ClassicSimilarity], result of:
           0.05582551 = score(doc=3084,freq=3.0), product of:
             0.12752984 = queryWeight, product of:
               1.3039223 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.024186883 = queryNorm
             0.43774468 = fieldWeight in 3084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.13848627 = weight(abstract_txt:trec in 3084) [ClassicSimilarity], result of:
           0.13848627 = score(doc=3084,freq=2.0), product of:
             0.23370133 = queryWeight, product of:
               1.4412216 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.024186883 = queryNorm
             0.592578 = fieldWeight in 3084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.048377637 = weight(abstract_txt:relevant in 3084) [ClassicSimilarity], result of:
           0.048377637 = score(doc=3084,freq=1.0), product of:
             0.16718356 = queryWeight, product of:
               1.4929408 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.024186883 = queryNorm
             0.2893684 = fieldWeight in 3084, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.078917354 = weight(abstract_txt:documents in 3084) [ClassicSimilarity], result of:
           0.078917354 = score(doc=3084,freq=3.0), product of:
             0.17680097 = queryWeight, product of:
               1.7727908 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.024186883 = queryNorm
             0.4463627 = fieldWeight in 3084, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
         0.12204041 = weight(abstract_txt:queries in 3084) [ClassicSimilarity], result of:
           0.12204041 = score(doc=3084,freq=2.0), product of:
             0.27064654 = queryWeight, product of:
               2.1933928 = boost
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.024186883 = queryNorm
             0.45092174 = fieldWeight in 3084, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1015973 = idf(docFreq=734, maxDocs=44421)
               0.0625 = fieldNorm(doc=3084)
       0.48 = coord(12/25)
   

5. Li, X.: ¬A new robust relevance model in the language model framework (2008) 0.43

   0.42705467 = sum of:
     0.42705467 = product of:
       0.9705788 = sum of:
         0.03492629 = weight(abstract_txt:query in 3076) [ClassicSimilarity], result of:
           0.03492629 = score(doc=3076,freq=1.0), product of:
             0.117535315 = queryWeight, product of:
               1.0220788 = boost
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.024186883 = queryNorm
             0.29715574 = fieldWeight in 3076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.754492 = idf(docFreq=1039, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.009054909 = weight(abstract_txt:this in 3076) [ClassicSimilarity], result of:
           0.009054909 = score(doc=3076,freq=1.0), product of:
             0.060209647 = queryWeight, product of:
               1.0345422 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.024186883 = queryNorm
             0.15038967 = fieldWeight in 3076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.020519273 = weight(abstract_txt:results in 3076) [ClassicSimilarity], result of:
           0.020519273 = score(doc=3076,freq=1.0), product of:
             0.09437822 = queryWeight, product of:
               1.1217128 = boost
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.024186883 = queryNorm
             0.21741535 = fieldWeight in 3076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4786456 = idf(docFreq=3724, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.05476319 = weight(abstract_txt:precision in 3076) [ClassicSimilarity], result of:
           0.05476319 = score(doc=3076,freq=1.0), product of:
             0.15863264 = queryWeight, product of:
               1.1873983 = boost
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.024186883 = queryNorm
             0.3452202 = fieldWeight in 3076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5235233 = idf(docFreq=481, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.06336687 = weight(abstract_txt:short in 3076) [ClassicSimilarity], result of:
           0.06336687 = score(doc=3076,freq=1.0), product of:
             0.1748403 = queryWeight, product of:
               1.2465823 = boost
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.024186883 = queryNorm
             0.36242715 = fieldWeight in 3076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.06682216 = weight(abstract_txt:average in 3076) [ClassicSimilarity], result of:
           0.06682216 = score(doc=3076,freq=1.0), product of:
             0.18113972 = queryWeight, product of:
               1.2688404 = boost
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.024186883 = queryNorm
             0.36889842 = fieldWeight in 3076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9023747 = idf(docFreq=329, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.117932126 = weight(abstract_txt:feedback in 3076) [ClassicSimilarity], result of:
           0.117932126 = score(doc=3076,freq=3.0), product of:
             0.18342043 = queryWeight, product of:
               1.2768034 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.024186883 = queryNorm
             0.64296067 = fieldWeight in 3076, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.045581337 = weight(abstract_txt:terms in 3076) [ClassicSimilarity], result of:
           0.045581337 = score(doc=3076,freq=2.0), product of:
             0.12752984 = queryWeight, product of:
               1.3039223 = boost
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.024186883 = queryNorm
             0.35741702 = fieldWeight in 3076, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.043712 = idf(docFreq=2116, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.048377637 = weight(abstract_txt:relevant in 3076) [ClassicSimilarity], result of:
           0.048377637 = score(doc=3076,freq=1.0), product of:
             0.16718356 = queryWeight, product of:
               1.4929408 = boost
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.024186883 = queryNorm
             0.2893684 = fieldWeight in 3076, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6298943 = idf(docFreq=1177, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.078917354 = weight(abstract_txt:documents in 3076) [ClassicSimilarity], result of:
           0.078917354 = score(doc=3076,freq=3.0), product of:
             0.17680097 = queryWeight, product of:
               1.7727908 = boost
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.024186883 = queryNorm
             0.4463627 = fieldWeight in 3076, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.123322 = idf(docFreq=1954, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
         0.43031764 = weight(abstract_txt:pseudo in 3076) [ClassicSimilarity], result of:
           0.43031764 = score(doc=3076,freq=3.0), product of:
             0.497641 = queryWeight, product of:
               2.5757508 = boost
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.024186883 = queryNorm
             0.86471504 = fieldWeight in 3076, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.9878955 = idf(docFreq=40, maxDocs=44421)
               0.0625 = fieldNorm(doc=3076)
       0.44 = coord(11/25)