Document (#32937)

Author

Wu, H.C.
Luk, R.W.P.
Wong, K.F,
Kwok, K.L.

Title

¬A retrospective study of a hybrid document-context based retrieval model

Source

Information processing and management. 43(2007) no.5, S.1308-1331

Year

2007

Abstract

This paper describes our novel retrieval model that is based on contexts of query terms in documents (i.e., document contexts). Our model is novel because it explicitly takes into account of the document contexts instead of implicitly using the document contexts to find query expansion terms. Our model is based on simulating a user making relevance decisions, and it is a hybrid of various existing effective models and techniques. It estimates the relevance decision preference of a document context as the log-odds and uses smoothing techniques as found in language models to solve the problem of zero probabilities. It combines these estimated preferences of document contexts using different types of aggregation operators that comply with different relevance decision principles (e.g., aggregate relevance principle). Our model is evaluated using retrospective experiments (i.e., with full relevance information), because such experiments can (a) reveal the potential of our model, (b) isolate the problems of the model from those of the parameter estimation, (c) provide information about the major factors affecting the retrieval effectiveness of the model, and (d) show that whether the model obeys the probability ranking principle. Our model is promising as its mean average precision is 60-80% in our experiments using different TREC ad hoc English collections and the NTCIR-5 ad hoc Chinese collection. Our experiments showed that (a) the operators that are consistent with aggregate relevance principle were effective in combining the estimated preferences, and (b) that estimating probabilities using the contexts in the relevant documents can produce better retrieval effectiveness than using the entire relevant documents.

Similar documents (author)

1. Wong, W.S.; Luk, R.W.P.; Leong, H.V.; Ho, K.S.; Lee, D.L.: Re-examining the effects of adding relevance information in a relevance feedback environment (2008) 2.10

   2.095418 = sum of:
     2.095418 = product of:
       3.1431267 = sum of:
         1.2555132 = weight(author_txt:wong in 2084) [ClassicSimilarity], result of:
           1.2555132 = score(doc=2084,freq=1.0), product of:
             0.48993373 = queryWeight, product of:
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.059745252 = queryNorm
             2.5626185 = fieldWeight in 2084, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.3125 = fieldNorm(doc=2084)
         1.8876135 = weight(author_txt:r.w.p in 2084) [ClassicSimilarity], result of:
           1.8876135 = score(doc=2084,freq=1.0), product of:
             0.6429816 = queryWeight, product of:
               1.1455936 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.059745252 = queryNorm
             2.9357195 = fieldWeight in 2084, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.3125 = fieldNorm(doc=2084)
       0.6666667 = coord(2/3)
   

2. Pong, J.Y.-H.; Kwok, R.C.-W.; Lau, R.Y.-K.; Hao, J.-X.; Wong, P.C.-C.: ¬A comparative study of two automatic document classification methods in a library setting (2008) 1.55

   1.5515263 = sum of:
     1.5515263 = product of:
       2.3272893 = sum of:
         1.0044106 = weight(author_txt:wong in 2532) [ClassicSimilarity], result of:
           1.0044106 = score(doc=2532,freq=1.0), product of:
             0.48993373 = queryWeight, product of:
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.059745252 = queryNorm
             2.0500948 = fieldWeight in 2532, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.25 = fieldNorm(doc=2532)
         1.3228787 = weight(author_txt:kwok in 2532) [ClassicSimilarity], result of:
           1.3228787 = score(doc=2532,freq=1.0), product of:
             0.5886762 = queryWeight, product of:
               1.096149 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.059745252 = queryNorm
             2.2472093 = fieldWeight in 2532, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.25 = fieldNorm(doc=2532)
       0.6666667 = coord(2/3)
   

3. Kwok, K.L.: ¬The use of titles and cited titles as document representations for automatic classification (1975) 1.10

   1.102399 = sum of:
     1.102399 = product of:
       3.3071969 = sum of:
         3.3071969 = weight(author_txt:kwok in 4347) [ClassicSimilarity], result of:
           3.3071969 = score(doc=4347,freq=1.0), product of:
             0.5886762 = queryWeight, product of:
               1.096149 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.059745252 = queryNorm
             5.6180234 = fieldWeight in 4347, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.625 = fieldNorm(doc=4347)
       0.33333334 = coord(1/3)
   

4. Kwok, K.L.: Employing multiple representations for Chinese information retrieval (1999) 1.10

   1.102399 = sum of:
     1.102399 = product of:
       3.3071969 = sum of:
         3.3071969 = weight(author_txt:kwok in 3773) [ClassicSimilarity], result of:
           3.3071969 = score(doc=3773,freq=1.0), product of:
             0.5886762 = queryWeight, product of:
               1.096149 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.059745252 = queryNorm
             5.6180234 = fieldWeight in 3773, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.625 = fieldNorm(doc=3773)
       0.33333334 = coord(1/3)
   

5. Kwok, K.L.: ¬A network approach to probabilistic information retrieval (1995) 1.10

   1.102399 = sum of:
     1.102399 = product of:
       3.3071969 = sum of:
         3.3071969 = weight(author_txt:kwok in 5696) [ClassicSimilarity], result of:
           3.3071969 = score(doc=5696,freq=1.0), product of:
             0.5886762 = queryWeight, product of:
               1.096149 = boost
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.059745252 = queryNorm
             5.6180234 = fieldWeight in 5696, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.625 = fieldNorm(doc=5696)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Lee, J.H.; Kim, M.H.; Lee, Y.J.: Information retrieval based on conceptual distance in is-a hierarchies (1993) 0.36

   0.3591688 = sum of:
     0.3591688 = product of:
       0.74826837 = sum of:
         0.03459965 = weight(abstract_txt:query in 6729) [ClassicSimilarity], result of:
           0.03459965 = score(doc=6729,freq=1.0), product of:
             0.09316311 = queryWeight, product of:
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019597754 = queryNorm
             0.37138787 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.015652198 = weight(abstract_txt:based in 6729) [ClassicSimilarity], result of:
           0.015652198 = score(doc=6729,freq=1.0), product of:
             0.062845886 = queryWeight, product of:
               1.0059168 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.019597754 = queryNorm
             0.24905685 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.036431562 = weight(abstract_txt:effective in 6729) [ClassicSimilarity], result of:
           0.036431562 = score(doc=6729,freq=1.0), product of:
             0.096423164 = queryWeight, product of:
               1.017346 = boost
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.019597754 = queryNorm
             0.37782997 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.042682983 = weight(abstract_txt:effectiveness in 6729) [ClassicSimilarity], result of:
           0.042682983 = score(doc=6729,freq=1.0), product of:
             0.10716 = queryWeight, product of:
               1.0724927 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019597754 = queryNorm
             0.39831078 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.047826476 = weight(abstract_txt:documents in 6729) [ClassicSimilarity], result of:
           0.047826476 = score(doc=6729,freq=2.0), product of:
             0.10503375 = queryWeight, product of:
               1.3004333 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019597754 = queryNorm
             0.4553439 = fieldWeight in 6729, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.02703369 = weight(abstract_txt:retrieval in 6729) [ClassicSimilarity], result of:
           0.02703369 = score(doc=6729,freq=1.0), product of:
             0.099573344 = queryWeight, product of:
               1.4620578 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019597754 = queryNorm
             0.27149525 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.012853942 = weight(abstract_txt:that in 6729) [ClassicSimilarity], result of:
           0.012853942 = score(doc=6729,freq=1.0), product of:
             0.06943751 = queryWeight, product of:
               1.4953254 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019597754 = queryNorm
             0.18511525 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.11686678 = weight(abstract_txt:operators in 6729) [ClassicSimilarity], result of:
           0.11686678 = score(doc=6729,freq=1.0), product of:
             0.20972824 = queryWeight, product of:
               1.5003979 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.019597754 = queryNorm
             0.5572296 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.04013119 = weight(abstract_txt:using in 6729) [ClassicSimilarity], result of:
           0.04013119 = score(doc=6729,freq=1.0), product of:
             0.1483285 = queryWeight, product of:
               2.1855006 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.019597754 = queryNorm
             0.27055615 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.09756007 = weight(abstract_txt:experiments in 6729) [ClassicSimilarity], result of:
           0.09756007 = score(doc=6729,freq=1.0), product of:
             0.23427229 = queryWeight, product of:
               2.2426085 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.019597754 = queryNorm
             0.41643882 = fieldWeight in 6729, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.1323745 = weight(abstract_txt:document in 6729) [ClassicSimilarity], result of:
           0.1323745 = score(doc=6729,freq=3.0), product of:
             0.22789374 = queryWeight, product of:
               2.708974 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.019597754 = queryNorm
             0.5808606 = fieldWeight in 6729, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
         0.14425537 = weight(abstract_txt:model in 6729) [ClassicSimilarity], result of:
           0.14425537 = score(doc=6729,freq=2.0), product of:
             0.3275399 = queryWeight, product of:
               4.192713 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.019597754 = queryNorm
             0.44042078 = fieldWeight in 6729, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.078125 = fieldNorm(doc=6729)
       0.48 = coord(12/25)
   

2. Campos, L.M. de; Fernández-Luna, J.M.; Huete, J.F.: Implementing relevance feedback in the Bayesian network retrieval model (2003) 0.35

   0.3452167 = sum of:
     0.3452167 = product of:
       0.8630417 = sum of:
         0.059928346 = weight(abstract_txt:query in 825) [ClassicSimilarity], result of:
           0.059928346 = score(doc=825,freq=3.0), product of:
             0.09316311 = queryWeight, product of:
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019597754 = queryNorm
             0.6432626 = fieldWeight in 825, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.015652198 = weight(abstract_txt:based in 825) [ClassicSimilarity], result of:
           0.015652198 = score(doc=825,freq=1.0), product of:
             0.062845886 = queryWeight, product of:
               1.0059168 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.019597754 = queryNorm
             0.24905685 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.023793055 = weight(abstract_txt:different in 825) [ClassicSimilarity], result of:
           0.023793055 = score(doc=825,freq=1.0), product of:
             0.08308579 = queryWeight, product of:
               1.1566103 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.019597754 = queryNorm
             0.28636733 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.047826476 = weight(abstract_txt:documents in 825) [ClassicSimilarity], result of:
           0.047826476 = score(doc=825,freq=2.0), product of:
             0.10503375 = queryWeight, product of:
               1.3004333 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019597754 = queryNorm
             0.4553439 = fieldWeight in 825, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.02703369 = weight(abstract_txt:retrieval in 825) [ClassicSimilarity], result of:
           0.02703369 = score(doc=825,freq=1.0), product of:
             0.099573344 = queryWeight, product of:
               1.4620578 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019597754 = queryNorm
             0.27149525 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.23843272 = weight(abstract_txt:probabilities in 825) [ClassicSimilarity], result of:
           0.23843272 = score(doc=825,freq=2.0), product of:
             0.26777092 = queryWeight, product of:
               1.6953514 = boost
               8.059301 = idf(docFreq=37, maxDocs=44218)
               0.019597754 = queryNorm
             0.89043546 = fieldWeight in 825, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.059301 = idf(docFreq=37, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.04013119 = weight(abstract_txt:using in 825) [ClassicSimilarity], result of:
           0.04013119 = score(doc=825,freq=1.0), product of:
             0.1483285 = queryWeight, product of:
               2.1855006 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.019597754 = queryNorm
             0.27055615 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.07642645 = weight(abstract_txt:document in 825) [ClassicSimilarity], result of:
           0.07642645 = score(doc=825,freq=1.0), product of:
             0.22789374 = queryWeight, product of:
               2.708974 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.019597754 = queryNorm
             0.33536002 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.23181362 = weight(abstract_txt:relevance in 825) [ClassicSimilarity], result of:
           0.23181362 = score(doc=825,freq=4.0), product of:
             0.30082175 = queryWeight, product of:
               3.1123846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019597754 = queryNorm
             0.7706013 = fieldWeight in 825, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.102003954 = weight(abstract_txt:model in 825) [ClassicSimilarity], result of:
           0.102003954 = score(doc=825,freq=1.0), product of:
             0.3275399 = queryWeight, product of:
               4.192713 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.019597754 = queryNorm
             0.31142452 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
       0.4 = coord(10/25)
   

3. Ponte, J.M.: Language models for relevance feedback (2000) 0.34

   0.34065023 = sum of:
     0.34065023 = product of:
       0.85162556 = sum of:
         0.059928346 = weight(abstract_txt:query in 35) [ClassicSimilarity], result of:
           0.059928346 = score(doc=35,freq=3.0), product of:
             0.09316311 = queryWeight, product of:
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019597754 = queryNorm
             0.6432626 = fieldWeight in 35, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.042682983 = weight(abstract_txt:effectiveness in 35) [ClassicSimilarity], result of:
           0.042682983 = score(doc=35,freq=1.0), product of:
             0.10716 = queryWeight, product of:
               1.0724927 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019597754 = queryNorm
             0.39831078 = fieldWeight in 35, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.047826476 = weight(abstract_txt:documents in 35) [ClassicSimilarity], result of:
           0.047826476 = score(doc=35,freq=2.0), product of:
             0.10503375 = queryWeight, product of:
               1.3004333 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019597754 = queryNorm
             0.4553439 = fieldWeight in 35, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.03823141 = weight(abstract_txt:retrieval in 35) [ClassicSimilarity], result of:
           0.03823141 = score(doc=35,freq=2.0), product of:
             0.099573344 = queryWeight, product of:
               1.4620578 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019597754 = queryNorm
             0.38395226 = fieldWeight in 35, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.02226368 = weight(abstract_txt:that in 35) [ClassicSimilarity], result of:
           0.02226368 = score(doc=35,freq=3.0), product of:
             0.06943751 = queryWeight, product of:
               1.4953254 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019597754 = queryNorm
             0.320629 = fieldWeight in 35, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.14246638 = weight(abstract_txt:estimated in 35) [ClassicSimilarity], result of:
           0.14246638 = score(doc=35,freq=1.0), product of:
             0.23933403 = queryWeight, product of:
               1.6028033 = boost
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.019597754 = queryNorm
             0.5952617 = fieldWeight in 35, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.09756007 = weight(abstract_txt:experiments in 35) [ClassicSimilarity], result of:
           0.09756007 = score(doc=35,freq=1.0), product of:
             0.23427229 = queryWeight, product of:
               2.2426085 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.019597754 = queryNorm
             0.41643882 = fieldWeight in 35, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.10808332 = weight(abstract_txt:document in 35) [ClassicSimilarity], result of:
           0.10808332 = score(doc=35,freq=2.0), product of:
             0.22789374 = queryWeight, product of:
               2.708974 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.019597754 = queryNorm
             0.4742707 = fieldWeight in 35, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.11590681 = weight(abstract_txt:relevance in 35) [ClassicSimilarity], result of:
           0.11590681 = score(doc=35,freq=1.0), product of:
             0.30082175 = queryWeight, product of:
               3.1123846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019597754 = queryNorm
             0.38530064 = fieldWeight in 35, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
         0.17667602 = weight(abstract_txt:model in 35) [ClassicSimilarity], result of:
           0.17667602 = score(doc=35,freq=3.0), product of:
             0.3275399 = queryWeight, product of:
               4.192713 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.019597754 = queryNorm
             0.5394031 = fieldWeight in 35, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.078125 = fieldNorm(doc=35)
       0.4 = coord(10/25)
   

4. Dang, E.K.F.; Luk, R.W.P.; Allan, J.: ¬A context-dependent relevance model (2016) 0.33

   0.33473983 = sum of:
     0.33473983 = product of:
       0.76077235 = sum of:
         0.04794268 = weight(abstract_txt:query in 2778) [ClassicSimilarity], result of:
           0.04794268 = score(doc=2778,freq=3.0), product of:
             0.09316311 = queryWeight, product of:
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019597754 = queryNorm
             0.5146101 = fieldWeight in 2778, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.012521759 = weight(abstract_txt:based in 2778) [ClassicSimilarity], result of:
           0.012521759 = score(doc=2778,freq=1.0), product of:
             0.062845886 = queryWeight, product of:
               1.0059168 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.019597754 = queryNorm
             0.19924548 = fieldWeight in 2778, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.048290286 = weight(abstract_txt:effectiveness in 2778) [ClassicSimilarity], result of:
           0.048290286 = score(doc=2778,freq=2.0), product of:
             0.10716 = queryWeight, product of:
               1.0724927 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019597754 = queryNorm
             0.45063722 = fieldWeight in 2778, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.027054742 = weight(abstract_txt:documents in 2778) [ClassicSimilarity], result of:
           0.027054742 = score(doc=2778,freq=1.0), product of:
             0.10503375 = queryWeight, product of:
               1.3004333 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019597754 = queryNorm
             0.2575814 = fieldWeight in 2778, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.043253906 = weight(abstract_txt:retrieval in 2778) [ClassicSimilarity], result of:
           0.043253906 = score(doc=2778,freq=4.0), product of:
             0.099573344 = queryWeight, product of:
               1.4620578 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019597754 = queryNorm
             0.43439242 = fieldWeight in 2778, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.014542575 = weight(abstract_txt:that in 2778) [ClassicSimilarity], result of:
           0.014542575 = score(doc=2778,freq=2.0), product of:
             0.06943751 = queryWeight, product of:
               1.4953254 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019597754 = queryNorm
             0.20943399 = fieldWeight in 2778, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.032104947 = weight(abstract_txt:using in 2778) [ClassicSimilarity], result of:
           0.032104947 = score(doc=2778,freq=1.0), product of:
             0.1483285 = queryWeight, product of:
               2.1855006 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.019597754 = queryNorm
             0.21644491 = fieldWeight in 2778, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.07804806 = weight(abstract_txt:experiments in 2778) [ClassicSimilarity], result of:
           0.07804806 = score(doc=2778,freq=1.0), product of:
             0.23427229 = queryWeight, product of:
               2.2426085 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.019597754 = queryNorm
             0.33315104 = fieldWeight in 2778, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.086466655 = weight(abstract_txt:document in 2778) [ClassicSimilarity], result of:
           0.086466655 = score(doc=2778,freq=2.0), product of:
             0.22789374 = queryWeight, product of:
               2.708974 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.019597754 = queryNorm
             0.37941656 = fieldWeight in 2778, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.2073404 = weight(abstract_txt:relevance in 2778) [ClassicSimilarity], result of:
           0.2073404 = score(doc=2778,freq=5.0), product of:
             0.30082175 = queryWeight, product of:
               3.1123846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019597754 = queryNorm
             0.6892467 = fieldWeight in 2778, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
         0.16320632 = weight(abstract_txt:model in 2778) [ClassicSimilarity], result of:
           0.16320632 = score(doc=2778,freq=4.0), product of:
             0.3275399 = queryWeight, product of:
               4.192713 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.019597754 = queryNorm
             0.49827924 = fieldWeight in 2778, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0625 = fieldNorm(doc=2778)
       0.44 = coord(11/25)
   

5. Rajashekar, T.B.; Croft, W.B.: Combining automatic and manual index representations in probabilistic retrieval (1995) 0.33

   0.32637563 = sum of:
     0.32637563 = product of:
       0.906599 = sum of:
         0.07191402 = weight(abstract_txt:query in 2418) [ClassicSimilarity], result of:
           0.07191402 = score(doc=2418,freq=3.0), product of:
             0.09316311 = queryWeight, product of:
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019597754 = queryNorm
             0.7719152 = fieldWeight in 2418, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
         0.01878264 = weight(abstract_txt:based in 2418) [ClassicSimilarity], result of:
           0.01878264 = score(doc=2418,freq=1.0), product of:
             0.062845886 = queryWeight, product of:
               1.0059168 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.019597754 = queryNorm
             0.29886824 = fieldWeight in 2418, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
         0.07243543 = weight(abstract_txt:effectiveness in 2418) [ClassicSimilarity], result of:
           0.07243543 = score(doc=2418,freq=2.0), product of:
             0.10716 = queryWeight, product of:
               1.0724927 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019597754 = queryNorm
             0.67595583 = fieldWeight in 2418, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
         0.072539 = weight(abstract_txt:retrieval in 2418) [ClassicSimilarity], result of:
           0.072539 = score(doc=2418,freq=5.0), product of:
             0.099573344 = queryWeight, product of:
               1.4620578 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019597754 = queryNorm
             0.7284982 = fieldWeight in 2418, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
         0.026716415 = weight(abstract_txt:that in 2418) [ClassicSimilarity], result of:
           0.026716415 = score(doc=2418,freq=3.0), product of:
             0.06943751 = queryWeight, product of:
               1.4953254 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.019597754 = queryNorm
             0.38475478 = fieldWeight in 2418, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
         0.20231687 = weight(abstract_txt:probabilities in 2418) [ClassicSimilarity], result of:
           0.20231687 = score(doc=2418,freq=1.0), product of:
             0.26777092 = queryWeight, product of:
               1.6953514 = boost
               8.059301 = idf(docFreq=37, maxDocs=44218)
               0.019597754 = queryNorm
             0.7555595 = fieldWeight in 2418, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.059301 = idf(docFreq=37, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
         0.12969999 = weight(abstract_txt:document in 2418) [ClassicSimilarity], result of:
           0.12969999 = score(doc=2418,freq=2.0), product of:
             0.22789374 = queryWeight, product of:
               2.708974 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.019597754 = queryNorm
             0.5691248 = fieldWeight in 2418, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
         0.13908817 = weight(abstract_txt:relevance in 2418) [ClassicSimilarity], result of:
           0.13908817 = score(doc=2418,freq=1.0), product of:
             0.30082175 = queryWeight, product of:
               3.1123846 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019597754 = queryNorm
             0.46236074 = fieldWeight in 2418, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
         0.17310645 = weight(abstract_txt:model in 2418) [ClassicSimilarity], result of:
           0.17310645 = score(doc=2418,freq=2.0), product of:
             0.3275399 = queryWeight, product of:
               4.192713 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.019597754 = queryNorm
             0.5285049 = fieldWeight in 2418, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.09375 = fieldNorm(doc=2418)
       0.36 = coord(9/25)