Document (#24691)

Author
Kantor, P.
Kim, M.H.
Ibraev, U.
Atasoy, K.
Title
Estimating the number of relevant documents in enormous collections
Source
Knowledge: creation, organization and use. Proceedings of the 62nd Annual Meeting of the American Society for Information Science, 31.10.-4.11.1999. Ed.: L. Woods
Imprint
Medford, NJ : Information Today
Year
1999
Pages
S.507-514
Series
Proceedings of the American Society for Information Science; vol.36
Abstract
In assessing information retrieval systems, it is important to know not only the precision of the retrieved set, but also to compare the number of retrieved relevant items to the total number of relevant items. For large collections, such as the TREC test collections, or the World Wide Web, it is not possible to enumerate the entire set of relevant documents. If the retrieved documents are evaluated, a variant of the statistical "capture-recapture" method can be used to estimate the total number of relevant documents, providing the several retrieval systems used are sufficiently independent. We show that the underlying signal detection model supporting such an analysis can be extended in two ways. First, assuming that there are two distinct performance characteristics (corresponding to the chance of retrieving a relevant, and retrieving a given non-relevant document), we show that if there are three or more independent systems available it is possible to estimate the number of relevant documents without actually having to decide whether each individual document is relevant. We report applications of this 3-system method to the TREC data, leading to the conclusion that the independence assumptions are not satisfied. We then extend the model to a multi-system, multi-problem model, and show that it is possible to include statistical dependencies of all orders in the model, and determine the number of relevant documents for each of the problems in the set. Application to the TREC setting will be presented
Theme
Retrievalalgorithmen
Retrievalstudien
Object
TREC

Similar documents (author)

  1. Kantor, P.B.: ¬The Adaptive Network Library Interface : a historical overview and interim report (1993) 5.11 
    5.1094418 = sum of:
  5.1094418 = weight(author_txt:kantor in 6975) [ClassicSimilarity], result of:
    5.1094418 = fieldWeight in 6975, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.175107 = idf(docFreq=33, maxDocs=44421)
      0.625 = fieldNorm(doc=6975)
  2. Kantor, P.B.: ¬The logic of weighted queries (1981) 5.11 
    5.1094418 = sum of:
  5.1094418 = weight(author_txt:kantor in 7621) [ClassicSimilarity], result of:
    5.1094418 = fieldWeight in 7621, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.175107 = idf(docFreq=33, maxDocs=44421)
      0.625 = fieldNorm(doc=7621)
  3. Kantor, A.: Baby steps (1994) 5.11 
    5.1094418 = sum of:
  5.1094418 = weight(author_txt:kantor in 7984) [ClassicSimilarity], result of:
    5.1094418 = fieldWeight in 7984, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.175107 = idf(docFreq=33, maxDocs=44421)
      0.625 = fieldNorm(doc=7984)
  4. Kantor, P.B.: Information retrieval techniques (1994) 5.11 
    5.1094418 = sum of:
  5.1094418 = weight(author_txt:kantor in 1124) [ClassicSimilarity], result of:
    5.1094418 = fieldWeight in 1124, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.175107 = idf(docFreq=33, maxDocs=44421)
      0.625 = fieldNorm(doc=1124)
  5. Kantor, P.B.: ¬A model for stopping behavior of the users of on-line systems (1987) 5.11 
    5.1094418 = sum of:
  5.1094418 = weight(author_txt:kantor in 4945) [ClassicSimilarity], result of:
    5.1094418 = fieldWeight in 4945, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.175107 = idf(docFreq=33, maxDocs=44421)
      0.625 = fieldNorm(doc=4945)

Similar documents (content)

  1. Collins-Thompson, K.; Callan, J.: Predicting reading difficulty with statistical language models (2005) 0.40 
    0.4014066 = sum of:
  0.4014066 = product of:
    0.77193576 = sum of:
      0.020956496 = weight(abstract_txt:each in 5579) [ClassicSimilarity], result of:
        0.020956496 = score(doc=5579,freq=1.0), product of:
          0.08142968 = queryWeight, product of:
            1.0278106 = boost
            4.1177115 = idf(docFreq=1965, maxDocs=44421)
            0.019240385 = queryNorm
          0.25735697 = fieldWeight in 5579, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1177115 = idf(docFreq=1965, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.023767447 = weight(abstract_txt:document in 5579) [ClassicSimilarity], result of:
        0.023767447 = score(doc=5579,freq=1.0), product of:
          0.0885575 = queryWeight, product of:
            1.0718509 = boost
            4.29415 = idf(docFreq=1647, maxDocs=44421)
            0.019240385 = queryNorm
          0.26838437 = fieldWeight in 5579, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.29415 = idf(docFreq=1647, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.027330203 = weight(abstract_txt:method in 5579) [ClassicSimilarity], result of:
        0.027330203 = score(doc=5579,freq=1.0), product of:
          0.097199835 = queryWeight, product of:
            1.1229346 = boost
            4.4988065 = idf(docFreq=1342, maxDocs=44421)
            0.019240385 = queryNorm
          0.2811754 = fieldWeight in 5579, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.4988065 = idf(docFreq=1342, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.01787122 = weight(abstract_txt:systems in 5579) [ClassicSimilarity], result of:
        0.01787122 = score(doc=5579,freq=1.0), product of:
          0.083824344 = queryWeight, product of:
            1.2771809 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.019240385 = queryNorm
          0.21319844 = fieldWeight in 5579, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.07243503 = weight(abstract_txt:statistical in 5579) [ClassicSimilarity], result of:
        0.07243503 = score(doc=5579,freq=2.0), product of:
          0.14774951 = queryWeight, product of:
            1.3844738 = boost
            5.5466094 = idf(docFreq=470, maxDocs=44421)
            0.019240385 = queryNorm
          0.49025562 = fieldWeight in 5579, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.5466094 = idf(docFreq=470, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.022193901 = weight(abstract_txt:that in 5579) [ClassicSimilarity], result of:
        0.022193901 = score(doc=5579,freq=5.0), product of:
          0.06715052 = queryWeight, product of:
            1.4757622 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019240385 = queryNorm
          0.33050975 = fieldWeight in 5579, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.054276235 = weight(abstract_txt:show in 5579) [ClassicSimilarity], result of:
        0.054276235 = score(doc=5579,freq=2.0), product of:
          0.1395288 = queryWeight, product of:
            1.6477801 = boost
            4.400995 = idf(docFreq=1480, maxDocs=44421)
            0.019240385 = queryNorm
          0.38899666 = fieldWeight in 5579, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.400995 = idf(docFreq=1480, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.06291647 = weight(abstract_txt:possible in 5579) [ClassicSimilarity], result of:
        0.06291647 = score(doc=5579,freq=2.0), product of:
          0.15396912 = queryWeight, product of:
            1.7309484 = boost
            4.623126 = idf(docFreq=1185, maxDocs=44421)
            0.019240385 = queryNorm
          0.40863046 = fieldWeight in 5579, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.623126 = idf(docFreq=1185, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.046670318 = weight(abstract_txt:collections in 5579) [ClassicSimilarity], result of:
        0.046670318 = score(doc=5579,freq=1.0), product of:
          0.15896244 = queryWeight, product of:
            1.7587925 = boost
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.019240385 = queryNorm
          0.29359335 = fieldWeight in 5579, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.11159579 = weight(abstract_txt:estimate in 5579) [ClassicSimilarity], result of:
        0.11159579 = score(doc=5579,freq=1.0), product of:
          0.24831454 = queryWeight, product of:
            1.7948277 = boost
            7.190608 = idf(docFreq=90, maxDocs=44421)
            0.019240385 = queryNorm
          0.449413 = fieldWeight in 5579, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.190608 = idf(docFreq=90, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.0536359 = weight(abstract_txt:model in 5579) [ClassicSimilarity], result of:
        0.0536359 = score(doc=5579,freq=2.0), product of:
          0.15236107 = queryWeight, product of:
            1.9882624 = boost
            3.9827821 = idf(docFreq=2249, maxDocs=44421)
            0.019240385 = queryNorm
          0.35203153 = fieldWeight in 5579, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.9827821 = idf(docFreq=2249, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.10933888 = weight(abstract_txt:documents in 5579) [ClassicSimilarity], result of:
        0.10933888 = score(doc=5579,freq=3.0), product of:
          0.24495523 = queryWeight, product of:
            3.0876331 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.019240385 = queryNorm
          0.4463627 = fieldWeight in 5579, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
      0.14894782 = weight(abstract_txt:relevant in 5579) [ClassicSimilarity], result of:
        0.14894782 = score(doc=5579,freq=1.0), product of:
          0.51473427 = queryWeight, product of:
            5.7782755 = boost
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.019240385 = queryNorm
          0.2893684 = fieldWeight in 5579, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.0625 = fieldNorm(doc=5579)
    0.52 = coord(13/25)
  2. Keenan, S.; Smeaton, A.F.; Keogh, G.: ¬The effect of pool depth on system evaluation in TREC (2001) 0.38 
    0.38312316 = sum of:
  0.38312316 = product of:
    0.9578079 = sum of:
      0.02059785 = weight(abstract_txt:there in 6908) [ClassicSimilarity], result of:
        0.02059785 = score(doc=6908,freq=1.0), product of:
          0.080497965 = queryWeight, product of:
            1.0219135 = boost
            4.094086 = idf(docFreq=2012, maxDocs=44421)
            0.019240385 = queryNorm
          0.2558804 = fieldWeight in 6908, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.094086 = idf(docFreq=2012, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.036297716 = weight(abstract_txt:each in 6908) [ClassicSimilarity], result of:
        0.036297716 = score(doc=6908,freq=3.0), product of:
          0.08142968 = queryWeight, product of:
            1.0278106 = boost
            4.1177115 = idf(docFreq=1965, maxDocs=44421)
            0.019240385 = queryNorm
          0.44575533 = fieldWeight in 6908, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.1177115 = idf(docFreq=1965, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.03095386 = weight(abstract_txt:systems in 6908) [ClassicSimilarity], result of:
        0.03095386 = score(doc=6908,freq=3.0), product of:
          0.083824344 = queryWeight, product of:
            1.2771809 = boost
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.019240385 = queryNorm
          0.36927053 = fieldWeight in 6908, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.411175 = idf(docFreq=3984, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.014036655 = weight(abstract_txt:that in 6908) [ClassicSimilarity], result of:
        0.014036655 = score(doc=6908,freq=2.0), product of:
          0.06715052 = queryWeight, product of:
            1.4757622 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019240385 = queryNorm
          0.20903271 = fieldWeight in 6908, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.03792631 = weight(abstract_txt:model in 6908) [ClassicSimilarity], result of:
        0.03792631 = score(doc=6908,freq=1.0), product of:
          0.15236107 = queryWeight, product of:
            1.9882624 = boost
            3.9827821 = idf(docFreq=2249, maxDocs=44421)
            0.019240385 = queryNorm
          0.24892388 = fieldWeight in 6908, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.9827821 = idf(docFreq=2249, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.08360124 = weight(abstract_txt:retrieved in 6908) [ClassicSimilarity], result of:
        0.08360124 = score(doc=6908,freq=1.0), product of:
          0.23446383 = queryWeight, product of:
            2.1360197 = boost
            5.7050157 = idf(docFreq=401, maxDocs=44421)
            0.019240385 = queryNorm
          0.35656348 = fieldWeight in 6908, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.7050157 = idf(docFreq=401, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.3033743 = weight(abstract_txt:trec in 6908) [ClassicSimilarity], result of:
        0.3033743 = score(doc=6908,freq=5.0), product of:
          0.32378986 = queryWeight, product of:
            2.510146 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.019240385 = queryNorm
          0.9369481 = fieldWeight in 6908, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.10933888 = weight(abstract_txt:documents in 6908) [ClassicSimilarity], result of:
        0.10933888 = score(doc=6908,freq=3.0), product of:
          0.24495523 = queryWeight, product of:
            3.0876331 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.019240385 = queryNorm
          0.4463627 = fieldWeight in 6908, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.06369586 = weight(abstract_txt:number in 6908) [ClassicSimilarity], result of:
        0.06369586 = score(doc=6908,freq=1.0), product of:
          0.24642506 = queryWeight, product of:
            3.0968828 = boost
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.019240385 = queryNorm
          0.25847965 = fieldWeight in 6908, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
      0.2579852 = weight(abstract_txt:relevant in 6908) [ClassicSimilarity], result of:
        0.2579852 = score(doc=6908,freq=3.0), product of:
          0.51473427 = queryWeight, product of:
            5.7782755 = boost
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.019240385 = queryNorm
          0.50120074 = fieldWeight in 6908, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.0625 = fieldNorm(doc=6908)
    0.4 = coord(10/25)
  3. Liu, X.; Zheng, W.; Fang, H.: ¬An exploration of ranking models and feedback method for related entity finding (2013) 0.35 
    0.3487981 = sum of:
  0.3487981 = product of:
    0.79272294 = sum of:
      0.023767447 = weight(abstract_txt:document in 3714) [ClassicSimilarity], result of:
        0.023767447 = score(doc=3714,freq=1.0), product of:
          0.0885575 = queryWeight, product of:
            1.0718509 = boost
            4.29415 = idf(docFreq=1647, maxDocs=44421)
            0.019240385 = queryNorm
          0.26838437 = fieldWeight in 3714, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.29415 = idf(docFreq=1647, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.038650744 = weight(abstract_txt:method in 3714) [ClassicSimilarity], result of:
        0.038650744 = score(doc=3714,freq=2.0), product of:
          0.097199835 = queryWeight, product of:
            1.1229346 = boost
            4.4988065 = idf(docFreq=1342, maxDocs=44421)
            0.019240385 = queryNorm
          0.39764208 = fieldWeight in 3714, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.4988065 = idf(docFreq=1342, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.014036655 = weight(abstract_txt:that in 3714) [ClassicSimilarity], result of:
        0.014036655 = score(doc=3714,freq=2.0), product of:
          0.06715052 = queryWeight, product of:
            1.4757622 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019240385 = queryNorm
          0.20903271 = fieldWeight in 3714, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.038379095 = weight(abstract_txt:show in 3714) [ClassicSimilarity], result of:
        0.038379095 = score(doc=3714,freq=1.0), product of:
          0.1395288 = queryWeight, product of:
            1.6477801 = boost
            4.400995 = idf(docFreq=1480, maxDocs=44421)
            0.019240385 = queryNorm
          0.27506217 = fieldWeight in 3714, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.400995 = idf(docFreq=1480, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.044488665 = weight(abstract_txt:possible in 3714) [ClassicSimilarity], result of:
        0.044488665 = score(doc=3714,freq=1.0), product of:
          0.15396912 = queryWeight, product of:
            1.7309484 = boost
            4.623126 = idf(docFreq=1185, maxDocs=44421)
            0.019240385 = queryNorm
          0.28894538 = fieldWeight in 3714, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.623126 = idf(docFreq=1185, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.046670318 = weight(abstract_txt:collections in 3714) [ClassicSimilarity], result of:
        0.046670318 = score(doc=3714,freq=1.0), product of:
          0.15896244 = queryWeight, product of:
            1.7587925 = boost
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.019240385 = queryNorm
          0.29359335 = fieldWeight in 3714, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.11159579 = weight(abstract_txt:estimate in 3714) [ClassicSimilarity], result of:
        0.11159579 = score(doc=3714,freq=1.0), product of:
          0.24831454 = queryWeight, product of:
            1.7948277 = boost
            7.190608 = idf(docFreq=90, maxDocs=44421)
            0.019240385 = queryNorm
          0.449413 = fieldWeight in 3714, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.190608 = idf(docFreq=90, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.06569029 = weight(abstract_txt:model in 3714) [ClassicSimilarity], result of:
        0.06569029 = score(doc=3714,freq=3.0), product of:
          0.15236107 = queryWeight, product of:
            1.9882624 = boost
            3.9827821 = idf(docFreq=2249, maxDocs=44421)
            0.019240385 = queryNorm
          0.4311488 = fieldWeight in 3714, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.9827821 = idf(docFreq=2249, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.13567312 = weight(abstract_txt:trec in 3714) [ClassicSimilarity], result of:
        0.13567312 = score(doc=3714,freq=1.0), product of:
          0.32378986 = queryWeight, product of:
            2.510146 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.019240385 = queryNorm
          0.41901594 = fieldWeight in 3714, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.06312683 = weight(abstract_txt:documents in 3714) [ClassicSimilarity], result of:
        0.06312683 = score(doc=3714,freq=1.0), product of:
          0.24495523 = queryWeight, product of:
            3.0876331 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.019240385 = queryNorm
          0.25770763 = fieldWeight in 3714, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
      0.21064402 = weight(abstract_txt:relevant in 3714) [ClassicSimilarity], result of:
        0.21064402 = score(doc=3714,freq=2.0), product of:
          0.51473427 = queryWeight, product of:
            5.7782755 = boost
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.019240385 = queryNorm
          0.40922868 = fieldWeight in 3714, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.0625 = fieldNorm(doc=3714)
    0.44 = coord(11/25)
  4. Dang, E.K.F.; Luk, R.W.P.; Allan, J.: ¬A context-dependent relevance model (2016) 0.35 
    0.3455062 = sum of:
  0.3455062 = product of:
    0.78524137 = sum of:
      0.07869613 = weight(abstract_txt:estimating in 3778) [ClassicSimilarity], result of:
        0.07869613 = score(doc=3778,freq=1.0), product of:
          0.15614541 = queryWeight, product of:
            1.0064015 = boost
            8.063882 = idf(docFreq=37, maxDocs=44421)
            0.019240385 = queryNorm
          0.5039926 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.063882 = idf(docFreq=37, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.033612248 = weight(abstract_txt:document in 3778) [ClassicSimilarity], result of:
        0.033612248 = score(doc=3778,freq=2.0), product of:
          0.0885575 = queryWeight, product of:
            1.0718509 = boost
            4.29415 = idf(docFreq=1647, maxDocs=44421)
            0.019240385 = queryNorm
          0.3795528 = fieldWeight in 3778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.29415 = idf(docFreq=1647, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.038650744 = weight(abstract_txt:method in 3778) [ClassicSimilarity], result of:
        0.038650744 = score(doc=3778,freq=2.0), product of:
          0.097199835 = queryWeight, product of:
            1.1229346 = boost
            4.4988065 = idf(docFreq=1342, maxDocs=44421)
            0.019240385 = queryNorm
          0.39764208 = fieldWeight in 3778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.4988065 = idf(docFreq=1342, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.014036655 = weight(abstract_txt:that in 3778) [ClassicSimilarity], result of:
        0.014036655 = score(doc=3778,freq=2.0), product of:
          0.06715052 = queryWeight, product of:
            1.4757622 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019240385 = queryNorm
          0.20903271 = fieldWeight in 3778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.038379095 = weight(abstract_txt:show in 3778) [ClassicSimilarity], result of:
        0.038379095 = score(doc=3778,freq=1.0), product of:
          0.1395288 = queryWeight, product of:
            1.6477801 = boost
            4.400995 = idf(docFreq=1480, maxDocs=44421)
            0.019240385 = queryNorm
          0.27506217 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.400995 = idf(docFreq=1480, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.046670318 = weight(abstract_txt:collections in 3778) [ClassicSimilarity], result of:
        0.046670318 = score(doc=3778,freq=1.0), product of:
          0.15896244 = queryWeight, product of:
            1.7587925 = boost
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.019240385 = queryNorm
          0.29359335 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.11159579 = weight(abstract_txt:estimate in 3778) [ClassicSimilarity], result of:
        0.11159579 = score(doc=3778,freq=1.0), product of:
          0.24831454 = queryWeight, product of:
            1.7948277 = boost
            7.190608 = idf(docFreq=90, maxDocs=44421)
            0.019240385 = queryNorm
          0.449413 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.190608 = idf(docFreq=90, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.07585262 = weight(abstract_txt:model in 3778) [ClassicSimilarity], result of:
        0.07585262 = score(doc=3778,freq=4.0), product of:
          0.15236107 = queryWeight, product of:
            1.9882624 = boost
            3.9827821 = idf(docFreq=2249, maxDocs=44421)
            0.019240385 = queryNorm
          0.49784777 = fieldWeight in 3778, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.9827821 = idf(docFreq=2249, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.13567312 = weight(abstract_txt:trec in 3778) [ClassicSimilarity], result of:
        0.13567312 = score(doc=3778,freq=1.0), product of:
          0.32378986 = queryWeight, product of:
            2.510146 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.019240385 = queryNorm
          0.41901594 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.06312683 = weight(abstract_txt:documents in 3778) [ClassicSimilarity], result of:
        0.06312683 = score(doc=3778,freq=1.0), product of:
          0.24495523 = queryWeight, product of:
            3.0876331 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.019240385 = queryNorm
          0.25770763 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.14894782 = weight(abstract_txt:relevant in 3778) [ClassicSimilarity], result of:
        0.14894782 = score(doc=3778,freq=1.0), product of:
          0.51473427 = queryWeight, product of:
            5.7782755 = boost
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.019240385 = queryNorm
          0.2893684 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
    0.44 = coord(11/25)
  5. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 0.32 
    0.3204967 = sum of:
  0.3204967 = product of:
    0.89026856 = sum of:
      0.02059785 = weight(abstract_txt:there in 5435) [ClassicSimilarity], result of:
        0.02059785 = score(doc=5435,freq=1.0), product of:
          0.080497965 = queryWeight, product of:
            1.0219135 = boost
            4.094086 = idf(docFreq=2012, maxDocs=44421)
            0.019240385 = queryNorm
          0.2558804 = fieldWeight in 5435, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.094086 = idf(docFreq=2012, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
      0.020956496 = weight(abstract_txt:each in 5435) [ClassicSimilarity], result of:
        0.020956496 = score(doc=5435,freq=1.0), product of:
          0.08142968 = queryWeight, product of:
            1.0278106 = boost
            4.1177115 = idf(docFreq=1965, maxDocs=44421)
            0.019240385 = queryNorm
          0.25735697 = fieldWeight in 5435, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1177115 = idf(docFreq=1965, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
      0.07371045 = weight(abstract_txt:items in 5435) [ClassicSimilarity], result of:
        0.07371045 = score(doc=5435,freq=2.0), product of:
          0.14947882 = queryWeight, product of:
            1.3925524 = boost
            5.5789747 = idf(docFreq=455, maxDocs=44421)
            0.019240385 = queryNorm
          0.49311635 = fieldWeight in 5435, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.5789747 = idf(docFreq=455, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
      0.014036655 = weight(abstract_txt:that in 5435) [ClassicSimilarity], result of:
        0.014036655 = score(doc=5435,freq=2.0), product of:
          0.06715052 = queryWeight, product of:
            1.4757622 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019240385 = queryNorm
          0.20903271 = fieldWeight in 5435, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
      0.11823 = weight(abstract_txt:retrieved in 5435) [ClassicSimilarity], result of:
        0.11823 = score(doc=5435,freq=2.0), product of:
          0.23446383 = queryWeight, product of:
            2.1360197 = boost
            5.7050157 = idf(docFreq=401, maxDocs=44421)
            0.019240385 = queryNorm
          0.5042569 = fieldWeight in 5435, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.7050157 = idf(docFreq=401, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
      0.19187075 = weight(abstract_txt:trec in 5435) [ClassicSimilarity], result of:
        0.19187075 = score(doc=5435,freq=2.0), product of:
          0.32378986 = queryWeight, product of:
            2.510146 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.019240385 = queryNorm
          0.592578 = fieldWeight in 5435, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
      0.089274816 = weight(abstract_txt:documents in 5435) [ClassicSimilarity], result of:
        0.089274816 = score(doc=5435,freq=2.0), product of:
          0.24495523 = queryWeight, product of:
            3.0876331 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.019240385 = queryNorm
          0.3644536 = fieldWeight in 5435, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
      0.06369586 = weight(abstract_txt:number in 5435) [ClassicSimilarity], result of:
        0.06369586 = score(doc=5435,freq=1.0), product of:
          0.24642506 = queryWeight, product of:
            3.0968828 = boost
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.019240385 = queryNorm
          0.25847965 = fieldWeight in 5435, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
      0.29789564 = weight(abstract_txt:relevant in 5435) [ClassicSimilarity], result of:
        0.29789564 = score(doc=5435,freq=4.0), product of:
          0.51473427 = queryWeight, product of:
            5.7782755 = boost
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.019240385 = queryNorm
          0.5787368 = fieldWeight in 5435, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.6298943 = idf(docFreq=1177, maxDocs=44421)
            0.0625 = fieldNorm(doc=5435)
    0.36 = coord(9/25)