Document (#34085)

Author
Wong, W.S.
Luk, R.W.P.
Leong, H.V.
Ho, K.S.
Lee, D.L.
Title
Re-examining the effects of adding relevance information in a relevance feedback environment
Source
Information processing and management. 44(2008) no.3, S.1086-1116
Year
2008
Abstract
This paper presents an investigation about how to automatically formulate effective queries using full or partial relevance information (i.e., the terms that are in relevant documents) in the context of relevance feedback (RF). The effects of adding relevance information in the RF environment are studied via controlled experiments. The conditions of these controlled experiments are formalized into a set of assumptions that form the framework of our study. This framework is called idealized relevance feedback (IRF) framework. In our IRF settings, we confirm the previous findings of relevance feedback studies. In addition, our experiments show that better retrieval effectiveness can be obtained when (i) we normalize the term weights by their ranks, (ii) we select weighted terms in the top K retrieved documents, (iii) we include terms in the initial title queries, and (iv) we use the best query sizes for each topic instead of the average best query size where they produce at most five percentage points improvement in the mean average precision (MAP) value. We have also achieved a new level of retrieval effectiveness which is about 55-60% MAP instead of 40+% in the previous findings. This new level of retrieval effectiveness was found to be similar to a level using a TREC ad hoc test collection that is about double the number of documents in the TREC-3 test collection used in previous works.

Similar documents (author)

  1. Lan, K.C.; Ho, K.S.; Luk, R.W.P.; Leong, H.V.: Dialogue act recognition using maximum entropy (2008) 2.51 
    2.5050611 = sum of:
  2.5050611 = product of:
    3.7575917 = sum of:
      1.7739377 = weight(author_txt:r.w.p in 2717) [ClassicSimilarity], result of:
        1.7739377 = score(doc=2717,freq=1.0), product of:
          0.60396546 = queryWeight, product of:
            1.1455123 = boost
            9.398883 = idf(docFreq=9, maxDocs=44421)
            0.056096543 = queryNorm
          2.937151 = fieldWeight in 2717, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.398883 = idf(docFreq=9, maxDocs=44421)
            0.3125 = fieldNorm(doc=2717)
      1.9836539 = weight(author_txt:leong in 2717) [ClassicSimilarity], result of:
        1.9836539 = score(doc=2717,freq=1.0), product of:
          0.6506745 = queryWeight, product of:
            1.188983 = boost
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.056096543 = queryNorm
          3.0486116 = fieldWeight in 2717, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.3125 = fieldNorm(doc=2717)
    0.6666667 = coord(2/3)
  2. Luk, R.W.P.; Leong, H.V.; Dillon, T.S.; Chan, A.T.S.; Croft, W.B.; Allen, J.: ¬A survey in indexing and searching XML documents (2002) 2.00 
    2.0040488 = sum of:
  2.0040488 = product of:
    3.0060732 = sum of:
      1.4191501 = weight(author_txt:r.w.p in 1460) [ClassicSimilarity], result of:
        1.4191501 = score(doc=1460,freq=1.0), product of:
          0.60396546 = queryWeight, product of:
            1.1455123 = boost
            9.398883 = idf(docFreq=9, maxDocs=44421)
            0.056096543 = queryNorm
          2.3497207 = fieldWeight in 1460, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.398883 = idf(docFreq=9, maxDocs=44421)
            0.25 = fieldNorm(doc=1460)
      1.5869231 = weight(author_txt:leong in 1460) [ClassicSimilarity], result of:
        1.5869231 = score(doc=1460,freq=1.0), product of:
          0.6506745 = queryWeight, product of:
            1.188983 = boost
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.056096543 = queryNorm
          2.4388893 = fieldWeight in 1460, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.25 = fieldNorm(doc=1460)
    0.6666667 = coord(2/3)
  3. Wu, H.C.; Luk, R.W.P.; Wong, K.F,; Kwok, K.L.: ¬A retrospective study of a hybrid document-context based retrieval model (2007) 1.97 
    1.969395 = sum of:
  1.969395 = product of:
    2.9540925 = sum of:
      1.1801549 = weight(author_txt:wong in 1936) [ClassicSimilarity], result of:
        1.1801549 = score(doc=1936,freq=1.0), product of:
          0.46026987 = queryWeight, product of:
            8.20496 = idf(docFreq=32, maxDocs=44421)
            0.056096543 = queryNorm
          2.56405 = fieldWeight in 1936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.20496 = idf(docFreq=32, maxDocs=44421)
            0.3125 = fieldNorm(doc=1936)
      1.7739377 = weight(author_txt:r.w.p in 1936) [ClassicSimilarity], result of:
        1.7739377 = score(doc=1936,freq=1.0), product of:
          0.60396546 = queryWeight, product of:
            1.1455123 = boost
            9.398883 = idf(docFreq=9, maxDocs=44421)
            0.056096543 = queryNorm
          2.937151 = fieldWeight in 1936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.398883 = idf(docFreq=9, maxDocs=44421)
            0.3125 = fieldNorm(doc=1936)
    0.6666667 = coord(2/3)
  4. Leong, J.H.-t.: ¬The convergence of metadata and bibliographic control? : trends and patterns in addressing the current issues and challenges of providing subject access (2010) 1.06 
    1.0579488 = sum of:
  1.0579488 = product of:
    3.1738462 = sum of:
      3.1738462 = weight(author_txt:leong in 342) [ClassicSimilarity], result of:
        3.1738462 = score(doc=342,freq=1.0), product of:
          0.6506745 = queryWeight, product of:
            1.188983 = boost
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.056096543 = queryNorm
          4.8777785 = fieldWeight in 342, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.5 = fieldNorm(doc=342)
    0.33333334 = coord(1/3)
  5. Yang, L.; Ji, D.; Leong, M.: Document reranking by term distribution and maximal marginal relevance for chinese information retrieval (2007) 0.79 
    0.79346156 = sum of:
  0.79346156 = product of:
    2.3803847 = sum of:
      2.3803847 = weight(author_txt:leong in 1907) [ClassicSimilarity], result of:
        2.3803847 = score(doc=1907,freq=1.0), product of:
          0.6506745 = queryWeight, product of:
            1.188983 = boost
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.056096543 = queryNorm
          3.6583338 = fieldWeight in 1907, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.755557 = idf(docFreq=6, maxDocs=44421)
            0.375 = fieldNorm(doc=1907)
    0.33333334 = coord(1/3)

Similar documents (content)

  1. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.71 
    0.7082416 = sum of:
  0.7082416 = product of:
    1.3620031 = sum of:
      0.040814415 = weight(abstract_txt:collection in 3884) [ClassicSimilarity], result of:
        0.040814415 = score(doc=3884,freq=1.0), product of:
          0.112358734 = queryWeight, product of:
            4.649612 = idf(docFreq=1154, maxDocs=44421)
            0.024165185 = queryNorm
          0.36325094 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.649612 = idf(docFreq=1154, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.015190294 = weight(abstract_txt:that in 3884) [ClassicSimilarity], result of:
        0.015190294 = score(doc=3884,freq=2.0), product of:
          0.05813556 = queryWeight, product of:
            1.0172613 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.024165185 = queryNorm
          0.2612909 = fieldWeight in 3884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.075585134 = weight(abstract_txt:query in 3884) [ClassicSimilarity], result of:
        0.075585134 = score(doc=3884,freq=3.0), product of:
          0.11748478 = queryWeight, product of:
            1.0225567 = boost
            4.754492 = idf(docFreq=1039, maxDocs=44421)
            0.024165185 = queryNorm
          0.6433611 = fieldWeight in 3884, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.754492 = idf(docFreq=1039, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.052168965 = weight(abstract_txt:test in 3884) [ClassicSimilarity], result of:
        0.052168965 = score(doc=3884,freq=1.0), product of:
          0.13233435 = queryWeight, product of:
            1.0852576 = boost
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.024165185 = queryNorm
          0.3942209 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.036190655 = weight(abstract_txt:retrieval in 3884) [ClassicSimilarity], result of:
        0.036190655 = score(doc=3884,freq=2.0), product of:
          0.094221324 = queryWeight, product of:
            1.1215453 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.024165185 = queryNorm
          0.3841026 = fieldWeight in 3884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.03656777 = weight(abstract_txt:about in 3884) [ClassicSimilarity], result of:
        0.03656777 = score(doc=3884,freq=1.0), product of:
          0.119534664 = queryWeight, product of:
            1.2632495 = boost
            3.9157467 = idf(docFreq=2405, maxDocs=44421)
            0.024165185 = queryNorm
          0.3059177 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.9157467 = idf(docFreq=2405, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.08539383 = weight(abstract_txt:documents in 3884) [ClassicSimilarity], result of:
        0.08539383 = score(doc=3884,freq=4.0), product of:
          0.13254374 = queryWeight, product of:
            1.330215 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.024165185 = queryNorm
          0.64426905 = fieldWeight in 3884, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.17303342 = weight(abstract_txt:trec in 3884) [ClassicSimilarity], result of:
        0.17303342 = score(doc=3884,freq=2.0), product of:
          0.23360087 = queryWeight, product of:
            1.4418956 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.024165185 = queryNorm
          0.7407225 = fieldWeight in 3884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.055318452 = weight(abstract_txt:level in 3884) [ClassicSimilarity], result of:
        0.055318452 = score(doc=3884,freq=1.0), product of:
          0.15752213 = queryWeight, product of:
            1.4501503 = boost
            4.4950905 = idf(docFreq=1347, maxDocs=44421)
            0.024165185 = queryNorm
          0.35117894 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.4950905 = idf(docFreq=1347, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.08060951 = weight(abstract_txt:effectiveness in 3884) [ClassicSimilarity], result of:
        0.08060951 = score(doc=3884,freq=1.0), product of:
          0.20246613 = queryWeight, product of:
            1.6440629 = boost
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.024165185 = queryNorm
          0.39813823 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.13003646 = weight(abstract_txt:experiments in 3884) [ClassicSimilarity], result of:
        0.13003646 = score(doc=3884,freq=2.0), product of:
          0.22103529 = queryWeight, product of:
            1.7178017 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.024165185 = queryNorm
          0.5883063 = fieldWeight in 3884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.24062446 = weight(abstract_txt:feedback in 3884) [ClassicSimilarity], result of:
        0.24062446 = score(doc=3884,freq=2.0), product of:
          0.36668316 = queryWeight, product of:
            2.554801 = boost
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.024165185 = queryNorm
          0.656219 = fieldWeight in 3884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.34046975 = weight(abstract_txt:relevance in 3884) [ClassicSimilarity], result of:
        0.34046975 = score(doc=3884,freq=4.0), product of:
          0.44203112 = queryWeight, product of:
            3.7107103 = boost
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.024165185 = queryNorm
          0.77023935 = fieldWeight in 3884, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
    0.52 = coord(13/25)
  2. Dang, E.K.F.; Luk, R.W.P.; Allan, J.: ¬A context-dependent relevance model (2016) 0.56 
    0.5599379 = sum of:
  0.5599379 = product of:
    1.1665373 = sum of:
      0.012152234 = weight(abstract_txt:that in 3778) [ClassicSimilarity], result of:
        0.012152234 = score(doc=3778,freq=2.0), product of:
          0.05813556 = queryWeight, product of:
            1.0172613 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.024165185 = queryNorm
          0.20903271 = fieldWeight in 3778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.060468104 = weight(abstract_txt:query in 3778) [ClassicSimilarity], result of:
        0.060468104 = score(doc=3778,freq=3.0), product of:
          0.11748478 = queryWeight, product of:
            1.0225567 = boost
            4.754492 = idf(docFreq=1039, maxDocs=44421)
            0.024165185 = queryNorm
          0.51468885 = fieldWeight in 3778, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.754492 = idf(docFreq=1039, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.040945053 = weight(abstract_txt:retrieval in 3778) [ClassicSimilarity], result of:
        0.040945053 = score(doc=3778,freq=4.0), product of:
          0.094221324 = queryWeight, product of:
            1.1215453 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.024165185 = queryNorm
          0.4345625 = fieldWeight in 3778, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.045561742 = weight(abstract_txt:terms in 3778) [ClassicSimilarity], result of:
        0.045561742 = score(doc=3778,freq=2.0), product of:
          0.12747502 = queryWeight, product of:
            1.304532 = boost
            4.043712 = idf(docFreq=2116, maxDocs=44421)
            0.024165185 = queryNorm
          0.35741702 = fieldWeight in 3778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.043712 = idf(docFreq=2116, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.034157533 = weight(abstract_txt:documents in 3778) [ClassicSimilarity], result of:
        0.034157533 = score(doc=3778,freq=1.0), product of:
          0.13254374 = queryWeight, product of:
            1.330215 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.024165185 = queryNorm
          0.25770763 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.09788249 = weight(abstract_txt:trec in 3778) [ClassicSimilarity], result of:
        0.09788249 = score(doc=3778,freq=1.0), product of:
          0.23360087 = queryWeight, product of:
            1.4418956 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.024165185 = queryNorm
          0.41901594 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.06467273 = weight(abstract_txt:framework in 3778) [ClassicSimilarity], result of:
        0.06467273 = score(doc=3778,freq=2.0), product of:
          0.16100487 = queryWeight, product of:
            1.4660937 = boost
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.024165185 = queryNorm
          0.40168184 = fieldWeight in 3778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.09119925 = weight(abstract_txt:effectiveness in 3778) [ClassicSimilarity], result of:
        0.09119925 = score(doc=3778,freq=2.0), product of:
          0.20246613 = queryWeight, product of:
            1.6440629 = boost
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.024165185 = queryNorm
          0.450442 = fieldWeight in 3778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.06917757 = weight(abstract_txt:previous in 3778) [ClassicSimilarity], result of:
        0.06917757 = score(doc=3778,freq=1.0), product of:
          0.21216728 = queryWeight, product of:
            1.6829895 = boost
            5.216832 = idf(docFreq=654, maxDocs=44421)
            0.024165185 = queryNorm
          0.326052 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.216832 = idf(docFreq=654, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.073559724 = weight(abstract_txt:experiments in 3778) [ClassicSimilarity], result of:
        0.073559724 = score(doc=3778,freq=1.0), product of:
          0.22103529 = queryWeight, product of:
            1.7178017 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.024165185 = queryNorm
          0.3327963 = fieldWeight in 3778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.27223548 = weight(abstract_txt:feedback in 3778) [ClassicSimilarity], result of:
        0.27223548 = score(doc=3778,freq=4.0), product of:
          0.36668316 = queryWeight, product of:
            2.554801 = boost
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.024165185 = queryNorm
          0.74242705 = fieldWeight in 3778, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
      0.30452543 = weight(abstract_txt:relevance in 3778) [ClassicSimilarity], result of:
        0.30452543 = score(doc=3778,freq=5.0), product of:
          0.44203112 = queryWeight, product of:
            3.7107103 = boost
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.024165185 = queryNorm
          0.68892306 = fieldWeight in 3778, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.0625 = fieldNorm(doc=3778)
    0.48 = coord(12/25)
  3. Meij, E.; Rijke, M. de: Thesaurus-based feedback to support mixed search and browsing environments (2007) 0.55 
    0.5548792 = sum of:
  0.5548792 = product of:
    0.9908557 = sum of:
      0.008592927 = weight(abstract_txt:that in 3432) [ClassicSimilarity], result of:
        0.008592927 = score(doc=3432,freq=1.0), product of:
          0.05813556 = queryWeight, product of:
            1.0172613 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.024165185 = queryNorm
          0.14780845 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.049372 = weight(abstract_txt:query in 3432) [ClassicSimilarity], result of:
        0.049372 = score(doc=3432,freq=2.0), product of:
          0.11748478 = queryWeight, product of:
            1.0225567 = boost
            4.754492 = idf(docFreq=1039, maxDocs=44421)
            0.024165185 = queryNorm
          0.42024165 = fieldWeight in 3432, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.754492 = idf(docFreq=1039, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.041735172 = weight(abstract_txt:test in 3432) [ClassicSimilarity], result of:
        0.041735172 = score(doc=3432,freq=1.0), product of:
          0.13233435 = queryWeight, product of:
            1.0852576 = boost
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.024165185 = queryNorm
          0.3153767 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.043129254 = weight(abstract_txt:queries in 3432) [ClassicSimilarity], result of:
        0.043129254 = score(doc=3432,freq=1.0), product of:
          0.1352651 = queryWeight, product of:
            1.0972092 = boost
            5.1015973 = idf(docFreq=734, maxDocs=44421)
            0.024165185 = queryNorm
          0.31884983 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.1015973 = idf(docFreq=734, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.020472527 = weight(abstract_txt:retrieval in 3432) [ClassicSimilarity], result of:
        0.020472527 = score(doc=3432,freq=1.0), product of:
          0.094221324 = queryWeight, product of:
            1.1215453 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.024165185 = queryNorm
          0.21728125 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.052625913 = weight(abstract_txt:controlled in 3432) [ClassicSimilarity], result of:
        0.052625913 = score(doc=3432,freq=1.0), product of:
          0.1544558 = queryWeight, product of:
            1.1724617 = boost
            5.4514923 = idf(docFreq=517, maxDocs=44421)
            0.024165185 = queryNorm
          0.34071827 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.4514923 = idf(docFreq=517, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.066793434 = weight(abstract_txt:average in 3432) [ClassicSimilarity], result of:
        0.066793434 = score(doc=3432,freq=1.0), product of:
          0.18106186 = queryWeight, product of:
            1.2694339 = boost
            5.9023747 = idf(docFreq=329, maxDocs=44421)
            0.024165185 = queryNorm
          0.36889842 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.9023747 = idf(docFreq=329, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.03221702 = weight(abstract_txt:terms in 3432) [ClassicSimilarity], result of:
        0.03221702 = score(doc=3432,freq=1.0), product of:
          0.12747502 = queryWeight, product of:
            1.304532 = boost
            4.043712 = idf(docFreq=2116, maxDocs=44421)
            0.024165185 = queryNorm
          0.252732 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.043712 = idf(docFreq=2116, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.034157533 = weight(abstract_txt:documents in 3432) [ClassicSimilarity], result of:
        0.034157533 = score(doc=3432,freq=1.0), product of:
          0.13254374 = queryWeight, product of:
            1.330215 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.024165185 = queryNorm
          0.25770763 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.09788249 = weight(abstract_txt:trec in 3432) [ClassicSimilarity], result of:
        0.09788249 = score(doc=3432,freq=1.0), product of:
          0.23360087 = queryWeight, product of:
            1.4418956 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.024165185 = queryNorm
          0.41901594 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.044254765 = weight(abstract_txt:level in 3432) [ClassicSimilarity], result of:
        0.044254765 = score(doc=3432,freq=1.0), product of:
          0.15752213 = queryWeight, product of:
            1.4501503 = boost
            4.4950905 = idf(docFreq=1347, maxDocs=44421)
            0.024165185 = queryNorm
          0.28094316 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.4950905 = idf(docFreq=1347, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.09119925 = weight(abstract_txt:effectiveness in 3432) [ClassicSimilarity], result of:
        0.09119925 = score(doc=3432,freq=2.0), product of:
          0.20246613 = queryWeight, product of:
            1.6440629 = boost
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.024165185 = queryNorm
          0.450442 = fieldWeight in 3432, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.27223548 = weight(abstract_txt:feedback in 3432) [ClassicSimilarity], result of:
        0.27223548 = score(doc=3432,freq=4.0), product of:
          0.36668316 = queryWeight, product of:
            2.554801 = boost
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.024165185 = queryNorm
          0.74242705 = fieldWeight in 3432, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
      0.13618791 = weight(abstract_txt:relevance in 3432) [ClassicSimilarity], result of:
        0.13618791 = score(doc=3432,freq=1.0), product of:
          0.44203112 = queryWeight, product of:
            3.7107103 = boost
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.024165185 = queryNorm
          0.30809575 = fieldWeight in 3432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.0625 = fieldNorm(doc=3432)
    0.56 = coord(14/25)
  4. Ye, Z.; Huang, J.X.: ¬A learning to rank approach for quality-aware pseudo-relevance feedback (2016) 0.54 
    0.5372971 = sum of:
  0.5372971 = product of:
    1.119369 = sum of:
      0.008592927 = weight(abstract_txt:that in 3855) [ClassicSimilarity], result of:
        0.008592927 = score(doc=3855,freq=1.0), product of:
          0.05813556 = queryWeight, product of:
            1.0172613 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.024165185 = queryNorm
          0.14780845 = fieldWeight in 3855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.041735172 = weight(abstract_txt:test in 3855) [ClassicSimilarity], result of:
        0.041735172 = score(doc=3855,freq=1.0), product of:
          0.13233435 = queryWeight, product of:
            1.0852576 = boost
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.024165185 = queryNorm
          0.3153767 = fieldWeight in 3855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.028952526 = weight(abstract_txt:retrieval in 3855) [ClassicSimilarity], result of:
        0.028952526 = score(doc=3855,freq=2.0), product of:
          0.094221324 = queryWeight, product of:
            1.1215453 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.024165185 = queryNorm
          0.3072821 = fieldWeight in 3855, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.03221702 = weight(abstract_txt:terms in 3855) [ClassicSimilarity], result of:
        0.03221702 = score(doc=3855,freq=1.0), product of:
          0.12747502 = queryWeight, product of:
            1.304532 = boost
            4.043712 = idf(docFreq=2116, maxDocs=44421)
            0.024165185 = queryNorm
          0.252732 = fieldWeight in 3855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.043712 = idf(docFreq=2116, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.059162583 = weight(abstract_txt:documents in 3855) [ClassicSimilarity], result of:
        0.059162583 = score(doc=3855,freq=3.0), product of:
          0.13254374 = queryWeight, product of:
            1.330215 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.024165185 = queryNorm
          0.4463627 = fieldWeight in 3855, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.09788249 = weight(abstract_txt:trec in 3855) [ClassicSimilarity], result of:
        0.09788249 = score(doc=3855,freq=1.0), product of:
          0.23360087 = queryWeight, product of:
            1.4418956 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.024165185 = queryNorm
          0.41901594 = fieldWeight in 3855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.06258569 = weight(abstract_txt:level in 3855) [ClassicSimilarity], result of:
        0.06258569 = score(doc=3855,freq=2.0), product of:
          0.15752213 = queryWeight, product of:
            1.4501503 = boost
            4.4950905 = idf(docFreq=1347, maxDocs=44421)
            0.024165185 = queryNorm
          0.39731362 = fieldWeight in 3855, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.4950905 = idf(docFreq=1347, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.045730527 = weight(abstract_txt:framework in 3855) [ClassicSimilarity], result of:
        0.045730527 = score(doc=3855,freq=1.0), product of:
          0.16100487 = queryWeight, product of:
            1.4660937 = boost
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.024165185 = queryNorm
          0.28403196 = fieldWeight in 3855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.06917757 = weight(abstract_txt:previous in 3855) [ClassicSimilarity], result of:
        0.06917757 = score(doc=3855,freq=1.0), product of:
          0.21216728 = queryWeight, product of:
            1.6829895 = boost
            5.216832 = idf(docFreq=654, maxDocs=44421)
            0.024165185 = queryNorm
          0.326052 = fieldWeight in 3855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.216832 = idf(docFreq=654, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.10402916 = weight(abstract_txt:experiments in 3855) [ClassicSimilarity], result of:
        0.10402916 = score(doc=3855,freq=2.0), product of:
          0.22103529 = queryWeight, product of:
            1.7178017 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.024165185 = queryNorm
          0.47064504 = fieldWeight in 3855, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.33341902 = weight(abstract_txt:feedback in 3855) [ClassicSimilarity], result of:
        0.33341902 = score(doc=3855,freq=6.0), product of:
          0.36668316 = queryWeight, product of:
            2.554801 = boost
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.024165185 = queryNorm
          0.90928376 = fieldWeight in 3855, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            5.9394164 = idf(docFreq=317, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
      0.23588437 = weight(abstract_txt:relevance in 3855) [ClassicSimilarity], result of:
        0.23588437 = score(doc=3855,freq=3.0), product of:
          0.44203112 = queryWeight, product of:
            3.7107103 = boost
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.024165185 = queryNorm
          0.53363746 = fieldWeight in 3855, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.0625 = fieldNorm(doc=3855)
    0.48 = coord(12/25)
  5. Wu, H.C.; Luk, R.W.P.; Wong, K.F,; Kwok, K.L.: ¬A retrospective study of a hybrid document-context based retrieval model (2007) 0.49 
    0.49349213 = sum of:
  0.49349213 = product of:
    0.94902337 = sum of:
      0.02857009 = weight(abstract_txt:collection in 1936) [ClassicSimilarity], result of:
        0.02857009 = score(doc=1936,freq=1.0), product of:
          0.112358734 = queryWeight, product of:
            4.649612 = idf(docFreq=1154, maxDocs=44421)
            0.024165185 = queryNorm
          0.25427565 = fieldWeight in 1936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.649612 = idf(docFreq=1154, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.018417252 = weight(abstract_txt:that in 1936) [ClassicSimilarity], result of:
        0.018417252 = score(doc=1936,freq=6.0), product of:
          0.05813556 = queryWeight, product of:
            1.0172613 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.024165185 = queryNorm
          0.3167984 = fieldWeight in 1936, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.0432005 = weight(abstract_txt:query in 1936) [ClassicSimilarity], result of:
        0.0432005 = score(doc=1936,freq=2.0), product of:
          0.11748478 = queryWeight, product of:
            1.0225567 = boost
            4.754492 = idf(docFreq=1039, maxDocs=44421)
            0.024165185 = queryNorm
          0.36771145 = fieldWeight in 1936, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.754492 = idf(docFreq=1039, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.031027025 = weight(abstract_txt:retrieval in 1936) [ClassicSimilarity], result of:
        0.031027025 = score(doc=1936,freq=3.0), product of:
          0.094221324 = queryWeight, product of:
            1.1215453 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.024165185 = queryNorm
          0.3292994 = fieldWeight in 1936, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.02559744 = weight(abstract_txt:about in 1936) [ClassicSimilarity], result of:
        0.02559744 = score(doc=1936,freq=1.0), product of:
          0.119534664 = queryWeight, product of:
            1.2632495 = boost
            3.9157467 = idf(docFreq=2405, maxDocs=44421)
            0.024165185 = queryNorm
          0.2141424 = fieldWeight in 1936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.9157467 = idf(docFreq=2405, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.058444258 = weight(abstract_txt:average in 1936) [ClassicSimilarity], result of:
        0.058444258 = score(doc=1936,freq=1.0), product of:
          0.18106186 = queryWeight, product of:
            1.2694339 = boost
            5.9023747 = idf(docFreq=329, maxDocs=44421)
            0.024165185 = queryNorm
          0.32278612 = fieldWeight in 1936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.9023747 = idf(docFreq=329, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.039866522 = weight(abstract_txt:terms in 1936) [ClassicSimilarity], result of:
        0.039866522 = score(doc=1936,freq=2.0), product of:
          0.12747502 = queryWeight, product of:
            1.304532 = boost
            4.043712 = idf(docFreq=2116, maxDocs=44421)
            0.024165185 = queryNorm
          0.31273988 = fieldWeight in 1936, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.043712 = idf(docFreq=2116, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.066064894 = weight(abstract_txt:instead in 1936) [ClassicSimilarity], result of:
        0.066064894 = score(doc=1936,freq=1.0), product of:
          0.19647755 = queryWeight, product of:
            1.3223702 = boost
            6.148508 = idf(docFreq=257, maxDocs=44421)
            0.024165185 = queryNorm
          0.33624655 = fieldWeight in 1936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.148508 = idf(docFreq=257, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.05176726 = weight(abstract_txt:documents in 1936) [ClassicSimilarity], result of:
        0.05176726 = score(doc=1936,freq=3.0), product of:
          0.13254374 = queryWeight, product of:
            1.330215 = boost
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.024165185 = queryNorm
          0.39056736 = fieldWeight in 1936, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.123322 = idf(docFreq=1954, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.08564718 = weight(abstract_txt:trec in 1936) [ClassicSimilarity], result of:
        0.08564718 = score(doc=1936,freq=1.0), product of:
          0.23360087 = queryWeight, product of:
            1.4418956 = boost
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.024165185 = queryNorm
          0.36663896 = fieldWeight in 1936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.704255 = idf(docFreq=147, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.07979934 = weight(abstract_txt:effectiveness in 1936) [ClassicSimilarity], result of:
        0.07979934 = score(doc=1936,freq=2.0), product of:
          0.20246613 = queryWeight, product of:
            1.6440629 = boost
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.024165185 = queryNorm
          0.39413673 = fieldWeight in 1936, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.12872952 = weight(abstract_txt:experiments in 1936) [ClassicSimilarity], result of:
        0.12872952 = score(doc=1936,freq=4.0), product of:
          0.22103529 = queryWeight, product of:
            1.7178017 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.024165185 = queryNorm
          0.5823935 = fieldWeight in 1936, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
      0.29189205 = weight(abstract_txt:relevance in 1936) [ClassicSimilarity], result of:
        0.29189205 = score(doc=1936,freq=6.0), product of:
          0.44203112 = queryWeight, product of:
            3.7107103 = boost
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.024165185 = queryNorm
          0.66034275 = fieldWeight in 1936, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            4.929532 = idf(docFreq=872, maxDocs=44421)
            0.0546875 = fieldNorm(doc=1936)
    0.52 = coord(13/25)