Document (#34445)

Author
Voorhees, E.M.
Title
On test collections for adaptive information retrieval
Source
Information processing and management. 44(2008) no.6, S.1879-1885
Year
2008
Abstract
Traditional Cranfield test collections represent an abstraction of a retrieval task that Sparck Jones calls the "core competency" of retrieval: a task that is necessary, but not sufficient, for user retrieval tasks. The abstraction facilitates research by controlling for (some) sources of variability, thus increasing the power of experiments that compare system effectiveness while reducing their cost. However, even within the highly-abstracted case of the Cranfield paradigm, meta-analysis demonstrates that the user/topic effect is greater than the system effect, so experiments must include a relatively large number of topics to distinguish systems' effectiveness. The evidence further suggests that changing the abstraction slightly to include just a bit more characterization of the user will result in a dramatic loss of power or increase in cost of retrieval experiments. Defining a new, feasible abstraction for supporting adaptive IR research will require winnowing the list of all possible factors that can affect retrieval behavior to a minimum number of essential factors.
Footnote
Beitrag in einem Themenheft "Adaptive information retrieval"
Theme
Retrievalstudien

Similar documents (author)

  1. Voorhees, E.M.: Implementing agglomerative hierarchic clustering algorithms for use in document retrieval (1986) 5.54 
    5.5426593 = sum of:
  5.5426593 = weight(author_txt:voorhees in 401) [ClassicSimilarity], result of:
    5.5426593 = fieldWeight in 401, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.868255 = idf(docFreq=16, maxDocs=44421)
      0.625 = fieldNorm(doc=401)
  2. Voorhees, E.M.: Question answering in TREC (2005) 5.54 
    5.5426593 = sum of:
  5.5426593 = weight(author_txt:voorhees in 6486) [ClassicSimilarity], result of:
    5.5426593 = fieldWeight in 6486, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.868255 = idf(docFreq=16, maxDocs=44421)
      0.625 = fieldNorm(doc=6486)
  3. Voorhees, E.M.: Variations in relevance judgements and the measurement of retrieval effectiveness (2000) 5.54 
    5.5426593 = sum of:
  5.5426593 = weight(author_txt:voorhees in 324) [ClassicSimilarity], result of:
    5.5426593 = fieldWeight in 324, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.868255 = idf(docFreq=16, maxDocs=44421)
      0.625 = fieldNorm(doc=324)
  4. Voorhees, E.M.: Using WordNet to disambiguate word senses for text retrieval (1993) 5.54 
    5.5426593 = sum of:
  5.5426593 = weight(author_txt:voorhees in 413) [ClassicSimilarity], result of:
    5.5426593 = fieldWeight in 413, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.868255 = idf(docFreq=16, maxDocs=44421)
      0.625 = fieldNorm(doc=413)
  5. Voorhees, E.M.: Text REtrieval Conference (TREC) (2009) 5.54 
    5.5426593 = sum of:
  5.5426593 = weight(author_txt:voorhees in 877) [ClassicSimilarity], result of:
    5.5426593 = fieldWeight in 877, product of:
      1.0 = tf(freq=1.0), with freq of:
        1.0 = termFreq=1.0
      8.868255 = idf(docFreq=16, maxDocs=44421)
      0.625 = fieldNorm(doc=877)

Similar documents (content)

  1. Kutlu, M.; Elsayed, T.; Lease, M.: Intelligent topic selection for low-cost information retrieval evaluation : a new perspective on deep vs. shallow judging (2018) 0.21 
    0.20547986 = sum of:
  0.20547986 = product of:
    0.51369965 = sum of:
      0.016895942 = weight(abstract_txt:number in 92) [ClassicSimilarity], result of:
        0.016895942 = score(doc=92,freq=1.0), product of:
          0.0871555 = queryWeight, product of:
            1.0709887 = boost
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.019677212 = queryNorm
          0.19385974 = fieldWeight in 92, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.04951901 = weight(abstract_txt:collections in 92) [ClassicSimilarity], result of:
        0.04951901 = score(doc=92,freq=4.0), product of:
          0.11244354 = queryWeight, product of:
            1.2164793 = boost
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.019677212 = queryNorm
          0.44039002 = fieldWeight in 92, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.0290389 = weight(abstract_txt:factors in 92) [ClassicSimilarity], result of:
        0.0290389 = score(doc=92,freq=1.0), product of:
          0.12505277 = queryWeight, product of:
            1.2828743 = boost
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.019677212 = queryNorm
          0.23221318 = fieldWeight in 92, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.053156056 = weight(abstract_txt:test in 92) [ClassicSimilarity], result of:
        0.053156056 = score(doc=92,freq=3.0), product of:
          0.12974818 = queryWeight, product of:
            1.3067368 = boost
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.019677212 = queryNorm
          0.40968633 = fieldWeight in 92, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.038014486 = weight(abstract_txt:effect in 92) [ClassicSimilarity], result of:
        0.038014486 = score(doc=92,freq=1.0), product of:
          0.14964858 = queryWeight, product of:
            1.4033751 = boost
            5.419201 = idf(docFreq=534, maxDocs=44421)
            0.019677212 = queryNorm
          0.25402504 = fieldWeight in 92, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.419201 = idf(docFreq=534, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.0904898 = weight(abstract_txt:cost in 92) [ClassicSimilarity], result of:
        0.0904898 = score(doc=92,freq=4.0), product of:
          0.16806847 = queryWeight, product of:
            1.4872384 = boost
            5.743043 = idf(docFreq=386, maxDocs=44421)
            0.019677212 = queryNorm
          0.5384103 = fieldWeight in 92, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.743043 = idf(docFreq=386, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.018956248 = weight(abstract_txt:that in 92) [ClassicSimilarity], result of:
        0.018956248 = score(doc=92,freq=4.0), product of:
          0.08549916 = queryWeight, product of:
            1.8372957 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019677212 = queryNorm
          0.22171268 = fieldWeight in 92, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.05409163 = weight(abstract_txt:experiments in 92) [ClassicSimilarity], result of:
        0.05409163 = score(doc=92,freq=1.0), product of:
          0.21671566 = queryWeight, product of:
            2.06837 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.019677212 = queryNorm
          0.24959722 = fieldWeight in 92, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.13342893 = weight(abstract_txt:cranfield in 92) [ClassicSimilarity], result of:
        0.13342893 = score(doc=92,freq=1.0), product of:
          0.3456261 = queryWeight, product of:
            2.1327538 = boost
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.019677212 = queryNorm
          0.38604993 = fieldWeight in 92, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
      0.030108655 = weight(abstract_txt:retrieval in 92) [ClassicSimilarity], result of:
        0.030108655 = score(doc=92,freq=1.0), product of:
          0.18475994 = queryWeight, product of:
            2.7008598 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.019677212 = queryNorm
          0.16296095 = fieldWeight in 92, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.046875 = fieldNorm(doc=92)
    0.4 = coord(10/25)
  2. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1985) 0.19 
    0.19125743 = sum of:
  0.19125743 = product of:
    0.68306226 = sum of:
      0.0290389 = weight(abstract_txt:factors in 4643) [ClassicSimilarity], result of:
        0.0290389 = score(doc=4643,freq=1.0), product of:
          0.12505277 = queryWeight, product of:
            1.2828743 = boost
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.019677212 = queryNorm
          0.23221318 = fieldWeight in 4643, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.046875 = fieldNorm(doc=4643)
      0.030689664 = weight(abstract_txt:test in 4643) [ClassicSimilarity], result of:
        0.030689664 = score(doc=4643,freq=1.0), product of:
          0.12974818 = queryWeight, product of:
            1.3067368 = boost
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.019677212 = queryNorm
          0.23653252 = fieldWeight in 4643, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.046875 = fieldNorm(doc=4643)
      0.030948969 = weight(abstract_txt:user in 4643) [ClassicSimilarity], result of:
        0.030948969 = score(doc=4643,freq=3.0), product of:
          0.103560455 = queryWeight, product of:
            1.4298158 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.019677212 = queryNorm
          0.29884928 = fieldWeight in 4643, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.046875 = fieldNorm(doc=4643)
      0.02843437 = weight(abstract_txt:that in 4643) [ClassicSimilarity], result of:
        0.02843437 = score(doc=4643,freq=9.0), product of:
          0.08549916 = queryWeight, product of:
            1.8372957 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019677212 = queryNorm
          0.332569 = fieldWeight in 4643, product of:
            3.0 = tf(freq=9.0), with freq of:
              9.0 = termFreq=9.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.046875 = fieldNorm(doc=4643)
      0.05409163 = weight(abstract_txt:experiments in 4643) [ClassicSimilarity], result of:
        0.05409163 = score(doc=4643,freq=1.0), product of:
          0.21671566 = queryWeight, product of:
            2.06837 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.019677212 = queryNorm
          0.24959722 = fieldWeight in 4643, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.046875 = fieldNorm(doc=4643)
      0.44253373 = weight(abstract_txt:cranfield in 4643) [ClassicSimilarity], result of:
        0.44253373 = score(doc=4643,freq=11.0), product of:
          0.3456261 = queryWeight, product of:
            2.1327538 = boost
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.019677212 = queryNorm
          1.2803829 = fieldWeight in 4643, product of:
            3.3166249 = tf(freq=11.0), with freq of:
              11.0 = termFreq=11.0
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.046875 = fieldNorm(doc=4643)
      0.067324996 = weight(abstract_txt:retrieval in 4643) [ClassicSimilarity], result of:
        0.067324996 = score(doc=4643,freq=5.0), product of:
          0.18475994 = queryWeight, product of:
            2.7008598 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.019677212 = queryNorm
          0.36439174 = fieldWeight in 4643, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.046875 = fieldNorm(doc=4643)
    0.28 = coord(7/25)
  3. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.14 
    0.1427005 = sum of:
  0.1427005 = product of:
    0.44593906 = sum of:
      0.028159903 = weight(abstract_txt:number in 3884) [ClassicSimilarity], result of:
        0.028159903 = score(doc=3884,freq=1.0), product of:
          0.0871555 = queryWeight, product of:
            1.0709887 = boost
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.019677212 = queryNorm
          0.32309955 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.051149443 = weight(abstract_txt:test in 3884) [ClassicSimilarity], result of:
        0.051149443 = score(doc=3884,freq=1.0), product of:
          0.12974818 = queryWeight, product of:
            1.3067368 = boost
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.019677212 = queryNorm
          0.3942209 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.05268945 = weight(abstract_txt:effectiveness in 3884) [ClassicSimilarity], result of:
        0.05268945 = score(doc=3884,freq=1.0), product of:
          0.1323396 = queryWeight, product of:
            1.3197218 = boost
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.019677212 = queryNorm
          0.39813823 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.06335748 = weight(abstract_txt:effect in 3884) [ClassicSimilarity], result of:
        0.06335748 = score(doc=3884,freq=1.0), product of:
          0.14964858 = queryWeight, product of:
            1.4033751 = boost
            5.419201 = idf(docFreq=534, maxDocs=44421)
            0.019677212 = queryNorm
          0.42337507 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.419201 = idf(docFreq=534, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.029780658 = weight(abstract_txt:user in 3884) [ClassicSimilarity], result of:
        0.029780658 = score(doc=3884,freq=1.0), product of:
          0.103560455 = queryWeight, product of:
            1.4298158 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.019677212 = queryNorm
          0.28756785 = fieldWeight in 3884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.022340152 = weight(abstract_txt:that in 3884) [ClassicSimilarity], result of:
        0.022340152 = score(doc=3884,freq=2.0), product of:
          0.08549916 = queryWeight, product of:
            1.8372957 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019677212 = queryNorm
          0.2612909 = fieldWeight in 3884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.12749518 = weight(abstract_txt:experiments in 3884) [ClassicSimilarity], result of:
        0.12749518 = score(doc=3884,freq=2.0), product of:
          0.21671566 = queryWeight, product of:
            2.06837 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.019677212 = queryNorm
          0.5883063 = fieldWeight in 3884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
      0.07096678 = weight(abstract_txt:retrieval in 3884) [ClassicSimilarity], result of:
        0.07096678 = score(doc=3884,freq=2.0), product of:
          0.18475994 = queryWeight, product of:
            2.7008598 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.019677212 = queryNorm
          0.3841026 = fieldWeight in 3884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.078125 = fieldNorm(doc=3884)
    0.32 = coord(8/25)
  4. Burgin, R.: ¬The retrieval effectiveness of 5 clustering algorithms as a function of indexing exhaustivity (1995) 0.14 
    0.13899992 = sum of:
  0.13899992 = product of:
    0.4964283 = sum of:
      0.022527924 = weight(abstract_txt:number in 3433) [ClassicSimilarity], result of:
        0.022527924 = score(doc=3433,freq=1.0), product of:
          0.0871555 = queryWeight, product of:
            1.0709887 = boost
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.019677212 = queryNorm
          0.25847965 = fieldWeight in 3433, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.0625 = fieldNorm(doc=3433)
      0.04668697 = weight(abstract_txt:collections in 3433) [ClassicSimilarity], result of:
        0.04668697 = score(doc=3433,freq=2.0), product of:
          0.11244354 = queryWeight, product of:
            1.2164793 = boost
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.019677212 = queryNorm
          0.4152037 = fieldWeight in 3433, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.6974936 = idf(docFreq=1100, maxDocs=44421)
            0.0625 = fieldNorm(doc=3433)
      0.040919553 = weight(abstract_txt:test in 3433) [ClassicSimilarity], result of:
        0.040919553 = score(doc=3433,freq=1.0), product of:
          0.12974818 = queryWeight, product of:
            1.3067368 = boost
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.019677212 = queryNorm
          0.3153767 = fieldWeight in 3433, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046027 = idf(docFreq=776, maxDocs=44421)
            0.0625 = fieldNorm(doc=3433)
      0.084303126 = weight(abstract_txt:effectiveness in 3433) [ClassicSimilarity], result of:
        0.084303126 = score(doc=3433,freq=4.0), product of:
          0.1323396 = queryWeight, product of:
            1.3197218 = boost
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.019677212 = queryNorm
          0.6370212 = fieldWeight in 3433, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.0625 = fieldNorm(doc=3433)
      0.017872121 = weight(abstract_txt:that in 3433) [ClassicSimilarity], result of:
        0.017872121 = score(doc=3433,freq=2.0), product of:
          0.08549916 = queryWeight, product of:
            1.8372957 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019677212 = queryNorm
          0.20903271 = fieldWeight in 3433, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=3433)
      0.17790525 = weight(abstract_txt:cranfield in 3433) [ClassicSimilarity], result of:
        0.17790525 = score(doc=3433,freq=1.0), product of:
          0.3456261 = queryWeight, product of:
            2.1327538 = boost
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.019677212 = queryNorm
          0.51473325 = fieldWeight in 3433, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.235732 = idf(docFreq=31, maxDocs=44421)
            0.0625 = fieldNorm(doc=3433)
      0.106213346 = weight(abstract_txt:retrieval in 3433) [ClassicSimilarity], result of:
        0.106213346 = score(doc=3433,freq=7.0), product of:
          0.18475994 = queryWeight, product of:
            2.7008598 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.019677212 = queryNorm
          0.57487214 = fieldWeight in 3433, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=3433)
    0.28 = coord(7/25)
  5. Albertson, D.: Analyzing user interaction with the ViewFinder video retrieval system (2010) 0.14 
    0.13627444 = sum of:
  0.13627444 = product of:
    0.42585763 = sum of:
      0.022527924 = weight(abstract_txt:number in 315) [ClassicSimilarity], result of:
        0.022527924 = score(doc=315,freq=1.0), product of:
          0.0871555 = queryWeight, product of:
            1.0709887 = boost
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.019677212 = queryNorm
          0.25847965 = fieldWeight in 315, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1356745 = idf(docFreq=1930, maxDocs=44421)
            0.0625 = fieldNorm(doc=315)
      0.053176098 = weight(abstract_txt:task in 315) [ClassicSimilarity], result of:
        0.053176098 = score(doc=315,freq=2.0), product of:
          0.12263516 = queryWeight, product of:
            1.2704132 = boost
            4.9057617 = idf(docFreq=893, maxDocs=44421)
            0.019677212 = queryNorm
          0.43361217 = fieldWeight in 315, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.9057617 = idf(docFreq=893, maxDocs=44421)
            0.0625 = fieldNorm(doc=315)
      0.038718533 = weight(abstract_txt:factors in 315) [ClassicSimilarity], result of:
        0.038718533 = score(doc=315,freq=1.0), product of:
          0.12505277 = queryWeight, product of:
            1.2828743 = boost
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.019677212 = queryNorm
          0.30961758 = fieldWeight in 315, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.0625 = fieldNorm(doc=315)
      0.05961131 = weight(abstract_txt:effectiveness in 315) [ClassicSimilarity], result of:
        0.05961131 = score(doc=315,freq=2.0), product of:
          0.1323396 = queryWeight, product of:
            1.3197218 = boost
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.019677212 = queryNorm
          0.450442 = fieldWeight in 315, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.0961695 = idf(docFreq=738, maxDocs=44421)
            0.0625 = fieldNorm(doc=315)
      0.047649052 = weight(abstract_txt:user in 315) [ClassicSimilarity], result of:
        0.047649052 = score(doc=315,freq=4.0), product of:
          0.103560455 = queryWeight, product of:
            1.4298158 = boost
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.019677212 = queryNorm
          0.46010855 = fieldWeight in 315, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.6808684 = idf(docFreq=3042, maxDocs=44421)
            0.0625 = fieldNorm(doc=315)
      0.021888787 = weight(abstract_txt:that in 315) [ClassicSimilarity], result of:
        0.021888787 = score(doc=315,freq=3.0), product of:
          0.08549916 = queryWeight, product of:
            1.8372957 = boost
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.019677212 = queryNorm
          0.25601172 = fieldWeight in 315, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            2.3649352 = idf(docFreq=11344, maxDocs=44421)
            0.0625 = fieldNorm(doc=315)
      0.10199615 = weight(abstract_txt:experiments in 315) [ClassicSimilarity], result of:
        0.10199615 = score(doc=315,freq=2.0), product of:
          0.21671566 = queryWeight, product of:
            2.06837 = boost
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.019677212 = queryNorm
          0.47064504 = fieldWeight in 315, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.324741 = idf(docFreq=587, maxDocs=44421)
            0.0625 = fieldNorm(doc=315)
      0.080289744 = weight(abstract_txt:retrieval in 315) [ClassicSimilarity], result of:
        0.080289744 = score(doc=315,freq=4.0), product of:
          0.18475994 = queryWeight, product of:
            2.7008598 = boost
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.019677212 = queryNorm
          0.4345625 = fieldWeight in 315, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4765 = idf(docFreq=3732, maxDocs=44421)
            0.0625 = fieldNorm(doc=315)
    0.32 = coord(8/25)