Document (#14019)

Author
Wallis, P.
Thom, J.A.
Title
Relevance judgements for assessing recall
Source
Information processing and management. 32(1996) no.3, S.273-286
Year
1996
Abstract
Selecting documents relevant to a query is problematic. To compare performance of different system standard collections have been used, but these have locked in a particular approach to relevance that is suitable for assessing precision but not recall. Demonstrates this problem by comparing 2 information retrieval methods over several queries, and showing how a new method of forming relevance judgements that is suitable for assessing recall gives different results

Similar documents (author)

  1. Thom, I.W.: ¬The divided catalog in college and university libraries (1949) 2.30 
    2.301311 = sum of:
  2.301311 = product of:
    4.602622 = sum of:
      4.602622 = weight(author_txt:thom in 1572) [ClassicSimilarity], result of:
        4.602622 = score(doc=1572,freq=1.0), product of:
          0.743473 = queryWeight, product of:
            1.054376 = boost
            9.905128 = idf(docFreq=5, maxDocs=44218)
            0.071188465 = queryNorm
          6.190705 = fieldWeight in 1572, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.905128 = idf(docFreq=5, maxDocs=44218)
            0.625 = fieldNorm(doc=1572)
    0.5 = coord(1/2)
  2. Wallis, L.: RVIB Talking Book Library computer system (1993) 1.96 
    1.9633093 = sum of:
  1.9633093 = product of:
    3.9266186 = sum of:
      3.9266186 = weight(author_txt:wallis in 3375) [ClassicSimilarity], result of:
        3.9266186 = score(doc=3375,freq=1.0), product of:
          0.66876596 = queryWeight, product of:
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.071188465 = queryNorm
          5.871439 = fieldWeight in 3375, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.625 = fieldNorm(doc=3375)
    0.5 = coord(1/2)
  3. Wallis, E.: Indexing training and accreditation in UK (1993) 1.96 
    1.9633093 = sum of:
  1.9633093 = product of:
    3.9266186 = sum of:
      3.9266186 = weight(author_txt:wallis in 7650) [ClassicSimilarity], result of:
        3.9266186 = score(doc=7650,freq=1.0), product of:
          0.66876596 = queryWeight, product of:
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.071188465 = queryNorm
          5.871439 = fieldWeight in 7650, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.625 = fieldNorm(doc=7650)
    0.5 = coord(1/2)
  4. Wallis, L.: VICNET: access to information for people with print disabilities (1995) 1.96 
    1.9633093 = sum of:
  1.9633093 = product of:
    3.9266186 = sum of:
      3.9266186 = weight(author_txt:wallis in 4021) [ClassicSimilarity], result of:
        3.9266186 = score(doc=4021,freq=1.0), product of:
          0.66876596 = queryWeight, product of:
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.071188465 = queryNorm
          5.871439 = fieldWeight in 4021, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.625 = fieldNorm(doc=4021)
    0.5 = coord(1/2)
  5. Wallis, E.: Indexing as a professional activity (1997) 1.96 
    1.9633093 = sum of:
  1.9633093 = product of:
    3.9266186 = sum of:
      3.9266186 = weight(author_txt:wallis in 3640) [ClassicSimilarity], result of:
        3.9266186 = score(doc=3640,freq=1.0), product of:
          0.66876596 = queryWeight, product of:
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.071188465 = queryNorm
          5.871439 = fieldWeight in 3640, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.625 = fieldNorm(doc=3640)
    0.5 = coord(1/2)

Similar documents (content)

  1. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.30 
    0.30255717 = sum of:
  0.30255717 = product of:
    1.2606549 = sum of:
      0.0605835 = weight(abstract_txt:performance in 3308) [ClassicSimilarity], result of:
        0.0605835 = score(doc=3308,freq=3.0), product of:
          0.080575325 = queryWeight, product of:
            1.0287651 = boost
            4.63042 = idf(docFreq=1171, maxDocs=44218)
            0.016914744 = queryNorm
          0.7518865 = fieldWeight in 3308, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.63042 = idf(docFreq=1171, maxDocs=44218)
            0.09375 = fieldNorm(doc=3308)
      0.046916373 = weight(abstract_txt:queries in 3308) [ClassicSimilarity], result of:
        0.046916373 = score(doc=3308,freq=1.0), product of:
          0.0979992 = queryWeight, product of:
            1.1345574 = boost
            5.106586 = idf(docFreq=727, maxDocs=44218)
            0.016914744 = queryNorm
          0.47874242 = fieldWeight in 3308, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.106586 = idf(docFreq=727, maxDocs=44218)
            0.09375 = fieldNorm(doc=3308)
      0.059425574 = weight(abstract_txt:precision in 3308) [ClassicSimilarity], result of:
        0.059425574 = score(doc=3308,freq=1.0), product of:
          0.114724234 = queryWeight, product of:
            1.2275602 = boost
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.016914744 = queryNorm
          0.51798624 = fieldWeight in 3308, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.09375 = fieldNorm(doc=3308)
      0.31056926 = weight(abstract_txt:relevance in 3308) [ClassicSimilarity], result of:
        0.31056926 = score(doc=3308,freq=6.0), product of:
          0.27422172 = queryWeight, product of:
            3.2872047 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.016914744 = queryNorm
          1.132548 = fieldWeight in 3308, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.09375 = fieldNorm(doc=3308)
      0.58234465 = weight(abstract_txt:judgements in 3308) [ClassicSimilarity], result of:
        0.58234465 = score(doc=3308,freq=4.0), product of:
          0.416981 = queryWeight, product of:
            3.3096979 = boost
            7.448392 = idf(docFreq=69, maxDocs=44218)
            0.016914744 = queryNorm
          1.3965735 = fieldWeight in 3308, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            7.448392 = idf(docFreq=69, maxDocs=44218)
            0.09375 = fieldNorm(doc=3308)
      0.20081551 = weight(abstract_txt:recall in 3308) [ClassicSimilarity], result of:
        0.20081551 = score(doc=3308,freq=1.0), product of:
          0.3726017 = queryWeight, product of:
            3.8317595 = boost
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.016914744 = queryNorm
          0.5389549 = fieldWeight in 3308, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.09375 = fieldNorm(doc=3308)
    0.24 = coord(6/25)
  2. Bellardo, T.; Saracevic, T.: Online searching and search output : relationships between overlap, relevance, recall and precision (1987) 0.24 
    0.24171942 = sum of:
  0.24171942 = product of:
    0.86328363 = sum of:
      0.029245287 = weight(abstract_txt:relevant in 4150) [ClassicSimilarity], result of:
        0.029245287 = score(doc=4150,freq=1.0), product of:
          0.08075405 = queryWeight, product of:
            1.0299054 = boost
            4.635553 = idf(docFreq=1165, maxDocs=44218)
            0.016914744 = queryNorm
          0.36215258 = fieldWeight in 4150, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.635553 = idf(docFreq=1165, maxDocs=44218)
            0.078125 = fieldNorm(doc=4150)
      0.08577342 = weight(abstract_txt:precision in 4150) [ClassicSimilarity], result of:
        0.08577342 = score(doc=4150,freq=3.0), product of:
          0.114724234 = queryWeight, product of:
            1.2275602 = boost
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.016914744 = queryNorm
          0.7476487 = fieldWeight in 4150, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.078125 = fieldNorm(doc=4150)
      0.08119239 = weight(abstract_txt:selecting in 4150) [ClassicSimilarity], result of:
        0.08119239 = score(doc=4150,freq=1.0), product of:
          0.15951589 = queryWeight, product of:
            1.4474953 = boost
            6.515104 = idf(docFreq=177, maxDocs=44218)
            0.016914744 = queryNorm
          0.5089925 = fieldWeight in 4150, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.515104 = idf(docFreq=177, maxDocs=44218)
            0.078125 = fieldNorm(doc=4150)
      0.028918888 = weight(abstract_txt:different in 4150) [ClassicSimilarity], result of:
        0.028918888 = score(doc=4150,freq=1.0), product of:
          0.100985296 = queryWeight, product of:
            1.6287681 = boost
            3.6655018 = idf(docFreq=3075, maxDocs=44218)
            0.016914744 = queryNorm
          0.28636733 = fieldWeight in 4150, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6655018 = idf(docFreq=3075, maxDocs=44218)
            0.078125 = fieldNorm(doc=4150)
      0.1056578 = weight(abstract_txt:relevance in 4150) [ClassicSimilarity], result of:
        0.1056578 = score(doc=4150,freq=1.0), product of:
          0.27422172 = queryWeight, product of:
            3.2872047 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.016914744 = queryNorm
          0.38530064 = fieldWeight in 4150, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.078125 = fieldNorm(doc=4150)
      0.24264358 = weight(abstract_txt:judgements in 4150) [ClassicSimilarity], result of:
        0.24264358 = score(doc=4150,freq=1.0), product of:
          0.416981 = queryWeight, product of:
            3.3096979 = boost
            7.448392 = idf(docFreq=69, maxDocs=44218)
            0.016914744 = queryNorm
          0.5819056 = fieldWeight in 4150, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.448392 = idf(docFreq=69, maxDocs=44218)
            0.078125 = fieldNorm(doc=4150)
      0.28985223 = weight(abstract_txt:recall in 4150) [ClassicSimilarity], result of:
        0.28985223 = score(doc=4150,freq=3.0), product of:
          0.3726017 = queryWeight, product of:
            3.8317595 = boost
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.016914744 = queryNorm
          0.7779144 = fieldWeight in 4150, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.078125 = fieldNorm(doc=4150)
    0.28 = coord(7/25)
  3. Nelson, M.J.: ¬The effect of query characteristics on retrieval results in the TREC retrieval tests (1995) 0.24 
    0.23581895 = sum of:
  0.23581895 = product of:
    0.6550526 = sum of:
      0.029245287 = weight(abstract_txt:relevant in 3608) [ClassicSimilarity], result of:
        0.029245287 = score(doc=3608,freq=1.0), product of:
          0.08075405 = queryWeight, product of:
            1.0299054 = boost
            4.635553 = idf(docFreq=1165, maxDocs=44218)
            0.016914744 = queryNorm
          0.36215258 = fieldWeight in 3608, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.635553 = idf(docFreq=1165, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
      0.03154019 = weight(abstract_txt:query in 3608) [ClassicSimilarity], result of:
        0.03154019 = score(doc=3608,freq=1.0), product of:
          0.084925205 = queryWeight, product of:
            1.0561692 = boost
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.016914744 = queryNorm
          0.37138787 = fieldWeight in 3608, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
      0.06771795 = weight(abstract_txt:queries in 3608) [ClassicSimilarity], result of:
        0.06771795 = score(doc=3608,freq=3.0), product of:
          0.0979992 = queryWeight, product of:
            1.1345574 = boost
            5.106586 = idf(docFreq=727, maxDocs=44218)
            0.016914744 = queryNorm
          0.6910051 = fieldWeight in 3608, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.106586 = idf(docFreq=727, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
      0.070033714 = weight(abstract_txt:precision in 3608) [ClassicSimilarity], result of:
        0.070033714 = score(doc=3608,freq=2.0), product of:
          0.114724234 = queryWeight, product of:
            1.2275602 = boost
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.016914744 = queryNorm
          0.61045265 = fieldWeight in 3608, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
      0.05196652 = weight(abstract_txt:compare in 3608) [ClassicSimilarity], result of:
        0.05196652 = score(doc=3608,freq=1.0), product of:
          0.118470296 = queryWeight, product of:
            1.2474408 = boost
            5.6146684 = idf(docFreq=437, maxDocs=44218)
            0.016914744 = queryNorm
          0.43864596 = fieldWeight in 3608, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.6146684 = idf(docFreq=437, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
      0.027328666 = weight(abstract_txt:have in 3608) [ClassicSimilarity], result of:
        0.027328666 = score(doc=3608,freq=2.0), product of:
          0.07718615 = queryWeight, product of:
            1.4239669 = boost
            3.2046018 = idf(docFreq=4876, maxDocs=44218)
            0.016914744 = queryNorm
          0.35406178 = fieldWeight in 3608, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.2046018 = idf(docFreq=4876, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
      0.028918888 = weight(abstract_txt:different in 3608) [ClassicSimilarity], result of:
        0.028918888 = score(doc=3608,freq=1.0), product of:
          0.100985296 = queryWeight, product of:
            1.6287681 = boost
            3.6655018 = idf(docFreq=3075, maxDocs=44218)
            0.016914744 = queryNorm
          0.28636733 = fieldWeight in 3608, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6655018 = idf(docFreq=3075, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
      0.1056578 = weight(abstract_txt:relevance in 3608) [ClassicSimilarity], result of:
        0.1056578 = score(doc=3608,freq=1.0), product of:
          0.27422172 = queryWeight, product of:
            3.2872047 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.016914744 = queryNorm
          0.38530064 = fieldWeight in 3608, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
      0.24264358 = weight(abstract_txt:judgements in 3608) [ClassicSimilarity], result of:
        0.24264358 = score(doc=3608,freq=1.0), product of:
          0.416981 = queryWeight, product of:
            3.3096979 = boost
            7.448392 = idf(docFreq=69, maxDocs=44218)
            0.016914744 = queryNorm
          0.5819056 = fieldWeight in 3608, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.448392 = idf(docFreq=69, maxDocs=44218)
            0.078125 = fieldNorm(doc=3608)
    0.36 = coord(9/25)
  4. Talvensaari, T.; Juhola, M.; Laurikkala, J.; Järvelin, K.: Corpus-based cross-language information retrieval in retrieval of highly relevant documents (2007) 0.23 
    0.23201239 = sum of:
  0.23201239 = product of:
    0.580031 = sum of:
      0.03297748 = weight(abstract_txt:performance in 139) [ClassicSimilarity], result of:
        0.03297748 = score(doc=139,freq=2.0), product of:
          0.080575325 = queryWeight, product of:
            1.0287651 = boost
            4.63042 = idf(docFreq=1171, maxDocs=44218)
            0.016914744 = queryNorm
          0.40927517 = fieldWeight in 139, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.63042 = idf(docFreq=1171, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.04679246 = weight(abstract_txt:relevant in 139) [ClassicSimilarity], result of:
        0.04679246 = score(doc=139,freq=4.0), product of:
          0.08075405 = queryWeight, product of:
            1.0299054 = boost
            4.635553 = idf(docFreq=1165, maxDocs=44218)
            0.016914744 = queryNorm
          0.5794441 = fieldWeight in 139, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.635553 = idf(docFreq=1165, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.034350738 = weight(abstract_txt:collections in 139) [ClassicSimilarity], result of:
        0.034350738 = score(doc=139,freq=2.0), product of:
          0.082796976 = queryWeight, product of:
            1.0428514 = boost
            4.693822 = idf(docFreq=1099, maxDocs=44218)
            0.016914744 = queryNorm
          0.41487914 = fieldWeight in 139, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.693822 = idf(docFreq=1099, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.00883777 = weight(abstract_txt:that in 139) [ClassicSimilarity], result of:
        0.00883777 = score(doc=139,freq=2.0), product of:
          0.042198356 = queryWeight, product of:
            1.0528778 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.016914744 = queryNorm
          0.20943399 = fieldWeight in 139, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.04370337 = weight(abstract_txt:query in 139) [ClassicSimilarity], result of:
        0.04370337 = score(doc=139,freq=3.0), product of:
          0.084925205 = queryWeight, product of:
            1.0561692 = boost
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.016914744 = queryNorm
          0.5146101 = fieldWeight in 139, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.031277582 = weight(abstract_txt:queries in 139) [ClassicSimilarity], result of:
        0.031277582 = score(doc=139,freq=1.0), product of:
          0.0979992 = queryWeight, product of:
            1.1345574 = boost
            5.106586 = idf(docFreq=727, maxDocs=44218)
            0.016914744 = queryNorm
          0.31916162 = fieldWeight in 139, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.106586 = idf(docFreq=727, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.05602697 = weight(abstract_txt:precision in 139) [ClassicSimilarity], result of:
        0.05602697 = score(doc=139,freq=2.0), product of:
          0.114724234 = queryWeight, product of:
            1.2275602 = boost
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.016914744 = queryNorm
          0.4883621 = fieldWeight in 139, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.023135113 = weight(abstract_txt:different in 139) [ClassicSimilarity], result of:
        0.023135113 = score(doc=139,freq=1.0), product of:
          0.100985296 = queryWeight, product of:
            1.6287681 = boost
            3.6655018 = idf(docFreq=3075, maxDocs=44218)
            0.016914744 = queryNorm
          0.22909386 = fieldWeight in 139, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6655018 = idf(docFreq=3075, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.16905248 = weight(abstract_txt:relevance in 139) [ClassicSimilarity], result of:
        0.16905248 = score(doc=139,freq=4.0), product of:
          0.27422172 = queryWeight, product of:
            3.2872047 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.016914744 = queryNorm
          0.616481 = fieldWeight in 139, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
      0.13387701 = weight(abstract_txt:recall in 139) [ClassicSimilarity], result of:
        0.13387701 = score(doc=139,freq=1.0), product of:
          0.3726017 = queryWeight, product of:
            3.8317595 = boost
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.016914744 = queryNorm
          0.35930327 = fieldWeight in 139, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.0625 = fieldNorm(doc=139)
    0.4 = coord(10/25)
  5. Wong, S.K.M.; Yao, Y.Y.; Salton, G.; Buckley, C.: Evaluation of an adaptive linear model (1991) 0.22 
    0.2190148 = sum of:
  0.2190148 = product of:
    0.7821957 = sum of:
      0.060575746 = weight(abstract_txt:method in 4836) [ClassicSimilarity], result of:
        0.060575746 = score(doc=4836,freq=2.0), product of:
          0.07613242 = queryWeight, product of:
            4.50095 = idf(docFreq=1333, maxDocs=44218)
            0.016914744 = queryNorm
          0.795663 = fieldWeight in 4836, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.50095 = idf(docFreq=1333, maxDocs=44218)
            0.125 = fieldNorm(doc=4836)
      0.0466372 = weight(abstract_txt:performance in 4836) [ClassicSimilarity], result of:
        0.0466372 = score(doc=4836,freq=1.0), product of:
          0.080575325 = queryWeight, product of:
            1.0287651 = boost
            4.63042 = idf(docFreq=1171, maxDocs=44218)
            0.016914744 = queryNorm
          0.5788025 = fieldWeight in 4836, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.63042 = idf(docFreq=1171, maxDocs=44218)
            0.125 = fieldNorm(doc=4836)
      0.049560655 = weight(abstract_txt:standard in 4836) [ClassicSimilarity], result of:
        0.049560655 = score(doc=4836,freq=1.0), product of:
          0.083908334 = queryWeight, product of:
            1.049827 = boost
            4.725219 = idf(docFreq=1065, maxDocs=44218)
            0.016914744 = queryNorm
          0.59065235 = fieldWeight in 4836, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.725219 = idf(docFreq=1065, maxDocs=44218)
            0.125 = fieldNorm(doc=4836)
      0.01767554 = weight(abstract_txt:that in 4836) [ClassicSimilarity], result of:
        0.01767554 = score(doc=4836,freq=2.0), product of:
          0.042198356 = queryWeight, product of:
            1.0528778 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.016914744 = queryNorm
          0.41886798 = fieldWeight in 4836, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.125 = fieldNorm(doc=4836)
      0.050464306 = weight(abstract_txt:query in 4836) [ClassicSimilarity], result of:
        0.050464306 = score(doc=4836,freq=1.0), product of:
          0.084925205 = queryWeight, product of:
            1.0561692 = boost
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.016914744 = queryNorm
          0.5942206 = fieldWeight in 4836, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.125 = fieldNorm(doc=4836)
      0.16905248 = weight(abstract_txt:relevance in 4836) [ClassicSimilarity], result of:
        0.16905248 = score(doc=4836,freq=1.0), product of:
          0.27422172 = queryWeight, product of:
            3.2872047 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.016914744 = queryNorm
          0.616481 = fieldWeight in 4836, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.125 = fieldNorm(doc=4836)
      0.38822976 = weight(abstract_txt:judgements in 4836) [ClassicSimilarity], result of:
        0.38822976 = score(doc=4836,freq=1.0), product of:
          0.416981 = queryWeight, product of:
            3.3096979 = boost
            7.448392 = idf(docFreq=69, maxDocs=44218)
            0.016914744 = queryNorm
          0.931049 = fieldWeight in 4836, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            7.448392 = idf(docFreq=69, maxDocs=44218)
            0.125 = fieldNorm(doc=4836)
    0.28 = coord(7/25)