Document (#26455)

Author
Alemayehu, N.
Title
Analysis of performance variation using quey expansion
Source
Journal of the American Society for Information Science and technology. 54(2003) no.5, S.379-391
Year
2003
Abstract
Information retrieval performance evaluation is commonly made based an the classical recall and precision based figures or graphs. However, important information indicating causes for variation may remain hidden under the average recall and precision figures. Identifying significant causes for variation can help researchers and developers to focus an opportunities for improvement that underlay the averages. This article presents a case study showing the potential of a statistical repeated measures analysis of variance for testing the significance of factors in retrieval performance variation. The TREC-9 Query Track performance data is used as a case study and the factors studied are retrieval method, topic, and their interaction. The results show that retrieval method, topic, and their interaction are all significant. A topic level analysis is also made to see the nature of variation in the performance of retrieval methods across topics. The observed retrieval performances of expansion runs are truly significant improvements for most of the topics. Analyses of the effect of query expansion an document ranking confirm that expansion affects ranking positively.
Theme
Retrievalstudien
Object
TREC-9

Similar documents (content)

  1. Järvelin, A.; Keskustalo, H.; Sormunen, E.; Saastamoinen, M.; Kettunen, K.: Information retrieval from historical newspaper collections in highly inflectional languages : a query expansion approach (2016) 0.31
    0.3103425 = sum of:
      0.3103425 = product of:
        0.96982026 = sum of:
          0.08247306 = weight(abstract_txt:query in 4223) [ClassicSimilarity], result of:
            0.08247306 = score(doc=4223,freq=7.0), product of:
              0.104900844 = queryWeight, product of:
                1.2782974 = boost
                4.754492 = idf(docFreq=1039, maxDocs=44421)
                0.017260086 = queryNorm
              0.78620017 = fieldWeight in 4223, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.754492 = idf(docFreq=1039, maxDocs=44421)
                0.0625 = fieldNorm(doc=4223)
          0.02108026 = weight(abstract_txt:analysis in 4223) [ClassicSimilarity], result of:
            0.02108026 = score(doc=4223,freq=1.0), product of:
              0.092516236 = queryWeight, product of:
                1.4702698 = boost
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.017260086 = queryNorm
              0.2278547 = fieldWeight in 4223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.0625 = fieldNorm(doc=4223)
          0.048876416 = weight(abstract_txt:precision in 4223) [ClassicSimilarity], result of:
            0.048876416 = score(doc=4223,freq=1.0), product of:
              0.1415804 = queryWeight, product of:
                1.48506 = boost
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.017260086 = queryNorm
              0.3452202 = fieldWeight in 4223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.0625 = fieldNorm(doc=4223)
          0.0561553 = weight(abstract_txt:topic in 4223) [ClassicSimilarity], result of:
            0.0561553 = score(doc=4223,freq=1.0), product of:
              0.17778474 = queryWeight, product of:
                2.038146 = boost
                5.053779 = idf(docFreq=770, maxDocs=44421)
                0.017260086 = queryNorm
              0.3158612 = fieldWeight in 4223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.053779 = idf(docFreq=770, maxDocs=44421)
                0.0625 = fieldNorm(doc=4223)
          0.05170276 = weight(abstract_txt:retrieval in 4223) [ClassicSimilarity], result of:
            0.05170276 = score(doc=4223,freq=2.0), product of:
              0.1682583 = queryWeight, product of:
                2.804086 = boost
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.017260086 = queryNorm
              0.3072821 = fieldWeight in 4223, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.0625 = fieldNorm(doc=4223)
          0.07149057 = weight(abstract_txt:performance in 4223) [ClassicSimilarity], result of:
            0.07149057 = score(doc=4223,freq=1.0), product of:
              0.2475993 = queryWeight, product of:
                3.1051826 = boost
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.017260086 = queryNorm
              0.28873494 = fieldWeight in 4223, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.0625 = fieldNorm(doc=4223)
          0.29539117 = weight(abstract_txt:expansion in 4223) [ClassicSimilarity], result of:
            0.29539117 = score(doc=4223,freq=5.0), product of:
              0.3461162 = queryWeight, product of:
                3.2837372 = boost
                6.106756 = idf(docFreq=268, maxDocs=44421)
                0.017260086 = queryNorm
              0.8534451 = fieldWeight in 4223, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                6.106756 = idf(docFreq=268, maxDocs=44421)
                0.0625 = fieldNorm(doc=4223)
          0.34265068 = weight(abstract_txt:variation in 4223) [ClassicSimilarity], result of:
            0.34265068 = score(doc=4223,freq=2.0), product of:
              0.5586519 = queryWeight, product of:
                4.6642637 = boost
                6.939294 = idf(docFreq=116, maxDocs=44421)
                0.017260086 = queryNorm
              0.6133527 = fieldWeight in 4223, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.939294 = idf(docFreq=116, maxDocs=44421)
                0.0625 = fieldNorm(doc=4223)
        0.32 = coord(8/25)
    
  2. Nelson, M.J.: ¬The effect of query characteristics on retrieval results in the TREC retrieval tests (1995) 0.30
    0.29701346 = sum of:
      0.29701346 = product of:
        0.82503736 = sum of:
          0.08702828 = weight(abstract_txt:variance in 3676) [ClassicSimilarity], result of:
            0.08702828 = score(doc=3676,freq=1.0), product of:
              0.1422636 = queryWeight, product of:
                1.0526266 = boost
                7.8302665 = idf(docFreq=47, maxDocs=44421)
                0.017260086 = queryNorm
              0.6117396 = fieldWeight in 3676, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.8302665 = idf(docFreq=47, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
          0.03896486 = weight(abstract_txt:query in 3676) [ClassicSimilarity], result of:
            0.03896486 = score(doc=3676,freq=1.0), product of:
              0.104900844 = queryWeight, product of:
                1.2782974 = boost
                4.754492 = idf(docFreq=1039, maxDocs=44421)
                0.017260086 = queryNorm
              0.37144467 = fieldWeight in 3676, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.754492 = idf(docFreq=1039, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
          0.047492657 = weight(abstract_txt:topics in 3676) [ClassicSimilarity], result of:
            0.047492657 = score(doc=3676,freq=1.0), product of:
              0.11969644 = queryWeight, product of:
                1.3654728 = boost
                5.078731 = idf(docFreq=751, maxDocs=44421)
                0.017260086 = queryNorm
              0.39677587 = fieldWeight in 3676, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.078731 = idf(docFreq=751, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
          0.026350325 = weight(abstract_txt:analysis in 3676) [ClassicSimilarity], result of:
            0.026350325 = score(doc=3676,freq=1.0), product of:
              0.092516236 = queryWeight, product of:
                1.4702698 = boost
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.017260086 = queryNorm
              0.28481838 = fieldWeight in 3676, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
          0.0864021 = weight(abstract_txt:precision in 3676) [ClassicSimilarity], result of:
            0.0864021 = score(doc=3676,freq=2.0), product of:
              0.1415804 = queryWeight, product of:
                1.48506 = boost
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.017260086 = queryNorm
              0.61026883 = fieldWeight in 3676, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
          0.06355517 = weight(abstract_txt:ranking in 3676) [ClassicSimilarity], result of:
            0.06355517 = score(doc=3676,freq=1.0), product of:
              0.14535528 = queryWeight, product of:
                1.5047275 = boost
                5.5966744 = idf(docFreq=447, maxDocs=44421)
                0.017260086 = queryNorm
              0.43724018 = fieldWeight in 3676, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5966744 = idf(docFreq=447, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
          0.070194125 = weight(abstract_txt:topic in 3676) [ClassicSimilarity], result of:
            0.070194125 = score(doc=3676,freq=1.0), product of:
              0.17778474 = queryWeight, product of:
                2.038146 = boost
                5.053779 = idf(docFreq=770, maxDocs=44421)
                0.017260086 = queryNorm
              0.3948265 = fieldWeight in 3676, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.053779 = idf(docFreq=770, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
          0.10218656 = weight(abstract_txt:retrieval in 3676) [ClassicSimilarity], result of:
            0.10218656 = score(doc=3676,freq=5.0), product of:
              0.1682583 = queryWeight, product of:
                2.804086 = boost
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.017260086 = queryNorm
              0.6073196 = fieldWeight in 3676, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
          0.30286327 = weight(abstract_txt:variation in 3676) [ClassicSimilarity], result of:
            0.30286327 = score(doc=3676,freq=1.0), product of:
              0.5586519 = queryWeight, product of:
                4.6642637 = boost
                6.939294 = idf(docFreq=116, maxDocs=44421)
                0.017260086 = queryNorm
              0.5421323 = fieldWeight in 3676, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.939294 = idf(docFreq=116, maxDocs=44421)
                0.078125 = fieldNorm(doc=3676)
        0.36 = coord(9/25)
    
  3. Wu, I.-C.; Liu, D.-R.; Chang, P.-C.: Learning dynamic information needs : a collaborative topic variation inspection approach (2009) 0.26
    0.26294968 = sum of:
      0.26294968 = product of:
        0.82171774 = sum of:
          0.026408436 = weight(abstract_txt:method in 280) [ClassicSimilarity], result of:
            0.026408436 = score(doc=280,freq=1.0), product of:
              0.09392157 = queryWeight, product of:
                1.2095536 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.017260086 = queryNorm
              0.2811754 = fieldWeight in 280, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.0625 = fieldNorm(doc=280)
          0.037994128 = weight(abstract_txt:topics in 280) [ClassicSimilarity], result of:
            0.037994128 = score(doc=280,freq=1.0), product of:
              0.11969644 = queryWeight, product of:
                1.3654728 = boost
                5.078731 = idf(docFreq=751, maxDocs=44421)
                0.017260086 = queryNorm
              0.3174207 = fieldWeight in 280, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.078731 = idf(docFreq=751, maxDocs=44421)
                0.0625 = fieldNorm(doc=280)
          0.048876416 = weight(abstract_txt:precision in 280) [ClassicSimilarity], result of:
            0.048876416 = score(doc=280,freq=1.0), product of:
              0.1415804 = queryWeight, product of:
                1.48506 = boost
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.017260086 = queryNorm
              0.3452202 = fieldWeight in 280, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.0625 = fieldNorm(doc=280)
          0.05516216 = weight(abstract_txt:recall in 280) [ClassicSimilarity], result of:
            0.05516216 = score(doc=280,freq=1.0), product of:
              0.15347269 = queryWeight, product of:
                1.5461726 = boost
                5.750825 = idf(docFreq=383, maxDocs=44421)
                0.017260086 = queryNorm
              0.35942656 = fieldWeight in 280, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.750825 = idf(docFreq=383, maxDocs=44421)
                0.0625 = fieldNorm(doc=280)
          0.12556706 = weight(abstract_txt:topic in 280) [ClassicSimilarity], result of:
            0.12556706 = score(doc=280,freq=5.0), product of:
              0.17778474 = queryWeight, product of:
                2.038146 = boost
                5.053779 = idf(docFreq=770, maxDocs=44421)
                0.017260086 = queryNorm
              0.7062871 = fieldWeight in 280, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.053779 = idf(docFreq=770, maxDocs=44421)
                0.0625 = fieldNorm(doc=280)
          0.036559373 = weight(abstract_txt:retrieval in 280) [ClassicSimilarity], result of:
            0.036559373 = score(doc=280,freq=1.0), product of:
              0.1682583 = queryWeight, product of:
                2.804086 = boost
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.017260086 = queryNorm
              0.21728125 = fieldWeight in 280, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.0625 = fieldNorm(doc=280)
          0.07149057 = weight(abstract_txt:performance in 280) [ClassicSimilarity], result of:
            0.07149057 = score(doc=280,freq=1.0), product of:
              0.2475993 = queryWeight, product of:
                3.1051826 = boost
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.017260086 = queryNorm
              0.28873494 = fieldWeight in 280, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.0625 = fieldNorm(doc=280)
          0.41965964 = weight(abstract_txt:variation in 280) [ClassicSimilarity], result of:
            0.41965964 = score(doc=280,freq=3.0), product of:
              0.5586519 = queryWeight, product of:
                4.6642637 = boost
                6.939294 = idf(docFreq=116, maxDocs=44421)
                0.017260086 = queryNorm
              0.75120056 = fieldWeight in 280, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.939294 = idf(docFreq=116, maxDocs=44421)
                0.0625 = fieldNorm(doc=280)
        0.32 = coord(8/25)
    
  4. Fernández-Reyes, F.C.; Hermosillo-Valadez, J.; Montes-y-Gómez, M.: ¬A prospect-guided global query expansion strategy using word embeddings (2018) 0.25
    0.2494751 = sum of:
      0.2494751 = product of:
        0.69298637 = sum of:
          0.05905106 = weight(abstract_txt:method in 90) [ClassicSimilarity], result of:
            0.05905106 = score(doc=90,freq=5.0), product of:
              0.09392157 = queryWeight, product of:
                1.2095536 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.017260086 = queryNorm
              0.6287273 = fieldWeight in 90, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
          0.08816741 = weight(abstract_txt:query in 90) [ClassicSimilarity], result of:
            0.08816741 = score(doc=90,freq=8.0), product of:
              0.104900844 = queryWeight, product of:
                1.2782974 = boost
                4.754492 = idf(docFreq=1039, maxDocs=44421)
                0.017260086 = queryNorm
              0.8404833 = fieldWeight in 90, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.754492 = idf(docFreq=1039, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
          0.037994128 = weight(abstract_txt:topics in 90) [ClassicSimilarity], result of:
            0.037994128 = score(doc=90,freq=1.0), product of:
              0.11969644 = queryWeight, product of:
                1.3654728 = boost
                5.078731 = idf(docFreq=751, maxDocs=44421)
                0.017260086 = queryNorm
              0.3174207 = fieldWeight in 90, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.078731 = idf(docFreq=751, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
          0.048876416 = weight(abstract_txt:precision in 90) [ClassicSimilarity], result of:
            0.048876416 = score(doc=90,freq=1.0), product of:
              0.1415804 = queryWeight, product of:
                1.48506 = boost
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.017260086 = queryNorm
              0.3452202 = fieldWeight in 90, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
          0.05516216 = weight(abstract_txt:recall in 90) [ClassicSimilarity], result of:
            0.05516216 = score(doc=90,freq=1.0), product of:
              0.15347269 = queryWeight, product of:
                1.5461726 = boost
                5.750825 = idf(docFreq=383, maxDocs=44421)
                0.017260086 = queryNorm
              0.35942656 = fieldWeight in 90, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.750825 = idf(docFreq=383, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
          0.046814635 = weight(abstract_txt:significant in 90) [ClassicSimilarity], result of:
            0.046814635 = score(doc=90,freq=1.0), product of:
              0.15747868 = queryWeight, product of:
                1.9182223 = boost
                4.7564163 = idf(docFreq=1037, maxDocs=44421)
                0.017260086 = queryNorm
              0.29727602 = fieldWeight in 90, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.7564163 = idf(docFreq=1037, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
          0.0561553 = weight(abstract_txt:topic in 90) [ClassicSimilarity], result of:
            0.0561553 = score(doc=90,freq=1.0), product of:
              0.17778474 = queryWeight, product of:
                2.038146 = boost
                5.053779 = idf(docFreq=770, maxDocs=44421)
                0.017260086 = queryNorm
              0.3158612 = fieldWeight in 90, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.053779 = idf(docFreq=770, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
          0.036559373 = weight(abstract_txt:retrieval in 90) [ClassicSimilarity], result of:
            0.036559373 = score(doc=90,freq=1.0), product of:
              0.1682583 = queryWeight, product of:
                2.804086 = boost
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.017260086 = queryNorm
              0.21728125 = fieldWeight in 90, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
          0.2642059 = weight(abstract_txt:expansion in 90) [ClassicSimilarity], result of:
            0.2642059 = score(doc=90,freq=4.0), product of:
              0.3461162 = queryWeight, product of:
                3.2837372 = boost
                6.106756 = idf(docFreq=268, maxDocs=44421)
                0.017260086 = queryNorm
              0.7633445 = fieldWeight in 90, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.106756 = idf(docFreq=268, maxDocs=44421)
                0.0625 = fieldNorm(doc=90)
        0.36 = coord(9/25)
    
  5. Hull, D.A.: Stemming algorithms : a case study for detailed evaluation (1996) 0.20
    0.20482482 = sum of:
      0.20482482 = product of:
        0.6400776 = sum of:
          0.04158237 = weight(abstract_txt:made in 3067) [ClassicSimilarity], result of:
            0.04158237 = score(doc=3067,freq=1.0), product of:
              0.097009785 = queryWeight, product of:
                1.2292783 = boost
                4.5721703 = idf(docFreq=1247, maxDocs=44421)
                0.017260086 = queryNorm
              0.42864096 = fieldWeight in 3067, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5721703 = idf(docFreq=1247, maxDocs=44421)
                0.09375 = fieldNorm(doc=3067)
          0.04795456 = weight(abstract_txt:case in 3067) [ClassicSimilarity], result of:
            0.04795456 = score(doc=3067,freq=1.0), product of:
              0.106683195 = queryWeight, product of:
                1.2891114 = boost
                4.794713 = idf(docFreq=998, maxDocs=44421)
                0.017260086 = queryNorm
              0.44950435 = fieldWeight in 3067, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.794713 = idf(docFreq=998, maxDocs=44421)
                0.09375 = fieldNorm(doc=3067)
          0.031620387 = weight(abstract_txt:analysis in 3067) [ClassicSimilarity], result of:
            0.031620387 = score(doc=3067,freq=1.0), product of:
              0.092516236 = queryWeight, product of:
                1.4702698 = boost
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.017260086 = queryNorm
              0.34178203 = fieldWeight in 3067, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.09375 = fieldNorm(doc=3067)
          0.07331462 = weight(abstract_txt:precision in 3067) [ClassicSimilarity], result of:
            0.07331462 = score(doc=3067,freq=1.0), product of:
              0.1415804 = queryWeight, product of:
                1.48506 = boost
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.017260086 = queryNorm
              0.5178303 = fieldWeight in 3067, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5235233 = idf(docFreq=481, maxDocs=44421)
                0.09375 = fieldNorm(doc=3067)
          0.08274325 = weight(abstract_txt:recall in 3067) [ClassicSimilarity], result of:
            0.08274325 = score(doc=3067,freq=1.0), product of:
              0.15347269 = queryWeight, product of:
                1.5461726 = boost
                5.750825 = idf(docFreq=383, maxDocs=44421)
                0.017260086 = queryNorm
              0.53913987 = fieldWeight in 3067, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.750825 = idf(docFreq=383, maxDocs=44421)
                0.09375 = fieldNorm(doc=3067)
          0.17807238 = weight(abstract_txt:figures in 3067) [ClassicSimilarity], result of:
            0.17807238 = score(doc=3067,freq=1.0), product of:
              0.2558235 = queryWeight, product of:
                1.9962395 = boost
                7.4248013 = idf(docFreq=71, maxDocs=44421)
                0.017260086 = queryNorm
              0.69607514 = fieldWeight in 3067, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4248013 = idf(docFreq=71, maxDocs=44421)
                0.09375 = fieldNorm(doc=3067)
          0.077554144 = weight(abstract_txt:retrieval in 3067) [ClassicSimilarity], result of:
            0.077554144 = score(doc=3067,freq=2.0), product of:
              0.1682583 = queryWeight, product of:
                2.804086 = boost
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.017260086 = queryNorm
              0.46092314 = fieldWeight in 3067, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.09375 = fieldNorm(doc=3067)
          0.10723586 = weight(abstract_txt:performance in 3067) [ClassicSimilarity], result of:
            0.10723586 = score(doc=3067,freq=1.0), product of:
              0.2475993 = queryWeight, product of:
                3.1051826 = boost
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.017260086 = queryNorm
              0.43310243 = fieldWeight in 3067, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.09375 = fieldNorm(doc=3067)
        0.32 = coord(8/25)