Document (#32433)

Author
Dinçer, B.T.
Title
Statistical principal components analysis for retrieval experiments
Source
Journal of the American Society for Information Science and Technology. 58(2007) no.4, S.560-574
Year
2007
Abstract
In this article, the statistical principal components analysis (PCA) is proposed as a method for performance comparisons of different retrieval strategies. It is shown that the PCA method can reveal implicit performance relations among retrieval systems across information needs (i.e., queries, topics). For illustration, the TREC 12 robust track data have been reevaluated by the PCA method and have been shown to reveal easily the performance relations that are hard to see with traditional techniques. Therefore, PCA promises a uniform evaluation framework that can be used for large-scale evaluation of retrieval experiments. In addition to the mean average precision (MAP) measure, relative analytic distance (RAD) is proposed as a new performance summary measure based on the same notion introduced by PCA.

Similar documents (content)

  1. An, X.; Huang, J.X.: geNov : a new metric for measuring novelty and relevancy in biomedical information retrieval (2017) 0.29
    0.28871983 = sum of:
      0.28871983 = product of:
        0.72179955 = sum of:
          0.06663615 = weight(abstract_txt:trec in 4921) [ClassicSimilarity], result of:
            0.06663615 = score(doc=4921,freq=1.0), product of:
              0.15903011 = queryWeight, product of:
                1.0010054 = boost
                6.704255 = idf(docFreq=147, maxDocs=44421)
                0.023696948 = queryNorm
              0.41901594 = fieldWeight in 4921, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.704255 = idf(docFreq=147, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.07529717 = weight(abstract_txt:track in 4921) [ClassicSimilarity], result of:
            0.07529717 = score(doc=4921,freq=1.0), product of:
              0.17252758 = queryWeight, product of:
                1.04262 = boost
                6.982969 = idf(docFreq=111, maxDocs=44421)
                0.023696948 = queryNorm
              0.43643555 = fieldWeight in 4921, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.982969 = idf(docFreq=111, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.023215942 = weight(abstract_txt:that in 4921) [ClassicSimilarity], result of:
            0.023215942 = score(doc=4921,freq=7.0), product of:
              0.059366036 = queryWeight, product of:
                1.0593182 = boost
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.023696948 = queryNorm
              0.39106438 = fieldWeight in 4921, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.08889971 = weight(abstract_txt:evaluation in 4921) [ClassicSimilarity], result of:
            0.08889971 = score(doc=4921,freq=5.0), product of:
              0.14200151 = queryWeight, product of:
                1.3376985 = boost
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.023696948 = queryNorm
              0.6260476 = fieldWeight in 4921, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.07495563 = weight(abstract_txt:proposed in 4921) [ClassicSimilarity], result of:
            0.07495563 = score(doc=4921,freq=3.0), product of:
              0.15026061 = queryWeight, product of:
                1.3760504 = boost
                4.608063 = idf(docFreq=1203, maxDocs=44421)
                0.023696948 = queryNorm
              0.49883747 = fieldWeight in 4921, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.608063 = idf(docFreq=1203, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.06677037 = weight(abstract_txt:experiments in 4921) [ClassicSimilarity], result of:
            0.06677037 = score(doc=4921,freq=1.0), product of:
              0.20063435 = queryWeight, product of:
                1.5900632 = boost
                5.324741 = idf(docFreq=587, maxDocs=44421)
                0.023696948 = queryNorm
              0.3327963 = fieldWeight in 4921, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.324741 = idf(docFreq=587, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.0710504 = weight(abstract_txt:measure in 4921) [ClassicSimilarity], result of:
            0.0710504 = score(doc=4921,freq=1.0), product of:
              0.20911914 = queryWeight, product of:
                1.6233368 = boost
                5.4361663 = idf(docFreq=525, maxDocs=44421)
                0.023696948 = queryNorm
              0.3397604 = fieldWeight in 4921, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4361663 = idf(docFreq=525, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.10338883 = weight(abstract_txt:reveal in 4921) [ClassicSimilarity], result of:
            0.10338883 = score(doc=4921,freq=1.0), product of:
              0.26853353 = queryWeight, product of:
                1.8395474 = boost
                6.160204 = idf(docFreq=254, maxDocs=44421)
                0.023696948 = queryNorm
              0.38501275 = fieldWeight in 4921, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.160204 = idf(docFreq=254, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.064373285 = weight(abstract_txt:retrieval in 4921) [ClassicSimilarity], result of:
            0.064373285 = score(doc=4921,freq=3.0), product of:
              0.1710499 = queryWeight, product of:
                2.0762906 = boost
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.023696948 = queryNorm
              0.37634215 = fieldWeight in 4921, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
          0.08721201 = weight(abstract_txt:performance in 4921) [ClassicSimilarity], result of:
            0.08721201 = score(doc=4921,freq=1.0), product of:
              0.30204868 = queryWeight, product of:
                2.759086 = boost
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.023696948 = queryNorm
              0.28873494 = fieldWeight in 4921, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.0625 = fieldNorm(doc=4921)
        0.4 = coord(10/25)
    
  2. Newby, G.B.: Cognitive space and information space (2001) 0.28
    0.28408894 = sum of:
      0.28408894 = product of:
        0.8877779 = sum of:
          0.08329519 = weight(abstract_txt:trec in 977) [ClassicSimilarity], result of:
            0.08329519 = score(doc=977,freq=1.0), product of:
              0.15903011 = queryWeight, product of:
                1.0010054 = boost
                6.704255 = idf(docFreq=147, maxDocs=44421)
                0.023696948 = queryNorm
              0.5237699 = fieldWeight in 977, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.704255 = idf(docFreq=147, maxDocs=44421)
                0.078125 = fieldNorm(doc=977)
          0.018998 = weight(abstract_txt:that in 977) [ClassicSimilarity], result of:
            0.018998 = score(doc=977,freq=3.0), product of:
              0.059366036 = queryWeight, product of:
                1.0593182 = boost
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.023696948 = queryNorm
              0.32001466 = fieldWeight in 977, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.078125 = fieldNorm(doc=977)
          0.04639732 = weight(abstract_txt:analysis in 977) [ClassicSimilarity], result of:
            0.04639732 = score(doc=977,freq=3.0), product of:
              0.09405118 = queryWeight, product of:
                1.088664 = boost
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.023696948 = queryNorm
              0.4933199 = fieldWeight in 977, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.078125 = fieldNorm(doc=977)
          0.08881301 = weight(abstract_txt:measure in 977) [ClassicSimilarity], result of:
            0.08881301 = score(doc=977,freq=1.0), product of:
              0.20911914 = queryWeight, product of:
                1.6233368 = boost
                5.4361663 = idf(docFreq=525, maxDocs=44421)
                0.023696948 = queryNorm
              0.4247005 = fieldWeight in 977, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4361663 = idf(docFreq=525, maxDocs=44421)
                0.078125 = fieldNorm(doc=977)
          0.13325937 = weight(abstract_txt:relations in 977) [ClassicSimilarity], result of:
            0.13325937 = score(doc=977,freq=2.0), product of:
              0.21753606 = queryWeight, product of:
                1.6556838 = boost
                5.5444884 = idf(docFreq=471, maxDocs=44421)
                0.023696948 = queryNorm
              0.6125852 = fieldWeight in 977, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.5444884 = idf(docFreq=471, maxDocs=44421)
                0.078125 = fieldNorm(doc=977)
          0.13656794 = weight(abstract_txt:components in 977) [ClassicSimilarity], result of:
            0.13656794 = score(doc=977,freq=2.0), product of:
              0.221122 = queryWeight, product of:
                1.6692743 = boost
                5.59 = idf(docFreq=450, maxDocs=44421)
                0.023696948 = queryNorm
              0.61761355 = fieldWeight in 977, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.59 = idf(docFreq=450, maxDocs=44421)
                0.078125 = fieldNorm(doc=977)
          0.10678163 = weight(abstract_txt:method in 977) [ClassicSimilarity], result of:
            0.10678163 = score(doc=977,freq=2.0), product of:
              0.21482964 = queryWeight, product of:
                2.0151365 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.023696948 = queryNorm
              0.4970526 = fieldWeight in 977, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.078125 = fieldNorm(doc=977)
          0.27366546 = weight(abstract_txt:principal in 977) [ClassicSimilarity], result of:
            0.27366546 = score(doc=977,freq=2.0), product of:
              0.3514628 = queryWeight, product of:
                2.1045122 = boost
                7.0475073 = idf(docFreq=104, maxDocs=44421)
                0.023696948 = queryNorm
              0.77864695 = fieldWeight in 977, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.0475073 = idf(docFreq=104, maxDocs=44421)
                0.078125 = fieldNorm(doc=977)
        0.32 = coord(8/25)
    
  3. Abdi, A.; Idris, N.; Alguliev, R.M.; Aliguliyev, R.M.: Automatic summarization assessment through a combination of semantic and syntactic information for intelligent educational systems (2015) 0.27
    0.26539993 = sum of:
      0.26539993 = product of:
        0.66349983 = sum of:
          0.012409444 = weight(abstract_txt:that in 3681) [ClassicSimilarity], result of:
            0.012409444 = score(doc=3681,freq=2.0), product of:
              0.059366036 = queryWeight, product of:
                1.0593182 = boost
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.023696948 = queryNorm
              0.20903271 = fieldWeight in 3681, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.029534329 = weight(abstract_txt:been in 3681) [ClassicSimilarity], result of:
            0.029534329 = score(doc=3681,freq=2.0), product of:
              0.09244658 = queryWeight, product of:
                1.0793372 = boost
                3.614442 = idf(docFreq=3251, maxDocs=44421)
                0.023696948 = queryNorm
              0.31947455 = fieldWeight in 3681, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.614442 = idf(docFreq=3251, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.021430004 = weight(abstract_txt:analysis in 3681) [ClassicSimilarity], result of:
            0.021430004 = score(doc=3681,freq=1.0), product of:
              0.09405118 = queryWeight, product of:
                1.088664 = boost
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.023696948 = queryNorm
              0.2278547 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6456752 = idf(docFreq=3151, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.056225106 = weight(abstract_txt:evaluation in 3681) [ClassicSimilarity], result of:
            0.056225106 = score(doc=3681,freq=2.0), product of:
              0.14200151 = queryWeight, product of:
                1.3376985 = boost
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.023696948 = queryNorm
              0.39594725 = fieldWeight in 3681, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.0865513 = weight(abstract_txt:proposed in 3681) [ClassicSimilarity], result of:
            0.0865513 = score(doc=3681,freq=4.0), product of:
              0.15026061 = queryWeight, product of:
                1.3760504 = boost
                4.608063 = idf(docFreq=1203, maxDocs=44421)
                0.023696948 = queryNorm
              0.5760079 = fieldWeight in 3681, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.608063 = idf(docFreq=1203, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.06677037 = weight(abstract_txt:experiments in 3681) [ClassicSimilarity], result of:
            0.06677037 = score(doc=3681,freq=1.0), product of:
              0.20063435 = queryWeight, product of:
                1.5900632 = boost
                5.324741 = idf(docFreq=587, maxDocs=44421)
                0.023696948 = queryNorm
              0.3327963 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.324741 = idf(docFreq=587, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.0710504 = weight(abstract_txt:measure in 3681) [ClassicSimilarity], result of:
            0.0710504 = score(doc=3681,freq=1.0), product of:
              0.20911914 = queryWeight, product of:
                1.6233368 = boost
                5.4361663 = idf(docFreq=525, maxDocs=44421)
                0.023696948 = queryNorm
              0.3397604 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4361663 = idf(docFreq=525, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.07538289 = weight(abstract_txt:relations in 3681) [ClassicSimilarity], result of:
            0.07538289 = score(doc=3681,freq=1.0), product of:
              0.21753606 = queryWeight, product of:
                1.6556838 = boost
                5.5444884 = idf(docFreq=471, maxDocs=44421)
                0.023696948 = queryNorm
              0.34653053 = fieldWeight in 3681, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5444884 = idf(docFreq=471, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.12080962 = weight(abstract_txt:method in 3681) [ClassicSimilarity], result of:
            0.12080962 = score(doc=3681,freq=4.0), product of:
              0.21482964 = queryWeight, product of:
                2.0151365 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.023696948 = queryNorm
              0.5623508 = fieldWeight in 3681, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
          0.123336405 = weight(abstract_txt:performance in 3681) [ClassicSimilarity], result of:
            0.123336405 = score(doc=3681,freq=2.0), product of:
              0.30204868 = queryWeight, product of:
                2.759086 = boost
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.023696948 = queryNorm
              0.40833285 = fieldWeight in 3681, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.0625 = fieldNorm(doc=3681)
        0.4 = coord(10/25)
    
  4. Ravana, S.D.; Taheri, M.S.; Rajagopal, P.: Document-based approach to improve the accuracy of pairwise comparison in evaluating information retrieval systems (2015) 0.26
    0.25979272 = sum of:
      0.25979272 = product of:
        0.6494818 = sum of:
          0.06663615 = weight(abstract_txt:trec in 3587) [ClassicSimilarity], result of:
            0.06663615 = score(doc=3587,freq=1.0), product of:
              0.15903011 = queryWeight, product of:
                1.0010054 = boost
                6.704255 = idf(docFreq=147, maxDocs=44421)
                0.023696948 = queryNorm
              0.41901594 = fieldWeight in 3587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.704255 = idf(docFreq=147, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.07529717 = weight(abstract_txt:track in 3587) [ClassicSimilarity], result of:
            0.07529717 = score(doc=3587,freq=1.0), product of:
              0.17252758 = queryWeight, product of:
                1.04262 = boost
                6.982969 = idf(docFreq=111, maxDocs=44421)
                0.023696948 = queryNorm
              0.43643555 = fieldWeight in 3587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.982969 = idf(docFreq=111, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.008774802 = weight(abstract_txt:that in 3587) [ClassicSimilarity], result of:
            0.008774802 = score(doc=3587,freq=1.0), product of:
              0.059366036 = queryWeight, product of:
                1.0593182 = boost
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.023696948 = queryNorm
              0.14780845 = fieldWeight in 3587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.06886141 = weight(abstract_txt:evaluation in 3587) [ClassicSimilarity], result of:
            0.06886141 = score(doc=3587,freq=3.0), product of:
              0.14200151 = queryWeight, product of:
                1.3376985 = boost
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.023696948 = queryNorm
              0.48493436 = fieldWeight in 3587, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.04327565 = weight(abstract_txt:proposed in 3587) [ClassicSimilarity], result of:
            0.04327565 = score(doc=3587,freq=1.0), product of:
              0.15026061 = queryWeight, product of:
                1.3760504 = boost
                4.608063 = idf(docFreq=1203, maxDocs=44421)
                0.023696948 = queryNorm
              0.28800395 = fieldWeight in 3587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.608063 = idf(docFreq=1203, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.06677037 = weight(abstract_txt:experiments in 3587) [ClassicSimilarity], result of:
            0.06677037 = score(doc=3587,freq=1.0), product of:
              0.20063435 = queryWeight, product of:
                1.5900632 = boost
                5.324741 = idf(docFreq=587, maxDocs=44421)
                0.023696948 = queryNorm
              0.3327963 = fieldWeight in 3587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.324741 = idf(docFreq=587, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.075469434 = weight(abstract_txt:statistical in 3587) [ClassicSimilarity], result of:
            0.075469434 = score(doc=3587,freq=1.0), product of:
              0.21770254 = queryWeight, product of:
                1.6563171 = boost
                5.5466094 = idf(docFreq=470, maxDocs=44421)
                0.023696948 = queryNorm
              0.3466631 = fieldWeight in 3587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5466094 = idf(docFreq=470, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.104624204 = weight(abstract_txt:method in 3587) [ClassicSimilarity], result of:
            0.104624204 = score(doc=3587,freq=3.0), product of:
              0.21482964 = queryWeight, product of:
                2.0151365 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.023696948 = queryNorm
              0.4870101 = fieldWeight in 3587, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.052560568 = weight(abstract_txt:retrieval in 3587) [ClassicSimilarity], result of:
            0.052560568 = score(doc=3587,freq=2.0), product of:
              0.1710499 = queryWeight, product of:
                2.0762906 = boost
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.023696948 = queryNorm
              0.3072821 = fieldWeight in 3587, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
          0.08721201 = weight(abstract_txt:performance in 3587) [ClassicSimilarity], result of:
            0.08721201 = score(doc=3587,freq=1.0), product of:
              0.30204868 = queryWeight, product of:
                2.759086 = boost
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.023696948 = queryNorm
              0.28873494 = fieldWeight in 3587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.619759 = idf(docFreq=1189, maxDocs=44421)
                0.0625 = fieldNorm(doc=3587)
        0.4 = coord(10/25)
    
  5. Vechtomova, O.; Robertson, S.E.: ¬A domain-independent approach to finding related entities (2012) 0.25
    0.24581252 = sum of:
      0.24581252 = product of:
        0.6828125 = sum of:
          0.11779717 = weight(abstract_txt:trec in 3733) [ClassicSimilarity], result of:
            0.11779717 = score(doc=3733,freq=2.0), product of:
              0.15903011 = queryWeight, product of:
                1.0010054 = boost
                6.704255 = idf(docFreq=147, maxDocs=44421)
                0.023696948 = queryNorm
              0.7407225 = fieldWeight in 3733, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.704255 = idf(docFreq=147, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
          0.09412146 = weight(abstract_txt:track in 3733) [ClassicSimilarity], result of:
            0.09412146 = score(doc=3733,freq=1.0), product of:
              0.17252758 = queryWeight, product of:
                1.04262 = boost
                6.982969 = idf(docFreq=111, maxDocs=44421)
                0.023696948 = queryNorm
              0.54554445 = fieldWeight in 3733, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.982969 = idf(docFreq=111, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
          0.018998 = weight(abstract_txt:that in 3733) [ClassicSimilarity], result of:
            0.018998 = score(doc=3733,freq=3.0), product of:
              0.059366036 = queryWeight, product of:
                1.0593182 = boost
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.023696948 = queryNorm
              0.32001466 = fieldWeight in 3733, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.3649352 = idf(docFreq=11344, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
          0.07028138 = weight(abstract_txt:evaluation in 3733) [ClassicSimilarity], result of:
            0.07028138 = score(doc=3733,freq=2.0), product of:
              0.14200151 = queryWeight, product of:
                1.3376985 = boost
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.023696948 = queryNorm
              0.49493405 = fieldWeight in 3733, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.479632 = idf(docFreq=1368, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
          0.076501265 = weight(abstract_txt:proposed in 3733) [ClassicSimilarity], result of:
            0.076501265 = score(doc=3733,freq=2.0), product of:
              0.15026061 = queryWeight, product of:
                1.3760504 = boost
                4.608063 = idf(docFreq=1203, maxDocs=44421)
                0.023696948 = queryNorm
              0.50912386 = fieldWeight in 3733, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.608063 = idf(docFreq=1203, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
          0.08881301 = weight(abstract_txt:measure in 3733) [ClassicSimilarity], result of:
            0.08881301 = score(doc=3733,freq=1.0), product of:
              0.20911914 = queryWeight, product of:
                1.6233368 = boost
                5.4361663 = idf(docFreq=525, maxDocs=44421)
                0.023696948 = queryNorm
              0.4247005 = fieldWeight in 3733, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4361663 = idf(docFreq=525, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
          0.09433679 = weight(abstract_txt:statistical in 3733) [ClassicSimilarity], result of:
            0.09433679 = score(doc=3733,freq=1.0), product of:
              0.21770254 = queryWeight, product of:
                1.6563171 = boost
                5.5466094 = idf(docFreq=470, maxDocs=44421)
                0.023696948 = queryNorm
              0.43332887 = fieldWeight in 3733, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5466094 = idf(docFreq=470, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
          0.07550601 = weight(abstract_txt:method in 3733) [ClassicSimilarity], result of:
            0.07550601 = score(doc=3733,freq=1.0), product of:
              0.21482964 = queryWeight, product of:
                2.0151365 = boost
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.023696948 = queryNorm
              0.35146925 = fieldWeight in 3733, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4988065 = idf(docFreq=1342, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
          0.046457417 = weight(abstract_txt:retrieval in 3733) [ClassicSimilarity], result of:
            0.046457417 = score(doc=3733,freq=1.0), product of:
              0.1710499 = queryWeight, product of:
                2.0762906 = boost
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.023696948 = queryNorm
              0.27160156 = fieldWeight in 3733, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4765 = idf(docFreq=3732, maxDocs=44421)
                0.078125 = fieldNorm(doc=3733)
        0.36 = coord(9/25)