Document (#39329)

Author

Bornmann, L.

Title

Interrater reliability and convergent validity of F1000Prime peer review

Source

Journal of the Association for Information Science and Technology. 66(2015) no.12, S.2415-2426

Year

2015

Abstract

Peer review is the backbone of modern science. F1000Prime is a postpublication peer review system of the biomedical literature (papers from medical and biological journals). This study is concerned with the interrater reliability and convergent validity of the peer recommendations formulated in the F1000Prime peer review system. The study is based on about 100,000 papers with recommendations from faculty members. Even if intersubjectivity plays a fundamental role in science, the analyses of the reliability of the F1000Prime peer review system show a rather low level of agreement between faculty members. This result is in agreement with most other studies that have been published on the journal peer review system. Logistic regression models are used to investigate the convergent validity of the F1000Prime peer review system. As the results show, the proportion of highly cited papers among those selected by the faculty members is significantly higher than expected. In addition, better recommendation scores are also associated with higher performing papers.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23334/abstract.

Theme

Informetrie

Similar documents (author)

1. Bornmann, L.: Complex tasks and simple solutions : the use of heuristics in the evaluation of research (2015) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 525) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 525, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=525)
   

2. Bornmann, L.: What is societal impact of research and how can it be assessed? : a literature survey (2013) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 1606) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 1606, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=1606)
   

3. Bornmann, L.: How to analyze percentile citation impact data meaningfully in bibliometrics : the statistical analysis of distributions, percentile rank classes, and top-cited papers (2013) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 1656) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 1656, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=1656)
   

4. Bornmann, L.: Lässt sich die Qualität von Forschung messen? (2013) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 1928) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 1928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=1928)
   

5. Bornmann, L.: On the function of university rankings (2014) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 2188) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 2188, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=2188)
   

Similar documents (content)

1. Cabanac, G.; Preuss, T.: Capitalizing on order effects in the bids of peer-reviewed conferences to secure reviews by expert referees (2013) 0.39

   0.3920481 = sum of:
     0.3920481 = product of:
       0.98012024 = sum of:
         0.008531917 = weight(abstract_txt:study in 1619) [ClassicSimilarity], result of:
           0.008531917 = score(doc=1619,freq=1.0), product of:
             0.039971523 = queryWeight, product of:
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.011704013 = queryNorm
             0.21344988 = fieldWeight in 1619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.017293945 = weight(abstract_txt:science in 1619) [ClassicSimilarity], result of:
           0.017293945 = score(doc=1619,freq=2.0), product of:
             0.050812706 = queryWeight, product of:
               1.1274852 = boost
               3.850585 = idf(docFreq=2567, maxDocs=44421)
               0.011704013 = queryNorm
             0.34034684 = fieldWeight in 1619, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.850585 = idf(docFreq=2567, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.018257927 = weight(abstract_txt:show in 1619) [ClassicSimilarity], result of:
           0.018257927 = score(doc=1619,freq=1.0), product of:
             0.06637745 = queryWeight, product of:
               1.2886499 = boost
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.011704013 = queryNorm
             0.27506217 = fieldWeight in 1619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.009422163 = weight(abstract_txt:with in 1619) [ClassicSimilarity], result of:
           0.009422163 = score(doc=1619,freq=2.0), product of:
             0.04270578 = queryWeight, product of:
               1.4617833 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.011704013 = queryNorm
             0.22062966 = fieldWeight in 1619, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.033167552 = weight(abstract_txt:higher in 1619) [ClassicSimilarity], result of:
           0.033167552 = score(doc=1619,freq=1.0), product of:
             0.098823875 = queryWeight, product of:
               1.572373 = boost
               5.3699656 = idf(docFreq=561, maxDocs=44421)
               0.011704013 = queryNorm
             0.33562285 = fieldWeight in 1619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3699656 = idf(docFreq=561, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.04057188 = weight(abstract_txt:recommendations in 1619) [ClassicSimilarity], result of:
           0.04057188 = score(doc=1619,freq=1.0), product of:
             0.11303242 = queryWeight, product of:
               1.6816134 = boost
               5.743043 = idf(docFreq=386, maxDocs=44421)
               0.011704013 = queryNorm
             0.35894018 = fieldWeight in 1619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.743043 = idf(docFreq=386, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.099558294 = weight(abstract_txt:validity in 1619) [ClassicSimilarity], result of:
           0.099558294 = score(doc=1619,freq=1.0), product of:
             0.2353974 = queryWeight, product of:
               2.9721525 = boost
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.011704013 = queryNorm
             0.4229371 = fieldWeight in 1619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.1398259 = weight(abstract_txt:papers in 1619) [ClassicSimilarity], result of:
           0.1398259 = score(doc=1619,freq=5.0), product of:
             0.19001943 = queryWeight, product of:
               3.0834625 = boost
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.011704013 = queryNorm
             0.7358505 = fieldWeight in 1619, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.14700587 = weight(abstract_txt:review in 1619) [ClassicSimilarity], result of:
           0.14700587 = score(doc=1619,freq=3.0), product of:
             0.28071028 = queryWeight, product of:
               4.9577866 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.011704013 = queryNorm
             0.5236925 = fieldWeight in 1619, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
         0.46648479 = weight(abstract_txt:peer in 1619) [ClassicSimilarity], result of:
           0.46648479 = score(doc=1619,freq=4.0), product of:
             0.57580835 = queryWeight, product of:
               7.590906 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.011704013 = queryNorm
             0.810139 = fieldWeight in 1619, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=1619)
       0.4 = coord(10/25)
   

2. Daniel, H.-D.: Guardians of science : fairness and reliabiblity of peer review (1993) 0.38

   0.37722427 = sum of:
     0.37722427 = product of:
       1.1788259 = sum of:
         0.015285832 = weight(abstract_txt:science in 2713) [ClassicSimilarity], result of:
           0.015285832 = score(doc=2713,freq=1.0), product of:
             0.050812706 = queryWeight, product of:
               1.1274852 = boost
               3.850585 = idf(docFreq=2567, maxDocs=44421)
               0.011704013 = queryNorm
             0.30082697 = fieldWeight in 2713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.850585 = idf(docFreq=2567, maxDocs=44421)
               0.078125 = fieldNorm(doc=2713)
         0.011777703 = weight(abstract_txt:with in 2713) [ClassicSimilarity], result of:
           0.011777703 = score(doc=2713,freq=2.0), product of:
             0.04270578 = queryWeight, product of:
               1.4617833 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.011704013 = queryNorm
             0.2757871 = fieldWeight in 2713, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=2713)
         0.025680952 = weight(abstract_txt:system in 2713) [ClassicSimilarity], result of:
           0.025680952 = score(doc=2713,freq=1.0), product of:
             0.09746163 = queryWeight, product of:
               2.4689455 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.011704013 = queryNorm
             0.26349807 = fieldWeight in 2713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=2713)
         0.12444787 = weight(abstract_txt:validity in 2713) [ClassicSimilarity], result of:
           0.12444787 = score(doc=2713,freq=1.0), product of:
             0.2353974 = queryWeight, product of:
               2.9721525 = boost
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.011704013 = queryNorm
             0.5286714 = fieldWeight in 2713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.078125 = fieldNorm(doc=2713)
         0.12817767 = weight(abstract_txt:reliability in 2713) [ClassicSimilarity], result of:
           0.12817767 = score(doc=2713,freq=1.0), product of:
             0.24007758 = queryWeight, product of:
               3.0015535 = boost
               6.8339334 = idf(docFreq=129, maxDocs=44421)
               0.011704013 = queryNorm
             0.53390104 = fieldWeight in 2713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8339334 = idf(docFreq=129, maxDocs=44421)
               0.078125 = fieldNorm(doc=2713)
         0.07816505 = weight(abstract_txt:papers in 2713) [ClassicSimilarity], result of:
           0.07816505 = score(doc=2713,freq=1.0), product of:
             0.19001943 = queryWeight, product of:
               3.0834625 = boost
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.011704013 = queryNorm
             0.41135293 = fieldWeight in 2713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.078125 = fieldNorm(doc=2713)
         0.2121847 = weight(abstract_txt:review in 2713) [ClassicSimilarity], result of:
           0.2121847 = score(doc=2713,freq=4.0), product of:
             0.28071028 = queryWeight, product of:
               4.9577866 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.011704013 = queryNorm
             0.755885 = fieldWeight in 2713, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.078125 = fieldNorm(doc=2713)
         0.583106 = weight(abstract_txt:peer in 2713) [ClassicSimilarity], result of:
           0.583106 = score(doc=2713,freq=4.0), product of:
             0.57580835 = queryWeight, product of:
               7.590906 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.011704013 = queryNorm
             1.0126737 = fieldWeight in 2713, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.078125 = fieldNorm(doc=2713)
       0.32 = coord(8/25)
   

3. Meho, L.I.; Sonnenwald, D.H.: Citation ranking versus peer evaluation of senior faculty research performance : a case study of Kurdish scholarship (2000) 0.23

   0.23482227 = sum of:
     0.23482227 = product of:
       0.97842616 = sum of:
         0.01847214 = weight(abstract_txt:study in 5382) [ClassicSimilarity], result of:
           0.01847214 = score(doc=5382,freq=3.0), product of:
             0.039971523 = queryWeight, product of:
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.011704013 = queryNorm
             0.46213254 = fieldWeight in 5382, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.008328093 = weight(abstract_txt:with in 5382) [ClassicSimilarity], result of:
           0.008328093 = score(doc=5382,freq=1.0), product of:
             0.04270578 = queryWeight, product of:
               1.4617833 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.011704013 = queryNorm
             0.19501092 = fieldWeight in 5382, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.08232773 = weight(abstract_txt:members in 5382) [ClassicSimilarity], result of:
           0.08232773 = score(doc=5382,freq=1.0), product of:
             0.1787204 = queryWeight, product of:
               2.5897472 = boost
               5.8963327 = idf(docFreq=331, maxDocs=44421)
               0.011704013 = queryNorm
             0.46065098 = fieldWeight in 5382, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8963327 = idf(docFreq=331, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.18009987 = weight(abstract_txt:faculty in 5382) [ClassicSimilarity], result of:
           0.18009987 = score(doc=5382,freq=3.0), product of:
             0.20882311 = queryWeight, product of:
               2.7993653 = boost
               6.3735914 = idf(docFreq=205, maxDocs=44421)
               0.011704013 = queryNorm
             0.86245185 = fieldWeight in 5382, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.3735914 = idf(docFreq=205, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.10609235 = weight(abstract_txt:review in 5382) [ClassicSimilarity], result of:
           0.10609235 = score(doc=5382,freq=1.0), product of:
             0.28071028 = queryWeight, product of:
               4.9577866 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.011704013 = queryNorm
             0.3779425 = fieldWeight in 5382, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
         0.583106 = weight(abstract_txt:peer in 5382) [ClassicSimilarity], result of:
           0.583106 = score(doc=5382,freq=4.0), product of:
             0.57580835 = queryWeight, product of:
               7.590906 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.011704013 = queryNorm
             1.0126737 = fieldWeight in 5382, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.078125 = fieldNorm(doc=5382)
       0.24 = coord(6/25)
   

4. Wood, D.J.: Peer review and the Web : the implications of electronic peer review for biomedical authors, referees and learned society publishers (1998) 0.21

   0.2103408 = sum of:
     0.2103408 = product of:
       0.87642 = sum of:
         0.067143716 = weight(abstract_txt:biomedical in 5717) [ClassicSimilarity], result of:
           0.067143716 = score(doc=5717,freq=3.0), product of:
             0.08703076 = queryWeight, product of:
               1.0433885 = boost
               7.1267567 = idf(docFreq=96, maxDocs=44421)
               0.011704013 = queryNorm
             0.77149403 = fieldWeight in 5717, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.1267567 = idf(docFreq=96, maxDocs=44421)
               0.0625 = fieldNorm(doc=5717)
         0.011539745 = weight(abstract_txt:with in 5717) [ClassicSimilarity], result of:
           0.011539745 = score(doc=5717,freq=3.0), product of:
             0.04270578 = queryWeight, product of:
               1.4617833 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.011704013 = queryNorm
             0.27021506 = fieldWeight in 5717, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=5717)
         0.02054476 = weight(abstract_txt:system in 5717) [ClassicSimilarity], result of:
           0.02054476 = score(doc=5717,freq=1.0), product of:
             0.09746163 = queryWeight, product of:
               2.4689455 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.011704013 = queryNorm
             0.21079844 = fieldWeight in 5717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=5717)
         0.065862186 = weight(abstract_txt:members in 5717) [ClassicSimilarity], result of:
           0.065862186 = score(doc=5717,freq=1.0), product of:
             0.1787204 = queryWeight, product of:
               2.5897472 = boost
               5.8963327 = idf(docFreq=331, maxDocs=44421)
               0.011704013 = queryNorm
             0.3685208 = fieldWeight in 5717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8963327 = idf(docFreq=331, maxDocs=44421)
               0.0625 = fieldNorm(doc=5717)
         0.18978375 = weight(abstract_txt:review in 5717) [ClassicSimilarity], result of:
           0.18978375 = score(doc=5717,freq=5.0), product of:
             0.28071028 = queryWeight, product of:
               4.9577866 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.011704013 = queryNorm
             0.6760841 = fieldWeight in 5717, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=5717)
         0.5215459 = weight(abstract_txt:peer in 5717) [ClassicSimilarity], result of:
           0.5215459 = score(doc=5717,freq=5.0), product of:
             0.57580835 = queryWeight, product of:
               7.590906 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.011704013 = queryNorm
             0.905763 = fieldWeight in 5717, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=5717)
       0.24 = coord(6/25)
   

5. Bornmann, L.; Schier, H.; Marx, W.; Daniel, H.-D.: Is interactive open access publishing able to identify high-impact submissions? : a study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes (2011) 0.21

   0.20891586 = sum of:
     0.20891586 = product of:
       0.6528621 = sum of:
         0.008531917 = weight(abstract_txt:study in 132) [ClassicSimilarity], result of:
           0.008531917 = score(doc=132,freq=1.0), product of:
             0.039971523 = queryWeight, product of:
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.011704013 = queryNorm
             0.21344988 = fieldWeight in 132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=132)
         0.018257927 = weight(abstract_txt:show in 132) [ClassicSimilarity], result of:
           0.018257927 = score(doc=132,freq=1.0), product of:
             0.06637745 = queryWeight, product of:
               1.2886499 = boost
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.011704013 = queryNorm
             0.27506217 = fieldWeight in 132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.0625 = fieldNorm(doc=132)
         0.006662475 = weight(abstract_txt:with in 132) [ClassicSimilarity], result of:
           0.006662475 = score(doc=132,freq=1.0), product of:
             0.04270578 = queryWeight, product of:
               1.4617833 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.011704013 = queryNorm
             0.15600874 = fieldWeight in 132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=132)
         0.02054476 = weight(abstract_txt:system in 132) [ClassicSimilarity], result of:
           0.02054476 = score(doc=132,freq=1.0), product of:
             0.09746163 = queryWeight, product of:
               2.4689455 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.011704013 = queryNorm
             0.21079844 = fieldWeight in 132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=132)
         0.17244002 = weight(abstract_txt:validity in 132) [ClassicSimilarity], result of:
           0.17244002 = score(doc=132,freq=3.0), product of:
             0.2353974 = queryWeight, product of:
               2.9721525 = boost
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.011704013 = queryNorm
             0.73254853 = fieldWeight in 132, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7669935 = idf(docFreq=138, maxDocs=44421)
               0.0625 = fieldNorm(doc=132)
         0.10830866 = weight(abstract_txt:papers in 132) [ClassicSimilarity], result of:
           0.10830866 = score(doc=132,freq=3.0), product of:
             0.19001943 = queryWeight, product of:
               3.0834625 = boost
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.011704013 = queryNorm
             0.5699873 = fieldWeight in 132, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2653174 = idf(docFreq=623, maxDocs=44421)
               0.0625 = fieldNorm(doc=132)
         0.08487388 = weight(abstract_txt:review in 132) [ClassicSimilarity], result of:
           0.08487388 = score(doc=132,freq=1.0), product of:
             0.28071028 = queryWeight, product of:
               4.9577866 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.011704013 = queryNorm
             0.302354 = fieldWeight in 132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=132)
         0.23324239 = weight(abstract_txt:peer in 132) [ClassicSimilarity], result of:
           0.23324239 = score(doc=132,freq=1.0), product of:
             0.57580835 = queryWeight, product of:
               7.590906 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.011704013 = queryNorm
             0.4050695 = fieldWeight in 132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=132)
       0.32 = coord(8/25)