Document (#39329)

Author

Bornmann, L.

Title

Interrater reliability and convergent validity of F1000Prime peer review

Source

Journal of the Association for Information Science and Technology. 66(2015) no.12, S.2415-2426

Year

2015

Abstract

Peer review is the backbone of modern science. F1000Prime is a postpublication peer review system of the biomedical literature (papers from medical and biological journals). This study is concerned with the interrater reliability and convergent validity of the peer recommendations formulated in the F1000Prime peer review system. The study is based on about 100,000 papers with recommendations from faculty members. Even if intersubjectivity plays a fundamental role in science, the analyses of the reliability of the F1000Prime peer review system show a rather low level of agreement between faculty members. This result is in agreement with most other studies that have been published on the journal peer review system. Logistic regression models are used to investigate the convergent validity of the F1000Prime peer review system. As the results show, the proportion of highly cited papers among those selected by the faculty members is significantly higher than expected. In addition, better recommendation scores are also associated with higher performing papers.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23334/abstract.

Theme

Informetrie

Similar documents (author)

1. Bornmann, L.: Complex tasks and simple solutions : the use of heuristics in the evaluation of research (2015) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 8911) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 8911, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=8911)
   

2. Bornmann, L.: What is societal impact of research and how can it be assessed? : a literature survey (2013) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 606) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 606, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=606)
   

3. Bornmann, L.: How to analyze percentile citation impact data meaningfully in bibliometrics : the statistical analysis of distributions, percentile rank classes, and top-cited papers (2013) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 656) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 656, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=656)
   

4. Bornmann, L.: Lässt sich die Qualität von Forschung messen? (2013) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 928) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=928)
   

5. Bornmann, L.: On the function of university rankings (2014) 4.73

   4.7310953 = sum of:
     4.7310953 = weight(author_txt:bornmann in 1188) [ClassicSimilarity], result of:
       4.7310953 = fieldWeight in 1188, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.5697527 = idf(docFreq=61, maxDocs=44218)
         0.625 = fieldNorm(doc=1188)
   

Similar documents (content)

1. Cabanac, G.; Preuss, T.: Capitalizing on order effects in the bids of peer-reviewed conferences to secure reviews by expert referees (2013) 0.39

   0.39389572 = sum of:
     0.39389572 = product of:
       0.9847393 = sum of:
         0.008568686 = weight(abstract_txt:study in 619) [ClassicSimilarity], result of:
           0.008568686 = score(doc=619,freq=1.0), product of:
             0.04004286 = queryWeight, product of:
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.011695423 = queryNorm
             0.21398787 = fieldWeight in 619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.017376877 = weight(abstract_txt:science in 619) [ClassicSimilarity], result of:
           0.017376877 = score(doc=619,freq=2.0), product of:
             0.050919805 = queryWeight, product of:
               1.1276668 = boost
               3.8609126 = idf(docFreq=2529, maxDocs=44218)
               0.011695423 = queryNorm
             0.3412597 = fieldWeight in 619, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.8609126 = idf(docFreq=2529, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.018259732 = weight(abstract_txt:show in 619) [ClassicSimilarity], result of:
           0.018259732 = score(doc=619,freq=1.0), product of:
             0.06630992 = queryWeight, product of:
               1.2868464 = boost
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.011695423 = queryNorm
             0.27536952 = fieldWeight in 619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.0094321985 = weight(abstract_txt:with in 619) [ClassicSimilarity], result of:
           0.0094321985 = score(doc=619,freq=2.0), product of:
             0.042689808 = queryWeight, product of:
               1.4602075 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.011695423 = queryNorm
             0.22094731 = fieldWeight in 619, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.033307504 = weight(abstract_txt:higher in 619) [ClassicSimilarity], result of:
           0.033307504 = score(doc=619,freq=1.0), product of:
             0.09899433 = queryWeight, product of:
               1.5723261 = boost
               5.3833394 = idf(docFreq=551, maxDocs=44218)
               0.011695423 = queryNorm
             0.3364587 = fieldWeight in 619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3833394 = idf(docFreq=551, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.040507853 = weight(abstract_txt:recommendations in 619) [ClassicSimilarity], result of:
           0.040507853 = score(doc=619,freq=1.0), product of:
             0.112791166 = queryWeight, product of:
               1.6783209 = boost
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.011695423 = queryNorm
             0.3591403 = fieldWeight in 619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.099995434 = weight(abstract_txt:validity in 619) [ClassicSimilarity], result of:
           0.099995434 = score(doc=619,freq=1.0), product of:
             0.23583022 = queryWeight, product of:
               2.9722326 = boost
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.011695423 = queryNorm
             0.4240145 = fieldWeight in 619, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.14016339 = weight(abstract_txt:papers in 619) [ClassicSimilarity], result of:
           0.14016339 = score(doc=619,freq=5.0), product of:
             0.19011891 = queryWeight, product of:
               3.0815208 = boost
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.011695423 = queryNorm
             0.7372407 = fieldWeight in 619, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.14842848 = weight(abstract_txt:review in 619) [ClassicSimilarity], result of:
           0.14842848 = score(doc=619,freq=3.0), product of:
             0.28221235 = queryWeight, product of:
               4.9666033 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.011695423 = queryNorm
             0.5259461 = fieldWeight in 619, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
         0.46869913 = weight(abstract_txt:peer in 619) [ClassicSimilarity], result of:
           0.46869913 = score(doc=619,freq=4.0), product of:
             0.57700336 = queryWeight, product of:
               7.5920076 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.011695423 = queryNorm
             0.8122988 = fieldWeight in 619, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=619)
       0.4 = coord(10/25)
   

2. Daniel, H.-D.: Guardians of science : fairness and reliabiblity of peer review (1993) 0.38

   0.37920424 = sum of:
     0.37920424 = product of:
       1.1850133 = sum of:
         0.015359134 = weight(abstract_txt:science in 1713) [ClassicSimilarity], result of:
           0.015359134 = score(doc=1713,freq=1.0), product of:
             0.050919805 = queryWeight, product of:
               1.1276668 = boost
               3.8609126 = idf(docFreq=2529, maxDocs=44218)
               0.011695423 = queryNorm
             0.3016338 = fieldWeight in 1713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8609126 = idf(docFreq=2529, maxDocs=44218)
               0.078125 = fieldNorm(doc=1713)
         0.011790248 = weight(abstract_txt:with in 1713) [ClassicSimilarity], result of:
           0.011790248 = score(doc=1713,freq=2.0), product of:
             0.042689808 = queryWeight, product of:
               1.4602075 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.011695423 = queryNorm
             0.27618414 = fieldWeight in 1713, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=1713)
         0.02558696 = weight(abstract_txt:system in 1713) [ClassicSimilarity], result of:
           0.02558696 = score(doc=1713,freq=1.0), product of:
             0.09711837 = queryWeight, product of:
               2.4623973 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.011695423 = queryNorm
             0.2634616 = fieldWeight in 1713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=1713)
         0.12499429 = weight(abstract_txt:validity in 1713) [ClassicSimilarity], result of:
           0.12499429 = score(doc=1713,freq=1.0), product of:
             0.23583022 = queryWeight, product of:
               2.9722326 = boost
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.011695423 = queryNorm
             0.53001815 = fieldWeight in 1713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.078125 = fieldNorm(doc=1713)
         0.12881704 = weight(abstract_txt:reliability in 1713) [ClassicSimilarity], result of:
           0.12881704 = score(doc=1713,freq=1.0), product of:
             0.24061435 = queryWeight, product of:
               3.0022295 = boost
               6.8527 = idf(docFreq=126, maxDocs=44218)
               0.011695423 = queryNorm
             0.5353672 = fieldWeight in 1713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8527 = idf(docFreq=126, maxDocs=44218)
               0.078125 = fieldNorm(doc=1713)
         0.07835372 = weight(abstract_txt:papers in 1713) [ClassicSimilarity], result of:
           0.07835372 = score(doc=1713,freq=1.0), product of:
             0.19011891 = queryWeight, product of:
               3.0815208 = boost
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.011695423 = queryNorm
             0.41213006 = fieldWeight in 1713, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.078125 = fieldNorm(doc=1713)
         0.21423806 = weight(abstract_txt:review in 1713) [ClassicSimilarity], result of:
           0.21423806 = score(doc=1713,freq=4.0), product of:
             0.28221235 = queryWeight, product of:
               4.9666033 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.011695423 = queryNorm
             0.7591378 = fieldWeight in 1713, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.078125 = fieldNorm(doc=1713)
         0.5858739 = weight(abstract_txt:peer in 1713) [ClassicSimilarity], result of:
           0.5858739 = score(doc=1713,freq=4.0), product of:
             0.57700336 = queryWeight, product of:
               7.5920076 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.011695423 = queryNorm
             1.0153735 = fieldWeight in 1713, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.078125 = fieldNorm(doc=1713)
       0.32 = coord(8/25)
   

3. Meho, L.I.; Sonnenwald, D.H.: Citation ranking versus peer evaluation of senior faculty research performance : a case study of Kurdish scholarship (2000) 0.24

   0.23566946 = sum of:
     0.23566946 = product of:
       0.9819561 = sum of:
         0.01855175 = weight(abstract_txt:study in 4382) [ClassicSimilarity], result of:
           0.01855175 = score(doc=4382,freq=3.0), product of:
             0.04004286 = queryWeight, product of:
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.011695423 = queryNorm
             0.46329734 = fieldWeight in 4382, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.008336964 = weight(abstract_txt:with in 4382) [ClassicSimilarity], result of:
           0.008336964 = score(doc=4382,freq=1.0), product of:
             0.042689808 = queryWeight, product of:
               1.4602075 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.011695423 = queryNorm
             0.19529167 = fieldWeight in 4382, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.082121536 = weight(abstract_txt:members in 4382) [ClassicSimilarity], result of:
           0.082121536 = score(doc=4382,freq=1.0), product of:
             0.17822859 = queryWeight, product of:
               2.5838766 = boost
               5.8977947 = idf(docFreq=329, maxDocs=44218)
               0.011695423 = queryNorm
             0.4607652 = fieldWeight in 4382, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8977947 = idf(docFreq=329, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.17995292 = weight(abstract_txt:faculty in 4382) [ClassicSimilarity], result of:
           0.17995292 = score(doc=4382,freq=3.0), product of:
             0.20848341 = queryWeight, product of:
               2.7945948 = boost
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.011695423 = queryNorm
             0.8631522 = fieldWeight in 4382, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.378767 = idf(docFreq=203, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.10711903 = weight(abstract_txt:review in 4382) [ClassicSimilarity], result of:
           0.10711903 = score(doc=4382,freq=1.0), product of:
             0.28221235 = queryWeight, product of:
               4.9666033 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.011695423 = queryNorm
             0.3795689 = fieldWeight in 4382, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.5858739 = weight(abstract_txt:peer in 4382) [ClassicSimilarity], result of:
           0.5858739 = score(doc=4382,freq=4.0), product of:
             0.57700336 = queryWeight, product of:
               7.5920076 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.011695423 = queryNorm
             1.0153735 = fieldWeight in 4382, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
       0.24 = coord(6/25)
   

4. Wood, D.J.: Peer review and the Web : the implications of electronic peer review for biomedical authors, referees and learned society publishers (1998) 0.21

   0.21130788 = sum of:
     0.21130788 = product of:
       0.88044953 = sum of:
         0.067088775 = weight(abstract_txt:biomedical in 4717) [ClassicSimilarity], result of:
           0.067088775 = score(doc=4717,freq=3.0), product of:
             0.08688906 = queryWeight, product of:
               1.0416096 = boost
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.011695423 = queryNorm
             0.77211994 = fieldWeight in 4717, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.132539 = idf(docFreq=95, maxDocs=44218)
               0.0625 = fieldNorm(doc=4717)
         0.011552036 = weight(abstract_txt:with in 4717) [ClassicSimilarity], result of:
           0.011552036 = score(doc=4717,freq=3.0), product of:
             0.042689808 = queryWeight, product of:
               1.4602075 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.011695423 = queryNorm
             0.27060407 = fieldWeight in 4717, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=4717)
         0.020469569 = weight(abstract_txt:system in 4717) [ClassicSimilarity], result of:
           0.020469569 = score(doc=4717,freq=1.0), product of:
             0.09711837 = queryWeight, product of:
               2.4623973 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.011695423 = queryNorm
             0.21076928 = fieldWeight in 4717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=4717)
         0.06569722 = weight(abstract_txt:members in 4717) [ClassicSimilarity], result of:
           0.06569722 = score(doc=4717,freq=1.0), product of:
             0.17822859 = queryWeight, product of:
               2.5838766 = boost
               5.8977947 = idf(docFreq=329, maxDocs=44218)
               0.011695423 = queryNorm
             0.36861217 = fieldWeight in 4717, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8977947 = idf(docFreq=329, maxDocs=44218)
               0.0625 = fieldNorm(doc=4717)
         0.19162035 = weight(abstract_txt:review in 4717) [ClassicSimilarity], result of:
           0.19162035 = score(doc=4717,freq=5.0), product of:
             0.28221235 = queryWeight, product of:
               4.9666033 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.011695423 = queryNorm
             0.6789935 = fieldWeight in 4717, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=4717)
         0.52402157 = weight(abstract_txt:peer in 4717) [ClassicSimilarity], result of:
           0.52402157 = score(doc=4717,freq=5.0), product of:
             0.57700336 = queryWeight, product of:
               7.5920076 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.011695423 = queryNorm
             0.9081777 = fieldWeight in 4717, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=4717)
       0.24 = coord(6/25)
   

5. Bornmann, L.; Schier, H.; Marx, W.; Daniel, H.-D.: Is interactive open access publishing able to identify high-impact submissions? : a study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes (2011) 0.21

   0.20984946 = sum of:
     0.20984946 = product of:
       0.6557796 = sum of:
         0.008568686 = weight(abstract_txt:study in 4132) [ClassicSimilarity], result of:
           0.008568686 = score(doc=4132,freq=1.0), product of:
             0.04004286 = queryWeight, product of:
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.011695423 = queryNorm
             0.21398787 = fieldWeight in 4132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=4132)
         0.018259732 = weight(abstract_txt:show in 4132) [ClassicSimilarity], result of:
           0.018259732 = score(doc=4132,freq=1.0), product of:
             0.06630992 = queryWeight, product of:
               1.2868464 = boost
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.011695423 = queryNorm
             0.27536952 = fieldWeight in 4132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.0625 = fieldNorm(doc=4132)
         0.006669571 = weight(abstract_txt:with in 4132) [ClassicSimilarity], result of:
           0.006669571 = score(doc=4132,freq=1.0), product of:
             0.042689808 = queryWeight, product of:
               1.4602075 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.011695423 = queryNorm
             0.15623334 = fieldWeight in 4132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=4132)
         0.020469569 = weight(abstract_txt:system in 4132) [ClassicSimilarity], result of:
           0.020469569 = score(doc=4132,freq=1.0), product of:
             0.09711837 = queryWeight, product of:
               2.4623973 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.011695423 = queryNorm
             0.21076928 = fieldWeight in 4132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=4132)
         0.17319717 = weight(abstract_txt:validity in 4132) [ClassicSimilarity], result of:
           0.17319717 = score(doc=4132,freq=3.0), product of:
             0.23583022 = queryWeight, product of:
               2.9722326 = boost
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.011695423 = queryNorm
             0.73441464 = fieldWeight in 4132, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.0625 = fieldNorm(doc=4132)
         0.1085701 = weight(abstract_txt:papers in 4132) [ClassicSimilarity], result of:
           0.1085701 = score(doc=4132,freq=3.0), product of:
             0.19011891 = queryWeight, product of:
               3.0815208 = boost
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.011695423 = queryNorm
             0.5710642 = fieldWeight in 4132, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.0625 = fieldNorm(doc=4132)
         0.08569522 = weight(abstract_txt:review in 4132) [ClassicSimilarity], result of:
           0.08569522 = score(doc=4132,freq=1.0), product of:
             0.28221235 = queryWeight, product of:
               4.9666033 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.011695423 = queryNorm
             0.30365512 = fieldWeight in 4132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=4132)
         0.23434956 = weight(abstract_txt:peer in 4132) [ClassicSimilarity], result of:
           0.23434956 = score(doc=4132,freq=1.0), product of:
             0.57700336 = queryWeight, product of:
               7.5920076 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.011695423 = queryNorm
             0.4061494 = fieldWeight in 4132, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=4132)
       0.32 = coord(8/25)