Document (#37526)

Author

Lee, C.J.
Sugimoto, C.R.
Zhang, G.
Cronin, B.

Title

Bias in peer review

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.1, S.2-17

Year

2013

Series

Advances in information science

Abstract

Research on bias in peer review examines scholarly communication and funding processes to assess the epistemic and social legitimacy of the mechanisms by which knowledge communities vet and self-regulate their work. Despite vocal concerns, a closer look at the empirical and methodological limitations of research on bias raises questions about the existence and extent of many hypothesized forms of bias. In addition, the notion of bias is predicated on an implicit ideal that, once articulated, raises questions about the normative implications of research on bias in peer review. This review provides a brief description of the function, history, and scope of peer review; articulates and critiques the conception of bias unifying research on bias in peer review; characterizes and examines the empirical, methodological, and normative claims of bias in peer review research; and assesses possible alternatives to the status quo. We close by identifying ways to expand conceptions and studies of bias to contend with the complexity of social interactions among actors involved directly and indirectly in peer review.

Similar documents (author)

1. Sugimoto, C.R.; Cronin, B.: Biobibliometric profiling : an examination of multifaceted approaches to scholarship (2012) 3.40

   3.4029002 = sum of:
     3.4029002 = product of:
       5.10435 = sum of:
         2.2979622 = weight(author_txt:cronin in 991) [ClassicSimilarity], result of:
           2.2979622 = score(doc=991,freq=1.0), product of:
             0.59873044 = queryWeight, product of:
               1.1988031 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.065064184 = queryNorm
             3.838058 = fieldWeight in 991, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.5 = fieldNorm(doc=991)
         2.806388 = weight(author_txt:sugimoto in 991) [ClassicSimilarity], result of:
           2.806388 = score(doc=991,freq=1.0), product of:
             0.68407106 = queryWeight, product of:
               1.2813942 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.065064184 = queryNorm
             4.10248 = fieldWeight in 991, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.5 = fieldNorm(doc=991)
       0.6666667 = coord(2/3)
   

2. Larivière, V.; Sugimoto, C.R.; Cronin, B.: ¬A bibliometric chronicling of library and information science's first hundred years (2012) 2.55

   2.552175 = sum of:
     2.552175 = product of:
       3.8282623 = sum of:
         1.7234715 = weight(author_txt:cronin in 1244) [ClassicSimilarity], result of:
           1.7234715 = score(doc=1244,freq=1.0), product of:
             0.59873044 = queryWeight, product of:
               1.1988031 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.065064184 = queryNorm
             2.8785434 = fieldWeight in 1244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.375 = fieldNorm(doc=1244)
         2.104791 = weight(author_txt:sugimoto in 1244) [ClassicSimilarity], result of:
           2.104791 = score(doc=1244,freq=1.0), product of:
             0.68407106 = queryWeight, product of:
               1.2813942 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.065064184 = queryNorm
             3.07686 = fieldWeight in 1244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.375 = fieldNorm(doc=1244)
       0.6666667 = coord(2/3)
   

3. Larivière, V.; Sugimoto, C.R.; Macaluso, B.; Milojevi´c, S.; Cronin, B.; Thelwall, M.: arXiv E-prints and the journal of record : an analysis of roles and relationships (2014) 1.70

   1.7014501 = sum of:
     1.7014501 = product of:
       2.552175 = sum of:
         1.1489811 = weight(author_txt:cronin in 2285) [ClassicSimilarity], result of:
           1.1489811 = score(doc=2285,freq=1.0), product of:
             0.59873044 = queryWeight, product of:
               1.1988031 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.065064184 = queryNorm
             1.919029 = fieldWeight in 2285, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.25 = fieldNorm(doc=2285)
         1.403194 = weight(author_txt:sugimoto in 2285) [ClassicSimilarity], result of:
           1.403194 = score(doc=2285,freq=1.0), product of:
             0.68407106 = queryWeight, product of:
               1.2813942 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.065064184 = queryNorm
             2.05124 = fieldWeight in 2285, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.25 = fieldNorm(doc=2285)
       0.6666667 = coord(2/3)
   

4. Sugimoto, M.: ¬A document retrieval system for assisting creative research (1995) 1.17

   1.1693283 = sum of:
     1.1693283 = product of:
       3.5079849 = sum of:
         3.5079849 = weight(author_txt:sugimoto in 4143) [ClassicSimilarity], result of:
           3.5079849 = score(doc=4143,freq=1.0), product of:
             0.68407106 = queryWeight, product of:
               1.2813942 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.065064184 = queryNorm
             5.1281 = fieldWeight in 4143, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.625 = fieldNorm(doc=4143)
       0.33333334 = coord(1/3)
   

5. Cronin, B.: Standing on ceremony (2013) 0.96

   0.95748425 = sum of:
     0.95748425 = product of:
       2.8724527 = sum of:
         2.8724527 = weight(author_txt:cronin in 1105) [ClassicSimilarity], result of:
           2.8724527 = score(doc=1105,freq=1.0), product of:
             0.59873044 = queryWeight, product of:
               1.1988031 = boost
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.065064184 = queryNorm
             4.7975726 = fieldWeight in 1105, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.676116 = idf(docFreq=55, maxDocs=44421)
               0.625 = fieldNorm(doc=1105)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. García, J.A.; Rodriguez-Sánchez, R.; Fdez-Valdivia, J.: Bias and effort in peer review (2015) 0.20

   0.19822788 = sum of:
     0.19822788 = product of:
       1.2389243 = sum of:
         0.0137211075 = weight(abstract_txt:about in 3121) [ClassicSimilarity], result of:
           0.0137211075 = score(doc=3121,freq=1.0), product of:
             0.044852283 = queryWeight, product of:
               1.0547748 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.01085951 = queryNorm
             0.3059177 = fieldWeight in 3121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.078125 = fieldNorm(doc=3121)
         0.17925578 = weight(abstract_txt:review in 3121) [ClassicSimilarity], result of:
           0.17925578 = score(doc=3121,freq=3.0), product of:
             0.27383363 = queryWeight, product of:
               5.2124376 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.01085951 = queryNorm
             0.65461564 = fieldWeight in 3121, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.078125 = fieldNorm(doc=3121)
         0.37715742 = weight(abstract_txt:peer in 3121) [ClassicSimilarity], result of:
           0.37715742 = score(doc=3121,freq=3.0), product of:
             0.43005347 = queryWeight, product of:
               6.1103024 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.01085951 = queryNorm
             0.8770012 = fieldWeight in 3121, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.078125 = fieldNorm(doc=3121)
         0.6687899 = weight(abstract_txt:bias in 3121) [ClassicSimilarity], result of:
           0.6687899 = score(doc=3121,freq=3.0), product of:
             0.7095797 = queryWeight, product of:
               9.381085 = boost
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.01085951 = queryNorm
             0.9425156 = fieldWeight in 3121, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.078125 = fieldNorm(doc=3121)
       0.16 = coord(4/25)
   

2. Zhao, Y.W.; Chi. C.-H.; Heuvel, W.J. van den: Imperfect referees : reducing the impact of multiple biases in peer review (2015) 0.19

   0.18759285 = sum of:
     0.18759285 = product of:
       1.1724553 = sum of:
         0.014416647 = weight(abstract_txt:research in 3271) [ClassicSimilarity], result of:
           0.014416647 = score(doc=3271,freq=1.0), product of:
             0.07300534 = queryWeight, product of:
               2.1277215 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.01085951 = queryNorm
             0.19747387 = fieldWeight in 3271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3271)
         0.16558939 = weight(abstract_txt:review in 3271) [ClassicSimilarity], result of:
           0.16558939 = score(doc=3271,freq=4.0), product of:
             0.27383363 = queryWeight, product of:
               5.2124376 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.01085951 = queryNorm
             0.604708 = fieldWeight in 3271, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=3271)
         0.30172592 = weight(abstract_txt:peer in 3271) [ClassicSimilarity], result of:
           0.30172592 = score(doc=3271,freq=3.0), product of:
             0.43005347 = queryWeight, product of:
               6.1103024 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.01085951 = queryNorm
             0.70160097 = fieldWeight in 3271, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=3271)
         0.6907233 = weight(abstract_txt:bias in 3271) [ClassicSimilarity], result of:
           0.6907233 = score(doc=3271,freq=5.0), product of:
             0.7095797 = queryWeight, product of:
               9.381085 = boost
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.01085951 = queryNorm
             0.973426 = fieldWeight in 3271, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.0625 = fieldNorm(doc=3271)
       0.16 = coord(4/25)
   

3. Sun, M.; Danfa, J.B.; Teplitskiy, M.: Does double-blind peer review reduce bias? : evidence from a top computer science conference (2022) 0.18

   0.18208033 = sum of:
     0.18208033 = product of:
       1.138002 = sum of:
         0.020388218 = weight(abstract_txt:research in 1563) [ClassicSimilarity], result of:
           0.020388218 = score(doc=1563,freq=2.0), product of:
             0.07300534 = queryWeight, product of:
               2.1277215 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.01085951 = queryNorm
             0.27927023 = fieldWeight in 1563, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1563)
         0.23417877 = weight(abstract_txt:review in 1563) [ClassicSimilarity], result of:
           0.23417877 = score(doc=1563,freq=8.0), product of:
             0.27383363 = queryWeight, product of:
               5.2124376 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.01085951 = queryNorm
             0.8551863 = fieldWeight in 1563, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=1563)
         0.3484031 = weight(abstract_txt:peer in 1563) [ClassicSimilarity], result of:
           0.3484031 = score(doc=1563,freq=4.0), product of:
             0.43005347 = queryWeight, product of:
               6.1103024 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.01085951 = queryNorm
             0.810139 = fieldWeight in 1563, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=1563)
         0.5350319 = weight(abstract_txt:bias in 1563) [ClassicSimilarity], result of:
           0.5350319 = score(doc=1563,freq=3.0), product of:
             0.7095797 = queryWeight, product of:
               9.381085 = boost
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.01085951 = queryNorm
             0.75401247 = fieldWeight in 1563, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.0625 = fieldNorm(doc=1563)
       0.16 = coord(4/25)
   

4. Mutz, R.; Bornmann, L.; Daniel, H.-D.: Testing for the fairness and predictive validity of research funding decisions : a multilevel multiple imputation for missing data approach using ex-ante and ex-post peer evaluation data from the Austrian science fund (2015) 0.18

   0.1779404 = sum of:
     0.1779404 = product of:
       1.1121275 = sum of:
         0.028833294 = weight(abstract_txt:research in 3270) [ClassicSimilarity], result of:
           0.028833294 = score(doc=3270,freq=4.0), product of:
             0.07300534 = queryWeight, product of:
               2.1277215 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.01085951 = queryNorm
             0.39494774 = fieldWeight in 3270, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3270)
         0.11708938 = weight(abstract_txt:review in 3270) [ClassicSimilarity], result of:
           0.11708938 = score(doc=3270,freq=2.0), product of:
             0.27383363 = queryWeight, product of:
               5.2124376 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.01085951 = queryNorm
             0.42759314 = fieldWeight in 3270, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=3270)
         0.3484031 = weight(abstract_txt:peer in 3270) [ClassicSimilarity], result of:
           0.3484031 = score(doc=3270,freq=4.0), product of:
             0.43005347 = queryWeight, product of:
               6.1103024 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.01085951 = queryNorm
             0.810139 = fieldWeight in 3270, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=3270)
         0.6178017 = weight(abstract_txt:bias in 3270) [ClassicSimilarity], result of:
           0.6178017 = score(doc=3270,freq=4.0), product of:
             0.7095797 = queryWeight, product of:
               9.381085 = boost
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.01085951 = queryNorm
             0.87065864 = fieldWeight in 3270, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.0625 = fieldNorm(doc=3270)
       0.16 = coord(4/25)
   

5. Mulligan, A.; Hall, L.; Raphael, E.: Peer review in a changing world : an international study measuring the attitudes of researchers (2013) 0.15

   0.14550655 = sum of:
     0.14550655 = product of:
       0.9094159 = sum of:
         0.010976886 = weight(abstract_txt:about in 1528) [ClassicSimilarity], result of:
           0.010976886 = score(doc=1528,freq=1.0), product of:
             0.044852283 = queryWeight, product of:
               1.0547748 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.01085951 = queryNorm
             0.24473417 = fieldWeight in 1528, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.0625 = fieldNorm(doc=1528)
         0.020388218 = weight(abstract_txt:research in 1528) [ClassicSimilarity], result of:
           0.020388218 = score(doc=1528,freq=2.0), product of:
             0.07300534 = queryWeight, product of:
               2.1277215 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.01085951 = queryNorm
             0.27927023 = fieldWeight in 1528, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1528)
         0.27459896 = weight(abstract_txt:review in 1528) [ClassicSimilarity], result of:
           0.27459896 = score(doc=1528,freq=11.0), product of:
             0.27383363 = queryWeight, product of:
               5.2124376 = boost
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.01085951 = queryNorm
             1.0027949 = fieldWeight in 1528, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.837664 = idf(docFreq=956, maxDocs=44421)
               0.0625 = fieldNorm(doc=1528)
         0.60345185 = weight(abstract_txt:peer in 1528) [ClassicSimilarity], result of:
           0.60345185 = score(doc=1528,freq=12.0), product of:
             0.43005347 = queryWeight, product of:
               6.1103024 = boost
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.01085951 = queryNorm
             1.4032019 = fieldWeight in 1528, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.481112 = idf(docFreq=184, maxDocs=44421)
               0.0625 = fieldNorm(doc=1528)
       0.16 = coord(4/25)