Document (#40693)

Author

Casnici, N.
Grimaldo, F.
Gilbert, N.
Squazzoni, F.

Title

Attitudes of referees in a multidisciplinary journal : an empirical analysis

Source

Journal of the Association for Information Science and Technology. 68(2017) no.7, S.1763-1771

Year

2017

Abstract

This paper looks at 10 years of reviews in a multidisciplinary journal, The Journal of Artificial Societies and Social Simulation (JASSS), which is the flagship journal of social simulation. We measured referee behavior and referees' agreement. We found that the disciplinary background and the academic status of the referee have an influence on the report time, the type of recommendation and the acceptance of the reviewing task. Referees from the humanities tend to be more generous in their recommendations than other referees, especially economists and environmental scientists. Second, we found that senior researchers are harsher in their judgments than junior researchers, and the latter accept requests to review more often and are faster in reporting. Finally, we found that articles that had been refereed and recommended for publication by a multidisciplinary set of referees were subsequently more likely to receive citations than those that had been reviewed by referees from the same discipline. Our results show that common standards of evaluation can be established even in multidisciplinary communities.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23665/full.

Similar documents (author)

1. Gilbert, S.K.: SGML theory and practice (1989) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:gilbert in 5943) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 5943, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=5943)
   

2. Gilbert, P.: ¬The generation gap : Minitel in the face of the Internet (1996) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:gilbert in 125) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 125, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=125)
   

3. Gilbert, J.: AACR2 headings for local churches and parishes in Great Britain (1997) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:gilbert in 1694) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 1694, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=1694)
   

4. Gilbert, M.: Was bedeutet es, dass wir beabsichtigen? (2009) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:gilbert in 3595) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 3595, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=3595)
   

5. Glastonbury, B.; Gilbert, D.: There's no such thing as a simple piece of information (1997) 4.81

   4.811013 = sum of:
     4.811013 = weight(author_txt:gilbert in 2383) [ClassicSimilarity], result of:
       4.811013 = fieldWeight in 2383, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.5 = fieldNorm(doc=2383)
   

Similar documents (content)

1. García, J.A.; Rodriguez-Sánchez, R.; Fdez-Valdivia, J.: Bias and effort in peer review (2015) 0.12

   0.116456814 = sum of:
     0.116456814 = product of:
       0.7278551 = sum of:
         0.021272263 = weight(abstract_txt:more in 3121) [ClassicSimilarity], result of:
           0.021272263 = score(doc=3121,freq=2.0), product of:
             0.05669066 = queryWeight, product of:
               1.4553223 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.011469781 = queryNorm
             0.375234 = fieldWeight in 3121, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.078125 = fieldNorm(doc=3121)
         0.014365142 = weight(abstract_txt:that in 3121) [ClassicSimilarity], result of:
           0.014365142 = score(doc=3121,freq=2.0), product of:
             0.05497758 = queryWeight, product of:
               2.0268016 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011469781 = queryNorm
             0.2612909 = fieldWeight in 3121, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=3121)
         0.1206492 = weight(abstract_txt:journal in 3121) [ClassicSimilarity], result of:
           0.1206492 = score(doc=3121,freq=3.0), product of:
             0.17335425 = queryWeight, product of:
               2.938597 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.011469781 = queryNorm
             0.6959691 = fieldWeight in 3121, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.078125 = fieldNorm(doc=3121)
         0.5715685 = weight(abstract_txt:referees in 3121) [ClassicSimilarity], result of:
           0.5715685 = score(doc=3121,freq=1.0), product of:
             0.80729926 = queryWeight, product of:
               7.766685 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.011469781 = queryNorm
             0.7080008 = fieldWeight in 3121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.078125 = fieldNorm(doc=3121)
       0.16 = coord(4/25)
   

2. Garfield, E.: When to cite (1996) 0.11

   0.11427963 = sum of:
     0.11427963 = product of:
       0.95233023 = sum of:
         0.014220764 = weight(abstract_txt:that in 149) [ClassicSimilarity], result of:
           0.014220764 = score(doc=149,freq=1.0), product of:
             0.05497758 = queryWeight, product of:
               2.0268016 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011469781 = queryNorm
             0.2586648 = fieldWeight in 149, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=149)
         0.13791354 = weight(abstract_txt:journal in 149) [ClassicSimilarity], result of:
           0.13791354 = score(doc=149,freq=2.0), product of:
             0.17335425 = queryWeight, product of:
               2.938597 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.011469781 = queryNorm
             0.795559 = fieldWeight in 149, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.109375 = fieldNorm(doc=149)
         0.80019593 = weight(abstract_txt:referees in 149) [ClassicSimilarity], result of:
           0.80019593 = score(doc=149,freq=1.0), product of:
             0.80729926 = queryWeight, product of:
               7.766685 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.011469781 = queryNorm
             0.99120116 = fieldWeight in 149, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.109375 = fieldNorm(doc=149)
       0.12 = coord(3/25)
   

3. Zhao, Y.W.; Chi. C.-H.; Heuvel, W.J. van den: Imperfect referees : reducing the impact of multiple biases in peer review (2015) 0.11

   0.11287416 = sum of:
     0.11287416 = product of:
       0.940618 = sum of:
         0.012033409 = weight(abstract_txt:more in 3271) [ClassicSimilarity], result of:
           0.012033409 = score(doc=3271,freq=1.0), product of:
             0.05669066 = queryWeight, product of:
               1.4553223 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.011469781 = queryNorm
             0.21226442 = fieldWeight in 3271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=3271)
         0.014074905 = weight(abstract_txt:that in 3271) [ClassicSimilarity], result of:
           0.014074905 = score(doc=3271,freq=3.0), product of:
             0.05497758 = queryWeight, product of:
               2.0268016 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011469781 = queryNorm
             0.25601172 = fieldWeight in 3271, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3271)
         0.91450965 = weight(abstract_txt:referees in 3271) [ClassicSimilarity], result of:
           0.91450965 = score(doc=3271,freq=4.0), product of:
             0.80729926 = queryWeight, product of:
               7.766685 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.011469781 = queryNorm
             1.1328013 = fieldWeight in 3271, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.0625 = fieldNorm(doc=3271)
       0.12 = coord(3/25)
   

4. Campanario, J.M.: Have referees rejected some of the most-cited articles of all times? (1996) 0.10

   0.10017271 = sum of:
     0.10017271 = product of:
       0.83477265 = sum of:
         0.012087589 = weight(abstract_txt:been in 4283) [ClassicSimilarity], result of:
           0.012087589 = score(doc=4283,freq=1.0), product of:
             0.04280637 = queryWeight, product of:
               1.0325521 = boost
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.011469781 = queryNorm
             0.2823783 = fieldWeight in 4283, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.078125 = fieldNorm(doc=4283)
         0.014365142 = weight(abstract_txt:that in 4283) [ClassicSimilarity], result of:
           0.014365142 = score(doc=4283,freq=2.0), product of:
             0.05497758 = queryWeight, product of:
               2.0268016 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011469781 = queryNorm
             0.2612909 = fieldWeight in 4283, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=4283)
         0.8083199 = weight(abstract_txt:referees in 4283) [ClassicSimilarity], result of:
           0.8083199 = score(doc=4283,freq=2.0), product of:
             0.80729926 = queryWeight, product of:
               7.766685 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.011469781 = queryNorm
             1.0012643 = fieldWeight in 4283, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.078125 = fieldNorm(doc=4283)
       0.12 = coord(3/25)
   

5. Haustein, S.; Sugimoto, C.; Larivière, V.: Social media in scholarly communication : Guest editorial (2015) 0.10

   0.09962585 = sum of:
     0.09962585 = product of:
       0.3558066 = sum of:
         0.019211583 = weight(abstract_txt:subsequently in 4809) [ClassicSimilarity], result of:
           0.019211583 = score(doc=4809,freq=1.0), product of:
             0.08523292 = queryWeight, product of:
               1.0302591 = boost
               7.212831 = idf(docFreq=88, maxDocs=44421)
               0.011469781 = queryNorm
             0.22540097 = fieldWeight in 4809, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.212831 = idf(docFreq=88, maxDocs=44421)
               0.03125 = fieldNorm(doc=4809)
         0.015206564 = weight(abstract_txt:social in 4809) [ClassicSimilarity], result of:
           0.015206564 = score(doc=4809,freq=4.0), product of:
             0.05788633 = queryWeight, product of:
               1.2007312 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.011469781 = queryNorm
             0.26269698 = fieldWeight in 4809, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.03125 = fieldNorm(doc=4809)
         0.012033409 = weight(abstract_txt:more in 4809) [ClassicSimilarity], result of:
           0.012033409 = score(doc=4809,freq=4.0), product of:
             0.05669066 = queryWeight, product of:
               1.4553223 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.011469781 = queryNorm
             0.21226442 = fieldWeight in 4809, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.03125 = fieldNorm(doc=4809)
         0.01281291 = weight(abstract_txt:than in 4809) [ClassicSimilarity], result of:
           0.01281291 = score(doc=4809,freq=2.0), product of:
             0.07447792 = queryWeight, product of:
               1.6680812 = boost
               3.8927383 = idf(docFreq=2461, maxDocs=44421)
               0.011469781 = queryNorm
             0.17203635 = fieldWeight in 4809, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.8927383 = idf(docFreq=2461, maxDocs=44421)
               0.03125 = fieldNorm(doc=4809)
         0.012189227 = weight(abstract_txt:that in 4809) [ClassicSimilarity], result of:
           0.012189227 = score(doc=4809,freq=9.0), product of:
             0.05497758 = queryWeight, product of:
               2.0268016 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.011469781 = queryNorm
             0.22171268 = fieldWeight in 4809, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.03125 = fieldNorm(doc=4809)
         0.055725485 = weight(abstract_txt:journal in 4809) [ClassicSimilarity], result of:
           0.055725485 = score(doc=4809,freq=4.0), product of:
             0.17335425 = queryWeight, product of:
               2.938597 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.011469781 = queryNorm
             0.32145438 = fieldWeight in 4809, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.03125 = fieldNorm(doc=4809)
         0.22862741 = weight(abstract_txt:referees in 4809) [ClassicSimilarity], result of:
           0.22862741 = score(doc=4809,freq=1.0), product of:
             0.80729926 = queryWeight, product of:
               7.766685 = boost
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.011469781 = queryNorm
             0.28320032 = fieldWeight in 4809, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.06241 = idf(docFreq=13, maxDocs=44421)
               0.03125 = fieldNorm(doc=4809)
       0.28 = coord(7/25)