Document (#39171)

Author

Rijcke, S. de
Rushforth, A.

Title

To intervene or not to intervene; is that the question? : on the role of scientometrics in research evaluation

Source

Journal of the Association for Information Science and Technology. 66(2015) no.9, S.1954-1958

Year

2015

Series

Opinion paper

Abstract

Recent high-profile statements, criticisms, and boycotts organized against certain quantitative indicators (e.g., the DORA declaration) have brought misuses of performance metrics to the center of attention. A key concern captured in these movements is that the metrics appear to carry authority even where established agents of quality control have explicitly outlined limits to their validity and reliability as measurement tools. This raises a number of challenging questions for those readers of this journal who are implicated in questions of indicator "production" and, by extension, "effects." In this opinion piece we wish to critically engage the question of how producers of indicators can come to terms with their role as (partly) responsible parties in the current age of evaluative bibliometrics. We do so through the illuminating case of the professional scientometrics community.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23382/abstract.

Theme

Informetrie

Similar documents (content)

1. Zhang, L.; Thijs, B.; Glänzel, W.: What does scientometrics share with other "metrics" sciences? (2013) 0.22

   0.21678686 = sum of:
     0.21678686 = product of:
       1.0839343 = sum of:
         0.15593168 = weight(abstract_txt:bibliometrics in 1960) [ClassicSimilarity], result of:
           0.15593168 = score(doc=1960,freq=1.0), product of:
             0.14160506 = queryWeight, product of:
               1.0143396 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.01980888 = queryNorm
             1.101173 = fieldWeight in 1960, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.15625 = fieldNorm(doc=1960)
         0.026331646 = weight(abstract_txt:this in 1960) [ClassicSimilarity], result of:
           0.026331646 = score(doc=1960,freq=2.0), product of:
             0.04952278 = queryWeight, product of:
               1.0389798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01980888 = queryNorm
             0.53170776 = fieldWeight in 1960, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.15625 = fieldNorm(doc=1960)
         0.12539749 = weight(abstract_txt:question in 1960) [ClassicSimilarity], result of:
           0.12539749 = score(doc=1960,freq=1.0), product of:
             0.1542855 = queryWeight, product of:
               1.4973438 = boost
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.01980888 = queryNorm
             0.8127626 = fieldWeight in 1960, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2016807 = idf(docFreq=664, maxDocs=44421)
               0.15625 = fieldNorm(doc=1960)
         0.36150995 = weight(abstract_txt:metrics in 1960) [ClassicSimilarity], result of:
           0.36150995 = score(doc=1960,freq=2.0), product of:
             0.2480482 = queryWeight, product of:
               1.8985717 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.01980888 = queryNorm
             1.4574182 = fieldWeight in 1960, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.15625 = fieldNorm(doc=1960)
         0.41476354 = weight(abstract_txt:scientometrics in 1960) [ClassicSimilarity], result of:
           0.41476354 = score(doc=1960,freq=1.0), product of:
             0.3425045 = queryWeight, product of:
               2.2309616 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.01980888 = queryNorm
             1.2109725 = fieldWeight in 1960, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.15625 = fieldNorm(doc=1960)
       0.2 = coord(5/25)
   

2. Rousseau, R.; Egghe, L.; Guns, R.: Becoming metric-wise : a bibliometric guide for researchers (2018) 0.11

   0.10722903 = sum of:
     0.10722903 = product of:
       0.53614515 = sum of:
         0.08820828 = weight(abstract_txt:bibliometrics in 226) [ClassicSimilarity], result of:
           0.08820828 = score(doc=226,freq=2.0), product of:
             0.14160506 = queryWeight, product of:
               1.0143396 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.01980888 = queryNorm
             0.62291753 = fieldWeight in 226, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.0074477145 = weight(abstract_txt:this in 226) [ClassicSimilarity], result of:
           0.0074477145 = score(doc=226,freq=1.0), product of:
             0.04952278 = queryWeight, product of:
               1.0389798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01980888 = queryNorm
             0.15038967 = fieldWeight in 226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.07507774 = weight(abstract_txt:evaluative in 226) [ClassicSimilarity], result of:
           0.07507774 = score(doc=226,freq=1.0), product of:
             0.16023475 = queryWeight, product of:
               1.0790023 = boost
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.01980888 = queryNorm
             0.46854845 = fieldWeight in 226, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.496775 = idf(docFreq=66, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.22080743 = weight(abstract_txt:indicators in 226) [ClassicSimilarity], result of:
           0.22080743 = score(doc=226,freq=8.0), product of:
             0.20720729 = queryWeight, product of:
               1.7352477 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.01980888 = queryNorm
             1.0656354 = fieldWeight in 226, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
         0.14460398 = weight(abstract_txt:metrics in 226) [ClassicSimilarity], result of:
           0.14460398 = score(doc=226,freq=2.0), product of:
             0.2480482 = queryWeight, product of:
               1.8985717 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.01980888 = queryNorm
             0.5829673 = fieldWeight in 226, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=226)
       0.2 = coord(5/25)
   

3. Jones, K.M.L.; Rubel, A.; LeClere, E.: ¬A matter of trust : higher education institutions as information fiduciaries in an age of educational data mining and learning analytics (2020) 0.11

   0.1054184 = sum of:
     0.1054184 = product of:
       0.527092 = sum of:
         0.010532659 = weight(abstract_txt:this in 968) [ClassicSimilarity], result of:
           0.010532659 = score(doc=968,freq=2.0), product of:
             0.04952278 = queryWeight, product of:
               1.0389798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01980888 = queryNorm
             0.21268311 = fieldWeight in 968, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=968)
         0.073349014 = weight(abstract_txt:parties in 968) [ClassicSimilarity], result of:
           0.073349014 = score(doc=968,freq=1.0), product of:
             0.15776552 = queryWeight, product of:
               1.0706562 = boost
               7.438788 = idf(docFreq=70, maxDocs=44421)
               0.01980888 = queryNorm
             0.46492425 = fieldWeight in 968, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.438788 = idf(docFreq=70, maxDocs=44421)
               0.0625 = fieldNorm(doc=968)
         0.10582755 = weight(abstract_txt:movements in 968) [ClassicSimilarity], result of:
           0.10582755 = score(doc=968,freq=1.0), product of:
             0.20144124 = queryWeight, product of:
               1.2098128 = boost
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.01980888 = queryNorm
             0.52535194 = fieldWeight in 968, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.0625 = fieldNorm(doc=968)
         0.041481666 = weight(abstract_txt:questions in 968) [ClassicSimilarity], result of:
           0.041481666 = score(doc=968,freq=1.0), product of:
             0.1359346 = queryWeight, product of:
               1.4054778 = boost
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.01980888 = queryNorm
             0.30515897 = fieldWeight in 968, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8825436 = idf(docFreq=914, maxDocs=44421)
               0.0625 = fieldNorm(doc=968)
         0.29590106 = weight(abstract_txt:intervene in 968) [ClassicSimilarity], result of:
           0.29590106 = score(doc=968,freq=1.0), product of:
             0.50372124 = queryWeight, product of:
               2.705541 = boost
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.01980888 = queryNorm
             0.5874302 = fieldWeight in 968, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.398883 = idf(docFreq=9, maxDocs=44421)
               0.0625 = fieldNorm(doc=968)
       0.2 = coord(5/25)
   

4. Beyond bibliometrics : harnessing multidimensional indicators of scholarly intent (2014) 0.10

   0.097177334 = sum of:
     0.097177334 = product of:
       0.60735834 = sum of:
         0.13504079 = weight(abstract_txt:bibliometrics in 4026) [ClassicSimilarity], result of:
           0.13504079 = score(doc=4026,freq=3.0), product of:
             0.14160506 = queryWeight, product of:
               1.0143396 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.01980888 = queryNorm
             0.9536438 = fieldWeight in 4026, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.009309643 = weight(abstract_txt:this in 4026) [ClassicSimilarity], result of:
           0.009309643 = score(doc=4026,freq=1.0), product of:
             0.04952278 = queryWeight, product of:
               1.0389798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01980888 = queryNorm
             0.18798709 = fieldWeight in 4026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.25562614 = weight(abstract_txt:metrics in 4026) [ClassicSimilarity], result of:
           0.25562614 = score(doc=4026,freq=4.0), product of:
             0.2480482 = queryWeight, product of:
               1.8985717 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.01980888 = queryNorm
             1.0305502 = fieldWeight in 4026, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.20738177 = weight(abstract_txt:scientometrics in 4026) [ClassicSimilarity], result of:
           0.20738177 = score(doc=4026,freq=1.0), product of:
             0.3425045 = queryWeight, product of:
               2.2309616 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.01980888 = queryNorm
             0.6054863 = fieldWeight in 4026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
       0.16 = coord(4/25)
   

5. Thelwall, M.: Web indicators for research evaluation : a practical guide (2016) 0.09

   0.08823815 = sum of:
     0.08823815 = product of:
       0.55148846 = sum of:
         0.01289982 = weight(abstract_txt:this in 4384) [ClassicSimilarity], result of:
           0.01289982 = score(doc=4384,freq=3.0), product of:
             0.04952278 = queryWeight, product of:
               1.0389798 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.01980888 = queryNorm
             0.26048255 = fieldWeight in 4384, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.27043277 = weight(abstract_txt:indicators in 4384) [ClassicSimilarity], result of:
           0.27043277 = score(doc=4384,freq=12.0), product of:
             0.20720729 = queryWeight, product of:
               1.7352477 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.01980888 = queryNorm
             1.3051316 = fieldWeight in 4384, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.10225046 = weight(abstract_txt:metrics in 4384) [ClassicSimilarity], result of:
           0.10225046 = score(doc=4384,freq=1.0), product of:
             0.2480482 = queryWeight, product of:
               1.8985717 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.01980888 = queryNorm
             0.41222012 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.16590542 = weight(abstract_txt:scientometrics in 4384) [ClassicSimilarity], result of:
           0.16590542 = score(doc=4384,freq=1.0), product of:
             0.3425045 = queryWeight, product of:
               2.2309616 = boost
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.01980888 = queryNorm
             0.484389 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.750224 = idf(docFreq=51, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
       0.16 = coord(4/25)