Document (#39653)

Author

Dobrota, M.
Dobrota, M.

Title

ARWU ranking uncertainty and sensitivity : what if the award factor was Excluded?

Source

Journal of the Association for Information Science and Technology. 67(2016) no.2, S.480-482

Year

2016

Series

Brief communications

Abstract

The Academic Ranking of World Universities (ARWU) uses six university performance indicators, including "Alumni" and "Awards"-the number of alumni and staff winning Nobel Prizes and Fields Medals. These two indicators raised doubts about the reliability of this ranking method because they are difficult to cope with. Recently, a newsletter was published featuring a reduced ARWU ranking list, leaving out Nobel Prize and Fields Medal indicators: the Alternative Ranking (Excluding Award Factor). We used uncertainty and sensitivity analyses to examine and compare the stability and confidence of the official ARWU ranking and the Alternative Ranking. The results indicate that if the ARWU ranking is reduced to the 4-indicator Alternative Ranking, it shows greater certainty and stability in ranking universities.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23527/abstract.

Footnote

Autoren: Milan Dobrota und Marina Dobrota

Theme

Informetrie

Similar documents (content)

1. Waltman, L.; Calero-Medina, C.; Kosten, J.; Noyons, E.C.M.; Tijssen, R.J.W.; Eck, N.J. van; Leeuwen, T.N. van; Raan, A.F.J. van; Visser, M.S.; Wouters, P.: ¬The Leiden ranking 2011/2012 : data collection, indicators, and interpretation (2012) 0.22

   0.2213081 = sum of:
     0.2213081 = product of:
       1.1065404 = sum of:
         0.074007146 = weight(abstract_txt:excluding in 514) [ClassicSimilarity], result of:
           0.074007146 = score(doc=514,freq=1.0), product of:
             0.13759421 = queryWeight, product of:
               1.1994044 = boost
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.013330335 = queryNorm
             0.5378653 = fieldWeight in 514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.6058445 = idf(docFreq=21, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.093111105 = weight(abstract_txt:universities in 514) [ClassicSimilarity], result of:
           0.093111105 = score(doc=514,freq=3.0), product of:
             0.14008392 = queryWeight, product of:
               1.7114912 = boost
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.013330335 = queryNorm
             0.6646809 = fieldWeight in 514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.10138273 = weight(abstract_txt:stability in 514) [ClassicSimilarity], result of:
           0.10138273 = score(doc=514,freq=1.0), product of:
             0.21383086 = queryWeight, product of:
               2.1145391 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.013330335 = queryNorm
             0.47412583 = fieldWeight in 514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.13209304 = weight(abstract_txt:indicators in 514) [ClassicSimilarity], result of:
           0.13209304 = score(doc=514,freq=3.0), product of:
             0.20245929 = queryWeight, product of:
               2.519968 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.013330335 = queryNorm
             0.6524425 = fieldWeight in 514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
         0.7059464 = weight(abstract_txt:ranking in 514) [ClassicSimilarity], result of:
           0.7059464 = score(doc=514,freq=12.0), product of:
             0.5823782 = queryWeight, product of:
               7.8031163 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.013330335 = queryNorm
             1.2121786 = fieldWeight in 514, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=514)
       0.2 = coord(5/25)
   

2. Dobrota, M.; Bulajic, M.; Bornmann, L.; Jeremic, V.: ¬A new approach to the QS university ranking using the composite I-distance indicator : uncertainty and sensitivity analyses (2016) 0.20

   0.19688995 = sum of:
     0.19688995 = product of:
       0.8203748 = sum of:
         0.06719715 = weight(abstract_txt:universities in 2500) [ClassicSimilarity], result of:
           0.06719715 = score(doc=2500,freq=1.0), product of:
             0.14008392 = queryWeight, product of:
               1.7114912 = boost
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.013330335 = queryNorm
             0.4796921 = fieldWeight in 2500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.140059 = idf(docFreq=258, maxDocs=44218)
               0.078125 = fieldNorm(doc=2500)
         0.0971696 = weight(abstract_txt:uncertainty in 2500) [ClassicSimilarity], result of:
           0.0971696 = score(doc=2500,freq=1.0), product of:
             0.17913261 = queryWeight, product of:
               1.9353873 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.013330335 = queryNorm
             0.54244506 = fieldWeight in 2500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.078125 = fieldNorm(doc=2500)
         0.09790162 = weight(abstract_txt:reduced in 2500) [ClassicSimilarity], result of:
           0.09790162 = score(doc=2500,freq=1.0), product of:
             0.18003114 = queryWeight, product of:
               1.940235 = boost
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.013330335 = queryNorm
             0.5438038 = fieldWeight in 2500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9606886 = idf(docFreq=113, maxDocs=44218)
               0.078125 = fieldNorm(doc=2500)
         0.12672842 = weight(abstract_txt:stability in 2500) [ClassicSimilarity], result of:
           0.12672842 = score(doc=2500,freq=1.0), product of:
             0.21383086 = queryWeight, product of:
               2.1145391 = boost
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.013330335 = queryNorm
             0.59265727 = fieldWeight in 2500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5860133 = idf(docFreq=60, maxDocs=44218)
               0.078125 = fieldNorm(doc=2500)
         0.07112628 = weight(abstract_txt:alternative in 2500) [ClassicSimilarity], result of:
           0.07112628 = score(doc=2500,freq=1.0), product of:
             0.16654754 = queryWeight, product of:
               2.285574 = boost
               5.466406 = idf(docFreq=507, maxDocs=44218)
               0.013330335 = queryNorm
             0.42706296 = fieldWeight in 2500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.466406 = idf(docFreq=507, maxDocs=44218)
               0.078125 = fieldNorm(doc=2500)
         0.36025172 = weight(abstract_txt:ranking in 2500) [ClassicSimilarity], result of:
           0.36025172 = score(doc=2500,freq=2.0), product of:
             0.5823782 = queryWeight, product of:
               7.8031163 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.013330335 = queryNorm
             0.61858726 = fieldWeight in 2500, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.078125 = fieldNorm(doc=2500)
       0.24 = coord(6/25)
   

3. Rodríguez-Navarro, A.: Research assessment based on infrequent achievements : a comparison of the United States and Europe in terms of highly cited papers and Nobel Prizes (2016) 0.13

   0.12645568 = sum of:
     0.12645568 = product of:
       0.6322784 = sum of:
         0.120863296 = weight(abstract_txt:prize in 2780) [ClassicSimilarity], result of:
           0.120863296 = score(doc=2780,freq=3.0), product of:
             0.13230419 = queryWeight, product of:
               1.176122 = boost
               8.43879 = idf(docFreq=25, maxDocs=44218)
               0.013330335 = queryNorm
             0.9135258 = fieldWeight in 2780, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.43879 = idf(docFreq=25, maxDocs=44218)
               0.0625 = fieldNorm(doc=2780)
         0.15315907 = weight(abstract_txt:winning in 2780) [ClassicSimilarity], result of:
           0.15315907 = score(doc=2780,freq=3.0), product of:
             0.15493128 = queryWeight, product of:
               1.2727265 = boost
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.013330335 = queryNorm
             0.9885613 = fieldWeight in 2780, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.0625 = fieldNorm(doc=2780)
         0.029575957 = weight(abstract_txt:fields in 2780) [ClassicSimilarity], result of:
           0.029575957 = score(doc=2780,freq=1.0), product of:
             0.09405609 = queryWeight, product of:
               1.4024068 = boost
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.013330335 = queryNorm
             0.3144502 = fieldWeight in 2780, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.0625 = fieldNorm(doc=2780)
         0.2524161 = weight(abstract_txt:nobel in 2780) [ClassicSimilarity], result of:
           0.2524161 = score(doc=2780,freq=3.0), product of:
             0.2723529 = queryWeight, product of:
               2.386418 = boost
               8.561393 = idf(docFreq=22, maxDocs=44218)
               0.013330335 = queryNorm
             0.9267979 = fieldWeight in 2780, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.561393 = idf(docFreq=22, maxDocs=44218)
               0.0625 = fieldNorm(doc=2780)
         0.076263964 = weight(abstract_txt:indicators in 2780) [ClassicSimilarity], result of:
           0.076263964 = score(doc=2780,freq=1.0), product of:
             0.20245929 = queryWeight, product of:
               2.519968 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.013330335 = queryNorm
             0.37668788 = fieldWeight in 2780, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.0625 = fieldNorm(doc=2780)
       0.2 = coord(5/25)
   

4. Leydesdorff, L.: How are new citation-based journal indicators adding to the bibliometric toolbox? (2009) 0.09

   0.09138911 = sum of:
     0.09138911 = product of:
       0.57118195 = sum of:
         0.08020291 = weight(abstract_txt:factor in 2929) [ClassicSimilarity], result of:
           0.08020291 = score(doc=2929,freq=2.0), product of:
             0.12510398 = queryWeight, product of:
               1.617395 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.013330335 = queryNorm
             0.64109 = fieldWeight in 2929, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.078125 = fieldNorm(doc=2929)
         0.07112628 = weight(abstract_txt:alternative in 2929) [ClassicSimilarity], result of:
           0.07112628 = score(doc=2929,freq=1.0), product of:
             0.16654754 = queryWeight, product of:
               2.285574 = boost
               5.466406 = idf(docFreq=507, maxDocs=44218)
               0.013330335 = queryNorm
             0.42706296 = fieldWeight in 2929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.466406 = idf(docFreq=507, maxDocs=44218)
               0.078125 = fieldNorm(doc=2929)
         0.16511631 = weight(abstract_txt:indicators in 2929) [ClassicSimilarity], result of:
           0.16511631 = score(doc=2929,freq=3.0), product of:
             0.20245929 = queryWeight, product of:
               2.519968 = boost
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.013330335 = queryNorm
             0.8155531 = fieldWeight in 2929, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.027006 = idf(docFreq=289, maxDocs=44218)
               0.078125 = fieldNorm(doc=2929)
         0.25473645 = weight(abstract_txt:ranking in 2929) [ClassicSimilarity], result of:
           0.25473645 = score(doc=2929,freq=1.0), product of:
             0.5823782 = queryWeight, product of:
               7.8031163 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.013330335 = queryNorm
             0.43740726 = fieldWeight in 2929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.078125 = fieldNorm(doc=2929)
       0.16 = coord(4/25)
   

5. Aledo, J.A.; Gámez, J.A.; Molina, D.; Rosete, A.: Consensus-based journal rankings : a complementary tool for bibliometric evaluation (2018) 0.09

   0.085276715 = sum of:
     0.085276715 = product of:
       0.5329795 = sum of:
         0.045369618 = weight(abstract_txt:factor in 4364) [ClassicSimilarity], result of:
           0.045369618 = score(doc=4364,freq=1.0), product of:
             0.12510398 = queryWeight, product of:
               1.617395 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.013330335 = queryNorm
             0.36265528 = fieldWeight in 4364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
         0.077735685 = weight(abstract_txt:uncertainty in 4364) [ClassicSimilarity], result of:
           0.077735685 = score(doc=4364,freq=1.0), product of:
             0.17913261 = queryWeight, product of:
               1.9353873 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.013330335 = queryNorm
             0.43395606 = fieldWeight in 4364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
         0.056901027 = weight(abstract_txt:alternative in 4364) [ClassicSimilarity], result of:
           0.056901027 = score(doc=4364,freq=1.0), product of:
             0.16654754 = queryWeight, product of:
               2.285574 = boost
               5.466406 = idf(docFreq=507, maxDocs=44218)
               0.013330335 = queryNorm
             0.34165037 = fieldWeight in 4364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.466406 = idf(docFreq=507, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
         0.3529732 = weight(abstract_txt:ranking in 4364) [ClassicSimilarity], result of:
           0.3529732 = score(doc=4364,freq=3.0), product of:
             0.5823782 = queryWeight, product of:
               7.8031163 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.013330335 = queryNorm
             0.6060893 = fieldWeight in 4364, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=4364)
       0.16 = coord(4/25)