Document (#39653)

Author

Dobrota, M.
Dobrota, M.

Title

ARWU ranking uncertainty and sensitivity : what if the award factor was Excluded?

Source

Journal of the Association for Information Science and Technology. 67(2016) no.2, S.480-482

Year

2016

Series

Brief communications

Abstract

The Academic Ranking of World Universities (ARWU) uses six university performance indicators, including "Alumni" and "Awards"-the number of alumni and staff winning Nobel Prizes and Fields Medals. These two indicators raised doubts about the reliability of this ranking method because they are difficult to cope with. Recently, a newsletter was published featuring a reduced ARWU ranking list, leaving out Nobel Prize and Fields Medal indicators: the Alternative Ranking (Excluding Award Factor). We used uncertainty and sensitivity analyses to examine and compare the stability and confidence of the official ARWU ranking and the Alternative Ranking. The results indicate that if the ARWU ranking is reduced to the 4-indicator Alternative Ranking, it shows greater certainty and stability in ranking universities.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23527/abstract.

Footnote

Autoren: Milan Dobrota und Marina Dobrota

Theme

Informetrie

Similar documents (content)

1. Waltman, L.; Calero-Medina, C.; Kosten, J.; Noyons, E.C.M.; Tijssen, R.J.W.; Eck, N.J. van; Leeuwen, T.N. van; Raan, A.F.J. van; Visser, M.S.; Wouters, P.: ¬The Leiden ranking 2011/2012 : data collection, indicators, and interpretation (2012) 0.22

   0.22094026 = sum of:
     0.22094026 = product of:
       1.1047013 = sum of:
         0.07301815 = weight(abstract_txt:excluding in 1514) [ClassicSimilarity], result of:
           0.07301815 = score(doc=1514,freq=1.0), product of:
             0.13638735 = queryWeight, product of:
               1.194885 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.013325124 = queryNorm
             0.53537333 = fieldWeight in 1514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.09301403 = weight(abstract_txt:universities in 1514) [ClassicSimilarity], result of:
           0.09301403 = score(doc=1514,freq=3.0), product of:
             0.14000884 = queryWeight, product of:
               1.7121105 = boost
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.013325124 = queryNorm
             0.664344 = fieldWeight in 1514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.10096339 = weight(abstract_txt:stability in 1514) [ClassicSimilarity], result of:
           0.10096339 = score(doc=1514,freq=1.0), product of:
             0.21327478 = queryWeight, product of:
               2.1131184 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.013325124 = queryNorm
             0.47339582 = fieldWeight in 1514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.13223107 = weight(abstract_txt:indicators in 1514) [ClassicSimilarity], result of:
           0.13223107 = score(doc=1514,freq=3.0), product of:
             0.20263255 = queryWeight, product of:
               2.5226343 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.013325124 = queryNorm
             0.6525658 = fieldWeight in 1514, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.7054747 = weight(abstract_txt:ranking in 1514) [ClassicSimilarity], result of:
           0.7054747 = score(doc=1514,freq=12.0), product of:
             0.58221143 = queryWeight, product of:
               7.806915 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.013325124 = queryNorm
             1.2117156 = fieldWeight in 1514, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
       0.2 = coord(5/25)
   

2. Dobrota, M.; Bulajic, M.; Bornmann, L.; Jeremic, V.: ¬A new approach to the QS university ranking using the composite I-distance indicator : uncertainty and sensitivity analyses (2016) 0.20

   0.19648324 = sum of:
     0.19648324 = product of:
       0.81868017 = sum of:
         0.0671271 = weight(abstract_txt:universities in 3500) [ClassicSimilarity], result of:
           0.0671271 = score(doc=3500,freq=1.0), product of:
             0.14000884 = queryWeight, product of:
               1.7121105 = boost
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.013325124 = queryNorm
             0.479449 = fieldWeight in 3500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.136947 = idf(docFreq=260, maxDocs=44421)
               0.078125 = fieldNorm(doc=3500)
         0.09669134 = weight(abstract_txt:uncertainty in 3500) [ClassicSimilarity], result of:
           0.09669134 = score(doc=3500,freq=1.0), product of:
             0.17857277 = queryWeight, product of:
               1.933578 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.013325124 = queryNorm
             0.5414674 = fieldWeight in 3500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.078125 = fieldNorm(doc=3500)
         0.098141894 = weight(abstract_txt:reduced in 3500) [ClassicSimilarity], result of:
           0.098141894 = score(doc=3500,freq=1.0), product of:
             0.1803543 = queryWeight, product of:
               1.9431992 = boost
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.013325124 = queryNorm
             0.5441617 = fieldWeight in 3500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.965269 = idf(docFreq=113, maxDocs=44421)
               0.078125 = fieldNorm(doc=3500)
         0.12620424 = weight(abstract_txt:stability in 3500) [ClassicSimilarity], result of:
           0.12620424 = score(doc=3500,freq=1.0), product of:
             0.21327478 = queryWeight, product of:
               2.1131184 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.013325124 = queryNorm
             0.5917448 = fieldWeight in 3500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.078125 = fieldNorm(doc=3500)
         0.07050454 = weight(abstract_txt:alternative in 3500) [ClassicSimilarity], result of:
           0.07050454 = score(doc=3500,freq=1.0), product of:
             0.16560191 = queryWeight, product of:
               2.280512 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.013325124 = queryNorm
             0.42574716 = fieldWeight in 3500, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.078125 = fieldNorm(doc=3500)
         0.360011 = weight(abstract_txt:ranking in 3500) [ClassicSimilarity], result of:
           0.360011 = score(doc=3500,freq=2.0), product of:
             0.58221143 = queryWeight, product of:
               7.806915 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.013325124 = queryNorm
             0.618351 = fieldWeight in 3500, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.078125 = fieldNorm(doc=3500)
       0.24 = coord(6/25)
   

3. Rodríguez-Navarro, A.: Research assessment based on infrequent achievements : a comparison of the United States and Europe in terms of highly cited papers and Nobel Prizes (2016) 0.13

   0.12666295 = sum of:
     0.12666295 = product of:
       0.6333147 = sum of:
         0.12111807 = weight(abstract_txt:prize in 3780) [ClassicSimilarity], result of:
           0.12111807 = score(doc=3780,freq=3.0), product of:
             0.13251115 = queryWeight, product of:
               1.177783 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.013325124 = queryNorm
             0.9140217 = fieldWeight in 3780, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.0625 = fieldNorm(doc=3780)
         0.15346293 = weight(abstract_txt:winning in 3780) [ClassicSimilarity], result of:
           0.15346293 = score(doc=3780,freq=3.0), product of:
             0.15516084 = queryWeight, product of:
               1.2744715 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.013325124 = queryNorm
             0.9890571 = fieldWeight in 3780, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0625 = fieldNorm(doc=3780)
         0.029447798 = weight(abstract_txt:fields in 3780) [ClassicSimilarity], result of:
           0.029447798 = score(doc=3780,freq=1.0), product of:
             0.09379912 = queryWeight, product of:
               1.4013721 = boost
               5.0231256 = idf(docFreq=794, maxDocs=44421)
               0.013325124 = queryNorm
             0.31394535 = fieldWeight in 3780, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0231256 = idf(docFreq=794, maxDocs=44421)
               0.0625 = fieldNorm(doc=3780)
         0.25294226 = weight(abstract_txt:nobel in 3780) [ClassicSimilarity], result of:
           0.25294226 = score(doc=3780,freq=3.0), product of:
             0.2727747 = queryWeight, product of:
               2.38977 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.013325124 = queryNorm
             0.9272938 = fieldWeight in 3780, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.0625 = fieldNorm(doc=3780)
         0.07634364 = weight(abstract_txt:indicators in 3780) [ClassicSimilarity], result of:
           0.07634364 = score(doc=3780,freq=1.0), product of:
             0.20263255 = queryWeight, product of:
               2.5226343 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.013325124 = queryNorm
             0.37675902 = fieldWeight in 3780, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=3780)
       0.2 = coord(5/25)
   

4. Leydesdorff, L.: How are new citation-based journal indicators adding to the bibliometric toolbox? (2009) 0.09

   0.091271915 = sum of:
     0.091271915 = product of:
       0.5704495 = sum of:
         0.08008991 = weight(abstract_txt:factor in 3929) [ClassicSimilarity], result of:
           0.08008991 = score(doc=3929,freq=2.0), product of:
             0.12500635 = queryWeight, product of:
               1.6177824 = boost
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.013325124 = queryNorm
             0.64068675 = fieldWeight in 3929, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.078125 = fieldNorm(doc=3929)
         0.07050454 = weight(abstract_txt:alternative in 3929) [ClassicSimilarity], result of:
           0.07050454 = score(doc=3929,freq=1.0), product of:
             0.16560191 = queryWeight, product of:
               2.280512 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.013325124 = queryNorm
             0.42574716 = fieldWeight in 3929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.078125 = fieldNorm(doc=3929)
         0.16528884 = weight(abstract_txt:indicators in 3929) [ClassicSimilarity], result of:
           0.16528884 = score(doc=3929,freq=3.0), product of:
             0.20263255 = queryWeight, product of:
               2.5226343 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.013325124 = queryNorm
             0.8157072 = fieldWeight in 3929, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.078125 = fieldNorm(doc=3929)
         0.25456622 = weight(abstract_txt:ranking in 3929) [ClassicSimilarity], result of:
           0.25456622 = score(doc=3929,freq=1.0), product of:
             0.58221143 = queryWeight, product of:
               7.806915 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.013325124 = queryNorm
             0.43724018 = fieldWeight in 3929, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.078125 = fieldNorm(doc=3929)
       0.16 = coord(4/25)
   

5. Aledo, J.A.; Gámez, J.A.; Molina, D.; Rosete, A.: Consensus-based journal rankings : a complementary tool for bibliometric evaluation (2018) 0.09

   0.085087955 = sum of:
     0.085087955 = product of:
       0.53179973 = sum of:
         0.045305695 = weight(abstract_txt:factor in 364) [ClassicSimilarity], result of:
           0.045305695 = score(doc=364,freq=1.0), product of:
             0.12500635 = queryWeight, product of:
               1.6177824 = boost
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.013325124 = queryNorm
             0.36242715 = fieldWeight in 364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
         0.07735307 = weight(abstract_txt:uncertainty in 364) [ClassicSimilarity], result of:
           0.07735307 = score(doc=364,freq=1.0), product of:
             0.17857277 = queryWeight, product of:
               1.933578 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.013325124 = queryNorm
             0.43317392 = fieldWeight in 364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
         0.056403633 = weight(abstract_txt:alternative in 364) [ClassicSimilarity], result of:
           0.056403633 = score(doc=364,freq=1.0), product of:
             0.16560191 = queryWeight, product of:
               2.280512 = boost
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.013325124 = queryNorm
             0.34059772 = fieldWeight in 364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4495635 = idf(docFreq=518, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
         0.35273734 = weight(abstract_txt:ranking in 364) [ClassicSimilarity], result of:
           0.35273734 = score(doc=364,freq=3.0), product of:
             0.58221143 = queryWeight, product of:
               7.806915 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.013325124 = queryNorm
             0.6058578 = fieldWeight in 364, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
       0.16 = coord(4/25)