Document (#39501)

Author

Dobrota, M.
Bulajic, M.
Bornmann, L.
Jeremic, V.

Title

¬A new approach to the QS university ranking using the composite I-distance indicator : uncertainty and sensitivity analyses

Source

Journal of the Association for Information Science and Technology. 67(2016) no.1, S.200-211

Year

2016

Abstract

Some major concerns of universities are to provide quality in higher education and enhance global competitiveness, thus ensuring a high global rank and an excellent performance evaluation. This article examines the Quacquarelli Symonds (QS) World University Ranking methodology, pointing to a drawback of using subjective, possibly biased, weightings to build a composite indicator (QS scores). We propose an alternative approach to creating QS scores, which is referred to as the composite I-distance indicator (CIDI) methodology. The main contribution is the proposal of a composite indicator weights correction based on the CIDI methodology. It leads to the improved stability and reduced uncertainty of the QS ranking system. The CIDI methodology is also applicable to other university rankings by proposing a specific statistical approach to creating a composite indicator.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23355/abstract.

Similar documents (author)

1. Bornmann, L.: Complex tasks and simple solutions : the use of heuristics in the evaluation of research (2015) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 525) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 525, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=525)
   

2. Bornmann, L.: What is societal impact of research and how can it be assessed? : a literature survey (2013) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 1606) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 1606, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=1606)
   

3. Bornmann, L.: How to analyze percentile citation impact data meaningfully in bibliometrics : the statistical analysis of distributions, percentile rank classes, and top-cited papers (2013) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 1656) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 1656, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=1656)
   

4. Bornmann, L.: Lässt sich die Qualität von Forschung messen? (2013) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 1928) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 1928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=1928)
   

5. Bornmann, L.: On the function of university rankings (2014) 4.73

   4.7339582 = sum of:
     4.7339582 = weight(author_txt:bornmann in 2188) [ClassicSimilarity], result of:
       4.7339582 = fieldWeight in 2188, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.574333 = idf(docFreq=61, maxDocs=44421)
         0.625 = fieldNorm(doc=2188)
   

Similar documents (content)

1. Franceschet, M.: ¬A cluster analysis of scholar and journal bibliometric indicators (2009) 0.23

   0.23003493 = sum of:
     0.23003493 = product of:
       1.1501746 = sum of:
         0.06101496 = weight(abstract_txt:possibly in 96) [ClassicSimilarity], result of:
           0.06101496 = score(doc=96,freq=1.0), product of:
             0.10576838 = queryWeight, product of:
               1.0463226 = boost
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.013689885 = queryNorm
             0.57687336 = fieldWeight in 96, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3839793 = idf(docFreq=74, maxDocs=44421)
               0.078125 = fieldNorm(doc=96)
         0.0523862 = weight(abstract_txt:global in 96) [ClassicSimilarity], result of:
           0.0523862 = score(doc=96,freq=1.0), product of:
             0.1203796 = queryWeight, product of:
               1.5786256 = boost
               5.570241 = idf(docFreq=459, maxDocs=44421)
               0.013689885 = queryNorm
             0.43517506 = fieldWeight in 96, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.570241 = idf(docFreq=459, maxDocs=44421)
               0.078125 = fieldNorm(doc=96)
         0.08215814 = weight(abstract_txt:methodology in 96) [ClassicSimilarity], result of:
           0.08215814 = score(doc=96,freq=2.0), product of:
             0.16249576 = queryWeight, product of:
               2.5938132 = boost
               4.5761847 = idf(docFreq=1242, maxDocs=44421)
               0.013689885 = queryNorm
             0.50560176 = fieldWeight in 96, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5761847 = idf(docFreq=1242, maxDocs=44421)
               0.078125 = fieldNorm(doc=96)
         0.41334936 = weight(abstract_txt:indicator in 96) [ClassicSimilarity], result of:
           0.41334936 = score(doc=96,freq=3.0), product of:
             0.44897902 = queryWeight, product of:
               4.820429 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.013689885 = queryNorm
             0.9206429 = fieldWeight in 96, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.078125 = fieldNorm(doc=96)
         0.5412659 = weight(abstract_txt:composite in 96) [ClassicSimilarity], result of:
           0.5412659 = score(doc=96,freq=2.0), product of:
             0.6151562 = queryWeight, product of:
               5.6424193 = boost
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.013689885 = queryNorm
             0.8798837 = fieldWeight in 96, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.078125 = fieldNorm(doc=96)
       0.2 = coord(5/25)
   

2. Dobrota, M.; Dobrota, M.: ARWU ranking uncertainty and sensitivity : what if the award factor was Excluded? (2016) 0.19

   0.19002627 = sum of:
     0.19002627 = product of:
       0.7917761 = sum of:
         0.09313505 = weight(abstract_txt:stability in 3652) [ClassicSimilarity], result of:
           0.09313505 = score(doc=3652,freq=2.0), product of:
             0.11129195 = queryWeight, product of:
               1.0732961 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.013689885 = queryNorm
             0.83685344 = fieldWeight in 3652, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.078125 = fieldNorm(doc=3652)
         0.08465871 = weight(abstract_txt:sensitivity in 3652) [ClassicSimilarity], result of:
           0.08465871 = score(doc=3652,freq=1.0), product of:
             0.13157682 = queryWeight, product of:
               1.1670175 = boost
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.013689885 = queryNorm
             0.6434166 = fieldWeight in 3652, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.235732 = idf(docFreq=31, maxDocs=44421)
               0.078125 = fieldNorm(doc=3652)
         0.035313282 = weight(abstract_txt:university in 3652) [ClassicSimilarity], result of:
           0.035313282 = score(doc=3652,freq=1.0), product of:
             0.105941005 = queryWeight, product of:
               1.8137622 = boost
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.013689885 = queryNorm
             0.33332968 = fieldWeight in 3652, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.078125 = fieldNorm(doc=3652)
         0.100911774 = weight(abstract_txt:uncertainty in 3652) [ClassicSimilarity], result of:
           0.100911774 = score(doc=3652,freq=1.0), product of:
             0.18636721 = queryWeight, product of:
               1.9642078 = boost
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.013689885 = queryNorm
             0.5414674 = fieldWeight in 3652, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.078125 = fieldNorm(doc=3652)
         0.23910996 = weight(abstract_txt:ranking in 3652) [ClassicSimilarity], result of:
           0.23910996 = score(doc=3652,freq=9.0), product of:
             0.18228726 = queryWeight, product of:
               2.3791754 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.013689885 = queryNorm
             1.3117206 = fieldWeight in 3652, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.078125 = fieldNorm(doc=3652)
         0.23864736 = weight(abstract_txt:indicator in 3652) [ClassicSimilarity], result of:
           0.23864736 = score(doc=3652,freq=1.0), product of:
             0.44897902 = queryWeight, product of:
               4.820429 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.013689885 = queryNorm
             0.5315334 = fieldWeight in 3652, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.078125 = fieldNorm(doc=3652)
       0.24 = coord(6/25)
   

3. Waltman, L.; Calero-Medina, C.; Kosten, J.; Noyons, E.C.M.; Tijssen, R.J.W.; Eck, N.J. van; Leeuwen, T.N. van; Raan, A.F.J. van; Visser, M.S.; Wouters, P.: ¬The Leiden ranking 2011/2012 : data collection, indicators, and interpretation (2012) 0.14

   0.1422769 = sum of:
     0.1422769 = product of:
       0.5928204 = sum of:
         0.052685145 = weight(abstract_txt:stability in 1514) [ClassicSimilarity], result of:
           0.052685145 = score(doc=1514,freq=1.0), product of:
             0.11129195 = queryWeight, product of:
               1.0732961 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.013689885 = queryNorm
             0.47339582 = fieldWeight in 1514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.04190896 = weight(abstract_txt:global in 1514) [ClassicSimilarity], result of:
           0.04190896 = score(doc=1514,freq=1.0), product of:
             0.1203796 = queryWeight, product of:
               1.5786256 = boost
               5.570241 = idf(docFreq=459, maxDocs=44421)
               0.013689885 = queryNorm
             0.34814006 = fieldWeight in 1514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.570241 = idf(docFreq=459, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.039952412 = weight(abstract_txt:university in 1514) [ClassicSimilarity], result of:
           0.039952412 = score(doc=1514,freq=2.0), product of:
             0.105941005 = queryWeight, product of:
               1.8137622 = boost
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.013689885 = queryNorm
             0.37711945 = fieldWeight in 1514, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2666197 = idf(docFreq=1693, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.22088031 = weight(abstract_txt:ranking in 1514) [ClassicSimilarity], result of:
           0.22088031 = score(doc=1514,freq=12.0), product of:
             0.18228726 = queryWeight, product of:
               2.3791754 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.013689885 = queryNorm
             1.2117156 = fieldWeight in 1514, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.046475664 = weight(abstract_txt:methodology in 1514) [ClassicSimilarity], result of:
           0.046475664 = score(doc=1514,freq=1.0), product of:
             0.16249576 = queryWeight, product of:
               2.5938132 = boost
               4.5761847 = idf(docFreq=1242, maxDocs=44421)
               0.013689885 = queryNorm
             0.28601155 = fieldWeight in 1514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5761847 = idf(docFreq=1242, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
         0.1909179 = weight(abstract_txt:indicator in 1514) [ClassicSimilarity], result of:
           0.1909179 = score(doc=1514,freq=1.0), product of:
             0.44897902 = queryWeight, product of:
               4.820429 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.013689885 = queryNorm
             0.42522675 = fieldWeight in 1514, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.0625 = fieldNorm(doc=1514)
       0.24 = coord(6/25)
   

4. Rousseau, R.: Basic properties of both percentile rank scores and the I3 indicator (2012) 0.09

   0.09283543 = sum of:
     0.09283543 = product of:
       0.7736286 = sum of:
         0.105230935 = weight(abstract_txt:scores in 993) [ClassicSimilarity], result of:
           0.105230935 = score(doc=993,freq=1.0), product of:
             0.16971351 = queryWeight, product of:
               1.8743939 = boost
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.013689885 = queryNorm
             0.62005043 = fieldWeight in 993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.613871 = idf(docFreq=161, maxDocs=44421)
               0.09375 = fieldNorm(doc=993)
         0.09564398 = weight(abstract_txt:ranking in 993) [ClassicSimilarity], result of:
           0.09564398 = score(doc=993,freq=1.0), product of:
             0.18228726 = queryWeight, product of:
               2.3791754 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.013689885 = queryNorm
             0.52468824 = fieldWeight in 993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.09375 = fieldNorm(doc=993)
         0.57275367 = weight(abstract_txt:indicator in 993) [ClassicSimilarity], result of:
           0.57275367 = score(doc=993,freq=4.0), product of:
             0.44897902 = queryWeight, product of:
               4.820429 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.013689885 = queryNorm
             1.2756803 = fieldWeight in 993, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.09375 = fieldNorm(doc=993)
       0.12 = coord(3/25)
   

5. Zeynali-Tazehkandi, M.; Nowkarizi, M.: ¬ A dialectical approach to search engine evaluation (2020) 0.08

   0.077802815 = sum of:
     0.077802815 = product of:
       0.6483568 = sum of:
         0.065856434 = weight(abstract_txt:stability in 1186) [ClassicSimilarity], result of:
           0.065856434 = score(doc=1186,freq=1.0), product of:
             0.11129195 = queryWeight, product of:
               1.0732961 = boost
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.013689885 = queryNorm
             0.5917448 = fieldWeight in 1186, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.574333 = idf(docFreq=61, maxDocs=44421)
               0.078125 = fieldNorm(doc=1186)
         0.04123444 = weight(abstract_txt:approach in 1186) [ClassicSimilarity], result of:
           0.04123444 = score(doc=1186,freq=3.0), product of:
             0.081452616 = queryWeight, product of:
               1.5903797 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.013689885 = queryNorm
             0.5062384 = fieldWeight in 1186, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=1186)
         0.5412659 = weight(abstract_txt:composite in 1186) [ClassicSimilarity], result of:
           0.5412659 = score(doc=1186,freq=2.0), product of:
             0.6151562 = queryWeight, product of:
               5.6424193 = boost
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.013689885 = queryNorm
             0.8798837 = fieldWeight in 1186, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.963798 = idf(docFreq=41, maxDocs=44421)
               0.078125 = fieldNorm(doc=1186)
       0.12 = coord(3/25)