Document (#36752)

Author

Bouyssou, D.
Marchant, T.

Title

Ranking scientists and departments in a consistent manner

Source

Journal of the American Society for Information Science and Technology. 62(2011) no.9, S.1761-1769

Year

2011

Abstract

The standard data that we use when computing bibliometric rankings of scientists are their publication/ citation records, i.e., so many papers with 0 citation, so many with 1 citation, so many with 2 citations, etc. The standard data for bibliometric rankings of departments have the same structure. It is therefore tempting (and many authors gave in to temptation) to use the same method for computing rankings of scientists and rankings of departments. Depending on the method, this can yield quite surprising and unpleasant results. Indeed, with some methods, it may happen that the "best" department contains the "worst" scientists, and only them. This problem will not occur if the rankings satisfy a property called consistency, recently introduced in the literature. In this article, we explore the consequences of consistency and we characterize two families of consistent rankings.

Theme

Informetrie

Similar documents (content)

1. Hooydonk, G. Van: Standardizing relative impacts : estimating the quality of research from citation counts (1998) 0.21

   0.21404983 = sum of:
     0.21404983 = product of:
       0.76446366 = sum of:
         0.04585113 = weight(abstract_txt:method in 2791) [ClassicSimilarity], result of:
           0.04585113 = score(doc=2791,freq=2.0), product of:
             0.09224603 = queryWeight, product of:
               1.3500776 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.015187687 = queryNorm
             0.4970526 = fieldWeight in 2791, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.078125 = fieldNorm(doc=2791)
         0.065218896 = weight(abstract_txt:standard in 2791) [ClassicSimilarity], result of:
           0.065218896 = score(doc=2791,freq=3.0), product of:
             0.101921596 = queryWeight, product of:
               1.4191164 = boost
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.015187687 = queryNorm
             0.6398928 = fieldWeight in 2791, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7288613 = idf(docFreq=1066, maxDocs=44421)
               0.078125 = fieldNorm(doc=2791)
         0.037970543 = weight(abstract_txt:same in 2791) [ClassicSimilarity], result of:
           0.037970543 = score(doc=2791,freq=1.0), product of:
             0.102491744 = queryWeight, product of:
               1.4230801 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.015187687 = queryNorm
             0.37047416 = fieldWeight in 2791, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.078125 = fieldNorm(doc=2791)
         0.015663717 = weight(abstract_txt:with in 2791) [ClassicSimilarity], result of:
           0.015663717 = score(doc=2791,freq=2.0), product of:
             0.05679641 = queryWeight, product of:
               1.4981674 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.015187687 = queryNorm
             0.2757871 = fieldWeight in 2791, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=2791)
         0.14472826 = weight(abstract_txt:bibliometric in 2791) [ClassicSimilarity], result of:
           0.14472826 = score(doc=2791,freq=3.0), product of:
             0.17340149 = queryWeight, product of:
               1.8510208 = boost
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.015187687 = queryNorm
             0.8346425 = fieldWeight in 2791, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.078125 = fieldNorm(doc=2791)
         0.10818848 = weight(abstract_txt:citation in 2791) [ClassicSimilarity], result of:
           0.10818848 = score(doc=2791,freq=3.0), product of:
             0.16349395 = queryWeight, product of:
               2.2013109 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.015187687 = queryNorm
             0.6617277 = fieldWeight in 2791, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.078125 = fieldNorm(doc=2791)
         0.34684265 = weight(abstract_txt:rankings in 2791) [ClassicSimilarity], result of:
           0.34684265 = score(doc=2791,freq=1.0), product of:
             0.6459314 = queryWeight, product of:
               6.187835 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015187687 = queryNorm
             0.53696513 = fieldWeight in 2791, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=2791)
       0.28 = coord(7/25)
   

2. Abramo, G.; D'Angelo, C.A.; Viel, F.: Assessing the accuracy of the h- and g-indexes for measuring researchers' productivity (2013) 0.19

   0.18862772 = sum of:
     0.18862772 = product of:
       0.7859489 = sum of:
         0.05270099 = weight(abstract_txt:occur in 1957) [ClassicSimilarity], result of:
           0.05270099 = score(doc=1957,freq=1.0), product of:
             0.10121857 = queryWeight, product of:
               6.664515 = idf(docFreq=153, maxDocs=44421)
               0.015187687 = queryNorm
             0.5206652 = fieldWeight in 1957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.664515 = idf(docFreq=153, maxDocs=44421)
               0.078125 = fieldNorm(doc=1957)
         0.007441293 = weight(abstract_txt:this in 1957) [ClassicSimilarity], result of:
           0.007441293 = score(doc=1957,freq=1.0), product of:
             0.039584063 = queryWeight, product of:
               1.0831553 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.015187687 = queryNorm
             0.18798709 = fieldWeight in 1957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=1957)
         0.0110759195 = weight(abstract_txt:with in 1957) [ClassicSimilarity], result of:
           0.0110759195 = score(doc=1957,freq=1.0), product of:
             0.05679641 = queryWeight, product of:
               1.4981674 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.015187687 = queryNorm
             0.19501092 = fieldWeight in 1957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=1957)
         0.083558895 = weight(abstract_txt:bibliometric in 1957) [ClassicSimilarity], result of:
           0.083558895 = score(doc=1957,freq=1.0), product of:
             0.17340149 = queryWeight, product of:
               1.8510208 = boost
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.015187687 = queryNorm
             0.48188108 = fieldWeight in 1957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.078125 = fieldNorm(doc=1957)
         0.14066215 = weight(abstract_txt:scientists in 1957) [ClassicSimilarity], result of:
           0.14066215 = score(doc=1957,freq=1.0), product of:
             0.3091618 = queryWeight, product of:
               3.4953673 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.015187687 = queryNorm
             0.45497906 = fieldWeight in 1957, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.078125 = fieldNorm(doc=1957)
         0.4905096 = weight(abstract_txt:rankings in 1957) [ClassicSimilarity], result of:
           0.4905096 = score(doc=1957,freq=2.0), product of:
             0.6459314 = queryWeight, product of:
               6.187835 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015187687 = queryNorm
             0.7593834 = fieldWeight in 1957, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=1957)
       0.24 = coord(6/25)
   

3. Waltman, L.; Eck, N.J. van: ¬The inconsistency of the h-index : the case of web accessibility in Western European countries (2012) 0.17

   0.17047384 = sum of:
     0.17047384 = product of:
       0.7103077 = sum of:
         0.007441293 = weight(abstract_txt:this in 1040) [ClassicSimilarity], result of:
           0.007441293 = score(doc=1040,freq=1.0), product of:
             0.039584063 = queryWeight, product of:
               1.0831553 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.015187687 = queryNorm
             0.18798709 = fieldWeight in 1040, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.0110759195 = weight(abstract_txt:with in 1040) [ClassicSimilarity], result of:
           0.0110759195 = score(doc=1040,freq=1.0), product of:
             0.05679641 = queryWeight, product of:
               1.4981674 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.015187687 = queryNorm
             0.19501092 = fieldWeight in 1040, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.083558895 = weight(abstract_txt:bibliometric in 1040) [ClassicSimilarity], result of:
           0.083558895 = score(doc=1040,freq=1.0), product of:
             0.17340149 = queryWeight, product of:
               1.8510208 = boost
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.015187687 = queryNorm
             0.48188108 = fieldWeight in 1040, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.062462643 = weight(abstract_txt:citation in 1040) [ClassicSimilarity], result of:
           0.062462643 = score(doc=1040,freq=1.0), product of:
             0.16349395 = queryWeight, product of:
               2.2013109 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.015187687 = queryNorm
             0.38204867 = fieldWeight in 1040, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.1989263 = weight(abstract_txt:scientists in 1040) [ClassicSimilarity], result of:
           0.1989263 = score(doc=1040,freq=2.0), product of:
             0.3091618 = queryWeight, product of:
               3.4953673 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.015187687 = queryNorm
             0.6434375 = fieldWeight in 1040, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.34684265 = weight(abstract_txt:rankings in 1040) [ClassicSimilarity], result of:
           0.34684265 = score(doc=1040,freq=1.0), product of:
             0.6459314 = queryWeight, product of:
               6.187835 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015187687 = queryNorm
             0.53696513 = fieldWeight in 1040, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
       0.24 = coord(6/25)
   

4. Frittelli, M.; Mancini, L.; Peri, I.: Scientific research measures (2016) 0.17

   0.1652524 = sum of:
     0.1652524 = product of:
       0.826262 = sum of:
         0.14947471 = weight(abstract_txt:bibliometric in 4229) [ClassicSimilarity], result of:
           0.14947471 = score(doc=4229,freq=5.0), product of:
             0.17340149 = queryWeight, product of:
               1.8510208 = boost
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.015187687 = queryNorm
             0.8620151 = fieldWeight in 4229, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.0625 = fieldNorm(doc=4229)
         0.08655078 = weight(abstract_txt:citation in 4229) [ClassicSimilarity], result of:
           0.08655078 = score(doc=4229,freq=3.0), product of:
             0.16349395 = queryWeight, product of:
               2.2013109 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.015187687 = queryNorm
             0.52938217 = fieldWeight in 4229, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=4229)
         0.03868781 = weight(abstract_txt:many in 4229) [ClassicSimilarity], result of:
           0.03868781 = score(doc=4229,freq=1.0), product of:
             0.151725 = queryWeight, product of:
               2.44866 = boost
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.015187687 = queryNorm
             0.2549864 = fieldWeight in 4229, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.0625 = fieldNorm(doc=4229)
         0.15914105 = weight(abstract_txt:scientists in 4229) [ClassicSimilarity], result of:
           0.15914105 = score(doc=4229,freq=2.0), product of:
             0.3091618 = queryWeight, product of:
               3.4953673 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.015187687 = queryNorm
             0.51475 = fieldWeight in 4229, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0625 = fieldNorm(doc=4229)
         0.39240766 = weight(abstract_txt:rankings in 4229) [ClassicSimilarity], result of:
           0.39240766 = score(doc=4229,freq=2.0), product of:
             0.6459314 = queryWeight, product of:
               6.187835 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015187687 = queryNorm
             0.6075067 = fieldWeight in 4229, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=4229)
       0.2 = coord(5/25)
   

5. Holsapple, C.W.; O'Leary, D.: How much and where? : private versus public universities' publication patterns in the information systems discipline (2009) 0.16

   0.16434075 = sum of:
     0.16434075 = product of:
       0.5869312 = sum of:
         0.042284552 = weight(abstract_txt:indeed in 3719) [ClassicSimilarity], result of:
           0.042284552 = score(doc=3719,freq=1.0), product of:
             0.10141655 = queryWeight, product of:
               1.0009775 = boost
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.015187687 = queryNorm
             0.41693935 = fieldWeight in 3719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6710296 = idf(docFreq=152, maxDocs=44421)
               0.0625 = fieldNorm(doc=3719)
         0.011906069 = weight(abstract_txt:this in 3719) [ClassicSimilarity], result of:
           0.011906069 = score(doc=3719,freq=4.0), product of:
             0.039584063 = queryWeight, product of:
               1.0831553 = boost
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.015187687 = queryNorm
             0.30077934 = fieldWeight in 3719, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4062347 = idf(docFreq=10885, maxDocs=44421)
               0.0625 = fieldNorm(doc=3719)
         0.025937315 = weight(abstract_txt:method in 3719) [ClassicSimilarity], result of:
           0.025937315 = score(doc=3719,freq=1.0), product of:
             0.09224603 = queryWeight, product of:
               1.3500776 = boost
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.015187687 = queryNorm
             0.2811754 = fieldWeight in 3719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4988065 = idf(docFreq=1342, maxDocs=44421)
               0.0625 = fieldNorm(doc=3719)
         0.008860736 = weight(abstract_txt:with in 3719) [ClassicSimilarity], result of:
           0.008860736 = score(doc=3719,freq=1.0), product of:
             0.05679641 = queryWeight, product of:
               1.4981674 = boost
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.015187687 = queryNorm
             0.15600874 = fieldWeight in 3719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4961398 = idf(docFreq=9949, maxDocs=44421)
               0.0625 = fieldNorm(doc=3719)
         0.066847116 = weight(abstract_txt:bibliometric in 3719) [ClassicSimilarity], result of:
           0.066847116 = score(doc=3719,freq=1.0), product of:
             0.17340149 = queryWeight, product of:
               1.8510208 = boost
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.015187687 = queryNorm
             0.38550487 = fieldWeight in 3719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.0625 = fieldNorm(doc=3719)
         0.03868781 = weight(abstract_txt:many in 3719) [ClassicSimilarity], result of:
           0.03868781 = score(doc=3719,freq=1.0), product of:
             0.151725 = queryWeight, product of:
               2.44866 = boost
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.015187687 = queryNorm
             0.2549864 = fieldWeight in 3719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0797825 = idf(docFreq=2041, maxDocs=44421)
               0.0625 = fieldNorm(doc=3719)
         0.39240766 = weight(abstract_txt:rankings in 3719) [ClassicSimilarity], result of:
           0.39240766 = score(doc=3719,freq=2.0), product of:
             0.6459314 = queryWeight, product of:
               6.187835 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015187687 = queryNorm
             0.6075067 = fieldWeight in 3719, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3719)
       0.28 = coord(7/25)