Document (#37958)

Author

Abramo, G.
D'Angelo, C.A.
Viel, F.

Title

Assessing the accuracy of the h- and g-indexes for measuring researchers' productivity

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.6, S.1224-1234

Year

2013

Abstract

Bibliometric indicators are increasingly used in support of decisions about recruitment, career advancement, rewards, and selective funding for scientists. Given the importance of the applications, bibliometricians are obligated to carry out empirical testing of the robustness of the indicators, in simulations of real contexts. In this work, we compare the results of national-scale research assessments at the individual level, based on the following three different indexes: the h-index, the g-index, and "fractional scientific strength" (FSS), an indicator previously proposed by the authors. For each index, we construct and compare rankings lists of all Italian academic researchers working in the hard sciences during the period 2001-2005. The analysis quantifies the shifts in ranks that occur when researchers' productivity rankings by simple indicators such as the h- or g-indexes are compared with those by more accurate FSS.

Theme

Informetrie

Object

g-index
h-index
FSS

Similar documents (author)

1. Abramo, G.; D'Angelo, C.A.: ¬A decision support system for public research organizations participating in national research assessment exercises (2009) 6.68

   6.6832643 = sum of:
     6.6832643 = sum of:
       3.2857614 = weight(author_txt:d'angelo in 110) [ClassicSimilarity], result of:
         3.2857614 = score(doc=110,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           4.6994414 = fieldWeight in 110, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.5 = fieldNorm(doc=110)
       3.397503 = weight(author_txt:abramo in 110) [ClassicSimilarity], result of:
         3.397503 = score(doc=110,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           4.7521214 = fieldWeight in 110, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.5 = fieldNorm(doc=110)
   

2. Abramo, G.; D'Angelo, C.A.: ¬The VQR, Italy's second national research assessment : methodological failures and ranking distortions (2015) 6.68

   6.6832643 = sum of:
     6.6832643 = sum of:
       3.2857614 = weight(author_txt:d'angelo in 3256) [ClassicSimilarity], result of:
         3.2857614 = score(doc=3256,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           4.6994414 = fieldWeight in 3256, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.5 = fieldNorm(doc=3256)
       3.397503 = weight(author_txt:abramo in 3256) [ClassicSimilarity], result of:
         3.397503 = score(doc=3256,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           4.7521214 = fieldWeight in 3256, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.5 = fieldNorm(doc=3256)
   

3. Abramo, G.; D'Angelo, C.A.; Di Costa, F.: Testing the trade-off between productivity and quality in research activities (2009) 5.01

   5.0124483 = sum of:
     5.0124483 = sum of:
       2.464321 = weight(author_txt:d'angelo in 304) [ClassicSimilarity], result of:
         2.464321 = score(doc=304,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           3.524581 = fieldWeight in 304, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.375 = fieldNorm(doc=304)
       2.5481274 = weight(author_txt:abramo in 304) [ClassicSimilarity], result of:
         2.5481274 = score(doc=304,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           3.5640912 = fieldWeight in 304, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.375 = fieldNorm(doc=304)
   

4. Abramo, G.; D'Angelo, C.A.; Viel, F.: ¬A robust benchmark for the h- and g-indexes (2010) 5.01

   5.0124483 = sum of:
     5.0124483 = sum of:
       2.464321 = weight(author_txt:d'angelo in 457) [ClassicSimilarity], result of:
         2.464321 = score(doc=457,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           3.524581 = fieldWeight in 457, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.375 = fieldNorm(doc=457)
       2.5481274 = weight(author_txt:abramo in 457) [ClassicSimilarity], result of:
         2.5481274 = score(doc=457,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           3.5640912 = fieldWeight in 457, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.375 = fieldNorm(doc=457)
   

5. D'Angelo, C.A.; Giuffrida, C.; Abramo, G.: ¬A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments (2011) 5.01

   5.0124483 = sum of:
     5.0124483 = sum of:
       2.464321 = weight(author_txt:d'angelo in 190) [ClassicSimilarity], result of:
         2.464321 = score(doc=190,freq=1.0), product of:
           0.69918126 = queryWeight, product of:
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.07438982 = queryNorm
           3.524581 = fieldWeight in 190, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.398883 = idf(docFreq=9, maxDocs=44421)
             0.375 = fieldNorm(doc=190)
       2.5481274 = weight(author_txt:abramo in 190) [ClassicSimilarity], result of:
         2.5481274 = score(doc=190,freq=1.0), product of:
           0.7149445 = queryWeight, product of:
             1.0112098 = boost
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.07438982 = queryNorm
           3.5640912 = fieldWeight in 190, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.504243 = idf(docFreq=8, maxDocs=44421)
             0.375 = fieldNorm(doc=190)
   

Similar documents (content)

1. Waltman, L.; Eck, N.J. van: ¬The inconsistency of the h-index : the case of web accessibility in Western European countries (2012) 0.14

   0.13882035 = sum of:
     0.13882035 = product of:
       0.69410175 = sum of:
         0.065748475 = weight(abstract_txt:assessing in 1040) [ClassicSimilarity], result of:
           0.065748475 = score(doc=1040,freq=1.0), product of:
             0.12603062 = queryWeight, product of:
               6.677587 = idf(docFreq=151, maxDocs=44421)
               0.018873677 = queryNorm
             0.5216865 = fieldWeight in 1040, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.677587 = idf(docFreq=151, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.13908447 = weight(abstract_txt:indicator in 1040) [ClassicSimilarity], result of:
           0.13908447 = score(doc=1040,freq=4.0), product of:
             0.13083324 = queryWeight, product of:
               1.0188752 = boost
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.018873677 = queryNorm
             1.0630668 = fieldWeight in 1040, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.803628 = idf(docFreq=133, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.14339207 = weight(abstract_txt:rankings in 1040) [ClassicSimilarity], result of:
           0.14339207 = score(doc=1040,freq=1.0), product of:
             0.26704168 = queryWeight, product of:
               2.058574 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.018873677 = queryNorm
             0.53696513 = fieldWeight in 1040, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.20076615 = weight(abstract_txt:index in 1040) [ClassicSimilarity], result of:
           0.20076615 = score(doc=1040,freq=8.0), product of:
             0.19128887 = queryWeight, product of:
               2.1338675 = boost
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.018873677 = queryNorm
             1.0495443 = fieldWeight in 1040, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
         0.14511059 = weight(abstract_txt:indicators in 1040) [ClassicSimilarity], result of:
           0.14511059 = score(doc=1040,freq=1.0), product of:
             0.30812395 = queryWeight, product of:
               2.7082286 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.018873677 = queryNorm
             0.4709488 = fieldWeight in 1040, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.078125 = fieldNorm(doc=1040)
       0.2 = coord(5/25)
   

2. Abramo, G.; D'Angelo, C.A.; Viel, F.: ¬A robust benchmark for the h- and g-indexes (2010) 0.13

   0.13266383 = sum of:
     0.13266383 = product of:
       0.55276597 = sum of:
         0.06537807 = weight(abstract_txt:italian in 457) [ClassicSimilarity], result of:
           0.06537807 = score(doc=457,freq=1.0), product of:
             0.1456958 = queryWeight, product of:
               1.0751907 = boost
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.018873677 = queryNorm
             0.44872993 = fieldWeight in 457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.179679 = idf(docFreq=91, maxDocs=44421)
               0.0625 = fieldNorm(doc=457)
         0.088224076 = weight(abstract_txt:compare in 457) [ClassicSimilarity], result of:
           0.088224076 = score(doc=457,freq=2.0), product of:
             0.17791684 = queryWeight, product of:
               1.6802949 = boost
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.018873677 = queryNorm
             0.49587253 = fieldWeight in 457, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.0625 = fieldNorm(doc=457)
         0.11090317 = weight(abstract_txt:productivity in 457) [ClassicSimilarity], result of:
           0.11090317 = score(doc=457,freq=1.0), product of:
             0.26109484 = queryWeight, product of:
               2.0355234 = boost
               6.7961926 = idf(docFreq=134, maxDocs=44421)
               0.018873677 = queryNorm
             0.42476204 = fieldWeight in 457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7961926 = idf(docFreq=134, maxDocs=44421)
               0.0625 = fieldNorm(doc=457)
         0.05678524 = weight(abstract_txt:index in 457) [ClassicSimilarity], result of:
           0.05678524 = score(doc=457,freq=1.0), product of:
             0.19128887 = queryWeight, product of:
               2.1338675 = boost
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.018873677 = queryNorm
             0.29685596 = fieldWeight in 457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.0625 = fieldNorm(doc=457)
         0.058305696 = weight(abstract_txt:researchers in 457) [ClassicSimilarity], result of:
           0.058305696 = score(doc=457,freq=1.0), product of:
             0.1946884 = queryWeight, product of:
               2.1527452 = boost
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.018873677 = queryNorm
             0.29948214 = fieldWeight in 457, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.0625 = fieldNorm(doc=457)
         0.17316975 = weight(abstract_txt:indexes in 457) [ClassicSimilarity], result of:
           0.17316975 = score(doc=457,freq=3.0), product of:
             0.27891615 = queryWeight, product of:
               2.5766737 = boost
               5.735321 = idf(docFreq=389, maxDocs=44421)
               0.018873677 = queryNorm
             0.6208667 = fieldWeight in 457, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.735321 = idf(docFreq=389, maxDocs=44421)
               0.0625 = fieldNorm(doc=457)
       0.24 = coord(6/25)
   

3. Egghe, L.: Mathematical theory of the h- and g-index in case of fractional counting of authorship (2008) 0.12

   0.12238159 = sum of:
     0.12238159 = product of:
       0.76488495 = sum of:
         0.09534656 = weight(abstract_txt:ranks in 3004) [ClassicSimilarity], result of:
           0.09534656 = score(doc=3004,freq=1.0), product of:
             0.16146894 = queryWeight, product of:
               1.1318958 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.018873677 = queryNorm
             0.59049475 = fieldWeight in 3004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.078125 = fieldNorm(doc=3004)
         0.3301325 = weight(abstract_txt:fractional in 3004) [ClassicSimilarity], result of:
           0.3301325 = score(doc=3004,freq=6.0), product of:
             0.20337336 = queryWeight, product of:
               1.2703079 = boost
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.018873677 = queryNorm
             1.623283 = fieldWeight in 3004, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.482592 = idf(docFreq=24, maxDocs=44421)
               0.078125 = fieldNorm(doc=3004)
         0.122943655 = weight(abstract_txt:index in 3004) [ClassicSimilarity], result of:
           0.122943655 = score(doc=3004,freq=3.0), product of:
             0.19128887 = queryWeight, product of:
               2.1338675 = boost
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.018873677 = queryNorm
             0.642712 = fieldWeight in 3004, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.078125 = fieldNorm(doc=3004)
         0.2164622 = weight(abstract_txt:indexes in 3004) [ClassicSimilarity], result of:
           0.2164622 = score(doc=3004,freq=3.0), product of:
             0.27891615 = queryWeight, product of:
               2.5766737 = boost
               5.735321 = idf(docFreq=389, maxDocs=44421)
               0.018873677 = queryNorm
             0.7760834 = fieldWeight in 3004, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.735321 = idf(docFreq=389, maxDocs=44421)
               0.078125 = fieldNorm(doc=3004)
       0.16 = coord(4/25)
   

4. Archambault, E.; Campbell, D; Gingras, Y.; Larivière, V.: Comparing bibliometric statistics obtained from the Web of Science and Scopus (2009) 0.12

   0.119415976 = sum of:
     0.119415976 = product of:
       0.5970799 = sum of:
         0.07627725 = weight(abstract_txt:ranks in 3933) [ClassicSimilarity], result of:
           0.07627725 = score(doc=3933,freq=1.0), product of:
             0.16146894 = queryWeight, product of:
               1.1318958 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.018873677 = queryNorm
             0.4723958 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.0625 = fieldNorm(doc=3933)
         0.15736806 = weight(abstract_txt:bibliometricians in 3933) [ClassicSimilarity], result of:
           0.15736806 = score(doc=3933,freq=1.0), product of:
             0.2616797 = queryWeight, product of:
               1.4409436 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.018873677 = queryNorm
             0.60137665 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=3933)
         0.06238384 = weight(abstract_txt:compare in 3933) [ClassicSimilarity], result of:
           0.06238384 = score(doc=3933,freq=1.0), product of:
             0.17791684 = queryWeight, product of:
               1.6802949 = boost
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.018873677 = queryNorm
             0.35063484 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6101575 = idf(docFreq=441, maxDocs=44421)
               0.0625 = fieldNorm(doc=3933)
         0.0999796 = weight(abstract_txt:indexes in 3933) [ClassicSimilarity], result of:
           0.0999796 = score(doc=3933,freq=1.0), product of:
             0.27891615 = queryWeight, product of:
               2.5766737 = boost
               5.735321 = idf(docFreq=389, maxDocs=44421)
               0.018873677 = queryNorm
             0.35845757 = fieldWeight in 3933, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.735321 = idf(docFreq=389, maxDocs=44421)
               0.0625 = fieldNorm(doc=3933)
         0.20107114 = weight(abstract_txt:indicators in 3933) [ClassicSimilarity], result of:
           0.20107114 = score(doc=3933,freq=3.0), product of:
             0.30812395 = queryWeight, product of:
               2.7082286 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.018873677 = queryNorm
             0.6525658 = fieldWeight in 3933, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.0625 = fieldNorm(doc=3933)
       0.2 = coord(5/25)
   

5. James, J.: Digital preparedness versus the digital divide : a confusion of means and ends (2008) 0.12

   0.11566912 = sum of:
     0.11566912 = product of:
       0.722932 = sum of:
         0.16635478 = weight(abstract_txt:productivity in 2616) [ClassicSimilarity], result of:
           0.16635478 = score(doc=2616,freq=1.0), product of:
             0.26109484 = queryWeight, product of:
               2.0355234 = boost
               6.7961926 = idf(docFreq=134, maxDocs=44421)
               0.018873677 = queryNorm
             0.6371431 = fieldWeight in 2616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.7961926 = idf(docFreq=134, maxDocs=44421)
               0.09375 = fieldNorm(doc=2616)
         0.17035574 = weight(abstract_txt:index in 2616) [ClassicSimilarity], result of:
           0.17035574 = score(doc=2616,freq=4.0), product of:
             0.19128887 = queryWeight, product of:
               2.1338675 = boost
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.018873677 = queryNorm
             0.8905679 = fieldWeight in 2616, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.7496953 = idf(docFreq=1044, maxDocs=44421)
               0.09375 = fieldNorm(doc=2616)
         0.21208875 = weight(abstract_txt:indexes in 2616) [ClassicSimilarity], result of:
           0.21208875 = score(doc=2616,freq=2.0), product of:
             0.27891615 = queryWeight, product of:
               2.5766737 = boost
               5.735321 = idf(docFreq=389, maxDocs=44421)
               0.018873677 = queryNorm
             0.7604033 = fieldWeight in 2616, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.735321 = idf(docFreq=389, maxDocs=44421)
               0.09375 = fieldNorm(doc=2616)
         0.1741327 = weight(abstract_txt:indicators in 2616) [ClassicSimilarity], result of:
           0.1741327 = score(doc=2616,freq=1.0), product of:
             0.30812395 = queryWeight, product of:
               2.7082286 = boost
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.018873677 = queryNorm
             0.5651385 = fieldWeight in 2616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0281444 = idf(docFreq=290, maxDocs=44421)
               0.09375 = fieldNorm(doc=2616)
       0.16 = coord(4/25)