Document (#40230)

Author

Frittelli, M.
Mancini, L.
Peri, I.

Title

Scientific research measures

Source

Journal of the Association for Information Science and Technology. 67(2016) no.12, S.3051-3063

Year

2016

Abstract

The evaluation of scientific research is crucial for both the academic community and society as a whole. Numerous bibliometric indices have been proposed for the ranking of research performance, mainly on an ad hoc basis. We introduce the novel class of Scientific Research Measures (SRMs) to rank scientists' research performance and provide a rigorous theoretical foundation for these measures. In contrast to many bibliometric indices, SRMs take into account the whole citation curve of the scientist, offer appealing structural properties, allow a finer ranking of scientists, correspond to specific features of different disciplines, research areas and seniorities, and include several bibliometric indices as special cases. Thus SRMs result in more accurate rankings than ad hoc bibliometric indices. We also introduce the further general class of Dual SRMs that reflect the "value" of journals and permit the ranking of research institutions based on theoretically sound criteria, which has been a central theme in the scientific community over recent decades. An empirical application to the citation curves of 173 finance scholars shows that SRMs can be easily calibrated to actual citation curves and generate different authors' rankings than those produced by seven traditional bibliometric indices.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23530/full.

Theme

Informetrie

Similar documents (content)

1. Bornmann, L.; Mutz, R.; Daniel, H.D.: Do we need the h index and its variants in addition to standard bibliometric measures? (2009) 0.21

   0.2145517 = sum of:
     0.2145517 = product of:
       0.8939654 = sum of:
         0.0219549 = weight(abstract_txt:performance in 3861) [ClassicSimilarity], result of:
           0.0219549 = score(doc=3861,freq=1.0), product of:
             0.08690085 = queryWeight, product of:
               1.2275035 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015324347 = queryNorm
             0.25264308 = fieldWeight in 3861, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3861)
         0.043982267 = weight(abstract_txt:scientists in 3861) [ClassicSimilarity], result of:
           0.043982267 = score(doc=3861,freq=1.0), product of:
             0.13809824 = queryWeight, product of:
               1.5474079 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.015324347 = queryNorm
             0.31848535 = fieldWeight in 3861, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3861)
         0.055241533 = weight(abstract_txt:citation in 3861) [ClassicSimilarity], result of:
           0.055241533 = score(doc=3861,freq=2.0), product of:
             0.14606091 = queryWeight, product of:
               1.9490517 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.015324347 = queryNorm
             0.37820888 = fieldWeight in 3861, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3861)
         0.053323887 = weight(abstract_txt:measures in 3861) [ClassicSimilarity], result of:
           0.053323887 = score(doc=3861,freq=1.0), product of:
             0.17974137 = queryWeight, product of:
               2.162123 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.015324347 = queryNorm
             0.29667008 = fieldWeight in 3861, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3861)
         0.18474726 = weight(abstract_txt:bibliometric in 3861) [ClassicSimilarity], result of:
           0.18474726 = score(doc=3861,freq=2.0), product of:
             0.38728002 = queryWeight, product of:
               4.0972576 = boost
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.015324347 = queryNorm
             0.47703794 = fieldWeight in 3861, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3861)
         0.5347156 = weight(abstract_txt:indices in 3861) [ClassicSimilarity], result of:
           0.5347156 = score(doc=3861,freq=6.0), product of:
             0.5453574 = queryWeight, product of:
               4.862072 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.015324347 = queryNorm
             0.9804865 = fieldWeight in 3861, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3861)
       0.24 = coord(6/25)
   

2. Zhao, S.X.; Tan, A.M.; Ye, F.Y.: Distributive h-indices for measuring multilevel impact (2012) 0.21

   0.21279053 = sum of:
     0.21279053 = product of:
       1.0639527 = sum of:
         0.08725286 = weight(abstract_txt:introduce in 1460) [ClassicSimilarity], result of:
           0.08725286 = score(doc=1460,freq=1.0), product of:
             0.15221849 = queryWeight, product of:
               1.6245924 = boost
               6.114219 = idf(docFreq=266, maxDocs=44421)
               0.015324347 = queryNorm
             0.57320803 = fieldWeight in 1460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.114219 = idf(docFreq=266, maxDocs=44421)
               0.09375 = fieldNorm(doc=1460)
         0.09469978 = weight(abstract_txt:citation in 1460) [ClassicSimilarity], result of:
           0.09469978 = score(doc=1460,freq=2.0), product of:
             0.14606091 = queryWeight, product of:
               1.9490517 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.015324347 = queryNorm
             0.6483581 = fieldWeight in 1460, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.09375 = fieldNorm(doc=1460)
         0.09141238 = weight(abstract_txt:measures in 1460) [ClassicSimilarity], result of:
           0.09141238 = score(doc=1460,freq=1.0), product of:
             0.17974137 = queryWeight, product of:
               2.162123 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.015324347 = queryNorm
             0.5085773 = fieldWeight in 1460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.09375 = fieldNorm(doc=1460)
         0.042141844 = weight(abstract_txt:research in 1460) [ClassicSimilarity], result of:
           0.042141844 = score(doc=1460,freq=1.0), product of:
             0.14226978 = queryWeight, product of:
               2.9383335 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.015324347 = queryNorm
             0.2962108 = fieldWeight in 1460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.09375 = fieldNorm(doc=1460)
         0.74844587 = weight(abstract_txt:indices in 1460) [ClassicSimilarity], result of:
           0.74844587 = score(doc=1460,freq=4.0), product of:
             0.5453574 = queryWeight, product of:
               4.862072 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.015324347 = queryNorm
             1.3723952 = fieldWeight in 1460, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.09375 = fieldNorm(doc=1460)
       0.2 = coord(5/25)
   

3. Gingras, Y.: Bibliometrics and research evaluation : uses and abuses (2016) 0.19

   0.18844089 = sum of:
     0.18844089 = product of:
       0.5888778 = sum of:
         0.015011741 = weight(abstract_txt:than in 4805) [ClassicSimilarity], result of:
           0.015011741 = score(doc=4805,freq=1.0), product of:
             0.061701514 = queryWeight, product of:
               1.0343288 = boost
               3.8927383 = idf(docFreq=2461, maxDocs=44421)
               0.015324347 = queryNorm
             0.24329615 = fieldWeight in 4805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8927383 = idf(docFreq=2461, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.050265446 = weight(abstract_txt:scientists in 4805) [ClassicSimilarity], result of:
           0.050265446 = score(doc=4805,freq=1.0), product of:
             0.13809824 = queryWeight, product of:
               1.5474079 = boost
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.015324347 = queryNorm
             0.36398324 = fieldWeight in 4805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.823732 = idf(docFreq=356, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.116855346 = weight(abstract_txt:rankings in 4805) [ClassicSimilarity], result of:
           0.116855346 = score(doc=4805,freq=2.0), product of:
             0.19235235 = queryWeight, product of:
               1.8262469 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015324347 = queryNorm
             0.6075067 = fieldWeight in 4805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.044641905 = weight(abstract_txt:citation in 4805) [ClassicSimilarity], result of:
           0.044641905 = score(doc=4805,freq=1.0), product of:
             0.14606091 = queryWeight, product of:
               1.9490517 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.015324347 = queryNorm
             0.30563894 = fieldWeight in 4805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.0669186 = weight(abstract_txt:ranking in 4805) [ClassicSimilarity], result of:
           0.0669186 = score(doc=4805,freq=1.0), product of:
             0.1913096 = queryWeight, product of:
               2.2306156 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.015324347 = queryNorm
             0.34979215 = fieldWeight in 4805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.07155518 = weight(abstract_txt:scientific in 4805) [ClassicSimilarity], result of:
           0.07155518 = score(doc=4805,freq=2.0), product of:
             0.17475751 = queryWeight, product of:
               2.4617484 = boost
               4.6324444 = idf(docFreq=1174, maxDocs=44421)
               0.015324347 = queryNorm
             0.4094541 = fieldWeight in 4805, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6324444 = idf(docFreq=1174, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.074331224 = weight(abstract_txt:research in 4805) [ClassicSimilarity], result of:
           0.074331224 = score(doc=4805,freq=7.0), product of:
             0.14226978 = queryWeight, product of:
               2.9383335 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.015324347 = queryNorm
             0.5224667 = fieldWeight in 4805, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
         0.14929834 = weight(abstract_txt:bibliometric in 4805) [ClassicSimilarity], result of:
           0.14929834 = score(doc=4805,freq=1.0), product of:
             0.38728002 = queryWeight, product of:
               4.0972576 = boost
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.015324347 = queryNorm
             0.38550487 = fieldWeight in 4805, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.0625 = fieldNorm(doc=4805)
       0.32 = coord(8/25)
   

4. Song, M.; Kim, S.Y.; Lee, K.: Ensemble analysis of topical journal ranking in bioinformatics (2017) 0.17

   0.17352827 = sum of:
     0.17352827 = product of:
       0.6197438 = sum of:
         0.025091313 = weight(abstract_txt:performance in 4650) [ClassicSimilarity], result of:
           0.025091313 = score(doc=4650,freq=1.0), product of:
             0.08690085 = queryWeight, product of:
               1.2275035 = boost
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.015324347 = queryNorm
             0.28873494 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.619759 = idf(docFreq=1189, maxDocs=44421)
               0.0625 = fieldNorm(doc=4650)
         0.116855346 = weight(abstract_txt:rankings in 4650) [ClassicSimilarity], result of:
           0.116855346 = score(doc=4650,freq=2.0), product of:
             0.19235235 = queryWeight, product of:
               1.8262469 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.015324347 = queryNorm
             0.6075067 = fieldWeight in 4650, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=4650)
         0.044641905 = weight(abstract_txt:citation in 4650) [ClassicSimilarity], result of:
           0.044641905 = score(doc=4650,freq=1.0), product of:
             0.14606091 = queryWeight, product of:
               1.9490517 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.015324347 = queryNorm
             0.30563894 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=4650)
         0.060941584 = weight(abstract_txt:measures in 4650) [ClassicSimilarity], result of:
           0.060941584 = score(doc=4650,freq=1.0), product of:
             0.17974137 = queryWeight, product of:
               2.162123 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.015324347 = queryNorm
             0.3390515 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=4650)
         0.094637185 = weight(abstract_txt:ranking in 4650) [ClassicSimilarity], result of:
           0.094637185 = score(doc=4650,freq=2.0), product of:
             0.1913096 = queryWeight, product of:
               2.2306156 = boost
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.015324347 = queryNorm
             0.4946808 = fieldWeight in 4650, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5966744 = idf(docFreq=447, maxDocs=44421)
               0.0625 = fieldNorm(doc=4650)
         0.028094564 = weight(abstract_txt:research in 4650) [ClassicSimilarity], result of:
           0.028094564 = score(doc=4650,freq=1.0), product of:
             0.14226978 = queryWeight, product of:
               2.9383335 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.015324347 = queryNorm
             0.19747387 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=4650)
         0.24948196 = weight(abstract_txt:indices in 4650) [ClassicSimilarity], result of:
           0.24948196 = score(doc=4650,freq=1.0), product of:
             0.5453574 = queryWeight, product of:
               4.862072 = boost
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.015324347 = queryNorm
             0.45746505 = fieldWeight in 4650, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.319441 = idf(docFreq=79, maxDocs=44421)
               0.0625 = fieldNorm(doc=4650)
       0.28 = coord(7/25)
   

5. Kurtz, M.J.; Eichhorn, G.; Accomazzi, A.; Grant, C.; Demleitner, D.; Murray, S.S.; Martimbeau, N.; Elwell, B.: ¬The bibliometric properties of article readership information (2005) 0.17

   0.17010763 = sum of:
     0.17010763 = product of:
       0.53158635 = sum of:
         0.051449385 = weight(abstract_txt:permit in 4307) [ClassicSimilarity], result of:
           0.051449385 = score(doc=4307,freq=1.0), product of:
             0.121687666 = queryWeight, product of:
               1.0271149 = boost
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.015324347 = queryNorm
             0.4227987 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.731176 = idf(docFreq=52, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.013135273 = weight(abstract_txt:than in 4307) [ClassicSimilarity], result of:
           0.013135273 = score(doc=4307,freq=1.0), product of:
             0.061701514 = queryWeight, product of:
               1.0343288 = boost
               3.8927383 = idf(docFreq=2461, maxDocs=44421)
               0.015324347 = queryNorm
             0.21288413 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8927383 = idf(docFreq=2461, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.050897505 = weight(abstract_txt:introduce in 4307) [ClassicSimilarity], result of:
           0.050897505 = score(doc=4307,freq=1.0), product of:
             0.15221849 = queryWeight, product of:
               1.6245924 = boost
               6.114219 = idf(docFreq=266, maxDocs=44421)
               0.015324347 = queryNorm
             0.33437136 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.114219 = idf(docFreq=266, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.067656785 = weight(abstract_txt:citation in 4307) [ClassicSimilarity], result of:
           0.067656785 = score(doc=4307,freq=3.0), product of:
             0.14606091 = queryWeight, product of:
               1.9490517 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.015324347 = queryNorm
             0.4632094 = fieldWeight in 4307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.053323887 = weight(abstract_txt:measures in 4307) [ClassicSimilarity], result of:
           0.053323887 = score(doc=4307,freq=1.0), product of:
             0.17974137 = queryWeight, product of:
               2.162123 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.015324347 = queryNorm
             0.29667008 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.044272505 = weight(abstract_txt:scientific in 4307) [ClassicSimilarity], result of:
           0.044272505 = score(doc=4307,freq=1.0), product of:
             0.17475751 = queryWeight, product of:
               2.4617484 = boost
               4.6324444 = idf(docFreq=1174, maxDocs=44421)
               0.015324347 = queryNorm
             0.2533368 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6324444 = idf(docFreq=1174, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.024582742 = weight(abstract_txt:research in 4307) [ClassicSimilarity], result of:
           0.024582742 = score(doc=4307,freq=1.0), product of:
             0.14226978 = queryWeight, product of:
               2.9383335 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.015324347 = queryNorm
             0.17278963 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.22626825 = weight(abstract_txt:bibliometric in 4307) [ClassicSimilarity], result of:
           0.22626825 = score(doc=4307,freq=3.0), product of:
             0.38728002 = queryWeight, product of:
               4.0972576 = boost
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.015324347 = queryNorm
             0.58424973 = fieldWeight in 4307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.168078 = idf(docFreq=252, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
       0.32 = coord(8/25)