Document (#40431)

Author

Kurtz, M.J.
Henneken, E.A.

Title

Measuring metrics : a 40-year longitudinal cross-validation of citations, downloads, and peer review in astrophysics

Source

Journal of the Association for Information Science and Technology. 68(2017) no.3, S.695-708

Year

2017

Abstract

Citation measures, and newer altmetric measures such as downloads are now commonly used to inform personnel decisions. How well do or can these measures measure or predict the past, current, or future scholarly performance of an individual? Using data from the Smithsonian/NASA Astrophysics Data System we analyze the publication, citation, download, and distinction histories of a cohort of 922 individuals who received a U.S. PhD in astronomy in the period 1972-1976. By examining the same and different measures at the same and different times for the same individuals we are able to show the capabilities and limitations of each measure. Because the distributions are lognormal, measurement uncertainties are multiplicative; we show that in order to state with 95% confidence that one person's citations and downloads are significantly higher than another person's, the log difference in the ratio of counts must be at least 0.3dex, which corresponds to a multiplicative factor of 2.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23689/full.

Theme

Informetrie

Field

Astronomie

Similar documents (author)

1. Kurtz, J.: Multicultural children's books : the subtle tug of war (1996) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:kurtz in 4841) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 4841, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=4841)
   

2. Kurtz, L.A.: Data base management systems : an introduction (1985) 6.01

   6.0137663 = sum of:
     6.0137663 = weight(author_txt:kurtz in 889) [ClassicSimilarity], result of:
       6.0137663 = fieldWeight in 889, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.625 = fieldNorm(doc=889)
   

3. Kurtz, M.; Bollen, J.: Usage bibliometrics (2010) 4.81

   4.811013 = sum of:
     4.811013 = weight(author_txt:kurtz in 206) [ClassicSimilarity], result of:
       4.811013 = fieldWeight in 206, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.5 = fieldNorm(doc=206)
   

4. Kurtz, M.J.; Eichhorn, G.; Accomazzi, A.; Grant, C.; Demleitner, M.; Murray, S.S.: Worldwide use and impact of the NASA Astrophysics Data System Digital Library (2005) 2.41

   2.4055066 = sum of:
     2.4055066 = weight(author_txt:kurtz in 4267) [ClassicSimilarity], result of:
       2.4055066 = fieldWeight in 4267, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.25 = fieldNorm(doc=4267)
   

5. Kurtz, M.J.; Eichhorn, G.; Accomazzi, A.; Grant, C.; Demleitner, D.; Murray, S.S.; Martimbeau, N.; Elwell, B.: ¬The bibliometric properties of article readership information (2005) 2.41

   2.4055066 = sum of:
     2.4055066 = weight(author_txt:kurtz in 4307) [ClassicSimilarity], result of:
       2.4055066 = fieldWeight in 4307, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.622026 = idf(docFreq=7, maxDocs=44421)
         0.25 = fieldNorm(doc=4307)
   

Similar documents (content)

1. Moed, H.F.: Statistical relationships between downloads and citations at the level of individual documents within a single journal (2005) 0.28

   0.27670547 = sum of:
     0.27670547 = product of:
       0.98823386 = sum of:
         0.048594844 = weight(abstract_txt:download in 4882) [ClassicSimilarity], result of:
           0.048594844 = score(doc=4882,freq=1.0), product of:
             0.13342829 = queryWeight, product of:
               1.0213641 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.016813818 = queryNorm
             0.36420196 = fieldWeight in 4882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.046875 = fieldNorm(doc=4882)
         0.017663214 = weight(abstract_txt:show in 4882) [ClassicSimilarity], result of:
           0.017663214 = score(doc=4882,freq=1.0), product of:
             0.08562047 = queryWeight, product of:
               1.1570721 = boost
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.016813818 = queryNorm
             0.20629662 = fieldWeight in 4882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.046875 = fieldNorm(doc=4882)
         0.092296846 = weight(abstract_txt:cohort in 4882) [ClassicSimilarity], result of:
           0.092296846 = score(doc=4882,freq=1.0), product of:
             0.20463458 = queryWeight, product of:
               1.2648706 = boost
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.016813818 = queryNorm
             0.4510325 = fieldWeight in 4882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.046875 = fieldNorm(doc=4882)
         0.06854065 = weight(abstract_txt:citation in 4882) [ClassicSimilarity], result of:
           0.06854065 = score(doc=4882,freq=8.0), product of:
             0.10571418 = queryWeight, product of:
               1.2856958 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.016813818 = queryNorm
             0.6483581 = fieldWeight in 4882, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.046875 = fieldNorm(doc=4882)
         0.06280754 = weight(abstract_txt:citations in 4882) [ClassicSimilarity], result of:
           0.06280754 = score(doc=4882,freq=4.0), product of:
             0.1256567 = queryWeight, product of:
               1.4017302 = boost
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.016813818 = queryNorm
             0.4998344 = fieldWeight in 4882, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.046875 = fieldNorm(doc=4882)
         0.033288587 = weight(abstract_txt:measure in 4882) [ClassicSimilarity], result of:
           0.033288587 = score(doc=4882,freq=1.0), product of:
             0.13063554 = queryWeight, product of:
               1.4292306 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.016813818 = queryNorm
             0.2548203 = fieldWeight in 4882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.046875 = fieldNorm(doc=4882)
         0.66504216 = weight(abstract_txt:downloads in 4882) [ClassicSimilarity], result of:
           0.66504216 = score(doc=4882,freq=14.0), product of:
             0.45682687 = queryWeight, product of:
               3.2733545 = boost
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.016813818 = queryNorm
             1.455786 = fieldWeight in 4882, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.046875 = fieldNorm(doc=4882)
       0.28 = coord(7/25)
   

2. Kurtz, M.J.; Eichhorn, G.; Accomazzi, A.; Grant, C.; Demleitner, D.; Murray, S.S.; Martimbeau, N.; Elwell, B.: ¬The bibliometric properties of article readership information (2005) 0.20

   0.19942443 = sum of:
     0.19942443 = product of:
       0.6232014 = sum of:
         0.07975361 = weight(abstract_txt:nasa in 4307) [ClassicSimilarity], result of:
           0.07975361 = score(doc=4307,freq=1.0), product of:
             0.1675162 = queryWeight, product of:
               1.144419 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.016813818 = queryNorm
             0.4760949 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.046078835 = weight(abstract_txt:show in 4307) [ClassicSimilarity], result of:
           0.046078835 = score(doc=4307,freq=5.0), product of:
             0.08562047 = queryWeight, product of:
               1.1570721 = boost
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.016813818 = queryNorm
             0.53817546 = fieldWeight in 4307, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.0489678 = weight(abstract_txt:citation in 4307) [ClassicSimilarity], result of:
           0.0489678 = score(doc=4307,freq=3.0), product of:
             0.10571418 = queryWeight, product of:
               1.2856958 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.016813818 = queryNorm
             0.4632094 = fieldWeight in 4307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.07327546 = weight(abstract_txt:citations in 4307) [ClassicSimilarity], result of:
           0.07327546 = score(doc=4307,freq=4.0), product of:
             0.1256567 = queryWeight, product of:
               1.4017302 = boost
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.016813818 = queryNorm
             0.58314013 = fieldWeight in 4307, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.06726711 = weight(abstract_txt:measure in 4307) [ClassicSimilarity], result of:
           0.06726711 = score(doc=4307,freq=3.0), product of:
             0.13063554 = queryWeight, product of:
               1.4292306 = boost
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.016813818 = queryNorm
             0.51492196 = fieldWeight in 4307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4361663 = idf(docFreq=525, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.046293538 = weight(abstract_txt:individuals in 4307) [ClassicSimilarity], result of:
           0.046293538 = score(doc=4307,freq=1.0), product of:
             0.14686337 = queryWeight, product of:
               1.5154037 = boost
               5.7639313 = idf(docFreq=378, maxDocs=44421)
               0.016813818 = queryNorm
             0.315215 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7639313 = idf(docFreq=378, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.18437675 = weight(abstract_txt:astrophysics in 4307) [ClassicSimilarity], result of:
           0.18437675 = score(doc=4307,freq=1.0), product of:
             0.36900935 = queryWeight, product of:
               2.4020956 = boost
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.016813818 = queryNorm
             0.49965334 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.1365185 = idf(docFreq=12, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
         0.07718822 = weight(abstract_txt:measures in 4307) [ClassicSimilarity], result of:
           0.07718822 = score(doc=4307,freq=1.0), product of:
             0.26018202 = queryWeight, product of:
               2.8524973 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.016813818 = queryNorm
             0.29667008 = fieldWeight in 4307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=4307)
       0.32 = coord(8/25)
   

3. Schloegl, C.; Gorraiz, J.: Global usage versus global citation metrics : the case of pharmacology journals (2011) 0.18

   0.18269321 = sum of:
     0.18269321 = product of:
       0.76122177 = sum of:
         0.08017741 = weight(abstract_txt:download in 141) [ClassicSimilarity], result of:
           0.08017741 = score(doc=141,freq=2.0), product of:
             0.13342829 = queryWeight, product of:
               1.0213641 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.016813818 = queryNorm
             0.6009026 = fieldWeight in 141, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0546875 = fieldNorm(doc=141)
         0.020607084 = weight(abstract_txt:show in 141) [ClassicSimilarity], result of:
           0.020607084 = score(doc=141,freq=1.0), product of:
             0.08562047 = queryWeight, product of:
               1.1570721 = boost
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.016813818 = queryNorm
             0.2406794 = fieldWeight in 141, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.400995 = idf(docFreq=1480, maxDocs=44421)
               0.0546875 = fieldNorm(doc=141)
         0.08481472 = weight(abstract_txt:citation in 141) [ClassicSimilarity], result of:
           0.08481472 = score(doc=141,freq=9.0), product of:
             0.10571418 = queryWeight, product of:
               1.2856958 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.016813818 = queryNorm
             0.80230224 = fieldWeight in 141, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0546875 = fieldNorm(doc=141)
         0.07327546 = weight(abstract_txt:citations in 141) [ClassicSimilarity], result of:
           0.07327546 = score(doc=141,freq=4.0), product of:
             0.1256567 = queryWeight, product of:
               1.4017302 = boost
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.016813818 = queryNorm
             0.58314013 = fieldWeight in 141, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.0546875 = fieldNorm(doc=141)
         0.038668644 = weight(abstract_txt:same in 141) [ClassicSimilarity], result of:
           0.038668644 = score(doc=141,freq=1.0), product of:
             0.1491087 = queryWeight, product of:
               1.8701167 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.016813818 = queryNorm
             0.2593319 = fieldWeight in 141, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0546875 = fieldNorm(doc=141)
         0.4636785 = weight(abstract_txt:downloads in 141) [ClassicSimilarity], result of:
           0.4636785 = score(doc=141,freq=5.0), product of:
             0.45682687 = queryWeight, product of:
               3.2733545 = boost
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.016813818 = queryNorm
             1.0149983 = fieldWeight in 141, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.0546875 = fieldNorm(doc=141)
       0.24 = coord(6/25)
   

4. Botting, N.; Dipper, L.; Hilari, K.: ¬The effect of social media promotion on academic article uptake (2017) 0.11

   0.11290909 = sum of:
     0.11290909 = product of:
       0.56454545 = sum of:
         0.11222499 = weight(abstract_txt:download in 4522) [ClassicSimilarity], result of:
           0.11222499 = score(doc=4522,freq=3.0), product of:
             0.13342829 = queryWeight, product of:
               1.0213641 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.016813818 = queryNorm
             0.8410884 = fieldWeight in 4522, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=4522)
         0.06462074 = weight(abstract_txt:citation in 4522) [ClassicSimilarity], result of:
           0.06462074 = score(doc=4522,freq=4.0), product of:
             0.10571418 = queryWeight, product of:
               1.2856958 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.016813818 = queryNorm
             0.6112779 = fieldWeight in 4522, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=4522)
         0.062497962 = weight(abstract_txt:same in 4522) [ClassicSimilarity], result of:
           0.062497962 = score(doc=4522,freq=2.0), product of:
             0.1491087 = queryWeight, product of:
               1.8701167 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.016813818 = queryNorm
             0.41914365 = fieldWeight in 4522, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=4522)
         0.08821511 = weight(abstract_txt:measures in 4522) [ClassicSimilarity], result of:
           0.08821511 = score(doc=4522,freq=1.0), product of:
             0.26018202 = queryWeight, product of:
               2.8524973 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.016813818 = queryNorm
             0.3390515 = fieldWeight in 4522, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=4522)
         0.23698665 = weight(abstract_txt:downloads in 4522) [ClassicSimilarity], result of:
           0.23698665 = score(doc=4522,freq=1.0), product of:
             0.45682687 = queryWeight, product of:
               3.2733545 = boost
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.016813818 = queryNorm
             0.5187669 = fieldWeight in 4522, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.0625 = fieldNorm(doc=4522)
       0.2 = coord(5/25)
   

5. Moed, H.F.; Halevi, G.: On full text download and citation distributions in scientific-scholarly journals (2016) 0.10

   0.097839236 = sum of:
     0.097839236 = product of:
       0.61149526 = sum of:
         0.14488183 = weight(abstract_txt:download in 3646) [ClassicSimilarity], result of:
           0.14488183 = score(doc=3646,freq=5.0), product of:
             0.13342829 = queryWeight, product of:
               1.0213641 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.016813818 = queryNorm
             1.0858405 = fieldWeight in 3646, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=3646)
         0.07224818 = weight(abstract_txt:citation in 3646) [ClassicSimilarity], result of:
           0.07224818 = score(doc=3646,freq=5.0), product of:
             0.10571418 = queryWeight, product of:
               1.2856958 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.016813818 = queryNorm
             0.6834295 = fieldWeight in 3646, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=3646)
         0.059215512 = weight(abstract_txt:citations in 3646) [ClassicSimilarity], result of:
           0.059215512 = score(doc=3646,freq=2.0), product of:
             0.1256567 = queryWeight, product of:
               1.4017302 = boost
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.016813818 = queryNorm
             0.47124836 = fieldWeight in 3646, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.0625 = fieldNorm(doc=3646)
         0.33514974 = weight(abstract_txt:downloads in 3646) [ClassicSimilarity], result of:
           0.33514974 = score(doc=3646,freq=2.0), product of:
             0.45682687 = queryWeight, product of:
               3.2733545 = boost
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.016813818 = queryNorm
             0.73364717 = fieldWeight in 3646, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.30027 = idf(docFreq=29, maxDocs=44421)
               0.0625 = fieldNorm(doc=3646)
       0.16 = coord(4/25)