Document (#40797)

Author

Farys, R.
Wolbring, T.

Title

Matched control groups for modeling events in citation data : an illustration of nobel prize effects in citation networks

Source

Journal of the Association for Information Science and Technology. 68(2017) no.9, S.2201-2210

Year

2017

Abstract

Bibliometric data are frequently used to study the effects of events, such as the honoring of a scholar with an award, and to investigate changes of citation impact over time. However, the number of yearly citations depends upon time for multiple reasons: a) general time trends in citation data, b) changing coverage of databases, c) individual citation life-cycles, and d) selection on citation impact. Hence, it is often ill-advised to simply compare the average number of citations before and after an event to estimate its causal effect. Using a recent publication in this journal on the potential citation chain reaction of a Nobel Prize, we demonstrate that a simple pre-post comparison can lead to biased and misleading results. We propose using matched control groups to improve causal inference and illustrate that the inclusion of a tailor-made synthetic control group in the statistical analysis helps to avoid methodological artifacts. Our results suggest that there is neither a Nobel Prize effect as regards citation impact of the Nobel laureate under investigation nor a related chain reaction in the citation network, as suggested in the original study. Finally, we explain that these methodological recommendations extend far beyond the study of Nobel Prize effects in citation data.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23781/full. Der Beitrag ist frei verfügbar.

Theme

Informetrie

Similar documents (content)

1. Frandsen, T.F.; Nicolaisen, J.: ¬The ripple effect : citation chain reactions of a nobel prize (2013) 0.59

   0.5899635 = sum of:
     0.5899635 = product of:
       1.8436359 = sum of:
         0.011253773 = weight(abstract_txt:that in 1654) [ClassicSimilarity], result of:
           0.011253773 = score(doc=1654,freq=3.0), product of:
             0.03516643 = queryWeight, product of:
               1.1571397 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012850597 = queryNorm
             0.32001466 = fieldWeight in 1654, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=1654)
         0.052641638 = weight(abstract_txt:citations in 1654) [ClassicSimilarity], result of:
           0.052641638 = score(doc=1654,freq=2.0), product of:
             0.08936543 = queryWeight, product of:
               1.3043418 = boost
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.012850597 = queryNorm
             0.5890604 = fieldWeight in 1654, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.078125 = fieldNorm(doc=1654)
         0.087405875 = weight(abstract_txt:effect in 1654) [ClassicSimilarity], result of:
           0.087405875 = score(doc=1654,freq=5.0), product of:
             0.09232734 = queryWeight, product of:
               1.325781 = boost
               5.419201 = idf(docFreq=534, maxDocs=44421)
               0.012850597 = queryNorm
             0.94669545 = fieldWeight in 1654, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.419201 = idf(docFreq=534, maxDocs=44421)
               0.078125 = fieldNorm(doc=1654)
         0.13157736 = weight(abstract_txt:chain in 1654) [ClassicSimilarity], result of:
           0.13157736 = score(doc=1654,freq=2.0), product of:
             0.16459022 = queryWeight, product of:
               1.7701442 = boost
               7.2355595 = idf(docFreq=86, maxDocs=44421)
               0.012850597 = queryNorm
             0.79942393 = fieldWeight in 1654, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.2355595 = idf(docFreq=86, maxDocs=44421)
               0.078125 = fieldNorm(doc=1654)
         0.131398 = weight(abstract_txt:reaction in 1654) [ClassicSimilarity], result of:
           0.131398 = score(doc=1654,freq=1.0), product of:
             0.2071822 = queryWeight, product of:
               1.9860165 = boost
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.012850597 = queryNorm
             0.63421476 = fieldWeight in 1654, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.117949 = idf(docFreq=35, maxDocs=44421)
               0.078125 = fieldNorm(doc=1654)
         0.5121393 = weight(abstract_txt:prize in 1654) [ClassicSimilarity], result of:
           0.5121393 = score(doc=1654,freq=3.0), product of:
             0.44825134 = queryWeight, product of:
               4.131259 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.012850597 = queryNorm
             1.1425271 = fieldWeight in 1654, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.078125 = fieldNorm(doc=1654)
         0.668468 = weight(abstract_txt:nobel in 1654) [ClassicSimilarity], result of:
           0.668468 = score(doc=1654,freq=3.0), product of:
             0.5767044 = queryWeight, product of:
               5.2390585 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.012850597 = queryNorm
             1.1591172 = fieldWeight in 1654, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.078125 = fieldNorm(doc=1654)
         0.24875195 = weight(abstract_txt:citation in 1654) [ClassicSimilarity], result of:
           0.24875195 = score(doc=1654,freq=3.0), product of:
             0.37591285 = queryWeight, product of:
               5.981846 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.012850597 = queryNorm
             0.6617277 = fieldWeight in 1654, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.078125 = fieldNorm(doc=1654)
       0.32 = coord(8/25)
   

2. Yan, E.; Chen, Z.; Li, K.: Authors' status and the perceived quality of their work : measuring citation sentiment change in nobel articles (2020) 0.43

   0.4255745 = sum of:
     0.4255745 = product of:
       1.7732272 = sum of:
         0.014675362 = weight(abstract_txt:study in 670) [ClassicSimilarity], result of:
           0.014675362 = score(doc=670,freq=1.0), product of:
             0.05500256 = queryWeight, product of:
               1.2532673 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.012850597 = queryNorm
             0.26681235 = fieldWeight in 670, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.078125 = fieldNorm(doc=670)
         0.035231955 = weight(abstract_txt:impact in 670) [ClassicSimilarity], result of:
           0.035231955 = score(doc=670,freq=1.0), product of:
             0.09861618 = queryWeight, product of:
               1.6781329 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.012850597 = queryNorm
             0.35726342 = fieldWeight in 670, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.078125 = fieldNorm(doc=670)
         0.062719025 = weight(abstract_txt:control in 670) [ClassicSimilarity], result of:
           0.062719025 = score(doc=670,freq=2.0), product of:
             0.11496877 = queryWeight, product of:
               1.8119333 = boost
               4.9375825 = idf(docFreq=865, maxDocs=44421)
               0.012850597 = queryNorm
             0.545531 = fieldWeight in 670, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9375825 = idf(docFreq=865, maxDocs=44421)
               0.078125 = fieldNorm(doc=670)
         0.5121393 = weight(abstract_txt:prize in 670) [ClassicSimilarity], result of:
           0.5121393 = score(doc=670,freq=3.0), product of:
             0.44825134 = queryWeight, product of:
               4.131259 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.012850597 = queryNorm
             1.1425271 = fieldWeight in 670, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.078125 = fieldNorm(doc=670)
         0.9453565 = weight(abstract_txt:nobel in 670) [ClassicSimilarity], result of:
           0.9453565 = score(doc=670,freq=6.0), product of:
             0.5767044 = queryWeight, product of:
               5.2390585 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.012850597 = queryNorm
             1.6392393 = fieldWeight in 670, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.078125 = fieldNorm(doc=670)
         0.2031051 = weight(abstract_txt:citation in 670) [ClassicSimilarity], result of:
           0.2031051 = score(doc=670,freq=2.0), product of:
             0.37591285 = queryWeight, product of:
               5.981846 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.012850597 = queryNorm
             0.5402984 = fieldWeight in 670, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.078125 = fieldNorm(doc=670)
       0.24 = coord(6/25)
   

3. Liu, Y.; Rousseau, R.: Towards a representation of diffusion and interaction of scientific ideas : the case of fiber optics communication (2012) 0.32

   0.32274753 = sum of:
     0.32274753 = product of:
       1.1526698 = sum of:
         0.011026402 = weight(abstract_txt:that in 3723) [ClassicSimilarity], result of:
           0.011026402 = score(doc=3723,freq=2.0), product of:
             0.03516643 = queryWeight, product of:
               1.1571397 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012850597 = queryNorm
             0.31354907 = fieldWeight in 3723, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.09375 = fieldNorm(doc=3723)
         0.017610434 = weight(abstract_txt:study in 3723) [ClassicSimilarity], result of:
           0.017610434 = score(doc=3723,freq=1.0), product of:
             0.05500256 = queryWeight, product of:
               1.2532673 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.012850597 = queryNorm
             0.3201748 = fieldWeight in 3723, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.09375 = fieldNorm(doc=3723)
         0.031568952 = weight(abstract_txt:time in 3723) [ClassicSimilarity], result of:
           0.031568952 = score(doc=3723,freq=1.0), product of:
             0.0811664 = queryWeight, product of:
               1.5224408 = boost
               4.1487055 = idf(docFreq=1905, maxDocs=44421)
               0.012850597 = queryNorm
             0.38894114 = fieldWeight in 3723, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1487055 = idf(docFreq=1905, maxDocs=44421)
               0.09375 = fieldNorm(doc=3723)
         0.030789101 = weight(abstract_txt:data in 3723) [ClassicSimilarity], result of:
           0.030789101 = score(doc=3723,freq=2.0), product of:
             0.0697328 = queryWeight, product of:
               1.6294467 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.012850597 = queryNorm
             0.4415297 = fieldWeight in 3723, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.09375 = fieldNorm(doc=3723)
         0.35482052 = weight(abstract_txt:prize in 3723) [ClassicSimilarity], result of:
           0.35482052 = score(doc=3723,freq=1.0), product of:
             0.44825134 = queryWeight, product of:
               4.131259 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.012850597 = queryNorm
             0.791566 = fieldWeight in 3723, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.09375 = fieldNorm(doc=3723)
         0.4631282 = weight(abstract_txt:nobel in 3723) [ClassicSimilarity], result of:
           0.4631282 = score(doc=3723,freq=1.0), product of:
             0.5767044 = queryWeight, product of:
               5.2390585 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.012850597 = queryNorm
             0.80306 = fieldWeight in 3723, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.09375 = fieldNorm(doc=3723)
         0.24372613 = weight(abstract_txt:citation in 3723) [ClassicSimilarity], result of:
           0.24372613 = score(doc=3723,freq=2.0), product of:
             0.37591285 = queryWeight, product of:
               5.981846 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.012850597 = queryNorm
             0.6483581 = fieldWeight in 3723, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.09375 = fieldNorm(doc=3723)
       0.28 = coord(7/25)
   

4. Liu, Y.; Rousseau, R.: Citation analysis and the development of science : a case study using articles by some Nobel prize winners (2014) 0.31

   0.31047893 = sum of:
     0.31047893 = product of:
       1.2936622 = sum of:
         0.009096317 = weight(abstract_txt:that in 2197) [ClassicSimilarity], result of:
           0.009096317 = score(doc=2197,freq=1.0), product of:
             0.03516643 = queryWeight, product of:
               1.1571397 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.012850597 = queryNorm
             0.2586648 = fieldWeight in 2197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.109375 = fieldNorm(doc=2197)
         0.020545507 = weight(abstract_txt:study in 2197) [ClassicSimilarity], result of:
           0.020545507 = score(doc=2197,freq=1.0), product of:
             0.05500256 = queryWeight, product of:
               1.2532673 = boost
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.012850597 = queryNorm
             0.3735373 = fieldWeight in 2197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.109375 = fieldNorm(doc=2197)
         0.025399713 = weight(abstract_txt:data in 2197) [ClassicSimilarity], result of:
           0.025399713 = score(doc=2197,freq=1.0), product of:
             0.0697328 = queryWeight, product of:
               1.6294467 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.012850597 = queryNorm
             0.36424342 = fieldWeight in 2197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.109375 = fieldNorm(doc=2197)
         0.41395727 = weight(abstract_txt:prize in 2197) [ClassicSimilarity], result of:
           0.41395727 = score(doc=2197,freq=1.0), product of:
             0.44825134 = queryWeight, product of:
               4.131259 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.012850597 = queryNorm
             0.9234937 = fieldWeight in 2197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.109375 = fieldNorm(doc=2197)
         0.5403163 = weight(abstract_txt:nobel in 2197) [ClassicSimilarity], result of:
           0.5403163 = score(doc=2197,freq=1.0), product of:
             0.5767044 = queryWeight, product of:
               5.2390585 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.012850597 = queryNorm
             0.93690336 = fieldWeight in 2197, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.109375 = fieldNorm(doc=2197)
         0.28434715 = weight(abstract_txt:citation in 2197) [ClassicSimilarity], result of:
           0.28434715 = score(doc=2197,freq=2.0), product of:
             0.37591285 = queryWeight, product of:
               5.981846 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.012850597 = queryNorm
             0.75641775 = fieldWeight in 2197, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.109375 = fieldNorm(doc=2197)
       0.24 = coord(6/25)
   

5. Ho, Y.-S.; Kahn, M.: ¬A bibliometric study of highly cited reviews in the Science Citation Index expanded(TM) (2014) 0.26

   0.2587924 = sum of:
     0.2587924 = product of:
       0.9242586 = sum of:
         0.05834731 = weight(abstract_txt:cycles in 2203) [ClassicSimilarity], result of:
           0.05834731 = score(doc=2203,freq=1.0), product of:
             0.11106328 = queryWeight, product of:
               1.0281982 = boost
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.012850597 = queryNorm
             0.52535194 = fieldWeight in 2203, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.405631 = idf(docFreq=26, maxDocs=44421)
               0.0625 = fieldNorm(doc=2203)
         0.04211331 = weight(abstract_txt:citations in 2203) [ClassicSimilarity], result of:
           0.04211331 = score(doc=2203,freq=2.0), product of:
             0.08936543 = queryWeight, product of:
               1.3043418 = boost
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.012850597 = queryNorm
             0.47124836 = fieldWeight in 2203, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.331567 = idf(docFreq=583, maxDocs=44421)
               0.0625 = fieldNorm(doc=2203)
         0.020526068 = weight(abstract_txt:data in 2203) [ClassicSimilarity], result of:
           0.020526068 = score(doc=2203,freq=2.0), product of:
             0.0697328 = queryWeight, product of:
               1.6294467 = boost
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.012850597 = queryNorm
             0.29435313 = fieldWeight in 2203, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3302255 = idf(docFreq=4320, maxDocs=44421)
               0.0625 = fieldNorm(doc=2203)
         0.028185563 = weight(abstract_txt:impact in 2203) [ClassicSimilarity], result of:
           0.028185563 = score(doc=2203,freq=1.0), product of:
             0.09861618 = queryWeight, product of:
               1.6781329 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.012850597 = queryNorm
             0.28581074 = fieldWeight in 2203, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0625 = fieldNorm(doc=2203)
         0.23654702 = weight(abstract_txt:prize in 2203) [ClassicSimilarity], result of:
           0.23654702 = score(doc=2203,freq=1.0), product of:
             0.44825134 = queryWeight, product of:
               4.131259 = boost
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.012850597 = queryNorm
             0.5277107 = fieldWeight in 2203, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.443371 = idf(docFreq=25, maxDocs=44421)
               0.0625 = fieldNorm(doc=2203)
         0.30875215 = weight(abstract_txt:nobel in 2203) [ClassicSimilarity], result of:
           0.30875215 = score(doc=2203,freq=1.0), product of:
             0.5767044 = queryWeight, product of:
               5.2390585 = boost
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.012850597 = queryNorm
             0.53537333 = fieldWeight in 2203, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.565973 = idf(docFreq=22, maxDocs=44421)
               0.0625 = fieldNorm(doc=2203)
         0.2297872 = weight(abstract_txt:citation in 2203) [ClassicSimilarity], result of:
           0.2297872 = score(doc=2203,freq=4.0), product of:
             0.37591285 = queryWeight, product of:
               5.981846 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.012850597 = queryNorm
             0.6112779 = fieldWeight in 2203, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=2203)
       0.28 = coord(7/25)