Document (#40126)

Author

Bohlin, L.
Esquivel, A.V.
Lancichinetti, A.
Rosvall, M.

Title

Robustness of journal rankings by network flows with different amounts of memory

Source

Journal of the Association for Information Science and Technology. 67(2016) no.10, S.2527-2535

Year

2016

Abstract

As the number of scientific journals has multiplied, journal rankings have become increasingly important for scientific decisions. From submissions and subscriptions to grants and hirings, researchers, policy makers, and funding agencies make important decisions influenced by journal rankings such as the ISI journal impact factor. Typically, the rankings are derived from the citation network between a selection of journals and unavoidably depend on this selection. However, little is known about how robust rankings are to the selection of included journals. We compare the robustness of three journal rankings based on network flows induced on citation networks. They model pathways of researchers navigating the scholarly literature, stepping between journals and remembering their previous steps to different degrees: zero-step memory as impact factor, one-step memory as Eigenfactor, and two-step memory, corresponding to zero-, first-, and second-order Markov models of citation flow between journals. We conclude that higher-order Markov models perform better and are more robust to the selection of journals. Whereas our analysis indicates that higher-order models perform better, the performance gain for higher-order Markov models comes at the cost of requiring more citation data over a longer time period.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23582/full.

Theme

Informetrie

Similar documents (content)

1. Aledo, J.A.; Gámez, J.A.; Molina, D.; Rosete, A.: Consensus-based journal rankings : a complementary tool for bibliometric evaluation (2018) 0.19

   0.19458759 = sum of:
     0.19458759 = product of:
       0.81078166 = sum of:
         0.017977333 = weight(abstract_txt:between in 364) [ClassicSimilarity], result of:
           0.017977333 = score(doc=364,freq=2.0), product of:
             0.05882759 = queryWeight, product of:
               1.077963 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0157844 = queryNorm
             0.30559355 = fieldWeight in 364, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
         0.039984684 = weight(abstract_txt:factor in 364) [ClassicSimilarity], result of:
           0.039984684 = score(doc=364,freq=1.0), product of:
             0.11032475 = queryWeight, product of:
               1.205325 = boost
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0157844 = queryNorm
             0.36242715 = fieldWeight in 364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
         0.047960922 = weight(abstract_txt:citation in 364) [ClassicSimilarity], result of:
           0.047960922 = score(doc=364,freq=1.0), product of:
             0.1569202 = queryWeight, product of:
               2.0329285 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0157844 = queryNorm
             0.30563894 = fieldWeight in 364, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
         0.1394953 = weight(abstract_txt:journal in 364) [ClassicSimilarity], result of:
           0.1394953 = score(doc=364,freq=4.0), product of:
             0.21697526 = queryWeight, product of:
               2.6726544 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0157844 = queryNorm
             0.64290875 = fieldWeight in 364, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
         0.16588719 = weight(abstract_txt:journals in 364) [ClassicSimilarity], result of:
           0.16588719 = score(doc=364,freq=4.0), product of:
             0.2588051 = queryWeight, product of:
               3.1975307 = boost
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0157844 = queryNorm
             0.64097345 = fieldWeight in 364, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
         0.39947623 = weight(abstract_txt:rankings in 364) [ClassicSimilarity], result of:
           0.39947623 = score(doc=364,freq=4.0), product of:
             0.46496993 = queryWeight, product of:
               4.2858872 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0157844 = queryNorm
             0.8591442 = fieldWeight in 364, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=364)
       0.24 = coord(6/25)
   

2. Kulczycki, E.; Huang, Y.; Zuccala, A.A.; Engels, T.C.E.; Ferrara, A.; Guns, R.; Pölönen, J.; Sivertsen, G.; Taskin, Z.; Zhang, L.: Uses of the Journal Impact Factor in national journal rankings in China and Europe (2022) 0.19

   0.19230948 = sum of:
     0.19230948 = product of:
       0.9615474 = sum of:
         0.039872054 = weight(abstract_txt:decisions in 1770) [ClassicSimilarity], result of:
           0.039872054 = score(doc=1770,freq=1.0), product of:
             0.11011747 = queryWeight, product of:
               1.2041922 = boost
               5.7933846 = idf(docFreq=367, maxDocs=44421)
               0.0157844 = queryNorm
             0.36208653 = fieldWeight in 1770, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7933846 = idf(docFreq=367, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
         0.0692555 = weight(abstract_txt:factor in 1770) [ClassicSimilarity], result of:
           0.0692555 = score(doc=1770,freq=3.0), product of:
             0.11032475 = queryWeight, product of:
               1.205325 = boost
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0157844 = queryNorm
             0.62774223 = fieldWeight in 1770, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
         0.19727613 = weight(abstract_txt:journal in 1770) [ClassicSimilarity], result of:
           0.19727613 = score(doc=1770,freq=8.0), product of:
             0.21697526 = queryWeight, product of:
               2.6726544 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0157844 = queryNorm
             0.90921026 = fieldWeight in 1770, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
         0.16588719 = weight(abstract_txt:journals in 1770) [ClassicSimilarity], result of:
           0.16588719 = score(doc=1770,freq=4.0), product of:
             0.2588051 = queryWeight, product of:
               3.1975307 = boost
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0157844 = queryNorm
             0.64097345 = fieldWeight in 1770, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
         0.48925647 = weight(abstract_txt:rankings in 1770) [ClassicSimilarity], result of:
           0.48925647 = score(doc=1770,freq=6.0), product of:
             0.46496993 = queryWeight, product of:
               4.2858872 = boost
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0157844 = queryNorm
             1.0522325 = fieldWeight in 1770, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.8731537 = idf(docFreq=124, maxDocs=44421)
               0.0625 = fieldNorm(doc=1770)
       0.2 = coord(5/25)
   

3. Franceschet, M.: ¬The large-scale structure of journal citation networks (2012) 0.18

   0.18355538 = sum of:
     0.18355538 = product of:
       0.7648141 = sum of:
         0.09268606 = weight(abstract_txt:robust in 1060) [ClassicSimilarity], result of:
           0.09268606 = score(doc=1060,freq=1.0), product of:
             0.14746623 = queryWeight, product of:
               1.3935225 = boost
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.0157844 = queryNorm
             0.62852395 = fieldWeight in 1060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.704255 = idf(docFreq=147, maxDocs=44421)
               0.09375 = fieldNorm(doc=1060)
         0.079005904 = weight(abstract_txt:network in 1060) [ClassicSimilarity], result of:
           0.079005904 = score(doc=1060,freq=3.0), product of:
             0.105223484 = queryWeight, product of:
               1.4416826 = boost
               4.6239696 = idf(docFreq=1184, maxDocs=44421)
               0.0157844 = queryNorm
             0.7508391 = fieldWeight in 1060, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6239696 = idf(docFreq=1184, maxDocs=44421)
               0.09375 = fieldNorm(doc=1060)
         0.1628909 = weight(abstract_txt:robustness in 1060) [ClassicSimilarity], result of:
           0.1628909 = score(doc=1060,freq=1.0), product of:
             0.2147571 = queryWeight, product of:
               1.6816727 = boost
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.0157844 = queryNorm
             0.758489 = fieldWeight in 1060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.090549 = idf(docFreq=36, maxDocs=44421)
               0.09375 = fieldNorm(doc=1060)
         0.124606125 = weight(abstract_txt:citation in 1060) [ClassicSimilarity], result of:
           0.124606125 = score(doc=1060,freq=3.0), product of:
             0.1569202 = queryWeight, product of:
               2.0329285 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0157844 = queryNorm
             0.7940732 = fieldWeight in 1060, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.09375 = fieldNorm(doc=1060)
         0.18120968 = weight(abstract_txt:journal in 1060) [ClassicSimilarity], result of:
           0.18120968 = score(doc=1060,freq=3.0), product of:
             0.21697526 = queryWeight, product of:
               2.6726544 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0157844 = queryNorm
             0.8351629 = fieldWeight in 1060, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.09375 = fieldNorm(doc=1060)
         0.1244154 = weight(abstract_txt:journals in 1060) [ClassicSimilarity], result of:
           0.1244154 = score(doc=1060,freq=1.0), product of:
             0.2588051 = queryWeight, product of:
               3.1975307 = boost
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0157844 = queryNorm
             0.4807301 = fieldWeight in 1060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.09375 = fieldNorm(doc=1060)
       0.24 = coord(6/25)
   

4. Zhang, C.; Liu, X.; Xu, Y.(C.); Wang, Y.: Quality-structure index : a new metric to measure scientific journal influence (2011) 0.18

   0.17956774 = sum of:
     0.17956774 = product of:
       0.6413134 = sum of:
         0.091335826 = weight(abstract_txt:eigenfactor in 366) [ClassicSimilarity], result of:
           0.091335826 = score(doc=366,freq=1.0), product of:
             0.15187791 = queryWeight, product of:
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0157844 = queryNorm
             0.60137665 = fieldWeight in 366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.622026 = idf(docFreq=7, maxDocs=44421)
               0.0625 = fieldNorm(doc=366)
         0.012711893 = weight(abstract_txt:between in 366) [ClassicSimilarity], result of:
           0.012711893 = score(doc=366,freq=1.0), product of:
             0.05882759 = queryWeight, product of:
               1.077963 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0157844 = queryNorm
             0.21608727 = fieldWeight in 366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=366)
         0.039984684 = weight(abstract_txt:factor in 366) [ClassicSimilarity], result of:
           0.039984684 = score(doc=366,freq=1.0), product of:
             0.11032475 = queryWeight, product of:
               1.205325 = boost
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0157844 = queryNorm
             0.36242715 = fieldWeight in 366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7988343 = idf(docFreq=365, maxDocs=44421)
               0.0625 = fieldNorm(doc=366)
         0.043005366 = weight(abstract_txt:network in 366) [ClassicSimilarity], result of:
           0.043005366 = score(doc=366,freq=2.0), product of:
             0.105223484 = queryWeight, product of:
               1.4416826 = boost
               4.6239696 = idf(docFreq=1184, maxDocs=44421)
               0.0157844 = queryNorm
             0.40870503 = fieldWeight in 366, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6239696 = idf(docFreq=1184, maxDocs=44421)
               0.0625 = fieldNorm(doc=366)
         0.06782699 = weight(abstract_txt:citation in 366) [ClassicSimilarity], result of:
           0.06782699 = score(doc=366,freq=2.0), product of:
             0.1569202 = queryWeight, product of:
               2.0329285 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0157844 = queryNorm
             0.43223873 = fieldWeight in 366, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=366)
         0.22056143 = weight(abstract_txt:journal in 366) [ClassicSimilarity], result of:
           0.22056143 = score(doc=366,freq=10.0), product of:
             0.21697526 = queryWeight, product of:
               2.6726544 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0157844 = queryNorm
             1.016528 = fieldWeight in 366, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0625 = fieldNorm(doc=366)
         0.16588719 = weight(abstract_txt:journals in 366) [ClassicSimilarity], result of:
           0.16588719 = score(doc=366,freq=4.0), product of:
             0.2588051 = queryWeight, product of:
               3.1975307 = boost
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0157844 = queryNorm
             0.64097345 = fieldWeight in 366, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0625 = fieldNorm(doc=366)
       0.28 = coord(7/25)
   

5. Yan, E.: Disciplinary knowledge production and diffusion in science (2016) 0.16

   0.16102488 = sum of:
     0.16102488 = product of:
       0.57508886 = sum of:
         0.012711893 = weight(abstract_txt:between in 4092) [ClassicSimilarity], result of:
           0.012711893 = score(doc=4092,freq=1.0), product of:
             0.05882759 = queryWeight, product of:
               1.077963 = boost
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0157844 = queryNorm
             0.21608727 = fieldWeight in 4092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4573963 = idf(docFreq=3804, maxDocs=44421)
               0.0625 = fieldNorm(doc=4092)
         0.10648791 = weight(abstract_txt:flows in 4092) [ClassicSimilarity], result of:
           0.10648791 = score(doc=4092,freq=1.0), product of:
             0.21197145 = queryWeight, product of:
               1.6707304 = boost
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.0157844 = queryNorm
             0.5023691 = fieldWeight in 4092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.0625 = fieldNorm(doc=4092)
         0.047629643 = weight(abstract_txt:higher in 4092) [ClassicSimilarity], result of:
           0.047629643 = score(doc=4092,freq=1.0), product of:
             0.14191419 = queryWeight, product of:
               1.6742729 = boost
               5.3699656 = idf(docFreq=561, maxDocs=44421)
               0.0157844 = queryNorm
             0.33562285 = fieldWeight in 4092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3699656 = idf(docFreq=561, maxDocs=44421)
               0.0625 = fieldNorm(doc=4092)
         0.13808835 = weight(abstract_txt:step in 4092) [ClassicSimilarity], result of:
           0.13808835 = score(doc=4092,freq=4.0), product of:
             0.18177143 = queryWeight, product of:
               1.8948556 = boost
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.0157844 = queryNorm
             0.7596813 = fieldWeight in 4092, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.0774503 = idf(docFreq=276, maxDocs=44421)
               0.0625 = fieldNorm(doc=4092)
         0.117479794 = weight(abstract_txt:citation in 4092) [ClassicSimilarity], result of:
           0.117479794 = score(doc=4092,freq=6.0), product of:
             0.1569202 = queryWeight, product of:
               2.0329285 = boost
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0157844 = queryNorm
             0.7486595 = fieldWeight in 4092, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.890223 = idf(docFreq=907, maxDocs=44421)
               0.0625 = fieldNorm(doc=4092)
         0.06974765 = weight(abstract_txt:journal in 4092) [ClassicSimilarity], result of:
           0.06974765 = score(doc=4092,freq=1.0), product of:
             0.21697526 = queryWeight, product of:
               2.6726544 = boost
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0157844 = queryNorm
             0.32145438 = fieldWeight in 4092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.14327 = idf(docFreq=704, maxDocs=44421)
               0.0625 = fieldNorm(doc=4092)
         0.082943596 = weight(abstract_txt:journals in 4092) [ClassicSimilarity], result of:
           0.082943596 = score(doc=4092,freq=1.0), product of:
             0.2588051 = queryWeight, product of:
               3.1975307 = boost
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0157844 = queryNorm
             0.32048672 = fieldWeight in 4092, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1277876 = idf(docFreq=715, maxDocs=44421)
               0.0625 = fieldNorm(doc=4092)
       0.28 = coord(7/25)