Document (#43249)

Author

Lemke, S.
Mazarakis, A.
Peters, I.

Title

Conjoint analysis of researchers' hidden preferences for bibliometrics, altmetrics, and usage metrics

Source

Journal of the Association for Information Science and Technology. 72(2021) no.6, S.777-792

Year

2021

Abstract

The amount of annually published scholarly articles is growing steadily, as is the number of indicators through which impact of publications is measured. Little is known about how the increasing variety of available metrics affects researchers' processes of selecting literature to read. We conducted ranking experiments embedded into an online survey with 247 participating researchers, most from social sciences. Participants completed series of tasks in which they were asked to rank fictitious publications regarding their expected relevance, based on their scores regarding six prototypical metrics. Through applying logistic regression, cluster analysis, and manual coding of survey answers, we obtained detailed data on how prominent metrics for research impact influence our participants in decisions about which scientific articles to read. Survey answers revealed a combination of qualitative and quantitative characteristics that researchers consult when selecting literature, while regression analysis showed that among quantitative metrics, citation counts tend to be of highest concern, followed by Journal Impact Factors. Our results suggest a comparatively favorable view of many researchers on bibliometrics and widespread skepticism toward altmetrics. The findings underline the importance of equipping researchers with solid knowledge about specific metrics' limitations, as they seem to play significant roles in researchers' everyday relevance assessments.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24445.

Theme

Informetrie

Similar documents (author)

1. Peters, C.M.: CD-ROM: its potential in libraries (1986) 4.76

   4.7649565 = sum of:
     4.7649565 = weight(author_txt:peters in 534) [ClassicSimilarity], result of:
       4.7649565 = fieldWeight in 534, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.62393 = idf(docFreq=58, maxDocs=44421)
         0.625 = fieldNorm(doc=534)
   

2. Peters, T.A.: When smart people fail : an analysis of the transaction log of an online public access catalog (1989) 4.76

   4.7649565 = sum of:
     4.7649565 = weight(author_txt:peters in 2282) [ClassicSimilarity], result of:
       4.7649565 = fieldWeight in 2282, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.62393 = idf(docFreq=58, maxDocs=44421)
         0.625 = fieldNorm(doc=2282)
   

3. Peters, C.M.: CD-ROM and optical technology : the user interface (1988) 4.76

   4.7649565 = sum of:
     4.7649565 = weight(author_txt:peters in 4012) [ClassicSimilarity], result of:
       4.7649565 = fieldWeight in 4012, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.62393 = idf(docFreq=58, maxDocs=44421)
         0.625 = fieldNorm(doc=4012)
   

4. Peters, B.F.: Online searching using speech as a man / machine interface (1989) 4.76

   4.7649565 = sum of:
     4.7649565 = weight(author_txt:peters in 4636) [ClassicSimilarity], result of:
       4.7649565 = fieldWeight in 4636, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.62393 = idf(docFreq=58, maxDocs=44421)
         0.625 = fieldNorm(doc=4636)
   

5. Peters, R.: Katalogisierung mit MIDAS (1991) 4.76

   4.7649565 = sum of:
     4.7649565 = weight(author_txt:peters in 4739) [ClassicSimilarity], result of:
       4.7649565 = fieldWeight in 4739, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.62393 = idf(docFreq=58, maxDocs=44421)
         0.625 = fieldNorm(doc=4739)
   

Similar documents (content)

1. Mohammadi, E.; Thelwall, M.; Kousha, K.: Can Mendeley bookmarks reflect readership? : a survey of user motivations (2016) 0.24

   0.2361892 = sum of:
     0.2361892 = product of:
       0.7380913 = sum of:
         0.047968432 = weight(abstract_txt:articles in 3897) [ClassicSimilarity], result of:
           0.047968432 = score(doc=3897,freq=3.0), product of:
             0.09270525 = queryWeight, product of:
               1.0849522 = boost
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.017876526 = queryNorm
             0.51742953 = fieldWeight in 3897, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.0625 = fieldNorm(doc=3897)
         0.06394552 = weight(abstract_txt:publications in 3897) [ClassicSimilarity], result of:
           0.06394552 = score(doc=3897,freq=3.0), product of:
             0.112289906 = queryWeight, product of:
               1.1940674 = boost
               5.260521 = idf(docFreq=626, maxDocs=44421)
               0.017876526 = queryNorm
             0.5694681 = fieldWeight in 3897, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.260521 = idf(docFreq=626, maxDocs=44421)
               0.0625 = fieldNorm(doc=3897)
         0.02284011 = weight(abstract_txt:about in 3897) [ClassicSimilarity], result of:
           0.02284011 = score(doc=3897,freq=1.0), product of:
             0.0933262 = queryWeight, product of:
               1.3332325 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.017876526 = queryNorm
             0.24473417 = fieldWeight in 3897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.0625 = fieldNorm(doc=3897)
         0.12268622 = weight(abstract_txt:read in 3897) [ClassicSimilarity], result of:
           0.12268622 = score(doc=3897,freq=3.0), product of:
             0.17337954 = queryWeight, product of:
               1.4837385 = boost
               6.5366817 = idf(docFreq=174, maxDocs=44421)
               0.017876526 = queryNorm
             0.7076165 = fieldWeight in 3897, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.5366817 = idf(docFreq=174, maxDocs=44421)
               0.0625 = fieldNorm(doc=3897)
         0.051447596 = weight(abstract_txt:impact in 3897) [ClassicSimilarity], result of:
           0.051447596 = score(doc=3897,freq=2.0), product of:
             0.12728333 = queryWeight, product of:
               1.5570045 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.017876526 = queryNorm
             0.40419742 = fieldWeight in 3897, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0625 = fieldNorm(doc=3897)
         0.046379738 = weight(abstract_txt:survey in 3897) [ClassicSimilarity], result of:
           0.046379738 = score(doc=3897,freq=1.0), product of:
             0.14965469 = queryWeight, product of:
               1.6882986 = boost
               4.958587 = idf(docFreq=847, maxDocs=44421)
               0.017876526 = queryNorm
             0.3099117 = fieldWeight in 3897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.958587 = idf(docFreq=847, maxDocs=44421)
               0.0625 = fieldNorm(doc=3897)
         0.16453458 = weight(abstract_txt:altmetrics in 3897) [ClassicSimilarity], result of:
           0.16453458 = score(doc=3897,freq=1.0), product of:
             0.30409727 = queryWeight, product of:
               1.9650098 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.017876526 = queryNorm
             0.5410591 = fieldWeight in 3897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=3897)
         0.21828906 = weight(abstract_txt:metrics in 3897) [ClassicSimilarity], result of:
           0.21828906 = score(doc=3897,freq=1.0), product of:
             0.5295449 = queryWeight, product of:
               4.4912834 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.017876526 = queryNorm
             0.41222012 = fieldWeight in 3897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=3897)
       0.32 = coord(8/25)
   

2. Moed, H.F.; Halevi, G.: Multidimensional assessment of scholarly research impact (2015) 0.23

   0.23116116 = sum of:
     0.23116116 = product of:
       0.8255756 = sum of:
         0.027694589 = weight(abstract_txt:articles in 3212) [ClassicSimilarity], result of:
           0.027694589 = score(doc=3212,freq=1.0), product of:
             0.09270525 = queryWeight, product of:
               1.0849522 = boost
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.017876526 = queryNorm
             0.2987381 = fieldWeight in 3212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.0625 = fieldNorm(doc=3212)
         0.018432675 = weight(abstract_txt:analysis in 3212) [ClassicSimilarity], result of:
           0.018432675 = score(doc=3212,freq=1.0), product of:
             0.080896616 = queryWeight, product of:
               1.2412786 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.017876526 = queryNorm
             0.2278547 = fieldWeight in 3212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0625 = fieldNorm(doc=3212)
         0.04429948 = weight(abstract_txt:regarding in 3212) [ClassicSimilarity], result of:
           0.04429948 = score(doc=3212,freq=1.0), product of:
             0.12679636 = queryWeight, product of:
               1.2688546 = boost
               5.59 = idf(docFreq=450, maxDocs=44421)
               0.017876526 = queryNorm
             0.349375 = fieldWeight in 3212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.59 = idf(docFreq=450, maxDocs=44421)
               0.0625 = fieldNorm(doc=3212)
         0.036378942 = weight(abstract_txt:impact in 3212) [ClassicSimilarity], result of:
           0.036378942 = score(doc=3212,freq=1.0), product of:
             0.12728333 = queryWeight, product of:
               1.5570045 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.017876526 = queryNorm
             0.28581074 = fieldWeight in 3212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0625 = fieldNorm(doc=3212)
         0.16453458 = weight(abstract_txt:altmetrics in 3212) [ClassicSimilarity], result of:
           0.16453458 = score(doc=3212,freq=1.0), product of:
             0.30409727 = queryWeight, product of:
               1.9650098 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.017876526 = queryNorm
             0.5410591 = fieldWeight in 3212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=3212)
         0.097657144 = weight(abstract_txt:researchers in 3212) [ClassicSimilarity], result of:
           0.097657144 = score(doc=3212,freq=1.0), product of:
             0.3260867 = queryWeight, product of:
               3.8067908 = boost
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.017876526 = queryNorm
             0.29948214 = fieldWeight in 3212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.0625 = fieldNorm(doc=3212)
         0.43657812 = weight(abstract_txt:metrics in 3212) [ClassicSimilarity], result of:
           0.43657812 = score(doc=3212,freq=4.0), product of:
             0.5295449 = queryWeight, product of:
               4.4912834 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.017876526 = queryNorm
             0.82444024 = fieldWeight in 3212, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=3212)
       0.28 = coord(7/25)
   

3. Aung, H.H.; Zheng, H.; Erdt, M.; Aw, A.S.; Sin, S.-C.J.; Theng, Y.-L.: Investigating familiarity and usage of traditional metrics and altmetrics (2019) 0.20

   0.20256352 = sum of:
     0.20256352 = product of:
       1.0128176 = sum of:
         0.03892399 = weight(abstract_txt:participants in 328) [ClassicSimilarity], result of:
           0.03892399 = score(doc=328,freq=1.0), product of:
             0.11631952 = queryWeight, product of:
               1.2153035 = boost
               5.3540783 = idf(docFreq=570, maxDocs=44421)
               0.017876526 = queryNorm
             0.3346299 = fieldWeight in 328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3540783 = idf(docFreq=570, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.036378942 = weight(abstract_txt:impact in 328) [ClassicSimilarity], result of:
           0.036378942 = score(doc=328,freq=1.0), product of:
             0.12728333 = queryWeight, product of:
               1.5570045 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.017876526 = queryNorm
             0.28581074 = fieldWeight in 328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.046379738 = weight(abstract_txt:survey in 328) [ClassicSimilarity], result of:
           0.046379738 = score(doc=328,freq=1.0), product of:
             0.14965469 = queryWeight, product of:
               1.6882986 = boost
               4.958587 = idf(docFreq=847, maxDocs=44421)
               0.017876526 = queryNorm
             0.3099117 = fieldWeight in 328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.958587 = idf(docFreq=847, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.40302578 = weight(abstract_txt:altmetrics in 328) [ClassicSimilarity], result of:
           0.40302578 = score(doc=328,freq=6.0), product of:
             0.30409727 = queryWeight, product of:
               1.9650098 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.017876526 = queryNorm
             1.3253187 = fieldWeight in 328, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.48810917 = weight(abstract_txt:metrics in 328) [ClassicSimilarity], result of:
           0.48810917 = score(doc=328,freq=5.0), product of:
             0.5295449 = queryWeight, product of:
               4.4912834 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.017876526 = queryNorm
             0.9217522 = fieldWeight in 328, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
       0.2 = coord(5/25)
   

4. Thelwall, M.: Web indicators for research evaluation : a practical guide (2016) 0.18

   0.18367572 = sum of:
     0.18367572 = product of:
       0.6559847 = sum of:
         0.027694589 = weight(abstract_txt:articles in 4384) [ClassicSimilarity], result of:
           0.027694589 = score(doc=4384,freq=1.0), product of:
             0.09270525 = queryWeight, product of:
               1.0849522 = boost
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.017876526 = queryNorm
             0.2987381 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7798095 = idf(docFreq=1013, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.052211296 = weight(abstract_txt:publications in 4384) [ClassicSimilarity], result of:
           0.052211296 = score(doc=4384,freq=2.0), product of:
             0.112289906 = queryWeight, product of:
               1.1940674 = boost
               5.260521 = idf(docFreq=626, maxDocs=44421)
               0.017876526 = queryNorm
             0.46496874 = fieldWeight in 4384, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.260521 = idf(docFreq=626, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.02284011 = weight(abstract_txt:about in 4384) [ClassicSimilarity], result of:
           0.02284011 = score(doc=4384,freq=1.0), product of:
             0.0933262 = queryWeight, product of:
               1.3332325 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.017876526 = queryNorm
             0.24473417 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.072757885 = weight(abstract_txt:impact in 4384) [ClassicSimilarity], result of:
           0.072757885 = score(doc=4384,freq=4.0), product of:
             0.12728333 = queryWeight, product of:
               1.5570045 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.017876526 = queryNorm
             0.5716215 = fieldWeight in 4384, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.16453458 = weight(abstract_txt:altmetrics in 4384) [ClassicSimilarity], result of:
           0.16453458 = score(doc=4384,freq=1.0), product of:
             0.30409727 = queryWeight, product of:
               1.9650098 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.017876526 = queryNorm
             0.5410591 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.097657144 = weight(abstract_txt:researchers in 4384) [ClassicSimilarity], result of:
           0.097657144 = score(doc=4384,freq=1.0), product of:
             0.3260867 = queryWeight, product of:
               3.8067908 = boost
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.017876526 = queryNorm
             0.29948214 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.791714 = idf(docFreq=1001, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
         0.21828906 = weight(abstract_txt:metrics in 4384) [ClassicSimilarity], result of:
           0.21828906 = score(doc=4384,freq=1.0), product of:
             0.5295449 = queryWeight, product of:
               4.4912834 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.017876526 = queryNorm
             0.41222012 = fieldWeight in 4384, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=4384)
       0.28 = coord(7/25)
   

5. Beyond bibliometrics : harnessing multidimensional indicators of scholarly intent (2014) 0.16

   0.16126312 = sum of:
     0.16126312 = product of:
       1.0078945 = sum of:
         0.06430949 = weight(abstract_txt:impact in 4026) [ClassicSimilarity], result of:
           0.06430949 = score(doc=4026,freq=2.0), product of:
             0.12728333 = queryWeight, product of:
               1.5570045 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.017876526 = queryNorm
             0.50524676 = fieldWeight in 4026, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.19219428 = weight(abstract_txt:bibliometrics in 4026) [ClassicSimilarity], result of:
           0.19219428 = score(doc=4026,freq=3.0), product of:
             0.20153676 = queryWeight, product of:
               1.5996891 = boost
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.017876526 = queryNorm
             0.9536438 = fieldWeight in 4026, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0475073 = idf(docFreq=104, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.20566823 = weight(abstract_txt:altmetrics in 4026) [ClassicSimilarity], result of:
           0.20566823 = score(doc=4026,freq=1.0), product of:
             0.30409727 = queryWeight, product of:
               1.9650098 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.017876526 = queryNorm
             0.67632383 = fieldWeight in 4026, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
         0.5457226 = weight(abstract_txt:metrics in 4026) [ClassicSimilarity], result of:
           0.5457226 = score(doc=4026,freq=4.0), product of:
             0.5295449 = queryWeight, product of:
               4.4912834 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.017876526 = queryNorm
             1.0305502 = fieldWeight in 4026, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.078125 = fieldNorm(doc=4026)
       0.16 = coord(4/25)