Document (#40636)

Author

Mayernik, M.S.
Hart, D.L.
Maull, K.E.
Weber, N.M.

Title

Assessing and tracing the outcomes and impact of research infrastructures

Source

Journal of the Association for Information Science and Technology. 68(2017) no.6, S.1341-1359

Year

2017

Series

AIS reviews

Abstract

Recent policy shifts on the part of funding agencies and journal publishers are causing changes in the acknowledgment and citation behaviors of scholars. A growing emphasis on open science and reproducibility is changing how authors cite and acknowledge "research infrastructures"-entities that are used as inputs to or as underlying foundations for scholarly research, including data sets, software packages, computational models, observational platforms, and computing facilities. At the same time, stakeholder interest in quantitative understanding of impact is spurring increased collection and analysis of metrics related to use of research infrastructures. This article reviews work spanning several decades on tracing and assessing the outcomes and impacts from these kinds of research infrastructures. We discuss how research infrastructures are identified and referenced by scholars in the research literature and how those references are being collected and analyzed for the purposes of evaluating impact. Synthesizing common features of a wide range of studies, we identify notable challenges that impede the analysis of impact metrics for research infrastructures and outline key open research questions that can guide future research and applications related to such metrics.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23721/full.

Theme

Informetrie

Similar documents (author)

1. Hart, R.L.: Information gathering among the faculty of a comprehensive college : formality and globality (1997) 2.53

   2.5273218 = sum of:
     2.5273218 = product of:
       5.0546436 = sum of:
         5.0546436 = weight(author_txt:hart in 636) [ClassicSimilarity], result of:
           5.0546436 = score(doc=636,freq=1.0), product of:
             0.85092837 = queryWeight, product of:
               1.2727714 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07034368 = queryNorm
             5.9401517 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.625 = fieldNorm(doc=636)
       0.5 = coord(1/2)
   

2. Hart, G.: Information literacy education : a new role for public libraries (1998) 2.53

   2.5273218 = sum of:
     2.5273218 = product of:
       5.0546436 = sum of:
         5.0546436 = weight(author_txt:hart in 4356) [ClassicSimilarity], result of:
           5.0546436 = score(doc=4356,freq=1.0), product of:
             0.85092837 = queryWeight, product of:
               1.2727714 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07034368 = queryNorm
             5.9401517 = fieldWeight in 4356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.625 = fieldNorm(doc=4356)
       0.5 = coord(1/2)
   

3. Hart, A.: RDA made simple : a practical guide to the new cataloging rules (2014) 2.53

   2.5273218 = sum of:
     2.5273218 = product of:
       5.0546436 = sum of:
         5.0546436 = weight(author_txt:hart in 3807) [ClassicSimilarity], result of:
           5.0546436 = score(doc=3807,freq=1.0), product of:
             0.85092837 = queryWeight, product of:
               1.2727714 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07034368 = queryNorm
             5.9401517 = fieldWeight in 3807, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.625 = fieldNorm(doc=3807)
       0.5 = coord(1/2)
   

4. Hart, J.L.; Miller, J.P.: Migrating databases : CD-ROM vs. the Internet (1997) 2.02

   2.0218575 = sum of:
     2.0218575 = product of:
       4.043715 = sum of:
         4.043715 = weight(author_txt:hart in 1030) [ClassicSimilarity], result of:
           4.043715 = score(doc=1030,freq=1.0), product of:
             0.85092837 = queryWeight, product of:
               1.2727714 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07034368 = queryNorm
             4.7521214 = fieldWeight in 1030, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.5 = fieldNorm(doc=1030)
       0.5 = coord(1/2)
   

5. Hart, P.E.; Graham, J.: Query-free information retrieval (1997) 2.02

   2.0218575 = sum of:
     2.0218575 = product of:
       4.043715 = sum of:
         4.043715 = weight(author_txt:hart in 3289) [ClassicSimilarity], result of:
           4.043715 = score(doc=3289,freq=1.0), product of:
             0.85092837 = queryWeight, product of:
               1.2727714 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.07034368 = queryNorm
             4.7521214 = fieldWeight in 3289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.5 = fieldNorm(doc=3289)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Hocker, J.; Schindler, C.; Rittberger, M.: Participatory design for ontologies : a case study of an open science ontology for qualitative coding schemas (2020) 0.14

   0.14310127 = sum of:
     0.14310127 = product of:
       0.5962553 = sum of:
         0.00440363 = weight(abstract_txt:that in 1180) [ClassicSimilarity], result of:
           0.00440363 = score(doc=1180,freq=1.0), product of:
             0.03404893 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014397405 = queryNorm
             0.1293324 = fieldWeight in 1180, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1180)
         0.015209352 = weight(abstract_txt:analysis in 1180) [ClassicSimilarity], result of:
           0.015209352 = score(doc=1180,freq=2.0), product of:
             0.053942323 = queryWeight, product of:
               1.0277026 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.014397405 = queryNorm
             0.2819558 = fieldWeight in 1180, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1180)
         0.05554254 = weight(abstract_txt:open in 1180) [ClassicSimilarity], result of:
           0.05554254 = score(doc=1180,freq=5.0), product of:
             0.09425253 = queryWeight, product of:
               1.3584671 = boost
               4.8190303 = idf(docFreq=974, maxDocs=44421)
               0.014397405 = queryNorm
             0.58929497 = fieldWeight in 1180, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.8190303 = idf(docFreq=974, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1180)
         0.059535783 = weight(abstract_txt:outcomes in 1180) [ClassicSimilarity], result of:
           0.059535783 = score(doc=1180,freq=1.0), product of:
             0.16880472 = queryWeight, product of:
               1.8180044 = boost
               6.449194 = idf(docFreq=190, maxDocs=44421)
               0.014397405 = queryNorm
             0.35269028 = fieldWeight in 1180, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.449194 = idf(docFreq=190, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1180)
         0.07827186 = weight(abstract_txt:research in 1180) [ClassicSimilarity], result of:
           0.07827186 = score(doc=1180,freq=5.0), product of:
             0.20258297 = queryWeight, product of:
               4.4533734 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014397405 = queryNorm
             0.38636938 = fieldWeight in 1180, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1180)
         0.3832921 = weight(abstract_txt:infrastructures in 1180) [ClassicSimilarity], result of:
           0.3832921 = score(doc=1180,freq=2.0), product of:
             0.66872805 = queryWeight, product of:
               6.267409 = boost
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.014397405 = queryNorm
             0.5731659 = fieldWeight in 1180, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1180)
       0.24 = coord(6/25)
   

2. Marín-Arraiza, P.: ORCID in the Open Science scenario : opportunities for academic libraries (2019) 0.13

   0.13284932 = sum of:
     0.13284932 = product of:
       0.83030826 = sum of:
         0.028153183 = weight(abstract_txt:related in 704) [ClassicSimilarity], result of:
           0.028153183 = score(doc=704,freq=1.0), product of:
             0.07153118 = queryWeight, product of:
               1.183451 = boost
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.014397405 = queryNorm
             0.39357919 = fieldWeight in 704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.198178 = idf(docFreq=1813, maxDocs=44421)
               0.09375 = fieldNorm(doc=704)
         0.060219746 = weight(abstract_txt:open in 704) [ClassicSimilarity], result of:
           0.060219746 = score(doc=704,freq=2.0), product of:
             0.09425253 = queryWeight, product of:
               1.3584671 = boost
               4.8190303 = idf(docFreq=974, maxDocs=44421)
               0.014397405 = queryNorm
             0.6389192 = fieldWeight in 704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8190303 = idf(docFreq=974, maxDocs=44421)
               0.09375 = fieldNorm(doc=704)
         0.08486309 = weight(abstract_txt:research in 704) [ClassicSimilarity], result of:
           0.08486309 = score(doc=704,freq=2.0), product of:
             0.20258297 = queryWeight, product of:
               4.4533734 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014397405 = queryNorm
             0.41890535 = fieldWeight in 704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.09375 = fieldNorm(doc=704)
         0.65707225 = weight(abstract_txt:infrastructures in 704) [ClassicSimilarity], result of:
           0.65707225 = score(doc=704,freq=2.0), product of:
             0.66872805 = queryWeight, product of:
               6.267409 = boost
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.014397405 = queryNorm
             0.9825702 = fieldWeight in 704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.09375 = fieldNorm(doc=704)
       0.16 = coord(4/25)
   

3. Aung, H.H.; Zheng, H.; Erdt, M.; Aw, A.S.; Sin, S.-C.J.; Theng, Y.-L.: Investigating familiarity and usage of traditional metrics and altmetrics (2019) 0.13

   0.13121977 = sum of:
     0.13121977 = product of:
       0.54674906 = sum of:
         0.0071173403 = weight(abstract_txt:that in 328) [ClassicSimilarity], result of:
           0.0071173403 = score(doc=328,freq=2.0), product of:
             0.03404893 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014397405 = queryNorm
             0.20903271 = fieldWeight in 328, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.08228445 = weight(abstract_txt:acknowledge in 328) [ClassicSimilarity], result of:
           0.08228445 = score(doc=328,freq=1.0), product of:
             0.15208034 = queryWeight, product of:
               1.2201807 = boost
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.014397405 = queryNorm
             0.5410591 = fieldWeight in 328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.656945 = idf(docFreq=20, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.08471673 = weight(abstract_txt:scholars in 328) [ClassicSimilarity], result of:
           0.08471673 = score(doc=328,freq=3.0), product of:
             0.13545975 = queryWeight, product of:
               1.628575 = boost
               5.7772117 = idf(docFreq=373, maxDocs=44421)
               0.014397405 = queryNorm
             0.6254015 = fieldWeight in 328, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7772117 = idf(docFreq=373, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.048515365 = weight(abstract_txt:impact in 328) [ClassicSimilarity], result of:
           0.048515365 = score(doc=328,freq=1.0), product of:
             0.16974647 = queryWeight, product of:
               2.5782084 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.014397405 = queryNorm
             0.28581074 = fieldWeight in 328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.24410546 = weight(abstract_txt:metrics in 328) [ClassicSimilarity], result of:
           0.24410546 = score(doc=328,freq=5.0), product of:
             0.26482764 = queryWeight, product of:
               2.7888806 = boost
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.014397405 = queryNorm
             0.9217522 = fieldWeight in 328, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.595522 = idf(docFreq=164, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
         0.080009684 = weight(abstract_txt:research in 328) [ClassicSimilarity], result of:
           0.080009684 = score(doc=328,freq=4.0), product of:
             0.20258297 = queryWeight, product of:
               4.4533734 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014397405 = queryNorm
             0.39494774 = fieldWeight in 328, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=328)
       0.24 = coord(6/25)
   

4. Hamilton, E.C.: ¬The impact of survey data : measuring success (2007) 0.13

   0.12741506 = sum of:
     0.12741506 = product of:
       0.39817208 = sum of:
         0.00440363 = weight(abstract_txt:that in 1071) [ClassicSimilarity], result of:
           0.00440363 = score(doc=1071,freq=1.0), product of:
             0.03404893 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014397405 = queryNorm
             0.1293324 = fieldWeight in 1071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1071)
         0.015209352 = weight(abstract_txt:analysis in 1071) [ClassicSimilarity], result of:
           0.015209352 = score(doc=1071,freq=2.0), product of:
             0.053942323 = queryWeight, product of:
               1.0277026 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.014397405 = queryNorm
             0.2819558 = fieldWeight in 1071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1071)
         0.04791923 = weight(abstract_txt:shifts in 1071) [ClassicSimilarity], result of:
           0.04791923 = score(doc=1071,freq=1.0), product of:
             0.115929976 = queryWeight, product of:
               1.0653334 = boost
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.014397405 = queryNorm
             0.41334632 = fieldWeight in 1071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.558333 = idf(docFreq=62, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1071)
         0.08669144 = weight(abstract_txt:inputs in 1071) [ClassicSimilarity], result of:
           0.08669144 = score(doc=1071,freq=2.0), product of:
             0.13661446 = queryWeight, product of:
               1.1564742 = boost
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.014397405 = queryNorm
             0.63457 = fieldWeight in 1071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.20496 = idf(docFreq=32, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1071)
         0.042797327 = weight(abstract_txt:scholars in 1071) [ClassicSimilarity], result of:
           0.042797327 = score(doc=1071,freq=1.0), product of:
             0.13545975 = queryWeight, product of:
               1.628575 = boost
               5.7772117 = idf(docFreq=373, maxDocs=44421)
               0.014397405 = queryNorm
             0.31594127 = fieldWeight in 1071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7772117 = idf(docFreq=373, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1071)
         0.06608767 = weight(abstract_txt:assessing in 1071) [ClassicSimilarity], result of:
           0.06608767 = score(doc=1071,freq=1.0), product of:
             0.18097259 = queryWeight, product of:
               1.8823875 = boost
               6.677587 = idf(docFreq=151, maxDocs=44421)
               0.014397405 = queryNorm
             0.36518055 = fieldWeight in 1071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.677587 = idf(docFreq=151, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1071)
         0.042450946 = weight(abstract_txt:impact in 1071) [ClassicSimilarity], result of:
           0.042450946 = score(doc=1071,freq=1.0), product of:
             0.16974647 = queryWeight, product of:
               2.5782084 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.014397405 = queryNorm
             0.2500844 = fieldWeight in 1071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1071)
         0.092612505 = weight(abstract_txt:research in 1071) [ClassicSimilarity], result of:
           0.092612505 = score(doc=1071,freq=7.0), product of:
             0.20258297 = queryWeight, product of:
               4.4533734 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014397405 = queryNorm
             0.4571584 = fieldWeight in 1071, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=1071)
       0.32 = coord(8/25)
   

5. Jonkers, K.; Moya Anegon, F. de; Aguillo, I.F.: Measuring the usage of e-research infrastructure as an indicator of research activity (2012) 0.13

   0.1251729 = sum of:
     0.1251729 = product of:
       0.62586445 = sum of:
         0.006290899 = weight(abstract_txt:that in 1277) [ClassicSimilarity], result of:
           0.006290899 = score(doc=1277,freq=1.0), product of:
             0.03404893 = queryWeight, product of:
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.014397405 = queryNorm
             0.18476056 = fieldWeight in 1277, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.078125 = fieldNorm(doc=1277)
         0.021727644 = weight(abstract_txt:analysis in 1277) [ClassicSimilarity], result of:
           0.021727644 = score(doc=1277,freq=2.0), product of:
             0.053942323 = queryWeight, product of:
               1.0277026 = boost
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.014397405 = queryNorm
             0.402794 = fieldWeight in 1277, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6456752 = idf(docFreq=3151, maxDocs=44421)
               0.078125 = fieldNorm(doc=1277)
         0.060644206 = weight(abstract_txt:impact in 1277) [ClassicSimilarity], result of:
           0.060644206 = score(doc=1277,freq=1.0), product of:
             0.16974647 = queryWeight, product of:
               2.5782084 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.014397405 = queryNorm
             0.35726342 = fieldWeight in 1277, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.078125 = fieldNorm(doc=1277)
         0.15001816 = weight(abstract_txt:research in 1277) [ClassicSimilarity], result of:
           0.15001816 = score(doc=1277,freq=9.0), product of:
             0.20258297 = queryWeight, product of:
               4.4533734 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.014397405 = queryNorm
             0.740527 = fieldWeight in 1277, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.078125 = fieldNorm(doc=1277)
         0.38718355 = weight(abstract_txt:infrastructures in 1277) [ClassicSimilarity], result of:
           0.38718355 = score(doc=1277,freq=1.0), product of:
             0.66872805 = queryWeight, product of:
               6.267409 = boost
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.014397405 = queryNorm
             0.57898504 = fieldWeight in 1277, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4110084 = idf(docFreq=72, maxDocs=44421)
               0.078125 = fieldNorm(doc=1277)
       0.2 = coord(5/25)