Document (#38390)

Author

Kenyon, T.

Title

Defining and measuring research impact in the humanities, social sciences and creative arts in the digital age

Source

Knowledge organization. 41(2014) no.3, S.249-257

Year

2014

Abstract

There are powerful reasons for and against research ers taking the lead in formulating research impact measures for disciplines in the humanities, social sciences and creative arts (HSSCA). On balance, the reasons in favour are stronger, not least because such measures are otherwise apt to be formulated badly by those with little expertise. This invites us to inquire about the sorts of measures would best apply to HSSCA disciplines (among others), and whether some of the more popular impact measures, such as citation indices, really are reasonable indicators of impact or quality in these domains. It also raises questions about how burgeoning modes of research, knowledge mobilization, and impact tracking in the digital domain play into HSSCA research measures. On reflection, empirically adequate and arithmetically meaningful HSSCA impact measures will be pluralistic, non-reductive, and highly context-dependent; they are unlikely to lend themselves to the current pseudoscience of single-dimensional ordinal rankings between research institutions. Nevertheless they may support comparisons of interesting sorts, and enable assessments for accountability and planning purposes.

Content

Vgl.: http://www.ergon-verlag.de/isko_ko/downloads/ko_41_2014_3_g.pdf.

Footnote

Papers from the 2013 World Social Science Forum, Montréal, Canada.

Theme

Informetrie

Field

Sozialwissenschaften
Geisteswissenschaften
Kunst

Similar documents (content)

1. Mohammadi , E.; Thelwall, M.: Mendeley readership altmetrics for the social sciences and humanities : research evaluation and knowledge flows (2014) 0.17

   0.17327897 = sum of:
     0.17327897 = product of:
       0.61885345 = sum of:
         0.038962327 = weight(abstract_txt:social in 3190) [ClassicSimilarity], result of:
           0.038962327 = score(doc=3190,freq=3.0), product of:
             0.08563064 = queryWeight, product of:
               1.1214991 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.018165829 = queryNorm
             0.4550045 = fieldWeight in 3190, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.0625 = fieldNorm(doc=3190)
         0.061475843 = weight(abstract_txt:sciences in 3190) [ClassicSimilarity], result of:
           0.061475843 = score(doc=3190,freq=2.0), product of:
             0.13285136 = queryWeight, product of:
               1.3969065 = boost
               5.235323 = idf(docFreq=642, maxDocs=44421)
               0.018165829 = queryNorm
             0.46274152 = fieldWeight in 3190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.235323 = idf(docFreq=642, maxDocs=44421)
               0.0625 = fieldNorm(doc=3190)
         0.092628226 = weight(abstract_txt:disciplines in 3190) [ClassicSimilarity], result of:
           0.092628226 = score(doc=3190,freq=4.0), product of:
             0.13858469 = queryWeight, product of:
               1.4267305 = boost
               5.3470974 = idf(docFreq=574, maxDocs=44421)
               0.018165829 = queryNorm
             0.6683872 = fieldWeight in 3190, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.3470974 = idf(docFreq=574, maxDocs=44421)
               0.0625 = fieldNorm(doc=3190)
         0.08962238 = weight(abstract_txt:humanities in 3190) [ClassicSimilarity], result of:
           0.08962238 = score(doc=3190,freq=2.0), product of:
             0.17080766 = queryWeight, product of:
               1.5839373 = boost
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.018165829 = queryNorm
             0.52469766 = fieldWeight in 3190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.0625 = fieldNorm(doc=3190)
         0.040540043 = weight(abstract_txt:research in 3190) [ClassicSimilarity], result of:
           0.040540043 = score(doc=3190,freq=2.0), product of:
             0.1451642 = queryWeight, product of:
               2.5291507 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018165829 = queryNorm
             0.27927023 = fieldWeight in 3190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=3190)
         0.15053469 = weight(abstract_txt:impact in 3190) [ClassicSimilarity], result of:
           0.15053469 = score(doc=3190,freq=3.0), product of:
             0.3040867 = queryWeight, product of:
               3.6605272 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.018165829 = queryNorm
             0.49503872 = fieldWeight in 3190, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0625 = fieldNorm(doc=3190)
         0.14508995 = weight(abstract_txt:measures in 3190) [ClassicSimilarity], result of:
           0.14508995 = score(doc=3190,freq=1.0), product of:
             0.42792895 = queryWeight, product of:
               4.3424096 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.018165829 = queryNorm
             0.3390515 = fieldWeight in 3190, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=3190)
       0.28 = coord(7/25)
   

2. Thelwall, M.; Delgado, M.M.: Arts and humanities research evaluation : no metrics please, just data (2015) 0.17

   0.1716604 = sum of:
     0.1716604 = product of:
       0.7152517 = sum of:
         0.01993414 = weight(abstract_txt:they in 3313) [ClassicSimilarity], result of:
           0.01993414 = score(doc=3313,freq=1.0), product of:
             0.06808185 = queryWeight, product of:
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.018165829 = queryNorm
             0.2927967 = fieldWeight in 3313, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.078125 = fieldNorm(doc=3313)
         0.032153472 = weight(abstract_txt:about in 3313) [ClassicSimilarity], result of:
           0.032153472 = score(doc=3313,freq=2.0), product of:
             0.074320436 = queryWeight, product of:
               1.0448127 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.018165829 = queryNorm
             0.43263298 = fieldWeight in 3313, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.078125 = fieldNorm(doc=3313)
         0.17713179 = weight(abstract_txt:humanities in 3313) [ClassicSimilarity], result of:
           0.17713179 = score(doc=3313,freq=5.0), product of:
             0.17080766 = queryWeight, product of:
               1.5839373 = boost
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.018165829 = queryNorm
             1.0370249 = fieldWeight in 3313, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.078125 = fieldNorm(doc=3313)
         0.26072815 = weight(abstract_txt:arts in 3313) [ClassicSimilarity], result of:
           0.26072815 = score(doc=3313,freq=5.0), product of:
             0.22102171 = queryWeight, product of:
               1.8017801 = boost
               6.7527075 = idf(docFreq=140, maxDocs=44421)
               0.018165829 = queryNorm
             1.1796495 = fieldWeight in 3313, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.7527075 = idf(docFreq=140, maxDocs=44421)
               0.078125 = fieldNorm(doc=3313)
         0.07166535 = weight(abstract_txt:research in 3313) [ClassicSimilarity], result of:
           0.07166535 = score(doc=3313,freq=4.0), product of:
             0.1451642 = queryWeight, product of:
               2.5291507 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018165829 = queryNorm
             0.49368468 = fieldWeight in 3313, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.078125 = fieldNorm(doc=3313)
         0.15363881 = weight(abstract_txt:impact in 3313) [ClassicSimilarity], result of:
           0.15363881 = score(doc=3313,freq=2.0), product of:
             0.3040867 = queryWeight, product of:
               3.6605272 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.018165829 = queryNorm
             0.50524676 = fieldWeight in 3313, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.078125 = fieldNorm(doc=3313)
       0.24 = coord(6/25)
   

3. White, H.D.; Boell, S.K.; Yu, H.; Davis, M.; Wilson, C.S.; Cole, F.T.H.: Libcitations : a measure for comparative assessment of book publications in the humanities and social sciences (2009) 0.14

   0.14294204 = sum of:
     0.14294204 = product of:
       0.5105073 = sum of:
         0.019733792 = weight(abstract_txt:they in 3846) [ClassicSimilarity], result of:
           0.019733792 = score(doc=3846,freq=2.0), product of:
             0.06808185 = queryWeight, product of:
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.018165829 = queryNorm
             0.28985393 = fieldWeight in 3846, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3846)
         0.019683046 = weight(abstract_txt:social in 3846) [ClassicSimilarity], result of:
           0.019683046 = score(doc=3846,freq=1.0), product of:
             0.08563064 = queryWeight, product of:
               1.1214991 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.018165829 = queryNorm
             0.22985986 = fieldWeight in 3846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3846)
         0.038036242 = weight(abstract_txt:sciences in 3846) [ClassicSimilarity], result of:
           0.038036242 = score(doc=3846,freq=1.0), product of:
             0.13285136 = queryWeight, product of:
               1.3969065 = boost
               5.235323 = idf(docFreq=642, maxDocs=44421)
               0.018165829 = queryNorm
             0.28630674 = fieldWeight in 3846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.235323 = idf(docFreq=642, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3846)
         0.05545102 = weight(abstract_txt:humanities in 3846) [ClassicSimilarity], result of:
           0.05545102 = score(doc=3846,freq=1.0), product of:
             0.17080766 = queryWeight, product of:
               1.5839373 = boost
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.018165829 = queryNorm
             0.32464013 = fieldWeight in 3846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3846)
         0.05016574 = weight(abstract_txt:research in 3846) [ClassicSimilarity], result of:
           0.05016574 = score(doc=3846,freq=4.0), product of:
             0.1451642 = queryWeight, product of:
               2.5291507 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018165829 = queryNorm
             0.34557927 = fieldWeight in 3846, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3846)
         0.10754717 = weight(abstract_txt:impact in 3846) [ClassicSimilarity], result of:
           0.10754717 = score(doc=3846,freq=2.0), product of:
             0.3040867 = queryWeight, product of:
               3.6605272 = boost
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.018165829 = queryNorm
             0.35367274 = fieldWeight in 3846, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.572972 = idf(docFreq=1246, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3846)
         0.21989028 = weight(abstract_txt:measures in 3846) [ClassicSimilarity], result of:
           0.21989028 = score(doc=3846,freq=3.0), product of:
             0.42792895 = queryWeight, product of:
               4.3424096 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.018165829 = queryNorm
             0.51384765 = fieldWeight in 3846, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0546875 = fieldNorm(doc=3846)
       0.28 = coord(7/25)
   

4. Larivière, V.; Gingras, Y.; Archambault, E.: ¬The decline in the concentration of citations, 1900-2007 (2009) 0.14

   0.14208804 = sum of:
     0.14208804 = product of:
       0.5920335 = sum of:
         0.028118638 = weight(abstract_txt:social in 3763) [ClassicSimilarity], result of:
           0.028118638 = score(doc=3763,freq=1.0), product of:
             0.08563064 = queryWeight, product of:
               1.1214991 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.018165829 = queryNorm
             0.32837123 = fieldWeight in 3763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.078125 = fieldNorm(doc=3763)
         0.076844804 = weight(abstract_txt:sciences in 3763) [ClassicSimilarity], result of:
           0.076844804 = score(doc=3763,freq=2.0), product of:
             0.13285136 = queryWeight, product of:
               1.3969065 = boost
               5.235323 = idf(docFreq=642, maxDocs=44421)
               0.018165829 = queryNorm
             0.5784269 = fieldWeight in 3763, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.235323 = idf(docFreq=642, maxDocs=44421)
               0.078125 = fieldNorm(doc=3763)
         0.057892643 = weight(abstract_txt:disciplines in 3763) [ClassicSimilarity], result of:
           0.057892643 = score(doc=3763,freq=1.0), product of:
             0.13858469 = queryWeight, product of:
               1.4267305 = boost
               5.3470974 = idf(docFreq=574, maxDocs=44421)
               0.018165829 = queryNorm
             0.41774198 = fieldWeight in 3763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3470974 = idf(docFreq=574, maxDocs=44421)
               0.078125 = fieldNorm(doc=3763)
         0.079215735 = weight(abstract_txt:humanities in 3763) [ClassicSimilarity], result of:
           0.079215735 = score(doc=3763,freq=1.0), product of:
             0.17080766 = queryWeight, product of:
               1.5839373 = boost
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.018165829 = queryNorm
             0.46377158 = fieldWeight in 3763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.078125 = fieldNorm(doc=3763)
         0.035832673 = weight(abstract_txt:research in 3763) [ClassicSimilarity], result of:
           0.035832673 = score(doc=3763,freq=1.0), product of:
             0.1451642 = queryWeight, product of:
               2.5291507 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018165829 = queryNorm
             0.24684234 = fieldWeight in 3763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.078125 = fieldNorm(doc=3763)
         0.314129 = weight(abstract_txt:measures in 3763) [ClassicSimilarity], result of:
           0.314129 = score(doc=3763,freq=3.0), product of:
             0.42792895 = queryWeight, product of:
               4.3424096 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.018165829 = queryNorm
             0.7340681 = fieldWeight in 3763, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=3763)
       0.24 = coord(6/25)
   

5. Hartley, J.: Reading and writing book reviews across the disciplines (2006) 0.14

   0.13914716 = sum of:
     0.13914716 = product of:
       0.4348349 = sum of:
         0.027621554 = weight(abstract_txt:they in 320) [ClassicSimilarity], result of:
           0.027621554 = score(doc=320,freq=3.0), product of:
             0.06808185 = queryWeight, product of:
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.018165829 = queryNorm
             0.405711 = fieldWeight in 320, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.7477977 = idf(docFreq=2845, maxDocs=44421)
               0.0625 = fieldNorm(doc=320)
         0.01818875 = weight(abstract_txt:about in 320) [ClassicSimilarity], result of:
           0.01818875 = score(doc=320,freq=1.0), product of:
             0.074320436 = queryWeight, product of:
               1.0448127 = boost
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.018165829 = queryNorm
             0.24473417 = fieldWeight in 320, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9157467 = idf(docFreq=2405, maxDocs=44421)
               0.0625 = fieldNorm(doc=320)
         0.03181261 = weight(abstract_txt:social in 320) [ClassicSimilarity], result of:
           0.03181261 = score(doc=320,freq=2.0), product of:
             0.08563064 = queryWeight, product of:
               1.1214991 = boost
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.018165829 = queryNorm
             0.37150964 = fieldWeight in 320, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2031517 = idf(docFreq=1804, maxDocs=44421)
               0.0625 = fieldNorm(doc=320)
         0.086939976 = weight(abstract_txt:sciences in 320) [ClassicSimilarity], result of:
           0.086939976 = score(doc=320,freq=4.0), product of:
             0.13285136 = queryWeight, product of:
               1.3969065 = boost
               5.235323 = idf(docFreq=642, maxDocs=44421)
               0.018165829 = queryNorm
             0.65441537 = fieldWeight in 320, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.235323 = idf(docFreq=642, maxDocs=44421)
               0.0625 = fieldNorm(doc=320)
         0.046314113 = weight(abstract_txt:disciplines in 320) [ClassicSimilarity], result of:
           0.046314113 = score(doc=320,freq=1.0), product of:
             0.13858469 = queryWeight, product of:
               1.4267305 = boost
               5.3470974 = idf(docFreq=574, maxDocs=44421)
               0.018165829 = queryNorm
             0.3341936 = fieldWeight in 320, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3470974 = idf(docFreq=574, maxDocs=44421)
               0.0625 = fieldNorm(doc=320)
         0.06337259 = weight(abstract_txt:humanities in 320) [ClassicSimilarity], result of:
           0.06337259 = score(doc=320,freq=1.0), product of:
             0.17080766 = queryWeight, product of:
               1.5839373 = boost
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.018165829 = queryNorm
             0.37101728 = fieldWeight in 320, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9362764 = idf(docFreq=318, maxDocs=44421)
               0.0625 = fieldNorm(doc=320)
         0.13191916 = weight(abstract_txt:arts in 320) [ClassicSimilarity], result of:
           0.13191916 = score(doc=320,freq=2.0), product of:
             0.22102171 = queryWeight, product of:
               1.8017801 = boost
               6.7527075 = idf(docFreq=140, maxDocs=44421)
               0.018165829 = queryNorm
             0.59686065 = fieldWeight in 320, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.7527075 = idf(docFreq=140, maxDocs=44421)
               0.0625 = fieldNorm(doc=320)
         0.028666137 = weight(abstract_txt:research in 320) [ClassicSimilarity], result of:
           0.028666137 = score(doc=320,freq=1.0), product of:
             0.1451642 = queryWeight, product of:
               2.5291507 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.018165829 = queryNorm
             0.19747387 = fieldWeight in 320, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=320)
       0.32 = coord(8/25)