Document (#33883)

Author
Kim, Y.H.
Kim, H.H.
Title
Development and validation of evaluation indicators for a consortium of institutional repositories : a case study of dcollection
Source
Journal of the American Society for Information Science and Technology. 59(2008) no.8, S.1282-1294
Year
2008
Abstract
This study develops evaluation indicators for a consortium of Korean institutional repositories called dCollection and validates the indicators against actual data from the participants of this consortium. The literature review reveals a conceptual framework for institutional repository (IR) evaluation with four categories and 19 items. In developing the initial framework, equal amounts of emphasis are put on the assessments of procedural achievement and actual performance to pinpoint the procedural weaknesses of each IR and to determine its customized solution. A Delphi method of three rounds with the help of IR librarians reveals a converging tendency pertaining to the measures of importance ascribed to the categories and items. Through a focus-group interview with middle- to top-level managers, 39 indicators derived from 19 items are identified as possessing relevancy, measurability, data availability, and differentiability. Validation of evaluation indicators employs actual evaluation data from 32 university IRs. Factor analysis shows a simpler structural pattern containing 12 factors than that of the structural pattern of the conceptual framework that contains 19 items. Correlation analysis using the factor scores identifies six key factors: Registration Rate, Archiving, Resource Allocation, System Performance, Multifunctionality, and Use Rate. The results from regression analyses suggest that two different approaches can be employed to promote the Use Rate factor. In the content-oriented approach, the Registration Rate factor is crucial while in the policy-oriented approach the Archiving factor assumes this role; however, the System Performance factor plays a mediating role for the key factors, thus forming a contingency for either approach.

Similar documents (content)

  1. Wang, J.; Guan, J.: ¬The analysis and evaluation of knowledge efficiency in research groups (2005) 0.17 
    0.16720222 = sum of:
  0.16720222 = product of:
    0.5971508 = sum of:
      0.034636587 = weight(abstract_txt:conceptual in 5238) [ClassicSimilarity], result of:
        0.034636587 = score(doc=5238,freq=1.0), product of:
          0.09080274 = queryWeight, product of:
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.018597424 = queryNorm
          0.38144872 = fieldWeight in 5238, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.078125 = fieldNorm(doc=5238)
      0.016485756 = weight(abstract_txt:data in 5238) [ClassicSimilarity], result of:
        0.016485756 = score(doc=5238,freq=1.0), product of:
          0.06336439 = queryWeight, product of:
            1.0231017 = boost
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.018597424 = queryNorm
          0.26017386 = fieldWeight in 5238, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.078125 = fieldNorm(doc=5238)
      0.023372283 = weight(abstract_txt:approach in 5238) [ClassicSimilarity], result of:
        0.023372283 = score(doc=5238,freq=1.0), product of:
          0.07996625 = queryWeight, product of:
            1.1493427 = boost
            3.741144 = idf(docFreq=2864, maxDocs=44421)
            0.018597424 = queryNorm
          0.29227686 = fieldWeight in 5238, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.741144 = idf(docFreq=2864, maxDocs=44421)
            0.078125 = fieldNorm(doc=5238)
      0.05924675 = weight(abstract_txt:framework in 5238) [ClassicSimilarity], result of:
        0.05924675 = score(doc=5238,freq=2.0), product of:
          0.11799736 = queryWeight, product of:
            1.3961507 = boost
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.018597424 = queryNorm
          0.5021023 = fieldWeight in 5238, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.078125 = fieldNorm(doc=5238)
      0.054265615 = weight(abstract_txt:factors in 5238) [ClassicSimilarity], result of:
        0.054265615 = score(doc=5238,freq=1.0), product of:
          0.14021327 = queryWeight, product of:
            1.5219162 = boost
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.018597424 = queryNorm
          0.38702196 = fieldWeight in 5238, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.078125 = fieldNorm(doc=5238)
      0.1629625 = weight(abstract_txt:indicators in 5238) [ClassicSimilarity], result of:
        0.1629625 = score(doc=5238,freq=1.0), product of:
          0.34603018 = queryWeight, product of:
            3.08658 = boost
            6.0281444 = idf(docFreq=290, maxDocs=44421)
            0.018597424 = queryNorm
          0.4709488 = fieldWeight in 5238, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.0281444 = idf(docFreq=290, maxDocs=44421)
            0.078125 = fieldNorm(doc=5238)
      0.2461813 = weight(abstract_txt:factor in 5238) [ClassicSimilarity], result of:
        0.2461813 = score(doc=5238,freq=2.0), product of:
          0.38424596 = queryWeight, product of:
            3.5630002 = boost
            5.7988343 = idf(docFreq=365, maxDocs=44421)
            0.018597424 = queryNorm
          0.64068675 = fieldWeight in 5238, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.7988343 = idf(docFreq=365, maxDocs=44421)
            0.078125 = fieldNorm(doc=5238)
    0.28 = coord(7/25)
  2. Pharo, N.; Järvelin, K.: ¬The SST method : a tool for analysing Web information search processes (2004) 0.15 
    0.14882596 = sum of:
  0.14882596 = product of:
    0.41340542 = sum of:
      0.02770927 = weight(abstract_txt:conceptual in 3533) [ClassicSimilarity], result of:
        0.02770927 = score(doc=3533,freq=1.0), product of:
          0.09080274 = queryWeight, product of:
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.018597424 = queryNorm
          0.30515897 = fieldWeight in 3533, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.8825436 = idf(docFreq=914, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
      0.013188606 = weight(abstract_txt:data in 3533) [ClassicSimilarity], result of:
        0.013188606 = score(doc=3533,freq=1.0), product of:
          0.06336439 = queryWeight, product of:
            1.0231017 = boost
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.018597424 = queryNorm
          0.20813909 = fieldWeight in 3533, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
      0.046737332 = weight(abstract_txt:categories in 3533) [ClassicSimilarity], result of:
        0.046737332 = score(doc=3533,freq=2.0), product of:
          0.10212094 = queryWeight, product of:
            1.0604934 = boost
            5.177905 = idf(docFreq=680, maxDocs=44421)
            0.018597424 = queryNorm
          0.45766646 = fieldWeight in 3533, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.177905 = idf(docFreq=680, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
      0.010003689 = weight(abstract_txt:from in 3533) [ClassicSimilarity], result of:
        0.010003689 = score(doc=3533,freq=1.0), product of:
          0.05800503 = queryWeight, product of:
            1.1303121 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.018597424 = queryNorm
          0.17246243 = fieldWeight in 3533, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
      0.018697828 = weight(abstract_txt:approach in 3533) [ClassicSimilarity], result of:
        0.018697828 = score(doc=3533,freq=1.0), product of:
          0.07996625 = queryWeight, product of:
            1.1493427 = boost
            3.741144 = idf(docFreq=2864, maxDocs=44421)
            0.018597424 = queryNorm
          0.2338215 = fieldWeight in 3533, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.741144 = idf(docFreq=2864, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
      0.03351502 = weight(abstract_txt:framework in 3533) [ClassicSimilarity], result of:
        0.03351502 = score(doc=3533,freq=1.0), product of:
          0.11799736 = queryWeight, product of:
            1.3961507 = boost
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.018597424 = queryNorm
          0.28403196 = fieldWeight in 3533, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
      0.04341249 = weight(abstract_txt:factors in 3533) [ClassicSimilarity], result of:
        0.04341249 = score(doc=3533,freq=1.0), product of:
          0.14021327 = queryWeight, product of:
            1.5219162 = boost
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.018597424 = queryNorm
          0.30961758 = fieldWeight in 3533, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
      0.08088003 = weight(abstract_txt:actual in 3533) [ClassicSimilarity], result of:
        0.08088003 = score(doc=3533,freq=1.0), product of:
          0.2122952 = queryWeight, product of:
            1.8726916 = boost
            6.0956655 = idf(docFreq=271, maxDocs=44421)
            0.018597424 = queryNorm
          0.3809791 = fieldWeight in 3533, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.0956655 = idf(docFreq=271, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
      0.13926117 = weight(abstract_txt:factor in 3533) [ClassicSimilarity], result of:
        0.13926117 = score(doc=3533,freq=1.0), product of:
          0.38424596 = queryWeight, product of:
            3.5630002 = boost
            5.7988343 = idf(docFreq=365, maxDocs=44421)
            0.018597424 = queryNorm
          0.36242715 = fieldWeight in 3533, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.7988343 = idf(docFreq=365, maxDocs=44421)
            0.0625 = fieldNorm(doc=3533)
    0.36 = coord(9/25)
  3. Tsagkias, M.; Larson, M.; Rijke, M. de: Predicting podcast preference : an analysis framework and its application (2010) 0.13 
    0.13256 = sum of:
  0.13256 = product of:
    0.47342855 = sum of:
      0.01154003 = weight(abstract_txt:data in 326) [ClassicSimilarity], result of:
        0.01154003 = score(doc=326,freq=1.0), product of:
          0.06336439 = queryWeight, product of:
            1.0231017 = boost
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.018597424 = queryNorm
          0.18212171 = fieldWeight in 326, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3302255 = idf(docFreq=4320, maxDocs=44421)
            0.0546875 = fieldNorm(doc=326)
      0.028917247 = weight(abstract_txt:categories in 326) [ClassicSimilarity], result of:
        0.028917247 = score(doc=326,freq=1.0), product of:
          0.10212094 = queryWeight, product of:
            1.0604934 = boost
            5.177905 = idf(docFreq=680, maxDocs=44421)
            0.018597424 = queryNorm
          0.28316668 = fieldWeight in 326, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.177905 = idf(docFreq=680, maxDocs=44421)
            0.0546875 = fieldNorm(doc=326)
      0.008753227 = weight(abstract_txt:from in 326) [ClassicSimilarity], result of:
        0.008753227 = score(doc=326,freq=1.0), product of:
          0.05800503 = queryWeight, product of:
            1.1303121 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.018597424 = queryNorm
          0.15090463 = fieldWeight in 326, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.0546875 = fieldNorm(doc=326)
      0.077588364 = weight(abstract_txt:framework in 326) [ClassicSimilarity], result of:
        0.077588364 = score(doc=326,freq=7.0), product of:
          0.11799736 = queryWeight, product of:
            1.3961507 = boost
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.018597424 = queryNorm
          0.6575432 = fieldWeight in 326, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            4.5445113 = idf(docFreq=1282, maxDocs=44421)
            0.0546875 = fieldNorm(doc=326)
      0.111062266 = weight(abstract_txt:validation in 326) [ClassicSimilarity], result of:
        0.111062266 = score(doc=326,freq=2.0), product of:
          0.19878237 = queryWeight, product of:
            1.4795835 = boost
            7.2241306 = idf(docFreq=87, maxDocs=44421)
            0.018597424 = queryNorm
          0.55871284 = fieldWeight in 326, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            7.2241306 = idf(docFreq=87, maxDocs=44421)
            0.0546875 = fieldNorm(doc=326)
      0.037985932 = weight(abstract_txt:factors in 326) [ClassicSimilarity], result of:
        0.037985932 = score(doc=326,freq=1.0), product of:
          0.14021327 = queryWeight, product of:
            1.5219162 = boost
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.018597424 = queryNorm
          0.2709154 = fieldWeight in 326, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.0546875 = fieldNorm(doc=326)
      0.19758151 = weight(abstract_txt:indicators in 326) [ClassicSimilarity], result of:
        0.19758151 = score(doc=326,freq=3.0), product of:
          0.34603018 = queryWeight, product of:
            3.08658 = boost
            6.0281444 = idf(docFreq=290, maxDocs=44421)
            0.018597424 = queryNorm
          0.57099503 = fieldWeight in 326, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.0281444 = idf(docFreq=290, maxDocs=44421)
            0.0546875 = fieldNorm(doc=326)
    0.28 = coord(7/25)
  4. Yeh, J.-F.; Wu, C.-H.; Chen, M.-J.: Ontology-based speech act identification in a bilingual dialog system using partial pattern trees (2008) 0.13 
    0.13117999 = sum of:
  0.13117999 = product of:
    0.5465833 = sum of:
      0.010003689 = weight(abstract_txt:from in 2607) [ClassicSimilarity], result of:
        0.010003689 = score(doc=2607,freq=1.0), product of:
          0.05800503 = queryWeight, product of:
            1.1303121 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.018597424 = queryNorm
          0.17246243 = fieldWeight in 2607, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.0625 = fieldNorm(doc=2607)
      0.08170746 = weight(abstract_txt:pattern in 2607) [ClassicSimilarity], result of:
        0.08170746 = score(doc=2607,freq=2.0), product of:
          0.14819948 = queryWeight, product of:
            1.2775382 = boost
            6.2376356 = idf(docFreq=235, maxDocs=44421)
            0.018597424 = queryNorm
          0.5513343 = fieldWeight in 2607, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.2376356 = idf(docFreq=235, maxDocs=44421)
            0.0625 = fieldNorm(doc=2607)
      0.06098129 = weight(abstract_txt:performance in 2607) [ClassicSimilarity], result of:
        0.06098129 = score(doc=2607,freq=3.0), product of:
          0.12193731 = queryWeight, product of:
            1.4192683 = boost
            4.619759 = idf(docFreq=1189, maxDocs=44421)
            0.018597424 = queryNorm
          0.5001036 = fieldWeight in 2607, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.619759 = idf(docFreq=1189, maxDocs=44421)
            0.0625 = fieldNorm(doc=2607)
      0.12868826 = weight(abstract_txt:registration in 2607) [ClassicSimilarity], result of:
        0.12868826 = score(doc=2607,freq=1.0), product of:
          0.2527599 = queryWeight, product of:
            1.6684171 = boost
            8.146119 = idf(docFreq=34, maxDocs=44421)
            0.018597424 = queryNorm
          0.50913244 = fieldWeight in 2607, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.146119 = idf(docFreq=34, maxDocs=44421)
            0.0625 = fieldNorm(doc=2607)
      0.07566041 = weight(abstract_txt:evaluation in 2607) [ClassicSimilarity], result of:
        0.07566041 = score(doc=2607,freq=2.0), product of:
          0.19108708 = queryWeight, product of:
            2.2936978 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018597424 = queryNorm
          0.39594725 = fieldWeight in 2607, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.0625 = fieldNorm(doc=2607)
      0.18954216 = weight(abstract_txt:rate in 2607) [ClassicSimilarity], result of:
        0.18954216 = score(doc=2607,freq=3.0), product of:
          0.28583956 = queryWeight, product of:
            2.5091505 = boost
            6.1255183 = idf(docFreq=263, maxDocs=44421)
            0.018597424 = queryNorm
          0.6631068 = fieldWeight in 2607, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            6.1255183 = idf(docFreq=263, maxDocs=44421)
            0.0625 = fieldNorm(doc=2607)
    0.24 = coord(6/25)
  5. Coleman, A.: Assessing the value of a journal beyond the impact factor (2007) 0.12 
    0.118081704 = sum of:
  0.118081704 = product of:
    0.4920071 = sum of:
      0.010003689 = weight(abstract_txt:from in 1447) [ClassicSimilarity], result of:
        0.010003689 = score(doc=1447,freq=1.0), product of:
          0.05800503 = queryWeight, product of:
            1.1303121 = boost
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.018597424 = queryNorm
          0.17246243 = fieldWeight in 1447, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.759399 = idf(docFreq=7646, maxDocs=44421)
            0.0625 = fieldNorm(doc=1447)
      0.0577759 = weight(abstract_txt:pattern in 1447) [ClassicSimilarity], result of:
        0.0577759 = score(doc=1447,freq=1.0), product of:
          0.14819948 = queryWeight, product of:
            1.2775382 = boost
            6.2376356 = idf(docFreq=235, maxDocs=44421)
            0.018597424 = queryNorm
          0.38985223 = fieldWeight in 1447, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.2376356 = idf(docFreq=235, maxDocs=44421)
            0.0625 = fieldNorm(doc=1447)
      0.04341249 = weight(abstract_txt:factors in 1447) [ClassicSimilarity], result of:
        0.04341249 = score(doc=1447,freq=1.0), product of:
          0.14021327 = queryWeight, product of:
            1.5219162 = boost
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.018597424 = queryNorm
          0.30961758 = fieldWeight in 1447, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.9538813 = idf(docFreq=851, maxDocs=44421)
            0.0625 = fieldNorm(doc=1447)
      0.053499985 = weight(abstract_txt:evaluation in 1447) [ClassicSimilarity], result of:
        0.053499985 = score(doc=1447,freq=1.0), product of:
          0.19108708 = queryWeight, product of:
            2.2936978 = boost
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.018597424 = queryNorm
          0.279977 = fieldWeight in 1447, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.479632 = idf(docFreq=1368, maxDocs=44421)
            0.0625 = fieldNorm(doc=1447)
      0.13036999 = weight(abstract_txt:indicators in 1447) [ClassicSimilarity], result of:
        0.13036999 = score(doc=1447,freq=1.0), product of:
          0.34603018 = queryWeight, product of:
            3.08658 = boost
            6.0281444 = idf(docFreq=290, maxDocs=44421)
            0.018597424 = queryNorm
          0.37675902 = fieldWeight in 1447, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.0281444 = idf(docFreq=290, maxDocs=44421)
            0.0625 = fieldNorm(doc=1447)
      0.19694504 = weight(abstract_txt:factor in 1447) [ClassicSimilarity], result of:
        0.19694504 = score(doc=1447,freq=2.0), product of:
          0.38424596 = queryWeight, product of:
            3.5630002 = boost
            5.7988343 = idf(docFreq=365, maxDocs=44421)
            0.018597424 = queryNorm
          0.5125494 = fieldWeight in 1447, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.7988343 = idf(docFreq=365, maxDocs=44421)
            0.0625 = fieldNorm(doc=1447)
    0.24 = coord(6/25)