Document (#34361)

Author

Zhang, Y.

Title

Developing a holistic model for digital library evaluation

Source

Journal of the American Society for Information Science and Technology. 61(2010) no.1, S.88-110

Year

2010

Abstract

This article reports the author's recent research in developing a holistic model for various levels of digital library (DL) evaluation in which perceived important criteria from heterogeneous stakeholder groups are organized and presented. To develop such a model, the author applied a three-stage research approach: exploration, confirmation, and verification. During the exploration stage, a literature review was conducted followed by an interview, along with a card sorting technique, to collect important criteria perceived by DL experts. Then the criteria identified were used for developing an online survey during the confirmation stage. Survey respondents (431 in total) from 22 countries rated the importance of the criteria. A holistic DL evaluation model was constructed using statistical techniques. Eventually, the verification stage was devised to test the reliability of the model in the context of searching and evaluating an operational DL. The proposed model fills two lacunae in the DL domain: (a) the lack of a comprehensive and flexible framework to guide and benchmark evaluations, and (b) the uncertainty about what divergence exists among heterogeneous DL stakeholders, including general users.

Similar documents (author)

1. Zhang, M.; Zhang, Y.: Professional organizations in Twittersphere : an empirical study of U.S. library and information science professional organizations-related Tweets (2020) 4.53

   4.5277104 = sum of:
     4.5277104 = weight(author_txt:zhang in 775) [ClassicSimilarity], result of:
       4.5277104 = score(doc=775,freq=2.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.527711 = fieldWeight in 775, product of:
           1.4142135 = tf(freq=2.0), with freq of:
             2.0 = termFreq=2.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.5 = fieldNorm(doc=775)
   

2. Zhang, Y.; Zhang, C.: Enhancing keyphrase extraction from microblogs using human reading time (2021) 4.53

   4.5277104 = sum of:
     4.5277104 = weight(author_txt:zhang in 1238) [ClassicSimilarity], result of:
       4.5277104 = score(doc=1238,freq=2.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.527711 = fieldWeight in 1238, product of:
           1.4142135 = tf(freq=2.0), with freq of:
             2.0 = termFreq=2.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.5 = fieldNorm(doc=1238)
   

3. Zhang, J.: TOFIR: A tool of facilitating information retrieval : introduce a visual retrieval model (2001) 4.00

   4.0019684 = sum of:
     4.0019684 = weight(author_txt:zhang in 7710) [ClassicSimilarity], result of:
       4.0019684 = score(doc=7710,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.001969 = fieldWeight in 7710, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.625 = fieldNorm(doc=7710)
   

4. Zhang, A.: Multimedia file formats on the Internet : a beginner's guide for PC users (1995) 4.00

   4.0019684 = sum of:
     4.0019684 = weight(author_txt:zhang in 3280) [ClassicSimilarity], result of:
       4.0019684 = score(doc=3280,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.001969 = fieldWeight in 3280, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.625 = fieldNorm(doc=3280)
   

5. Zhang, J.: ¬A representational analysis of relational information displays (1996) 4.00

   4.0019684 = sum of:
     4.0019684 = weight(author_txt:zhang in 6471) [ClassicSimilarity], result of:
       4.0019684 = score(doc=6471,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.15617312 = queryNorm
         4.001969 = fieldWeight in 6471, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           6.40315 = idf(docFreq=199, maxDocs=44421)
           0.625 = fieldNorm(doc=6471)
   

Similar documents (content)

1. Xie, H.I.: Users' evaluation of digital libraries (DLs) : their uses, their criteria, and their assessment (2008) 0.14

   0.14311202 = sum of:
     0.14311202 = product of:
       0.7155601 = sum of:
         0.03915986 = weight(abstract_txt:important in 3083) [ClassicSimilarity], result of:
           0.03915986 = score(doc=3083,freq=2.0), product of:
             0.08418114 = queryWeight, product of:
               1.2149796 = boost
               4.21038 = idf(docFreq=1791, maxDocs=44421)
               0.016456008 = queryNorm
             0.46518567 = fieldWeight in 3083, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.21038 = idf(docFreq=1791, maxDocs=44421)
               0.078125 = fieldNorm(doc=3083)
         0.10414866 = weight(abstract_txt:digital in 3083) [ClassicSimilarity], result of:
           0.10414866 = score(doc=3083,freq=12.0), product of:
             0.088928185 = queryWeight, product of:
               1.2487668 = boost
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.016456008 = queryNorm
             1.1711547 = fieldWeight in 3083, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.078125 = fieldNorm(doc=3083)
         0.14501716 = weight(abstract_txt:perceived in 3083) [ClassicSimilarity], result of:
           0.14501716 = score(doc=3083,freq=3.0), product of:
             0.1760232 = queryWeight, product of:
               1.756898 = boost
               6.0883393 = idf(docFreq=273, maxDocs=44421)
               0.016456008 = queryNorm
             0.82385254 = fieldWeight in 3083, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0883393 = idf(docFreq=273, maxDocs=44421)
               0.078125 = fieldNorm(doc=3083)
         0.14148991 = weight(abstract_txt:evaluation in 3083) [ClassicSimilarity], result of:
           0.14148991 = score(doc=3083,freq=8.0), product of:
             0.14293814 = queryWeight, product of:
               1.9390156 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.016456008 = queryNorm
             0.9898681 = fieldWeight in 3083, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=3083)
         0.2857445 = weight(abstract_txt:criteria in 3083) [ClassicSimilarity], result of:
           0.2857445 = score(doc=3083,freq=5.0), product of:
             0.29399228 = queryWeight, product of:
               3.2110317 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.016456008 = queryNorm
             0.9719455 = fieldWeight in 3083, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.078125 = fieldNorm(doc=3083)
       0.2 = coord(5/25)
   

2. Bateman, J.: Modelling the importance of end-user relevance criteria (1999) 0.14

   0.13507089 = sum of:
     0.13507089 = product of:
       0.5627954 = sum of:
         0.087466046 = weight(abstract_txt:rated in 606) [ClassicSimilarity], result of:
           0.087466046 = score(doc=606,freq=2.0), product of:
             0.14481215 = queryWeight, product of:
               1.1268059 = boost
               7.809647 = idf(docFreq=48, maxDocs=44421)
               0.016456008 = queryNorm
             0.6039966 = fieldWeight in 606, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.809647 = idf(docFreq=48, maxDocs=44421)
               0.0546875 = fieldNorm(doc=606)
         0.027411902 = weight(abstract_txt:important in 606) [ClassicSimilarity], result of:
           0.027411902 = score(doc=606,freq=2.0), product of:
             0.08418114 = queryWeight, product of:
               1.2149796 = boost
               4.21038 = idf(docFreq=1791, maxDocs=44421)
               0.016456008 = queryNorm
             0.32562998 = fieldWeight in 606, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.21038 = idf(docFreq=1791, maxDocs=44421)
               0.0546875 = fieldNorm(doc=606)
         0.044776395 = weight(abstract_txt:survey in 606) [ClassicSimilarity], result of:
           0.044776395 = score(doc=606,freq=2.0), product of:
             0.11675839 = queryWeight, product of:
               1.430888 = boost
               4.958587 = idf(docFreq=847, maxDocs=44421)
               0.016456008 = queryNorm
             0.38349617 = fieldWeight in 606, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.958587 = idf(docFreq=847, maxDocs=44421)
               0.0546875 = fieldNorm(doc=606)
         0.035016965 = weight(abstract_txt:evaluation in 606) [ClassicSimilarity], result of:
           0.035016965 = score(doc=606,freq=1.0), product of:
             0.14293814 = queryWeight, product of:
               1.9390156 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.016456008 = queryNorm
             0.24497987 = fieldWeight in 606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=606)
         0.28287262 = weight(abstract_txt:criteria in 606) [ClassicSimilarity], result of:
           0.28287262 = score(doc=606,freq=10.0), product of:
             0.29399228 = queryWeight, product of:
               3.2110317 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.016456008 = queryNorm
             0.962177 = fieldWeight in 606, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0546875 = fieldNorm(doc=606)
         0.08525146 = weight(abstract_txt:model in 606) [ClassicSimilarity], result of:
           0.08525146 = score(doc=606,freq=3.0), product of:
             0.22597821 = queryWeight, product of:
               3.4479067 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.016456008 = queryNorm
             0.3772552 = fieldWeight in 606, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.0546875 = fieldNorm(doc=606)
       0.24 = coord(6/25)
   

3. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 0.13

   0.13429525 = sum of:
     0.13429525 = product of:
       0.67147624 = sum of:
         0.033572584 = weight(abstract_txt:important in 213) [ClassicSimilarity], result of:
           0.033572584 = score(doc=213,freq=3.0), product of:
             0.08418114 = queryWeight, product of:
               1.2149796 = boost
               4.21038 = idf(docFreq=1791, maxDocs=44421)
               0.016456008 = queryNorm
             0.39881364 = fieldWeight in 213, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.21038 = idf(docFreq=1791, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.035016965 = weight(abstract_txt:evaluation in 213) [ClassicSimilarity], result of:
           0.035016965 = score(doc=213,freq=1.0), product of:
             0.14293814 = queryWeight, product of:
               1.9390156 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.016456008 = queryNorm
             0.24497987 = fieldWeight in 213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.21911219 = weight(abstract_txt:criteria in 213) [ClassicSimilarity], result of:
           0.21911219 = score(doc=213,freq=6.0), product of:
             0.29399228 = queryWeight, product of:
               3.2110317 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.016456008 = queryNorm
             0.7452991 = fieldWeight in 213, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.04921995 = weight(abstract_txt:model in 213) [ClassicSimilarity], result of:
           0.04921995 = score(doc=213,freq=1.0), product of:
             0.22597821 = queryWeight, product of:
               3.4479067 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.016456008 = queryNorm
             0.2178084 = fieldWeight in 213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
         0.33455458 = weight(abstract_txt:stage in 213) [ClassicSimilarity], result of:
           0.33455458 = score(doc=213,freq=8.0), product of:
             0.35417944 = queryWeight, product of:
               3.524425 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.016456008 = queryNorm
             0.9445906 = fieldWeight in 213, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.0546875 = fieldNorm(doc=213)
       0.2 = coord(5/25)
   

4. Kuhlthau, C.C.: Information search process (ISP) model (2009) 0.10

   0.1047007 = sum of:
     0.1047007 = product of:
       0.65437937 = sum of:
         0.12351199 = weight(abstract_txt:uncertainty in 806) [ClassicSimilarity], result of:
           0.12351199 = score(doc=806,freq=4.0), product of:
             0.11405302 = queryWeight, product of:
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.016456008 = queryNorm
             1.0829349 = fieldWeight in 806, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.930783 = idf(docFreq=117, maxDocs=44421)
               0.078125 = fieldNorm(doc=806)
         0.19246049 = weight(abstract_txt:holistic in 806) [ClassicSimilarity], result of:
           0.19246049 = score(doc=806,freq=1.0), product of:
             0.35095832 = queryWeight, product of:
               3.0383303 = boost
               7.019336 = idf(docFreq=107, maxDocs=44421)
               0.016456008 = queryNorm
             0.5483856 = fieldWeight in 806, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.019336 = idf(docFreq=107, maxDocs=44421)
               0.078125 = fieldNorm(doc=806)
         0.099439315 = weight(abstract_txt:model in 806) [ClassicSimilarity], result of:
           0.099439315 = score(doc=806,freq=2.0), product of:
             0.22597821 = queryWeight, product of:
               3.4479067 = boost
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.016456008 = queryNorm
             0.4400394 = fieldWeight in 806, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9827821 = idf(docFreq=2249, maxDocs=44421)
               0.078125 = fieldNorm(doc=806)
         0.23896755 = weight(abstract_txt:stage in 806) [ClassicSimilarity], result of:
           0.23896755 = score(doc=806,freq=2.0), product of:
             0.35417944 = queryWeight, product of:
               3.524425 = boost
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.016456008 = queryNorm
             0.6747076 = fieldWeight in 806, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.106756 = idf(docFreq=268, maxDocs=44421)
               0.078125 = fieldNorm(doc=806)
       0.16 = coord(4/25)
   

5. Park, J.-R.; Tosaka, Y.: Metadata quality control in digital repositories and collections : criteria, semantics, and mechanisms (2010) 0.09

   0.08833523 = sum of:
     0.08833523 = product of:
       0.44167614 = sum of:
         0.042518515 = weight(abstract_txt:digital in 163) [ClassicSimilarity], result of:
           0.042518515 = score(doc=163,freq=2.0), product of:
             0.088928185 = queryWeight, product of:
               1.2487668 = boost
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.016456008 = queryNorm
             0.4781219 = fieldWeight in 163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.078125 = fieldNorm(doc=163)
         0.06396628 = weight(abstract_txt:survey in 163) [ClassicSimilarity], result of:
           0.06396628 = score(doc=163,freq=2.0), product of:
             0.11675839 = queryWeight, product of:
               1.430888 = boost
               4.958587 = idf(docFreq=847, maxDocs=44421)
               0.016456008 = queryNorm
             0.5478517 = fieldWeight in 163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.958587 = idf(docFreq=847, maxDocs=44421)
               0.078125 = fieldNorm(doc=163)
         0.0837257 = weight(abstract_txt:perceived in 163) [ClassicSimilarity], result of:
           0.0837257 = score(doc=163,freq=1.0), product of:
             0.1760232 = queryWeight, product of:
               1.756898 = boost
               6.0883393 = idf(docFreq=273, maxDocs=44421)
               0.016456008 = queryNorm
             0.4756515 = fieldWeight in 163, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0883393 = idf(docFreq=273, maxDocs=44421)
               0.078125 = fieldNorm(doc=163)
         0.070744954 = weight(abstract_txt:evaluation in 163) [ClassicSimilarity], result of:
           0.070744954 = score(doc=163,freq=2.0), product of:
             0.14293814 = queryWeight, product of:
               1.9390156 = boost
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.016456008 = queryNorm
             0.49493405 = fieldWeight in 163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.479632 = idf(docFreq=1368, maxDocs=44421)
               0.078125 = fieldNorm(doc=163)
         0.18072067 = weight(abstract_txt:criteria in 163) [ClassicSimilarity], result of:
           0.18072067 = score(doc=163,freq=2.0), product of:
             0.29399228 = queryWeight, product of:
               3.2110317 = boost
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.016456008 = queryNorm
             0.6147123 = fieldWeight in 163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5637407 = idf(docFreq=462, maxDocs=44421)
               0.078125 = fieldNorm(doc=163)
       0.2 = coord(5/25)