Document (#35633)

Author

Buchanan, S.
Salako, A.

Title

Evaluating the usability and usefulness of a digital library

Source

Library review. 58(2009) no.9, S.638-651

Year

2009

Abstract

Purpose - System usability and system usefulness are interdependent properties of system interaction, which in combination, determine system satisfaction and usage. Often approached separately, or in the case of digital libraries, often focused upon usability, there is emerging consensus among the research community for their unified treatment and research attention. However, a key challenge is to identify, both respectively and relatively, what to measure and how, compounded by concerns regarding common understanding of usability measures, and associated calls for more valid and complete measures within integrated and comprehensive models. The purpose of this paper is to address this challenge. Design/methodology/approach - Identified key usability and usefulness attributes and associated measures, compiled an integrated measurement framework, identified a suitable methodological approach for application of the framework, and conducted a pilot study on an interactive search system developed by a Health Service as part of their e-library service. Findings - Effectiveness, efficiency, aesthetic appearance, terminology, navigation, and learnability are key attributes of system usability; and relevance, reliability, and currency key attributes of system usefulness. There are shared aspects to several of these attributes, but each is also sufficiently unique to preserve its respective validity. They can be combined as part of a multi-method approach to system evaluation. Research limitations/implications - Pilot study has demonstrated that usability and usefulness can be readily combined, and that questionnaire and observation are valid multi-method approaches, but further research is called for under a variety of conditions, with further combinations of methods, and larger samples. Originality/value - This paper provides an integrated measurement framework, derived from the goal, question, metric paradigm, which provides a relatively comprehensive and representative set of system usability and system usefulness attributes and associated measures, which could be adapted and further refined on a case-by-case basis.

Theme

Information Gateway

Similar documents (author)

1. Buchanan, B.: Glossary of indexing terms (1976) 5.30

   5.3016195 = sum of:
     5.3016195 = weight(author_txt:buchanan in 2500) [ClassicSimilarity], result of:
       5.3016195 = fieldWeight in 2500, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.482592 = idf(docFreq=24, maxDocs=44421)
         0.625 = fieldNorm(doc=2500)
   

2. Buchanan, N.L.: ¬The FirstSearch catalog : 37 databases and still growing (1993) 5.30

   5.3016195 = sum of:
     5.3016195 = weight(author_txt:buchanan in 6967) [ClassicSimilarity], result of:
       5.3016195 = fieldWeight in 6967, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.482592 = idf(docFreq=24, maxDocs=44421)
         0.625 = fieldNorm(doc=6967)
   

3. Buchanan, E.A.: Ethical transformations in a global information age (1996) 5.30

   5.3016195 = sum of:
     5.3016195 = weight(author_txt:buchanan in 3449) [ClassicSimilarity], result of:
       5.3016195 = fieldWeight in 3449, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.482592 = idf(docFreq=24, maxDocs=44421)
         0.625 = fieldNorm(doc=3449)
   

4. Buchanan, B.: Bibliothekarische Klassifikationstheorie (1989) 5.30

   5.3016195 = sum of:
     5.3016195 = weight(author_txt:buchanan in 908) [ClassicSimilarity], result of:
       5.3016195 = fieldWeight in 908, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.482592 = idf(docFreq=24, maxDocs=44421)
         0.625 = fieldNorm(doc=908)
   

5. Buchanan, S.A.: Regional information science : education and disciplinary precept in the Los Angeles Chapter of ASIST, 1961-2011 (2011) 5.30

   5.3016195 = sum of:
     5.3016195 = weight(author_txt:buchanan in 928) [ClassicSimilarity], result of:
       5.3016195 = fieldWeight in 928, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.482592 = idf(docFreq=24, maxDocs=44421)
         0.625 = fieldNorm(doc=928)
   

Similar documents (content)

1. O'Brien, H.L.; Lebow, M.: Mixed-methods approach to measuring user experience in online news interactions (2013) 0.22

   0.21539378 = sum of:
     0.21539378 = product of:
       0.6731056 = sum of:
         0.0177193 = weight(abstract_txt:approach in 2001) [ClassicSimilarity], result of:
           0.0177193 = score(doc=2001,freq=1.0), product of:
             0.075781316 = queryWeight, product of:
               1.2249918 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.016535776 = queryNorm
             0.2338215 = fieldWeight in 2001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=2001)
         0.020126857 = weight(abstract_txt:research in 2001) [ClassicSimilarity], result of:
           0.020126857 = score(doc=2001,freq=2.0), product of:
             0.072069466 = queryWeight, product of:
               1.379422 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.016535776 = queryNorm
             0.27927023 = fieldWeight in 2001, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.0625 = fieldNorm(doc=2001)
         0.031761054 = weight(abstract_txt:framework in 2001) [ClassicSimilarity], result of:
           0.031761054 = score(doc=2001,freq=1.0), product of:
             0.11182211 = queryWeight, product of:
               1.4880446 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.016535776 = queryNorm
             0.28403196 = fieldWeight in 2001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.0625 = fieldNorm(doc=2001)
         0.074834466 = weight(abstract_txt:measurement in 2001) [ClassicSimilarity], result of:
           0.074834466 = score(doc=2001,freq=1.0), product of:
             0.17296907 = queryWeight, product of:
               1.5110912 = boost
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.016535776 = queryNorm
             0.4326465 = fieldWeight in 2001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.0625 = fieldNorm(doc=2001)
         0.044434898 = weight(abstract_txt:associated in 2001) [ClassicSimilarity], result of:
           0.044434898 = score(doc=2001,freq=1.0), product of:
             0.13987729 = queryWeight, product of:
               1.6642773 = boost
               5.082729 = idf(docFreq=748, maxDocs=44421)
               0.016535776 = queryNorm
             0.31767055 = fieldWeight in 2001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.082729 = idf(docFreq=748, maxDocs=44421)
               0.0625 = fieldNorm(doc=2001)
         0.07203261 = weight(abstract_txt:measures in 2001) [ClassicSimilarity], result of:
           0.07203261 = score(doc=2001,freq=1.0), product of:
             0.21245328 = queryWeight, product of:
               2.3683898 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.016535776 = queryNorm
             0.3390515 = fieldWeight in 2001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.0625 = fieldNorm(doc=2001)
         0.04327871 = weight(abstract_txt:system in 2001) [ClassicSimilarity], result of:
           0.04327871 = score(doc=2001,freq=1.0), product of:
             0.20530848 = queryWeight, product of:
               3.6812468 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.016535776 = queryNorm
             0.21079844 = fieldWeight in 2001, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=2001)
         0.3689177 = weight(abstract_txt:usability in 2001) [ClassicSimilarity], result of:
           0.3689177 = score(doc=2001,freq=3.0), product of:
             0.5514421 = queryWeight, product of:
               5.39618 = boost
               6.1800065 = idf(docFreq=249, maxDocs=44421)
               0.016535776 = queryNorm
             0.66900533 = fieldWeight in 2001, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1800065 = idf(docFreq=249, maxDocs=44421)
               0.0625 = fieldNorm(doc=2001)
       0.32 = coord(8/25)
   

2. Yao, Y.Y.: Measuring retrieval effectiveness based on user preference of documents (1995) 0.21

   0.21195896 = sum of:
     0.21195896 = product of:
       0.66237175 = sum of:
         0.022149125 = weight(abstract_txt:approach in 1816) [ClassicSimilarity], result of:
           0.022149125 = score(doc=1816,freq=1.0), product of:
             0.075781316 = queryWeight, product of:
               1.2249918 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.016535776 = queryNorm
             0.29227686 = fieldWeight in 1816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.078125 = fieldNorm(doc=1816)
         0.039701317 = weight(abstract_txt:framework in 1816) [ClassicSimilarity], result of:
           0.039701317 = score(doc=1816,freq=1.0), product of:
             0.11182211 = queryWeight, product of:
               1.4880446 = boost
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.016535776 = queryNorm
             0.35503995 = fieldWeight in 1816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5445113 = idf(docFreq=1282, maxDocs=44421)
               0.078125 = fieldNorm(doc=1816)
         0.09320423 = weight(abstract_txt:valid in 1816) [ClassicSimilarity], result of:
           0.09320423 = score(doc=1816,freq=1.0), product of:
             0.17255111 = queryWeight, product of:
               1.5092645 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.016535776 = queryNorm
             0.54015434 = fieldWeight in 1816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.078125 = fieldNorm(doc=1816)
         0.09354308 = weight(abstract_txt:measurement in 1816) [ClassicSimilarity], result of:
           0.09354308 = score(doc=1816,freq=1.0), product of:
             0.17296907 = queryWeight, product of:
               1.5110912 = boost
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.016535776 = queryNorm
             0.54080814 = fieldWeight in 1816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.078125 = fieldNorm(doc=1816)
         0.0427831 = weight(abstract_txt:further in 1816) [ClassicSimilarity], result of:
           0.0427831 = score(doc=1816,freq=1.0), product of:
             0.117536455 = queryWeight, product of:
               1.525592 = boost
               4.6591816 = idf(docFreq=1143, maxDocs=44421)
               0.016535776 = queryNorm
             0.36399856 = fieldWeight in 1816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6591816 = idf(docFreq=1143, maxDocs=44421)
               0.078125 = fieldNorm(doc=1816)
         0.09004076 = weight(abstract_txt:measures in 1816) [ClassicSimilarity], result of:
           0.09004076 = score(doc=1816,freq=1.0), product of:
             0.21245328 = queryWeight, product of:
               2.3683898 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.016535776 = queryNorm
             0.4238144 = fieldWeight in 1816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=1816)
         0.093701154 = weight(abstract_txt:system in 1816) [ClassicSimilarity], result of:
           0.093701154 = score(doc=1816,freq=3.0), product of:
             0.20530848 = queryWeight, product of:
               3.6812468 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.016535776 = queryNorm
             0.45639202 = fieldWeight in 1816, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=1816)
         0.18724898 = weight(abstract_txt:usefulness in 1816) [ClassicSimilarity], result of:
           0.18724898 = score(doc=1816,freq=1.0), product of:
             0.39623004 = queryWeight, product of:
               3.9613278 = boost
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.016535776 = queryNorm
             0.47257644 = fieldWeight in 1816, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.078125 = fieldNorm(doc=1816)
       0.32 = coord(8/25)
   

3. Craven, J.; Johnson, F.; Butters, G.: ¬The usability and functionality of an online catalogue (2010) 0.19

   0.19338658 = sum of:
     0.19338658 = product of:
       0.9669329 = sum of:
         0.0177193 = weight(abstract_txt:approach in 939) [ClassicSimilarity], result of:
           0.0177193 = score(doc=939,freq=1.0), product of:
             0.075781316 = queryWeight, product of:
               1.2249918 = boost
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.016535776 = queryNorm
             0.2338215 = fieldWeight in 939, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.741144 = idf(docFreq=2864, maxDocs=44421)
               0.0625 = fieldNorm(doc=939)
         0.12987264 = weight(abstract_txt:attributes in 939) [ClassicSimilarity], result of:
           0.12987264 = score(doc=939,freq=1.0), product of:
             0.33902037 = queryWeight, product of:
               3.344948 = boost
               6.1293135 = idf(docFreq=262, maxDocs=44421)
               0.016535776 = queryNorm
             0.3830821 = fieldWeight in 939, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1293135 = idf(docFreq=262, maxDocs=44421)
               0.0625 = fieldNorm(doc=939)
         0.10601076 = weight(abstract_txt:system in 939) [ClassicSimilarity], result of:
           0.10601076 = score(doc=939,freq=6.0), product of:
             0.20530848 = queryWeight, product of:
               3.6812468 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.016535776 = queryNorm
             0.51634866 = fieldWeight in 939, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=939)
         0.14979918 = weight(abstract_txt:usefulness in 939) [ClassicSimilarity], result of:
           0.14979918 = score(doc=939,freq=1.0), product of:
             0.39623004 = queryWeight, product of:
               3.9613278 = boost
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.016535776 = queryNorm
             0.37806115 = fieldWeight in 939, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.0625 = fieldNorm(doc=939)
         0.56353104 = weight(abstract_txt:usability in 939) [ClassicSimilarity], result of:
           0.56353104 = score(doc=939,freq=7.0), product of:
             0.5514421 = queryWeight, product of:
               5.39618 = boost
               6.1800065 = idf(docFreq=249, maxDocs=44421)
               0.016535776 = queryNorm
             1.0219225 = fieldWeight in 939, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.1800065 = idf(docFreq=249, maxDocs=44421)
               0.0625 = fieldNorm(doc=939)
       0.2 = coord(5/25)
   

4. Treglown, M.: HIBROWSE for bibliographic databases : a study of the application of usability techniques in view-based searching (1997) 0.19

   0.18828882 = sum of:
     0.18828882 = product of:
       0.9414441 = sum of:
         0.047268674 = weight(abstract_txt:multi in 1767) [ClassicSimilarity], result of:
           0.047268674 = score(doc=1767,freq=1.0), product of:
             0.12733553 = queryWeight, product of:
               1.2965262 = boost
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.016535776 = queryNorm
             0.37121353 = fieldWeight in 1767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9394164 = idf(docFreq=317, maxDocs=44421)
               0.0625 = fieldNorm(doc=1767)
         0.074834466 = weight(abstract_txt:measurement in 1767) [ClassicSimilarity], result of:
           0.074834466 = score(doc=1767,freq=1.0), product of:
             0.17296907 = queryWeight, product of:
               1.5110912 = boost
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.016535776 = queryNorm
             0.4326465 = fieldWeight in 1767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.0625 = fieldNorm(doc=1767)
         0.10601076 = weight(abstract_txt:system in 1767) [ClassicSimilarity], result of:
           0.10601076 = score(doc=1767,freq=6.0), product of:
             0.20530848 = queryWeight, product of:
               3.6812468 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.016535776 = queryNorm
             0.51634866 = fieldWeight in 1767, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.0625 = fieldNorm(doc=1767)
         0.14979918 = weight(abstract_txt:usefulness in 1767) [ClassicSimilarity], result of:
           0.14979918 = score(doc=1767,freq=1.0), product of:
             0.39623004 = queryWeight, product of:
               3.9613278 = boost
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.016535776 = queryNorm
             0.37806115 = fieldWeight in 1767, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.0625 = fieldNorm(doc=1767)
         0.56353104 = weight(abstract_txt:usability in 1767) [ClassicSimilarity], result of:
           0.56353104 = score(doc=1767,freq=7.0), product of:
             0.5514421 = queryWeight, product of:
               5.39618 = boost
               6.1800065 = idf(docFreq=249, maxDocs=44421)
               0.016535776 = queryNorm
             1.0219225 = fieldWeight in 1767, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.1800065 = idf(docFreq=249, maxDocs=44421)
               0.0625 = fieldNorm(doc=1767)
       0.2 = coord(5/25)
   

5. Cheung, C.M.K.; Lee, M.K.O.: ¬The structure of Web-based information systems satisfaction : testing of competing models (2008) 0.18

   0.1754481 = sum of:
     0.1754481 = product of:
       0.7310338 = sum of:
         0.017789796 = weight(abstract_txt:research in 3005) [ClassicSimilarity], result of:
           0.017789796 = score(doc=3005,freq=1.0), product of:
             0.072069466 = queryWeight, product of:
               1.379422 = boost
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.016535776 = queryNorm
             0.24684234 = fieldWeight in 3005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.159582 = idf(docFreq=5124, maxDocs=44421)
               0.078125 = fieldNorm(doc=3005)
         0.09320423 = weight(abstract_txt:valid in 3005) [ClassicSimilarity], result of:
           0.09320423 = score(doc=3005,freq=1.0), product of:
             0.17255111 = queryWeight, product of:
               1.5092645 = boost
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.016535776 = queryNorm
             0.54015434 = fieldWeight in 3005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9139757 = idf(docFreq=119, maxDocs=44421)
               0.078125 = fieldNorm(doc=3005)
         0.09004076 = weight(abstract_txt:measures in 3005) [ClassicSimilarity], result of:
           0.09004076 = score(doc=3005,freq=1.0), product of:
             0.21245328 = queryWeight, product of:
               2.3683898 = boost
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.016535776 = queryNorm
             0.4238144 = fieldWeight in 3005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.424824 = idf(docFreq=531, maxDocs=44421)
               0.078125 = fieldNorm(doc=3005)
         0.07650667 = weight(abstract_txt:system in 3005) [ClassicSimilarity], result of:
           0.07650667 = score(doc=3005,freq=2.0), product of:
             0.20530848 = queryWeight, product of:
               3.6812468 = boost
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.016535776 = queryNorm
             0.37264252 = fieldWeight in 3005, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.372775 = idf(docFreq=4140, maxDocs=44421)
               0.078125 = fieldNorm(doc=3005)
         0.18724898 = weight(abstract_txt:usefulness in 3005) [ClassicSimilarity], result of:
           0.18724898 = score(doc=3005,freq=1.0), product of:
             0.39623004 = queryWeight, product of:
               3.9613278 = boost
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.016535776 = queryNorm
             0.47257644 = fieldWeight in 3005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0489783 = idf(docFreq=284, maxDocs=44421)
               0.078125 = fieldNorm(doc=3005)
         0.2662434 = weight(abstract_txt:usability in 3005) [ClassicSimilarity], result of:
           0.2662434 = score(doc=3005,freq=1.0), product of:
             0.5514421 = queryWeight, product of:
               5.39618 = boost
               6.1800065 = idf(docFreq=249, maxDocs=44421)
               0.016535776 = queryNorm
             0.482813 = fieldWeight in 3005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1800065 = idf(docFreq=249, maxDocs=44421)
               0.078125 = fieldNorm(doc=3005)
       0.24 = coord(6/25)