Document (#36136)

Author

Arazy, O.
Kopak, R.

Title

On the measurability of information quality

Source

Journal of the American Society for Information Science and Technology. 62(2011) no.1, S.89-99

Year

2011

Abstract

The notion of information quality (IQ) has been investigated extensively in recent years. Much of this research has been aimed at conceptualizing IQ and its underlying dimensions (e.g., accuracy, completeness) and at developing instruments for measuring these quality dimensions. However, less attention has been given to the measurability of IQ. The objective of this study is to explore the extent to which a set of IQ dimensions-accuracy, completeness, objectivity, and representation-lend themselves to reliable measurement. By reliable measurement, we refer to the degree to which independent assessors are able to agree when rating objects on these various dimensions. Our study reveals that multiple assessors tend to agree more on certain dimensions (e.g., accuracy) while finding it more difficult to agree on others (e.g., completeness). We argue that differences in measurability stem from properties inherent to the quality dimension (i.e., the availability of heuristics that make the assessment more tangible) as well as on assessors' reliance on these cues. Implications for theory and practice are discussed.

Similar documents (author)

1. Arazy, O.; Yeo, L.; Nov, O.: Stay on the Wikipedia task : when task-related disagreements slip into personal and procedural conflicts (2013) 3.72

   3.7161405 = sum of:
     3.7161405 = weight(author_txt:arazy in 2006) [ClassicSimilarity], result of:
       3.7161405 = fieldWeight in 2006, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.375 = fieldNorm(doc=2006)
   

2. Arazy, O.; Lifshitz-Assaf, H.; Balila, A.: Neither a Bazaar nor a cathedral : the interplay between structure and agency in Wikipedia's role system (2019) 3.72

   3.7161405 = sum of:
     3.7161405 = weight(author_txt:arazy in 670) [ClassicSimilarity], result of:
       3.7161405 = fieldWeight in 670, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.375 = fieldNorm(doc=670)
   

3. Arazy, O.; Gellatly, I.; Brainin, E.; Nov, O.: Motivation to share knowledge using wiki technology and the moderating effect of role perceptions (2016) 3.10

   3.0967836 = sum of:
     3.0967836 = weight(author_txt:arazy in 4143) [ClassicSimilarity], result of:
       3.0967836 = fieldWeight in 4143, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.3125 = fieldNorm(doc=4143)
   

4. Arazy, O.; Stroulia, E.; Ruecker, S.; Arias, C.; Fiorentino, C.; Ganev, V.; Yau, T.: Recognizing contributions in wikis : authorship categories, algorithms, and visualizations (2010) 2.48

   2.477427 = sum of:
     2.477427 = weight(author_txt:arazy in 454) [ClassicSimilarity], result of:
       2.477427 = fieldWeight in 454, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.909708 = idf(docFreq=5, maxDocs=44421)
         0.25 = fieldNorm(doc=454)
   

Similar documents (content)

1. Miller, H.: ¬The multiple dimensions of information quality (1996) 0.20

   0.20383537 = sum of:
     0.20383537 = product of:
       1.0191768 = sum of:
         0.024709411 = weight(abstract_txt:these in 4828) [ClassicSimilarity], result of:
           0.024709411 = score(doc=4828,freq=1.0), product of:
             0.062105883 = queryWeight, product of:
               1.3979608 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.013957837 = queryNorm
             0.39785942 = fieldWeight in 4828, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.125 = fieldNorm(doc=4828)
         0.16184774 = weight(abstract_txt:accuracy in 4828) [ClassicSimilarity], result of:
           0.16184774 = score(doc=4828,freq=1.0), product of:
             0.21741804 = queryWeight, product of:
               2.6156306 = boost
               5.9552646 = idf(docFreq=312, maxDocs=44421)
               0.013957837 = queryNorm
             0.7444081 = fieldWeight in 4828, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9552646 = idf(docFreq=312, maxDocs=44421)
               0.125 = fieldNorm(doc=4828)
         0.10236221 = weight(abstract_txt:quality in 4828) [ClassicSimilarity], result of:
           0.10236221 = score(doc=4828,freq=1.0), product of:
             0.1763182 = queryWeight, product of:
               2.71986 = boost
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.013957837 = queryNorm
             0.5805538 = fieldWeight in 4828, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.125 = fieldNorm(doc=4828)
         0.35942352 = weight(abstract_txt:completeness in 4828) [ClassicSimilarity], result of:
           0.35942352 = score(doc=4828,freq=1.0), product of:
             0.37007987 = queryWeight, product of:
               3.412529 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.013957837 = queryNorm
             0.97120523 = fieldWeight in 4828, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.125 = fieldNorm(doc=4828)
         0.37083402 = weight(abstract_txt:dimensions in 4828) [ClassicSimilarity], result of:
           0.37083402 = score(doc=4828,freq=2.0), product of:
             0.35559076 = queryWeight, product of:
               4.3184533 = boost
               5.899349 = idf(docFreq=330, maxDocs=44421)
               0.013957837 = queryNorm
             1.0428674 = fieldWeight in 4828, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.899349 = idf(docFreq=330, maxDocs=44421)
               0.125 = fieldNorm(doc=4828)
       0.2 = coord(5/25)
   

2. Zhang, Y.; Trace, C.B.: ¬The quality of health and wellness self-tracking data : a consumer perspective (2022) 0.18

   0.18493342 = sum of:
     0.18493342 = product of:
       0.6604765 = sum of:
         0.008777924 = weight(abstract_txt:that in 1460) [ClassicSimilarity], result of:
           0.008777924 = score(doc=1460,freq=3.0), product of:
             0.034287196 = queryWeight, product of:
               1.0387107 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013957837 = queryNorm
             0.25601172 = fieldWeight in 1460, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1460)
         0.0123547055 = weight(abstract_txt:these in 1460) [ClassicSimilarity], result of:
           0.0123547055 = score(doc=1460,freq=1.0), product of:
             0.062105883 = queryWeight, product of:
               1.3979608 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.013957837 = queryNorm
             0.19892971 = fieldWeight in 1460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=1460)
         0.015009458 = weight(abstract_txt:more in 1460) [ClassicSimilarity], result of:
           0.015009458 = score(doc=1460,freq=1.0), product of:
             0.070711136 = queryWeight, product of:
               1.4916693 = boost
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.013957837 = queryNorm
             0.21226442 = fieldWeight in 1460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3962307 = idf(docFreq=4044, maxDocs=44421)
               0.0625 = fieldNorm(doc=1460)
         0.114443645 = weight(abstract_txt:accuracy in 1460) [ClassicSimilarity], result of:
           0.114443645 = score(doc=1460,freq=2.0), product of:
             0.21741804 = queryWeight, product of:
               2.6156306 = boost
               5.9552646 = idf(docFreq=312, maxDocs=44421)
               0.013957837 = queryNorm
             0.526376 = fieldWeight in 1460, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9552646 = idf(docFreq=312, maxDocs=44421)
               0.0625 = fieldNorm(doc=1460)
         0.14476202 = weight(abstract_txt:quality in 1460) [ClassicSimilarity], result of:
           0.14476202 = score(doc=1460,freq=8.0), product of:
             0.1763182 = queryWeight, product of:
               2.71986 = boost
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.013957837 = queryNorm
             0.8210271 = fieldWeight in 1460, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.0625 = fieldNorm(doc=1460)
         0.17971176 = weight(abstract_txt:completeness in 1460) [ClassicSimilarity], result of:
           0.17971176 = score(doc=1460,freq=1.0), product of:
             0.37007987 = queryWeight, product of:
               3.412529 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.013957837 = queryNorm
             0.48560262 = fieldWeight in 1460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=1460)
         0.18541701 = weight(abstract_txt:dimensions in 1460) [ClassicSimilarity], result of:
           0.18541701 = score(doc=1460,freq=2.0), product of:
             0.35559076 = queryWeight, product of:
               4.3184533 = boost
               5.899349 = idf(docFreq=330, maxDocs=44421)
               0.013957837 = queryNorm
             0.5214337 = fieldWeight in 1460, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.899349 = idf(docFreq=330, maxDocs=44421)
               0.0625 = fieldNorm(doc=1460)
       0.28 = coord(7/25)
   

3. Gonçalves, M.A.; Moreira, B.L.; Fox, E.A.; Watson, L.T.: "What is a good digital library?" : a quality model for digital libraries (2007) 0.18

   0.18177979 = sum of:
     0.18177979 = product of:
       0.7574158 = sum of:
         0.005067937 = weight(abstract_txt:that in 1937) [ClassicSimilarity], result of:
           0.005067937 = score(doc=1937,freq=1.0), product of:
             0.034287196 = queryWeight, product of:
               1.0387107 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013957837 = queryNorm
             0.14780845 = fieldWeight in 1937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=1937)
         0.0847309 = weight(abstract_txt:measurement in 1937) [ClassicSimilarity], result of:
           0.0847309 = score(doc=1937,freq=1.0), product of:
             0.19584325 = queryWeight, product of:
               2.0269232 = boost
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.013957837 = queryNorm
             0.4326465 = fieldWeight in 1937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.922344 = idf(docFreq=118, maxDocs=44421)
               0.0625 = fieldNorm(doc=1937)
         0.08092387 = weight(abstract_txt:accuracy in 1937) [ClassicSimilarity], result of:
           0.08092387 = score(doc=1937,freq=1.0), product of:
             0.21741804 = queryWeight, product of:
               2.6156306 = boost
               5.9552646 = idf(docFreq=312, maxDocs=44421)
               0.013957837 = queryNorm
             0.37220404 = fieldWeight in 1937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9552646 = idf(docFreq=312, maxDocs=44421)
               0.0625 = fieldNorm(doc=1937)
         0.14476202 = weight(abstract_txt:quality in 1937) [ClassicSimilarity], result of:
           0.14476202 = score(doc=1937,freq=8.0), product of:
             0.1763182 = queryWeight, product of:
               2.71986 = boost
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.013957837 = queryNorm
             0.8210271 = fieldWeight in 1937, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.0625 = fieldNorm(doc=1937)
         0.17971176 = weight(abstract_txt:completeness in 1937) [ClassicSimilarity], result of:
           0.17971176 = score(doc=1937,freq=1.0), product of:
             0.37007987 = queryWeight, product of:
               3.412529 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.013957837 = queryNorm
             0.48560262 = fieldWeight in 1937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=1937)
         0.26221925 = weight(abstract_txt:dimensions in 1937) [ClassicSimilarity], result of:
           0.26221925 = score(doc=1937,freq=4.0), product of:
             0.35559076 = queryWeight, product of:
               4.3184533 = boost
               5.899349 = idf(docFreq=330, maxDocs=44421)
               0.013957837 = queryNorm
             0.73741865 = fieldWeight in 1937, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.899349 = idf(docFreq=330, maxDocs=44421)
               0.0625 = fieldNorm(doc=1937)
       0.24 = coord(6/25)
   

4. Verberne, S.; Heijden, M. van der; Hinne, M.; Sappelli, M.; Koldijk, S.; Hoenkamp, E.; Kraaij, W.: Reliability and validity of query intent assessments (2013) 0.17

   0.17061563 = sum of:
     0.17061563 = product of:
       0.71089846 = sum of:
         0.010174895 = weight(abstract_txt:study in 2104) [ClassicSimilarity], result of:
           0.010174895 = score(doc=2104,freq=1.0), product of:
             0.047668777 = queryWeight, product of:
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.013957837 = queryNorm
             0.21344988 = fieldWeight in 2104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=2104)
         0.008777924 = weight(abstract_txt:that in 2104) [ClassicSimilarity], result of:
           0.008777924 = score(doc=2104,freq=3.0), product of:
             0.034287196 = queryWeight, product of:
               1.0387107 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013957837 = queryNorm
             0.25601172 = fieldWeight in 2104, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=2104)
         0.017472193 = weight(abstract_txt:these in 2104) [ClassicSimilarity], result of:
           0.017472193 = score(doc=2104,freq=2.0), product of:
             0.062105883 = queryWeight, product of:
               1.3979608 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.013957837 = queryNorm
             0.2813291 = fieldWeight in 2104, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=2104)
         0.051181104 = weight(abstract_txt:quality in 2104) [ClassicSimilarity], result of:
           0.051181104 = score(doc=2104,freq=1.0), product of:
             0.1763182 = queryWeight, product of:
               2.71986 = boost
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.013957837 = queryNorm
             0.2902769 = fieldWeight in 2104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.0625 = fieldNorm(doc=2104)
         0.43787533 = weight(abstract_txt:assessors in 2104) [ClassicSimilarity], result of:
           0.43787533 = score(doc=2104,freq=3.0), product of:
             0.46462694 = queryWeight, product of:
               3.8236737 = boost
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.013957837 = queryNorm
             0.94242346 = fieldWeight in 2104, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.705735 = idf(docFreq=19, maxDocs=44421)
               0.0625 = fieldNorm(doc=2104)
         0.18541701 = weight(abstract_txt:dimensions in 2104) [ClassicSimilarity], result of:
           0.18541701 = score(doc=2104,freq=2.0), product of:
             0.35559076 = queryWeight, product of:
               4.3184533 = boost
               5.899349 = idf(docFreq=330, maxDocs=44421)
               0.013957837 = queryNorm
             0.5214337 = fieldWeight in 2104, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.899349 = idf(docFreq=330, maxDocs=44421)
               0.0625 = fieldNorm(doc=2104)
       0.24 = coord(6/25)
   

5. Zhang, Y.; Sun, Y.; Xie, B.: Quality of health information for consumers on the web : a systematic review of indicators, criteria, tools, and evaluation results (2015) 0.17

   0.1694972 = sum of:
     0.1694972 = product of:
       0.52967876 = sum of:
         0.010174895 = weight(abstract_txt:study in 3218) [ClassicSimilarity], result of:
           0.010174895 = score(doc=3218,freq=1.0), product of:
             0.047668777 = queryWeight, product of:
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.013957837 = queryNorm
             0.21344988 = fieldWeight in 3218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.415198 = idf(docFreq=3968, maxDocs=44421)
               0.0625 = fieldNorm(doc=3218)
         0.011332253 = weight(abstract_txt:that in 3218) [ClassicSimilarity], result of:
           0.011332253 = score(doc=3218,freq=5.0), product of:
             0.034287196 = queryWeight, product of:
               1.0387107 = boost
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.013957837 = queryNorm
             0.33050975 = fieldWeight in 3218, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3649352 = idf(docFreq=11344, maxDocs=44421)
               0.0625 = fieldNorm(doc=3218)
         0.07232684 = weight(abstract_txt:instruments in 3218) [ClassicSimilarity], result of:
           0.07232684 = score(doc=3218,freq=2.0), product of:
             0.111018084 = queryWeight, product of:
               1.0791079 = boost
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.013957837 = queryNorm
             0.651487 = fieldWeight in 3218, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.0625 = fieldNorm(doc=3218)
         0.0123547055 = weight(abstract_txt:these in 3218) [ClassicSimilarity], result of:
           0.0123547055 = score(doc=3218,freq=1.0), product of:
             0.062105883 = queryWeight, product of:
               1.3979608 = boost
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.013957837 = queryNorm
             0.19892971 = fieldWeight in 3218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1828754 = idf(docFreq=5006, maxDocs=44421)
               0.0625 = fieldNorm(doc=3218)
         0.018092446 = weight(abstract_txt:been in 3218) [ClassicSimilarity], result of:
           0.018092446 = score(doc=3218,freq=1.0), product of:
             0.08008958 = queryWeight, product of:
               1.5875106 = boost
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.013957837 = queryNorm
             0.22590263 = fieldWeight in 3218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.614442 = idf(docFreq=3251, maxDocs=44421)
               0.0625 = fieldNorm(doc=3218)
         0.08092387 = weight(abstract_txt:accuracy in 3218) [ClassicSimilarity], result of:
           0.08092387 = score(doc=3218,freq=1.0), product of:
             0.21741804 = queryWeight, product of:
               2.6156306 = boost
               5.9552646 = idf(docFreq=312, maxDocs=44421)
               0.013957837 = queryNorm
             0.37220404 = fieldWeight in 3218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9552646 = idf(docFreq=312, maxDocs=44421)
               0.0625 = fieldNorm(doc=3218)
         0.14476202 = weight(abstract_txt:quality in 3218) [ClassicSimilarity], result of:
           0.14476202 = score(doc=3218,freq=8.0), product of:
             0.1763182 = queryWeight, product of:
               2.71986 = boost
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.013957837 = queryNorm
             0.8210271 = fieldWeight in 3218, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.6444306 = idf(docFreq=1160, maxDocs=44421)
               0.0625 = fieldNorm(doc=3218)
         0.17971176 = weight(abstract_txt:completeness in 3218) [ClassicSimilarity], result of:
           0.17971176 = score(doc=3218,freq=1.0), product of:
             0.37007987 = queryWeight, product of:
               3.412529 = boost
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.013957837 = queryNorm
             0.48560262 = fieldWeight in 3218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.769642 = idf(docFreq=50, maxDocs=44421)
               0.0625 = fieldNorm(doc=3218)
       0.32 = coord(8/25)