Document (#36136)

Author

Arazy, O.
Kopak, R.

Title

On the measurability of information quality

Source

Journal of the American Society for Information Science and Technology. 62(2011) no.1, S.89-99

Year

2011

Abstract

The notion of information quality (IQ) has been investigated extensively in recent years. Much of this research has been aimed at conceptualizing IQ and its underlying dimensions (e.g., accuracy, completeness) and at developing instruments for measuring these quality dimensions. However, less attention has been given to the measurability of IQ. The objective of this study is to explore the extent to which a set of IQ dimensions-accuracy, completeness, objectivity, and representation-lend themselves to reliable measurement. By reliable measurement, we refer to the degree to which independent assessors are able to agree when rating objects on these various dimensions. Our study reveals that multiple assessors tend to agree more on certain dimensions (e.g., accuracy) while finding it more difficult to agree on others (e.g., completeness). We argue that differences in measurability stem from properties inherent to the quality dimension (i.e., the availability of heuristics that make the assessment more tangible) as well as on assessors' reliance on these cues. Implications for theory and practice are discussed.

Similar documents (author)

1. Arazy, O.; Yeo, L.; Nov, O.: Stay on the Wikipedia task : when task-related disagreements slip into personal and procedural conflicts (2013) 3.71

   3.7144227 = sum of:
     3.7144227 = weight(author_txt:arazy in 1006) [ClassicSimilarity], result of:
       3.7144227 = fieldWeight in 1006, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.905128 = idf(docFreq=5, maxDocs=44218)
         0.375 = fieldNorm(doc=1006)
   

2. Arazy, O.; Lifshitz-Assaf, H.; Balila, A.: Neither a Bazaar nor a cathedral : the interplay between structure and agency in Wikipedia's role system (2019) 3.71

   3.7144227 = sum of:
     3.7144227 = weight(author_txt:arazy in 4670) [ClassicSimilarity], result of:
       3.7144227 = fieldWeight in 4670, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.905128 = idf(docFreq=5, maxDocs=44218)
         0.375 = fieldNorm(doc=4670)
   

3. Arazy, O.; Gellatly, I.; Brainin, E.; Nov, O.: Motivation to share knowledge using wiki technology and the moderating effect of role perceptions (2016) 3.10

   3.0953524 = sum of:
     3.0953524 = weight(author_txt:arazy in 3143) [ClassicSimilarity], result of:
       3.0953524 = fieldWeight in 3143, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.905128 = idf(docFreq=5, maxDocs=44218)
         0.3125 = fieldNorm(doc=3143)
   

4. Arazy, O.; Stroulia, E.; Ruecker, S.; Arias, C.; Fiorentino, C.; Ganev, V.; Yau, T.: Recognizing contributions in wikis : authorship categories, algorithms, and visualizations (2010) 2.48

   2.476282 = sum of:
     2.476282 = weight(author_txt:arazy in 3467) [ClassicSimilarity], result of:
       2.476282 = fieldWeight in 3467, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.905128 = idf(docFreq=5, maxDocs=44218)
         0.25 = fieldNorm(doc=3467)
   

Similar documents (content)

1. Miller, H.: ¬The multiple dimensions of information quality (1996) 0.20

   0.20408686 = sum of:
     0.20408686 = product of:
       1.0204343 = sum of:
         0.024712376 = weight(abstract_txt:these in 4760) [ClassicSimilarity], result of:
           0.024712376 = score(doc=4760,freq=1.0), product of:
             0.062010974 = queryWeight, product of:
               1.396748 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.01392562 = queryNorm
             0.39851618 = fieldWeight in 4760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.125 = fieldNorm(doc=4760)
         0.16227001 = weight(abstract_txt:accuracy in 4760) [ClassicSimilarity], result of:
           0.16227001 = score(doc=4760,freq=1.0), product of:
             0.21744582 = queryWeight, product of:
               2.6155276 = boost
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.01392562 = queryNorm
             0.7462549 = fieldWeight in 4760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.125 = fieldNorm(doc=4760)
         0.102424495 = weight(abstract_txt:quality in 4760) [ClassicSimilarity], result of:
           0.102424495 = score(doc=4760,freq=1.0), product of:
             0.17610608 = queryWeight, product of:
               2.717943 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.01392562 = queryNorm
             0.5816068 = fieldWeight in 4760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.125 = fieldNorm(doc=4760)
         0.35706013 = weight(abstract_txt:completeness in 4760) [ClassicSimilarity], result of:
           0.35706013 = score(doc=4760,freq=1.0), product of:
             0.3678633 = queryWeight, product of:
               3.401943 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.01392562 = queryNorm
             0.9706327 = fieldWeight in 4760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.125 = fieldNorm(doc=4760)
         0.37396723 = weight(abstract_txt:dimensions in 4760) [ClassicSimilarity], result of:
           0.37396723 = score(doc=4760,freq=2.0), product of:
             0.35701588 = queryWeight, product of:
               4.3266516 = boost
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.01392562 = queryNorm
             1.0474807 = fieldWeight in 4760, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.125 = fieldNorm(doc=4760)
       0.2 = coord(5/25)
   

2. Zhang, Y.; Trace, C.B.: ¬The quality of health and wellness self-tracking data : a consumer perspective (2022) 0.19

   0.18515359 = sum of:
     0.18515359 = product of:
       0.6612628 = sum of:
         0.008786051 = weight(abstract_txt:that in 459) [ClassicSimilarity], result of:
           0.008786051 = score(doc=459,freq=3.0), product of:
             0.034253184 = queryWeight, product of:
               1.0380882 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01392562 = queryNorm
             0.2565032 = fieldWeight in 459, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=459)
         0.012356188 = weight(abstract_txt:these in 459) [ClassicSimilarity], result of:
           0.012356188 = score(doc=459,freq=1.0), product of:
             0.062010974 = queryWeight, product of:
               1.396748 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.01392562 = queryNorm
             0.19925809 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=459)
         0.015014582 = weight(abstract_txt:more in 459) [ClassicSimilarity], result of:
           0.015014582 = score(doc=459,freq=1.0), product of:
             0.070613496 = queryWeight, product of:
               1.4904851 = boost
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.01392562 = queryNorm
             0.2126305 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.0625 = fieldNorm(doc=459)
         0.11474222 = weight(abstract_txt:accuracy in 459) [ClassicSimilarity], result of:
           0.11474222 = score(doc=459,freq=2.0), product of:
             0.21744582 = queryWeight, product of:
               2.6155276 = boost
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.01392562 = queryNorm
             0.5276819 = fieldWeight in 459, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.0625 = fieldNorm(doc=459)
         0.1448501 = weight(abstract_txt:quality in 459) [ClassicSimilarity], result of:
           0.1448501 = score(doc=459,freq=8.0), product of:
             0.17610608 = queryWeight, product of:
               2.717943 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.01392562 = queryNorm
             0.8225162 = fieldWeight in 459, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.0625 = fieldNorm(doc=459)
         0.17853007 = weight(abstract_txt:completeness in 459) [ClassicSimilarity], result of:
           0.17853007 = score(doc=459,freq=1.0), product of:
             0.3678633 = queryWeight, product of:
               3.401943 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.01392562 = queryNorm
             0.48531634 = fieldWeight in 459, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=459)
         0.18698362 = weight(abstract_txt:dimensions in 459) [ClassicSimilarity], result of:
           0.18698362 = score(doc=459,freq=2.0), product of:
             0.35701588 = queryWeight, product of:
               4.3266516 = boost
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.01392562 = queryNorm
             0.52374035 = fieldWeight in 459, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.0625 = fieldNorm(doc=459)
       0.28 = coord(7/25)
   

3. Gonçalves, M.A.; Moreira, B.L.; Fox, E.A.; Watson, L.T.: "What is a good digital library?" : a quality model for digital libraries (2007) 0.18

   0.18203676 = sum of:
     0.18203676 = product of:
       0.7584865 = sum of:
         0.005072629 = weight(abstract_txt:that in 937) [ClassicSimilarity], result of:
           0.005072629 = score(doc=937,freq=1.0), product of:
             0.034253184 = queryWeight, product of:
               1.0380882 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01392562 = queryNorm
             0.1480922 = fieldWeight in 937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=937)
         0.08446389 = weight(abstract_txt:measurement in 937) [ClassicSimilarity], result of:
           0.08446389 = score(doc=937,freq=1.0), product of:
             0.19511732 = queryWeight, product of:
               2.0229542 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.01392562 = queryNorm
             0.43288767 = fieldWeight in 937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.0625 = fieldNorm(doc=937)
         0.081135005 = weight(abstract_txt:accuracy in 937) [ClassicSimilarity], result of:
           0.081135005 = score(doc=937,freq=1.0), product of:
             0.21744582 = queryWeight, product of:
               2.6155276 = boost
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.01392562 = queryNorm
             0.37312746 = fieldWeight in 937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.0625 = fieldNorm(doc=937)
         0.1448501 = weight(abstract_txt:quality in 937) [ClassicSimilarity], result of:
           0.1448501 = score(doc=937,freq=8.0), product of:
             0.17610608 = queryWeight, product of:
               2.717943 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.01392562 = queryNorm
             0.8225162 = fieldWeight in 937, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.0625 = fieldNorm(doc=937)
         0.17853007 = weight(abstract_txt:completeness in 937) [ClassicSimilarity], result of:
           0.17853007 = score(doc=937,freq=1.0), product of:
             0.3678633 = queryWeight, product of:
               3.401943 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.01392562 = queryNorm
             0.48531634 = fieldWeight in 937, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=937)
         0.26443478 = weight(abstract_txt:dimensions in 937) [ClassicSimilarity], result of:
           0.26443478 = score(doc=937,freq=4.0), product of:
             0.35701588 = queryWeight, product of:
               4.3266516 = boost
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.01392562 = queryNorm
             0.74068075 = fieldWeight in 937, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.0625 = fieldNorm(doc=937)
       0.24 = coord(6/25)
   

4. Verberne, S.; Heijden, M. van der; Hinne, M.; Sappelli, M.; Koldijk, S.; Hoenkamp, E.; Kraaij, W.: Reliability and validity of query intent assessments (2013) 0.17

   0.17219459 = sum of:
     0.17219459 = product of:
       0.71747744 = sum of:
         0.010202647 = weight(abstract_txt:study in 1104) [ClassicSimilarity], result of:
           0.010202647 = score(doc=1104,freq=1.0), product of:
             0.047678623 = queryWeight, product of:
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.01392562 = queryNorm
             0.21398787 = fieldWeight in 1104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=1104)
         0.008786051 = weight(abstract_txt:that in 1104) [ClassicSimilarity], result of:
           0.008786051 = score(doc=1104,freq=3.0), product of:
             0.034253184 = queryWeight, product of:
               1.0380882 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01392562 = queryNorm
             0.2565032 = fieldWeight in 1104, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=1104)
         0.017474288 = weight(abstract_txt:these in 1104) [ClassicSimilarity], result of:
           0.017474288 = score(doc=1104,freq=2.0), product of:
             0.062010974 = queryWeight, product of:
               1.396748 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.01392562 = queryNorm
             0.28179348 = fieldWeight in 1104, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=1104)
         0.051212247 = weight(abstract_txt:quality in 1104) [ClassicSimilarity], result of:
           0.051212247 = score(doc=1104,freq=1.0), product of:
             0.17610608 = queryWeight, product of:
               2.717943 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.01392562 = queryNorm
             0.2908034 = fieldWeight in 1104, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.0625 = fieldNorm(doc=1104)
         0.44281864 = weight(abstract_txt:assessors in 1104) [ClassicSimilarity], result of:
           0.44281864 = score(doc=1104,freq=3.0), product of:
             0.4673645 = queryWeight, product of:
               3.8345256 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.01392562 = queryNorm
             0.94748026 = fieldWeight in 1104, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0625 = fieldNorm(doc=1104)
         0.18698362 = weight(abstract_txt:dimensions in 1104) [ClassicSimilarity], result of:
           0.18698362 = score(doc=1104,freq=2.0), product of:
             0.35701588 = queryWeight, product of:
               4.3266516 = boost
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.01392562 = queryNorm
             0.52374035 = fieldWeight in 1104, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.925446 = idf(docFreq=320, maxDocs=44218)
               0.0625 = fieldNorm(doc=1104)
       0.24 = coord(6/25)
   

5. Zhang, Y.; Sun, Y.; Xie, B.: Quality of health information for consumers on the web : a systematic review of indicators, criteria, tools, and evaluation results (2015) 0.17

   0.16906029 = sum of:
     0.16906029 = product of:
       0.5283134 = sum of:
         0.010202647 = weight(abstract_txt:study in 2218) [ClassicSimilarity], result of:
           0.010202647 = score(doc=2218,freq=1.0), product of:
             0.047678623 = queryWeight, product of:
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.01392562 = queryNorm
             0.21398787 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.011342743 = weight(abstract_txt:that in 2218) [ClassicSimilarity], result of:
           0.011342743 = score(doc=2218,freq=5.0), product of:
             0.034253184 = queryWeight, product of:
               1.0380882 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01392562 = queryNorm
             0.3311442 = fieldWeight in 2218, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.07184437 = weight(abstract_txt:instruments in 2218) [ClassicSimilarity], result of:
           0.07184437 = score(doc=2218,freq=2.0), product of:
             0.110346094 = queryWeight, product of:
               1.0757259 = boost
               7.3661537 = idf(docFreq=75, maxDocs=44218)
               0.01392562 = queryNorm
             0.65108216 = fieldWeight in 2218, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3661537 = idf(docFreq=75, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.012356188 = weight(abstract_txt:these in 2218) [ClassicSimilarity], result of:
           0.012356188 = score(doc=2218,freq=1.0), product of:
             0.062010974 = queryWeight, product of:
               1.396748 = boost
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.01392562 = queryNorm
             0.19925809 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1881294 = idf(docFreq=4957, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.018052228 = weight(abstract_txt:been in 2218) [ClassicSimilarity], result of:
           0.018052228 = score(doc=2218,freq=1.0), product of:
             0.07984225 = queryWeight, product of:
               1.5848938 = boost
               3.617579 = idf(docFreq=3226, maxDocs=44218)
               0.01392562 = queryNorm
             0.22609869 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.617579 = idf(docFreq=3226, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.081135005 = weight(abstract_txt:accuracy in 2218) [ClassicSimilarity], result of:
           0.081135005 = score(doc=2218,freq=1.0), product of:
             0.21744582 = queryWeight, product of:
               2.6155276 = boost
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.01392562 = queryNorm
             0.37312746 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9700394 = idf(docFreq=306, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.1448501 = weight(abstract_txt:quality in 2218) [ClassicSimilarity], result of:
           0.1448501 = score(doc=2218,freq=8.0), product of:
             0.17610608 = queryWeight, product of:
               2.717943 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.01392562 = queryNorm
             0.8225162 = fieldWeight in 2218, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.17853007 = weight(abstract_txt:completeness in 2218) [ClassicSimilarity], result of:
           0.17853007 = score(doc=2218,freq=1.0), product of:
             0.3678633 = queryWeight, product of:
               3.401943 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.01392562 = queryNorm
             0.48531634 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
       0.32 = coord(8/25)