Document (#32916)

Author

Foulonneau, M.

Title

Information redundancy across metadata collections

Source

Information processing and management. 43(2007) no.3, S.740-751

Year

2007

Abstract

Metadata records made available by content providers often lack the implicit information of their original use environment. Metadata aggregators therefore tend to emphasize completeness as a primary quality for shareable metadata. However, when adding implicit information to item-level records, data providers increase the redundancy of information contained in records from the same collection. The present paper reports on an effort to assess the extent and potential impact of information redundancy in metadata collections aggregated using the Open Archives Protocol for Metadata Harvesting. The first experiment quantifies the resemblance of metadata records on a collection-by-collection basis across 176 metadata collections aggregated for the CIC metadata portal. A second experiment measures the tendency of items from the same collection to appear together in results lists generated for a set of user queries. Results of the analyses correlate and suggest that within some collections item-level metadata records are not sufficiently differentiated to support certain digital library functions well. Metadata collections have a distinct role when included in larger aggregations, and in that role a minimum level of descriptive granularity is required to support digital library functions implemented by service providers. The experiments suggest possible ways to deal simultaneously with metadata record completeness, consistency, and redundancy.

Footnote

Beitrag in: Special issue on Heterogeneous and Distributed IR

Theme

Metadaten

Similar documents (content)

1. Renear, A.H.; Wickett, K.M.; Urban, R.J.; Dubin, D.; Shreeves, S.L.: Collection/item metadata relationships (2008) 0.35

   0.34768996 = sum of:
     0.34768996 = product of:
       1.0865312 = sum of:
         0.024255555 = weight(abstract_txt:support in 3623) [ClassicSimilarity], result of:
           0.024255555 = score(doc=3623,freq=1.0), product of:
             0.07099679 = queryWeight, product of:
               1.0105292 = boost
               4.37303 = idf(docFreq=1522, maxDocs=44421)
               0.016065987 = queryNorm
             0.34164298 = fieldWeight in 3623, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.37303 = idf(docFreq=1522, maxDocs=44421)
               0.078125 = fieldNorm(doc=3623)
         0.038055066 = weight(abstract_txt:across in 3623) [ClassicSimilarity], result of:
           0.038055066 = score(doc=3623,freq=1.0), product of:
             0.095860474 = queryWeight, product of:
               1.1742195 = boost
               5.081394 = idf(docFreq=749, maxDocs=44421)
               0.016065987 = queryNorm
             0.39698392 = fieldWeight in 3623, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.081394 = idf(docFreq=749, maxDocs=44421)
               0.078125 = fieldNorm(doc=3623)
         0.014513505 = weight(abstract_txt:information in 3623) [ClassicSimilarity], result of:
           0.014513505 = score(doc=3623,freq=2.0), product of:
             0.054306205 = queryWeight, product of:
               1.3974112 = boost
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.016065987 = queryNorm
             0.26725316 = fieldWeight in 3623, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4188995 = idf(docFreq=10748, maxDocs=44421)
               0.078125 = fieldNorm(doc=3623)
         0.13158011 = weight(abstract_txt:item in 3623) [ClassicSimilarity], result of:
           0.13158011 = score(doc=3623,freq=3.0), product of:
             0.15197927 = queryWeight, product of:
               1.4785012 = boost
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.016065987 = queryNorm
             0.8657768 = fieldWeight in 3623, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.078125 = fieldNorm(doc=3623)
         0.08835993 = weight(abstract_txt:level in 3623) [ClassicSimilarity], result of:
           0.08835993 = score(doc=3623,freq=5.0), product of:
             0.11252316 = queryWeight, product of:
               1.5581027 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.016065987 = queryNorm
             0.78525996 = fieldWeight in 3623, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.078125 = fieldNorm(doc=3623)
         0.14283004 = weight(abstract_txt:collection in 3623) [ClassicSimilarity], result of:
           0.14283004 = score(doc=3623,freq=6.0), product of:
             0.16052297 = queryWeight, product of:
               2.1488845 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.016065987 = queryNorm
             0.88977945 = fieldWeight in 3623, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.078125 = fieldNorm(doc=3623)
         0.075162716 = weight(abstract_txt:collections in 3623) [ClassicSimilarity], result of:
           0.075162716 = score(doc=3623,freq=1.0), product of:
             0.20480767 = queryWeight, product of:
               2.7137673 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.016065987 = queryNorm
             0.3669917 = fieldWeight in 3623, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.078125 = fieldNorm(doc=3623)
         0.57177424 = weight(abstract_txt:metadata in 3623) [ClassicSimilarity], result of:
           0.57177424 = score(doc=3623,freq=8.0), product of:
             0.530316 = queryWeight, product of:
               6.765073 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.016065987 = queryNorm
             1.0781765 = fieldWeight in 3623, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.078125 = fieldNorm(doc=3623)
       0.32 = coord(8/25)
   

2. Stvilia, B.; Gasser, L.: Value-based metadata quality assessment (2008) 0.27

   0.2697658 = sum of:
     0.2697658 = product of:
       1.1240242 = sum of:
         0.03711494 = weight(abstract_txt:same in 1252) [ClassicSimilarity], result of:
           0.03711494 = score(doc=1252,freq=1.0), product of:
             0.08348522 = queryWeight, product of:
               1.0958076 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.016065987 = queryNorm
             0.444569 = fieldWeight in 1252, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.09375 = fieldNorm(doc=1252)
         0.13937257 = weight(abstract_txt:aggregated in 1252) [ClassicSimilarity], result of:
           0.13937257 = score(doc=1252,freq=1.0), product of:
             0.20169508 = queryWeight, product of:
               1.703245 = boost
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.016065987 = queryNorm
             0.6910063 = fieldWeight in 1252, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.09375 = fieldNorm(doc=1252)
         0.13994429 = weight(abstract_txt:collection in 1252) [ClassicSimilarity], result of:
           0.13994429 = score(doc=1252,freq=4.0), product of:
             0.16052297 = queryWeight, product of:
               2.1488845 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.016065987 = queryNorm
             0.8718022 = fieldWeight in 1252, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.09375 = fieldNorm(doc=1252)
         0.13803494 = weight(abstract_txt:providers in 1252) [ClassicSimilarity], result of:
           0.13803494 = score(doc=1252,freq=1.0), product of:
             0.22940359 = queryWeight, product of:
               2.2247193 = boost
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.016065987 = queryNorm
             0.6017122 = fieldWeight in 1252, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.418264 = idf(docFreq=196, maxDocs=44421)
               0.09375 = fieldNorm(doc=1252)
         0.07535208 = weight(abstract_txt:records in 1252) [ClassicSimilarity], result of:
           0.07535208 = score(doc=1252,freq=1.0), product of:
             0.1816717 = queryWeight, product of:
               2.5558958 = boost
               4.42422 = idf(docFreq=1446, maxDocs=44421)
               0.016065987 = queryNorm
             0.41477063 = fieldWeight in 1252, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.42422 = idf(docFreq=1446, maxDocs=44421)
               0.09375 = fieldNorm(doc=1252)
         0.59420526 = weight(abstract_txt:metadata in 1252) [ClassicSimilarity], result of:
           0.59420526 = score(doc=1252,freq=6.0), product of:
             0.530316 = queryWeight, product of:
               6.765073 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.016065987 = queryNorm
             1.120474 = fieldWeight in 1252, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.09375 = fieldNorm(doc=1252)
       0.24 = coord(6/25)
   

3. Park, J.-r.: Semantic interoperability and metadata quality : an analysis of metadata item records of digital image collections (2006) 0.25

   0.25112382 = sum of:
     0.25112382 = product of:
       0.8968708 = sum of:
         0.032569814 = weight(abstract_txt:digital in 297) [ClassicSimilarity], result of:
           0.032569814 = score(doc=297,freq=3.0), product of:
             0.069525 = queryWeight, product of:
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.016065987 = queryNorm
             0.46846187 = fieldWeight in 297, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.0625 = fieldNorm(doc=297)
         0.04305439 = weight(abstract_txt:across in 297) [ClassicSimilarity], result of:
           0.04305439 = score(doc=297,freq=2.0), product of:
             0.095860474 = queryWeight, product of:
               1.1742195 = boost
               5.081394 = idf(docFreq=749, maxDocs=44421)
               0.016065987 = queryNorm
             0.44913602 = fieldWeight in 297, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.081394 = idf(docFreq=749, maxDocs=44421)
               0.0625 = fieldNorm(doc=297)
         0.04586708 = weight(abstract_txt:suggest in 297) [ClassicSimilarity], result of:
           0.04586708 = score(doc=297,freq=2.0), product of:
             0.099991255 = queryWeight, product of:
               1.1992521 = boost
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.016065987 = queryNorm
             0.45871094 = fieldWeight in 297, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.189722 = idf(docFreq=672, maxDocs=44421)
               0.0625 = fieldNorm(doc=297)
         0.060774256 = weight(abstract_txt:item in 297) [ClassicSimilarity], result of:
           0.060774256 = score(doc=297,freq=1.0), product of:
             0.15197927 = queryWeight, product of:
               1.4785012 = boost
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.016065987 = queryNorm
             0.39988518 = fieldWeight in 297, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.0625 = fieldNorm(doc=297)
         0.050234724 = weight(abstract_txt:records in 297) [ClassicSimilarity], result of:
           0.050234724 = score(doc=297,freq=1.0), product of:
             0.1816717 = queryWeight, product of:
               2.5558958 = boost
               4.42422 = idf(docFreq=1446, maxDocs=44421)
               0.016065987 = queryNorm
             0.27651376 = fieldWeight in 297, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.42422 = idf(docFreq=1446, maxDocs=44421)
               0.0625 = fieldNorm(doc=297)
         0.10414851 = weight(abstract_txt:collections in 297) [ClassicSimilarity], result of:
           0.10414851 = score(doc=297,freq=3.0), product of:
             0.20480767 = queryWeight, product of:
               2.7137673 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.016065987 = queryNorm
             0.5085186 = fieldWeight in 297, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0625 = fieldNorm(doc=297)
         0.560222 = weight(abstract_txt:metadata in 297) [ClassicSimilarity], result of:
           0.560222 = score(doc=297,freq=12.0), product of:
             0.530316 = queryWeight, product of:
               6.765073 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.016065987 = queryNorm
             1.0563929 = fieldWeight in 297, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.0625 = fieldNorm(doc=297)
       0.28 = coord(7/25)
   

4. McCallum, S.H.: Library of Congress metadata landscape (2003) 0.22

   0.22280161 = sum of:
     0.22280161 = product of:
       0.696255 = sum of:
         0.01880419 = weight(abstract_txt:digital in 2760) [ClassicSimilarity], result of:
           0.01880419 = score(doc=2760,freq=1.0), product of:
             0.069525 = queryWeight, product of:
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.016065987 = queryNorm
             0.2704666 = fieldWeight in 2760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.0625 = fieldNorm(doc=2760)
         0.019404445 = weight(abstract_txt:support in 2760) [ClassicSimilarity], result of:
           0.019404445 = score(doc=2760,freq=1.0), product of:
             0.07099679 = queryWeight, product of:
               1.0105292 = boost
               4.37303 = idf(docFreq=1522, maxDocs=44421)
               0.016065987 = queryNorm
             0.2733144 = fieldWeight in 2760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.37303 = idf(docFreq=1522, maxDocs=44421)
               0.0625 = fieldNorm(doc=2760)
         0.024743294 = weight(abstract_txt:same in 2760) [ClassicSimilarity], result of:
           0.024743294 = score(doc=2760,freq=1.0), product of:
             0.08348522 = queryWeight, product of:
               1.0958076 = boost
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.016065987 = queryNorm
             0.29637933 = fieldWeight in 2760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7420692 = idf(docFreq=1052, maxDocs=44421)
               0.0625 = fieldNorm(doc=2760)
         0.060774256 = weight(abstract_txt:item in 2760) [ClassicSimilarity], result of:
           0.060774256 = score(doc=2760,freq=1.0), product of:
             0.15197927 = queryWeight, product of:
               1.4785012 = boost
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.016065987 = queryNorm
             0.39988518 = fieldWeight in 2760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.398163 = idf(docFreq=200, maxDocs=44421)
               0.0625 = fieldNorm(doc=2760)
         0.044706985 = weight(abstract_txt:level in 2760) [ClassicSimilarity], result of:
           0.044706985 = score(doc=2760,freq=2.0), product of:
             0.11252316 = queryWeight, product of:
               1.5581027 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.016065987 = queryNorm
             0.39731362 = fieldWeight in 2760, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.0625 = fieldNorm(doc=2760)
         0.046648093 = weight(abstract_txt:collection in 2760) [ClassicSimilarity], result of:
           0.046648093 = score(doc=2760,freq=1.0), product of:
             0.16052297 = queryWeight, product of:
               2.1488845 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.016065987 = queryNorm
             0.29060075 = fieldWeight in 2760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.0625 = fieldNorm(doc=2760)
         0.0850369 = weight(abstract_txt:collections in 2760) [ClassicSimilarity], result of:
           0.0850369 = score(doc=2760,freq=2.0), product of:
             0.20480767 = queryWeight, product of:
               2.7137673 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.016065987 = queryNorm
             0.4152037 = fieldWeight in 2760, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.0625 = fieldNorm(doc=2760)
         0.39613685 = weight(abstract_txt:metadata in 2760) [ClassicSimilarity], result of:
           0.39613685 = score(doc=2760,freq=6.0), product of:
             0.530316 = queryWeight, product of:
               6.765073 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.016065987 = queryNorm
             0.74698263 = fieldWeight in 2760, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.0625 = fieldNorm(doc=2760)
       0.32 = coord(8/25)
   

5. Zavalina, O.L.: Complementarity in subject metadata in large-scale digital libraries : a comparative analysis (2014) 0.22

   0.21670258 = sum of:
     0.21670258 = product of:
       0.90292746 = sum of:
         0.047010478 = weight(abstract_txt:digital in 2972) [ClassicSimilarity], result of:
           0.047010478 = score(doc=2972,freq=4.0), product of:
             0.069525 = queryWeight, product of:
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.016065987 = queryNorm
             0.6761665 = fieldWeight in 2972, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.3274655 = idf(docFreq=1593, maxDocs=44421)
               0.078125 = fieldNorm(doc=2972)
         0.06844331 = weight(abstract_txt:level in 2972) [ClassicSimilarity], result of:
           0.06844331 = score(doc=2972,freq=3.0), product of:
             0.11252316 = queryWeight, product of:
               1.5581027 = boost
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.016065987 = queryNorm
             0.6082598 = fieldWeight in 2972, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4950905 = idf(docFreq=1347, maxDocs=44421)
               0.078125 = fieldNorm(doc=2972)
         0.11614382 = weight(abstract_txt:aggregated in 2972) [ClassicSimilarity], result of:
           0.11614382 = score(doc=2972,freq=1.0), product of:
             0.20169508 = queryWeight, product of:
               1.703245 = boost
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.016065987 = queryNorm
             0.5758386 = fieldWeight in 2972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.370734 = idf(docFreq=75, maxDocs=44421)
               0.078125 = fieldNorm(doc=2972)
         0.100996085 = weight(abstract_txt:collection in 2972) [ClassicSimilarity], result of:
           0.100996085 = score(doc=2972,freq=3.0), product of:
             0.16052297 = queryWeight, product of:
               2.1488845 = boost
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.016065987 = queryNorm
             0.62916905 = fieldWeight in 2972, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.649612 = idf(docFreq=1154, maxDocs=44421)
               0.078125 = fieldNorm(doc=2972)
         0.075162716 = weight(abstract_txt:collections in 2972) [ClassicSimilarity], result of:
           0.075162716 = score(doc=2972,freq=1.0), product of:
             0.20480767 = queryWeight, product of:
               2.7137673 = boost
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.016065987 = queryNorm
             0.3669917 = fieldWeight in 2972, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6974936 = idf(docFreq=1100, maxDocs=44421)
               0.078125 = fieldNorm(doc=2972)
         0.49517104 = weight(abstract_txt:metadata in 2972) [ClassicSimilarity], result of:
           0.49517104 = score(doc=2972,freq=6.0), product of:
             0.530316 = queryWeight, product of:
               6.765073 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.016065987 = queryNorm
             0.9337283 = fieldWeight in 2972, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.078125 = fieldNorm(doc=2972)
       0.24 = coord(6/25)