Document (#40374)

Author

Mayo, D.
Bowers, K.

Title

¬The devil's shoehorn : a case study of EAD to ArchivesSpace migration at a large university

Source

Code4Lib journal. Issue 35(2017), [http://journal.code4lib.org]

Year

2017

Abstract

A band of archivists and IT professionals at Harvard took on a project to convert nearly two million descriptions of archival collection components from marked-up text into the ArchivesSpace archival metadata management system. Starting in the mid-1990s, Harvard was an alpha implementer of EAD, an SGML (later XML) text markup language for electronic inventories, indexes, and finding aids that archivists use to wend their way through the sometimes quirky filing systems that bureaucracies establish for their records or the utter chaos in which some individuals keep their personal archives. These pathfinder documents, designed to cope with messy reality, can themselves be difficult to classify. Portions of them are rigorously structured, while other parts are narrative. Early documents predate the establishment of the standard; many feature idiosyncratic encoding that had been through several machine conversions, while others were freshly encoded and fairly consistent. In this paper, we will cover the practical and technical challenges involved in preparing a large (900MiB) corpus of XML for ingest into an open-source archival information system (ArchivesSpace). This case study will give an overview of the project, discuss problem discovery and problem solving, and address the technical challenges, analysis, solutions, and decisions and provide information on the tools produced and lessons learned. The authors of this piece are Kate Bowers, Collections Services Archivist for Metadata, Systems, and Standards at the Harvard University Archive, and Dave Mayo, a Digital Library Software Engineer for Harvard's Library and Technology Services. Kate was heavily involved in both metadata analysis and later problem solving, while Dave was the sole full-time developer assigned to the migration project.

Content

Vgl.: http://journal.code4lib.org/articles/12239.

Theme

Formalerschließung
Auszeichnungssprachen

Object

EAD

Area

Archive

Similar documents (content)

1. Carini, P.; Shepherd, K.: ¬The MARC standard and encoded archival description (2004) 0.20

   0.19579776 = sum of:
     0.19579776 = product of:
       0.815824 = sum of:
         0.056324206 = weight(abstract_txt:case in 3830) [ClassicSimilarity], result of:
           0.056324206 = score(doc=3830,freq=1.0), product of:
             0.107402496 = queryWeight, product of:
               1.1077148 = boost
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.020221986 = queryNorm
             0.52442175 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.794713 = idf(docFreq=998, maxDocs=44421)
               0.109375 = fieldNorm(doc=3830)
         0.06912257 = weight(abstract_txt:challenges in 3830) [ClassicSimilarity], result of:
           0.06912257 = score(doc=3830,freq=1.0), product of:
             0.123111196 = queryWeight, product of:
               1.1859586 = boost
               5.1333895 = idf(docFreq=711, maxDocs=44421)
               0.020221986 = queryNorm
             0.5614645 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1333895 = idf(docFreq=711, maxDocs=44421)
               0.109375 = fieldNorm(doc=3830)
         0.06438831 = weight(abstract_txt:project in 3830) [ClassicSimilarity], result of:
           0.06438831 = score(doc=3830,freq=1.0), product of:
             0.13441657 = queryWeight, product of:
               1.5177239 = boost
               4.3796177 = idf(docFreq=1512, maxDocs=44421)
               0.020221986 = queryNorm
             0.47902068 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3796177 = idf(docFreq=1512, maxDocs=44421)
               0.109375 = fieldNorm(doc=3830)
         0.19935529 = weight(abstract_txt:archivists in 3830) [ClassicSimilarity], result of:
           0.19935529 = score(doc=3830,freq=1.0), product of:
             0.24944195 = queryWeight, product of:
               1.6881286 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.020221986 = queryNorm
             0.7992051 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.109375 = fieldNorm(doc=3830)
         0.08903547 = weight(abstract_txt:metadata in 3830) [ClassicSimilarity], result of:
           0.08903547 = score(doc=3830,freq=1.0), product of:
             0.16683613 = queryWeight, product of:
               1.6908747 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.020221986 = queryNorm
             0.5336702 = fieldWeight in 3830, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.109375 = fieldNorm(doc=3830)
         0.33759815 = weight(abstract_txt:archival in 3830) [ClassicSimilarity], result of:
           0.33759815 = score(doc=3830,freq=3.0), product of:
             0.2812814 = queryWeight, product of:
               2.1955175 = boost
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.020221986 = queryNorm
             1.2002149 = fieldWeight in 3830, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.109375 = fieldNorm(doc=3830)
       0.24 = coord(6/25)
   

2. Carpenter, K.E.: End of the war between print and electronics (1996) 0.13

   0.13380963 = sum of:
     0.13380963 = product of:
       0.8363102 = sum of:
         0.024011407 = weight(abstract_txt:their in 1599) [ClassicSimilarity], result of:
           0.024011407 = score(doc=1599,freq=1.0), product of:
             0.06964017 = queryWeight, product of:
               1.0924367 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.020221986 = queryNorm
             0.3447925 = fieldWeight in 1599, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.109375 = fieldNorm(doc=1599)
         0.21934602 = weight(abstract_txt:inventories in 1599) [ClassicSimilarity], result of:
           0.21934602 = score(doc=1599,freq=1.0), product of:
             0.21100569 = queryWeight, product of:
               1.0978749 = boost
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.020221986 = queryNorm
             1.0395266 = fieldWeight in 1599, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.504243 = idf(docFreq=8, maxDocs=44421)
               0.109375 = fieldNorm(doc=1599)
         0.19491237 = weight(abstract_txt:archival in 1599) [ClassicSimilarity], result of:
           0.19491237 = score(doc=1599,freq=1.0), product of:
             0.2812814 = queryWeight, product of:
               2.1955175 = boost
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.020221986 = queryNorm
             0.6929444 = fieldWeight in 1599, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.109375 = fieldNorm(doc=1599)
         0.3980404 = weight(abstract_txt:harvard in 1599) [ClassicSimilarity], result of:
           0.3980404 = score(doc=1599,freq=1.0), product of:
             0.45275807 = queryWeight, product of:
               2.7854764 = boost
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.020221986 = queryNorm
             0.8791459 = fieldWeight in 1599, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.037906 = idf(docFreq=38, maxDocs=44421)
               0.109375 = fieldNorm(doc=1599)
       0.16 = coord(4/25)
   

3. Heastrom, M.: Descriptive practices for electronic records : deciding what is essential and imaging what is possible (1993) 0.12

   0.11994195 = sum of:
     0.11994195 = product of:
       0.59970975 = sum of:
         0.05924791 = weight(abstract_txt:challenges in 8331) [ClassicSimilarity], result of:
           0.05924791 = score(doc=8331,freq=1.0), product of:
             0.123111196 = queryWeight, product of:
               1.1859586 = boost
               5.1333895 = idf(docFreq=711, maxDocs=44421)
               0.020221986 = queryNorm
             0.48125526 = fieldWeight in 8331, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1333895 = idf(docFreq=711, maxDocs=44421)
               0.09375 = fieldNorm(doc=8331)
         0.057000242 = weight(abstract_txt:while in 8331) [ClassicSimilarity], result of:
           0.057000242 = score(doc=8331,freq=1.0), product of:
             0.13734001 = queryWeight, product of:
               1.5341398 = boost
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.020221986 = queryNorm
             0.41503012 = fieldWeight in 8331, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.09375 = fieldNorm(doc=8331)
         0.17087597 = weight(abstract_txt:archivists in 8331) [ClassicSimilarity], result of:
           0.17087597 = score(doc=8331,freq=1.0), product of:
             0.24944195 = queryWeight, product of:
               1.6881286 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.020221986 = queryNorm
             0.68503296 = fieldWeight in 8331, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.09375 = fieldNorm(doc=8331)
         0.07631611 = weight(abstract_txt:metadata in 8331) [ClassicSimilarity], result of:
           0.07631611 = score(doc=8331,freq=1.0), product of:
             0.16683613 = queryWeight, product of:
               1.6908747 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.020221986 = queryNorm
             0.45743155 = fieldWeight in 8331, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.09375 = fieldNorm(doc=8331)
         0.23626947 = weight(abstract_txt:archival in 8331) [ClassicSimilarity], result of:
           0.23626947 = score(doc=8331,freq=2.0), product of:
             0.2812814 = queryWeight, product of:
               2.1955175 = boost
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.020221986 = queryNorm
             0.8399754 = fieldWeight in 8331, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.09375 = fieldNorm(doc=8331)
       0.2 = coord(5/25)
   

4. Gracy, K.F.: Enriching and enhancing moving images with Linked Data : an exploration in the alignment of metadata models (2018) 0.11

   0.108282864 = sum of:
     0.108282864 = product of:
       0.4511786 = sum of:
         0.010290602 = weight(abstract_txt:their in 200) [ClassicSimilarity], result of:
           0.010290602 = score(doc=200,freq=1.0), product of:
             0.06964017 = queryWeight, product of:
               1.0924367 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.020221986 = queryNorm
             0.1477682 = fieldWeight in 200, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.046875 = fieldNorm(doc=200)
         0.029623955 = weight(abstract_txt:challenges in 200) [ClassicSimilarity], result of:
           0.029623955 = score(doc=200,freq=1.0), product of:
             0.123111196 = queryWeight, product of:
               1.1859586 = boost
               5.1333895 = idf(docFreq=711, maxDocs=44421)
               0.020221986 = queryNorm
             0.24062763 = fieldWeight in 200, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1333895 = idf(docFreq=711, maxDocs=44421)
               0.046875 = fieldNorm(doc=200)
         0.028500121 = weight(abstract_txt:while in 200) [ClassicSimilarity], result of:
           0.028500121 = score(doc=200,freq=1.0), product of:
             0.13734001 = queryWeight, product of:
               1.5341398 = boost
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.020221986 = queryNorm
             0.20751506 = fieldWeight in 200, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.426988 = idf(docFreq=1442, maxDocs=44421)
               0.046875 = fieldNorm(doc=200)
         0.08543798 = weight(abstract_txt:archivists in 200) [ClassicSimilarity], result of:
           0.08543798 = score(doc=200,freq=1.0), product of:
             0.24944195 = queryWeight, product of:
               1.6881286 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.020221986 = queryNorm
             0.34251648 = fieldWeight in 200, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.046875 = fieldNorm(doc=200)
         0.07631611 = weight(abstract_txt:metadata in 200) [ClassicSimilarity], result of:
           0.07631611 = score(doc=200,freq=4.0), product of:
             0.16683613 = queryWeight, product of:
               1.6908747 = boost
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.020221986 = queryNorm
             0.45743155 = fieldWeight in 200, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.87927 = idf(docFreq=917, maxDocs=44421)
               0.046875 = fieldNorm(doc=200)
         0.22100985 = weight(abstract_txt:archival in 200) [ClassicSimilarity], result of:
           0.22100985 = score(doc=200,freq=7.0), product of:
             0.2812814 = queryWeight, product of:
               2.1955175 = boost
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.020221986 = queryNorm
             0.78572506 = fieldWeight in 200, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.046875 = fieldNorm(doc=200)
       0.24 = coord(6/25)
   

5. Trace, C.B.; Francisco-Revilla, L.: ¬The value and complexity of collection arrangement for evidentiary work (2015) 0.10

   0.10146805 = sum of:
     0.10146805 = product of:
       0.50734025 = sum of:
         0.019404147 = weight(abstract_txt:their in 3164) [ClassicSimilarity], result of:
           0.019404147 = score(doc=3164,freq=2.0), product of:
             0.06964017 = queryWeight, product of:
               1.0924367 = boost
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.020221986 = queryNorm
             0.2786344 = fieldWeight in 3164, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1523883 = idf(docFreq=5161, maxDocs=44421)
               0.0625 = fieldNorm(doc=3164)
         0.040989466 = weight(abstract_txt:involved in 3164) [ClassicSimilarity], result of:
           0.040989466 = score(doc=3164,freq=1.0), product of:
             0.12618989 = queryWeight, product of:
               1.2006959 = boost
               5.1971793 = idf(docFreq=667, maxDocs=44421)
               0.020221986 = queryNorm
             0.3248237 = fieldWeight in 3164, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1971793 = idf(docFreq=667, maxDocs=44421)
               0.0625 = fieldNorm(doc=3164)
         0.03679332 = weight(abstract_txt:project in 3164) [ClassicSimilarity], result of:
           0.03679332 = score(doc=3164,freq=1.0), product of:
             0.13441657 = queryWeight, product of:
               1.5177239 = boost
               4.3796177 = idf(docFreq=1512, maxDocs=44421)
               0.020221986 = queryNorm
             0.2737261 = fieldWeight in 3164, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.3796177 = idf(docFreq=1512, maxDocs=44421)
               0.0625 = fieldNorm(doc=3164)
         0.1611034 = weight(abstract_txt:archivists in 3164) [ClassicSimilarity], result of:
           0.1611034 = score(doc=3164,freq=2.0), product of:
             0.24944195 = queryWeight, product of:
               1.6881286 = boost
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.020221986 = queryNorm
             0.64585525 = fieldWeight in 3164, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3070183 = idf(docFreq=80, maxDocs=44421)
               0.0625 = fieldNorm(doc=3164)
         0.24904992 = weight(abstract_txt:archival in 3164) [ClassicSimilarity], result of:
           0.24904992 = score(doc=3164,freq=5.0), product of:
             0.2812814 = queryWeight, product of:
               2.1955175 = boost
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.020221986 = queryNorm
             0.8854119 = fieldWeight in 3164, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.3354917 = idf(docFreq=213, maxDocs=44421)
               0.0625 = fieldNorm(doc=3164)
       0.2 = coord(5/25)