Bulk ingest method for Curate

[eporter23]

Story

As a Library Staff Depositor, I want to create objects/metadata in bulk through a spreadsheet or other means, so that I can ingest related objects more quickly and reduce redundant data entry

Acceptance Criteria

Use one or more of the following options to provide acceptance criteria.

Notes

This epic describes an enhanced bulk-ingest process that will be developed for Phase 1 Migrations, with a goal of re-usability and extension to future migrations. Emory libraries staff depositors will need a customized bulk-ingest method to create complex objects supporting our Archival Information Package structure.

Links to Additional Information

Curate Generic Work: SIP Mapping Template Data Sources for Phase 1 Migrations DAMS metadata mapping (images) Alma/MARC metadata mapping (books) Pull-list mapping (books)

Checklist

• [x] Bulk-ingest may be initiated and monitored through a user interface within Curate
• [x] Bulk-ingest UI reports errors as part of the pre-check process (additional error reporting handled by the Curate/Cor environment)
• [x] Bulk ingest will assign or inherit appropriate Depositor and Manager role permissions from the Collection it is deposited into
• [x] Bulk-ingest method creates multiple objects in batch according to standardized, user-supplied pull-lists
• [x] Bulk-ingest method assigns objects to a specified collection in Curate
• [x] Bulk-ingest method maps files to the Curate generic work model, assigning their appropriate FileSet context and PCDM use according to supplied structural metadata
• [x] Bulk-ingest method extracts metadata from one or more input sources as specified in the SIP mappings for each collection, including spreadsheets and Alma records
• [x] Bulk ingest method extracts, maps, and stores selected metadata as RDF properties in the Curate generic work model as specified in the DAMS, Alma, and pull-list metadata mappings
• [x] Bulk-ingest method integrates with/interoperates with with an Emory supported file transfer process
• [x] Bulk-ingest method integrates with/interoperates with fixity checking process for pre-ingested, uploaded files
• [x] Bulk-ingest method integrates with Curate's preservation events and logging

Deferred:

• Bulk-ingest method may also extract and store metadata as part of an XML Preservation Log from one or more sources as specified in the SIP mappings for each collection
• Bulk-ingest method supports both flat and nested work structures

Given/When/Then

• Given (some context) and (some other optional context)
• When (some action is carried out)
• Then (a set of observable consequences should occur)

[eporter23]

More testing is needed for assignment of collection permissions on objects. Prior test loads into Production (where Collection permissions are correct) appear to assign the correct group level assignments at the Work-level (verified using the Sharing tab on a bulk-imported object).