esmero / archipelago-documentation

Archipelago Commons' ever evolving Documentation Repository

20 stars 20 forks source link

Data transformation and migrations Cookbooks and documentation #50

Open DiegoPino opened 4 years ago

DiegoPino commented 4 years ago

What is that we need

We need to document our and community members own ingest workflows and experiences

Provide demo scrips
Tiny overview of a well planned nano migration
Few scenarios
- Full uncleaned ingest, then using archipelago itself to conform and move data, including adapting or creating new webforms
- Full pre conformation and planning what you need upfront
- OAI, Solr, External APIs, Storage and XML based migrations
- Spreadsheet based ones

Demo assets and QA

@alliomeria this is for both of us. We will use our current migration projects as source for this. I have no rush but sill want this in our radar

alliomeria commented 4 years ago

@DiegoPino Definitely a useful and needed part of documentation. Will make sure to keep good notes as I'm going through these processes myself and with our community members.