Islandora / documentation

Contains islandora's documentation and main issue queue.
MIT License
104 stars 71 forks source link

7.x Style Batch Upload #1492

Open manez opened 4 years ago

manez commented 4 years ago

We had a good discussion about this on the April 22 Tech Call, so I'm making a ticket to capture the topic:

We need a way to add multiple objects (nodes with media) at once via the front end. We have https://islandora.github.io/documentation/technical-documentation/migrate-csv/, which works a treat, but it has quite a few steps where you have to go outside of the GUI and upload files to the filesystem, or input commands.

The Islandora 7.x Batch Upload, with a specifically formatted zip file that could be uploaded in the GUI to batch-create objects in the repo, seems like a good model for this, although we shouldn't let the way we did things in 7 dictate how it works in 8 if there are ways to make it better. A csv+files, for instance, might be easier to work with than the 7.x way with files and matching individual metadata records zipped together.

The use case I have in mind is the 5-50 objects range. Not something massive that should be scripted or that would time out if processed in the browser, but a big enough batch that it's a pain to make every object one-at-a-time.

mjordan commented 4 years ago

One CSV plus all the files sounds right to me @manez. It's also consistent with what the Migrate CSV tools use, should they end up being used under the hood to do the actual ingest.

That said, I'd like to recommend that whatever we implement does some basic validation on the CSV and file data so that the ingest is as reliable as possible. I've found that the Migrate tools are fairly forgiving of bad data, in the sense that they just skip bad-tasting objects, but doing some pre-emptive checks for detectable problems with the data before actually loading it might be worth looking into.