A new staging area which we will require Data Import to reset a project and import the staging area like a new project.
Pro(s): The design is simpler and more straightforward and covers all scenarios for metadata updates and deletes.
Con(s): It may be expensive for an extremely large dataset (e.g. Tabula Muris), in which case we could use the delta staging area approach once we really need to.
Update spec according to what has been agreed on last post DCP2 demo meeting
Related to ebi-ait/dcp-ingest-central#695 Related slack thread https://humancellatlas.slack.com/archives/C01360XN04S/p1646223040031019
Notes:
A new staging area which we will require Data Import to reset a project and import the staging area like a new project. Pro(s): The design is simpler and more straightforward and covers all scenarios for metadata updates and deletes. Con(s): It may be expensive for an extremely large dataset (e.g. Tabula Muris), in which case we could use the delta staging area approach once we really need to.