vendekagon-labs / unify

An engine for automating data integration & harmonization via schema inference.
Apache License 2.0
8 stars 0 forks source link

Basic retract dataset functionality #34

Closed benkamphaus closed 9 months ago

benkamphaus commented 9 months ago

Putting this in prior to diff/merge. This is also an important detail for generalizing dataset (batch import) lifecycles to multiple workflows. And retract then re-import provides some diff/merge functionality as well, though perhaps clunky and not always a great match semantically. I.e. it may be appropriate when substantially changing a dataset, but not with e.g. the equivalent of adding a few records.