search

datacraft-dsc / starfish-py

Developer Toolkit for Decentralised Data Ecosystems
Apache License 2.0
5 stars 0 forks source link

Provenance capturing in Starfish-py #231

Open aishwarya-nair opened 4 years ago

aishwarya-nair commented 4 years ago

Capture Provenance for the the data assets in line with DEP-12.

Update to DEP-12: Define the further levels of provenance and append on DEP-12. Based on the previous discussion - must include single step of input assets on provenance for every output assets , might include further steps of input assets for each output based on user requirements.

Mike:It would be preferable if the ability to generate provenance was captured in starfish-py as is current;y done with starfish-java and starfish-clj. This will need a bit of iteration and alignment with DEP12 (i.e. DEP12 should define the rules, starfish-xxx should implement them).

Aish: Updated to Starfish-py instead of Nemo. Please make not of the changes for provenance requirements on Starfish-py

aishwarya-nair commented 4 years ago

Dependency on completion of DEP-12