DataWorkz-NL / KubeETL

ETL controller for Kubernetes
Apache License 2.0
4 stars 0 forks source link

DataSet injection into Workflows #24

Closed Blokje5 closed 3 years ago

Blokje5 commented 3 years ago

DataSets contains some additional metadata over connection that would be useful to inject into the workflow. Besides the additional parameters, tracking the link between data set usage and workflows would allow for data lineage and data discoverability use cases in the future.