Periodic S3 source data updating

intel / vck

Volume Controller for Kubernetes

https://ai.intel.com/kubernetes-volume-controller-kvc-data-management-tailored-for-machine-learning-workloads-in-kubernetes/

Apache License 2.0

67 stars 17 forks source link

Periodic S3 source data updating #60

Open scttl opened 6 years ago

scttl commented 6 years ago

For example, to re-fetch updates to temporal input datasets.

One potential means of supporting this could be via Update hooks. May be worth adding new mutable flag to distinguish from non-updateable sources.

Possible issues: additional data now exceeds capacity, dataset provenance