Support consuming cloud PVs, multi-host subdots and failover on cloud volumes (aka CVv2)

dotmesh-io / roadmap

Roadmap: where we take the product in the next 1-6 months in terms of features

0 stars 0 forks source link

Support consuming cloud PVs, multi-host subdots and failover on cloud volumes (aka CVv2) #10

Open lukemarsden opened 6 years ago

lukemarsden commented 6 years ago

See design doc.

[ ] Design it
[ ] Prototype it

Maybe start with the NFS part to make @rimusz able to start using it straight away, adding cloud volumes failover later to enable HA.

lukemarsden commented 6 years ago

We urgently need the PV side of this for our own use on the dothub.

lukemarsden commented 6 years ago

https://github.com/dotmesh-io/dotmesh/issues/100

lukemarsden commented 6 years ago

I think we should:

[ ] Get to the point where upgrading our own GKE cluster doesn't lose data
[ ] Get to the point where losing a node in our own cluster results in automatic recovery (failover)
[ ] Make Rimas happy (implement minimal NFS support)

This gets us to the point where we have a plausible Kubernetes storage product, and one we'll need for our own use in dothub (which may become dotsciencehub).