coreos / torus

Torus Distributed Storage
https://coreos.com/blog/torus-distributed-storage-by-coreos.html
Apache License 2.0
1.77k stars 172 forks source link

Support schedulers other than kubernetes #186

Open F21 opened 8 years ago

F21 commented 8 years ago

It would be really cool if torus can be generalized to support schedulers other than kubernetes. For example, nomad and mesos.

barakmich commented 8 years ago

Right now there's nothing kubernetes-scheduler specific; it's just an app running in a pod, with the mount tool supporting the flexvolume plugin. Extending the mount capabilities for other platforms is completely open, and this is a good tracking issue for it.

philips commented 8 years ago

@F21 Kubernetes has the concept of mounting storage for a container, which is what the flexvolume integration is. Can you research what the alternatives would be for nomad or mesos?

F21 commented 8 years ago

@philips

For nomad, there is no way to mount storage volumes yet. Because nomad supports docker, qemu, raw exec and a few other task drivers to run tasks, the devs want to implement 1 interface/api that will support storage volumes for all task drivers. The tracking issue is here: https://github.com/hashicorp/nomad/issues/150

Mesos supports persistent volumes since 0.23. The behavior and semantics appears to be quite similar to how kubernetes handles volumes: http://mesos.apache.org/documentation/latest/persistent-volume/ Since 0.27, volumes can be managed using the HTTP API.

philips commented 8 years ago

@F21 can you do the work on either of these?

F21 commented 8 years ago

@philips Unfortunately, I don't have enough bandwidth at the moment, however, I am happy to help look at any proposed designs.

Having said that, I think the nomad team at hashicorp probably wants to work on their volume capability internally rather than source contributions from the community.