gluster / gluster-kubernetes

GlusterFS Native Storage Service for Kubernetes
Apache License 2.0
875 stars 390 forks source link

Glusterfs running in kubernetes pods Geo-rep #488

Open collins-b opened 6 years ago

collins-b commented 6 years ago

Is it possible to set up geo-replication in glusterfs running in K8s pods? If so, how? I can't see this in the docs.

jarrpa commented 6 years ago

It is technically feasible, but it's not entirely practical. At least not practical enough for us to want to document it. You should be able to use the sshd inside the GlusterFS containers to do geo-rep. If you haven't seen them already, see how far the main docs get you: https://docs.gluster.org/en/v3/Administrator%20Guide/Geo%20Replication/

alikhajeh1 commented 6 years ago

Step 10 of https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.2/html/container-native_storage_for_openshift_container_platform/chap-documentation-red_hat_gluster_storage_container_native_with_openshift_platform-gluster_pod_operations mentions: "You can set up Container Native Storage volumes for geo-replication to a non-Container Native Storage remote site." i.e. master can be gluster pods, but slave cannot unless we setup fixed IPs for them (not sure that's a good idea for pods).

jarrpa commented 6 years ago

Current deployments of containerized GlusterFS use hostNetwork: true, so they will maintain the IPs of the hosts they're running on which should ideally be stable.