ChileanVirtualObservatory / jovial.chivo.cl

A JupyterHub server over high-availability technologies
http://jovial.chivo.cl
2 stars 1 forks source link

HA Kubernetes Setup #5

Open capgadsx opened 7 years ago

capgadsx commented 7 years ago

The idea is to implement the solution described in the official kubernetes documentation, using a clustered etcd deployment and load-balanced api-servers. Clusterd Kubernetes

mosoriob commented 7 years ago

Maybe this is a good start. https://github.com/kubernetes/kubeadm/issues/277

madiazp commented 7 years ago

We were thinking with @capgadsx that it will be a good solution to put kubemaster and etcd in a VM in Ovirt and do backups in lustre with rsync, so the HA is up to Ovirt. With a good VM configuration(auto net, auto service up in restarts, etc) the only enemy will be a IML server's failure or an entire datacenter failure.

mosoriob commented 7 years ago

That is overthink. 3 etcd is enough.

maray commented 7 years ago

I agree with @sirspock. Please do not complicate things more than it will be needed. If 3 independent disks of 3 different servers fail at the same time, everyone will understand a 503!

@capgadsx can you edit your first comment to add a brief doc of the 3 etcd solution we are currently using? (just for the sake of documentation)

capgadsx commented 7 years ago

At this point we already implemented the 3-member etcd cluster and we have 3 kubernetes api-servers running. We still have to setup the load-balancer for the api-servers