redhat-openstack / openshift-on-openstack

A place to write templates, docs etc. for deploying OpenShift on OpenStack.
Apache License 2.0
136 stars 87 forks source link

Deploy etcd nodes on OpenStack Controller nodes #314

Open jeremyeder opened 7 years ago

jeremyeder commented 7 years ago

Due to storage latency requirements for etcd, we found in 3.4 testing that putting etcd inside a VM backed by rotational disks (via ceph) was unstable. We moved etcd to the OpenStack controllers, which use local disk, was sufficient to stabilize etcd.

Ceph also takes this approach by colocating it's Monitor nodes on OpenStack controllers. Feedback on this colocation approach internally has been positive.

ioggstream commented 7 years ago

Hi @jeremyeder Can you please share more details on that?

How can I reproduce the issue and check if it affects my installation too?

Thx++, R.

jeremyeder commented 7 years ago

You just need to provide etcd with sufficiently performant storage. If you're affected by this, you will see errors and warnings in the etcd logs.