Cassandra: Use a more intelligent snitch

jetstack / navigator

Managed Database-as-a-Service (DBaaS) on Kubernetes

Apache License 2.0

271 stars 31 forks source link

Cassandra: Use a more intelligent snitch #246

Closed kragniz closed 6 years ago

kragniz commented 6 years ago

Currently we're using SimpleSnitch, which assigns all cassandra nodes to rack1 in datacenter1. Cassandra uses the rack and datacenter information to spread replicas more evenly across them for fault tolerance, so it would be beneficial to teach it about the underlying infrastructure.

/kind feature

kragniz commented 6 years ago

Some options for this:

Use GossipingPropertyFileSnitch, which takes a config file named cassandra-rackdc.properties which we could generate at startup using information from the kubernetes api
Use Ec2Snitch or GoogleCloudSnitch if we're deployed to either of those clouds. These talk directly to the cloud APIs, however, which we may want to avoid.
Write a custom snitch that talks to the kubernetes API, similar to how the KubernetesSeedProvider works.

kragniz commented 6 years ago

/area cassandra

kragniz commented 6 years ago

I added a poc of using GossipingPropertyFileSnitch in #247

kragniz commented 6 years ago

Fixed via https://github.com/jetstack/navigator/pull/255