search

ramhiser / kafka-kubernetes

Apache Kafka on Kubernetes
70 stars 36 forks source link

Refactor Zookeeper to avoid hardcoding fixed number of deployments/services #3

Open ramhiser opened 8 years ago

ramhiser commented 8 years ago

Currently, our Zookeeper implementation uses 3 fixed Deployments and 3 corresponding fixed Services.

PetSets look like a promising direction to avoid hardcoding the nodes because they offer:

Zookeeper is even mentioned in the PetSet docs. There's even a zookeeper example in kubernetes/contrib.

ramhiser commented 8 years ago

On the Kubernetes blog, there's a good example of using PetSets to deploy a 1000-node Cassandra cluster.

adrianmkng commented 7 years ago

I'm looking into using StatefulSets for managing this, hope to create a PR for this once I've figured it out.