search

yahoo / CMAK

CMAK is a tool for managing Apache Kafka clusters
Apache License 2.0
11.81k stars 2.5k forks source link

Infra as code: import/export cluster/topics config to/from kafka-manager instead of repeat all from UI #862

Open chwongeric opened 2 years ago

chwongeric commented 2 years ago

Dear Kafka-manager support,

We have been using kafka-manager for easy manager kafka cluster in k8s env. However, all the kafka-manager operations has been manual replay all actions in UI if we want to replicate the same to another newly created clusters.

Is there a way to export all existing config manually done (including kafka clusters, topics creation, config etc) by kafka-manager UI as config files, checkin git repo or other SCM, and in another newly created cluster in different cloud region, we can import prior stored config files for kafka-manager? So that all the kafka clusters in different cloud region can all be exactly the same? This will be very critical helpful for CI/CD and all infra-as-code.

Could you please advise and guide how to achieve this using kafka-manager features?

Thank you very much!

eshepelyuk commented 2 years ago

@chwongeric you can take a lookat cmak2zk tool, I've developed for CMAK Helm chart. It is standalone tool that can be used without Helm.

https://github.com/eshepelyuk/cmak-operator#standalone-cmak2zk-tool.