Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.
I am trying to run a cruise control pod in kubernetes connecting to an AWS MSK kafka cluster. The zookeeper access in my case is sealed for security reasons. I have followed the wiki article https://github.com/linkedin/cruise-control/wiki/Run-without-ZooKeeper to run the cruise control without zookeeper. However the cruise control pod crashes with the following error complaining about the missing config zookeeper.connect which is against what is described in the wiki page,
14:35:03.711 [main] ERROR com.linkedin.kafka.cruisecontrol.KafkaCruiseControlMain - Uncaught exception on thread Thread[main,5,main]
org.apache.kafka.common.config.ConfigException: Missing required configuration "zookeeper.connect" which has no default value.
at org.apache.kafka.common.config.ConfigDef.parseValue(ConfigDef.java:493) ~[kafka-clients-3.1.0.jar:?]
at org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:483) ~[kafka-clients-3.1.0.jar:?]
at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:113) ~[kafka-clients-3.1.0.jar:?]
at org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:146) ~[kafka-clients-3.1.0.jar:?]
at com.linkedin.kafka.cruisecontrol.config.KafkaCruiseControlConfig.<init>(KafkaCruiseControlConfig.java:51) ~[cruise-control.jar:?]
at com.linkedin.kafka.cruisecontrol.config.KafkaCruiseControlConfig.<init>(KafkaCruiseControlConfig.java:47) ~[cruise-control.jar:?]
at com.linkedin.kafka.cruisecontrol.KafkaCruiseControlUtils.readConfig(KafkaCruiseControlUtils.java:865) ~[cruise-control.jar:?]
at com.linkedin.kafka.cruisecontrol.KafkaCruiseControlMain.main(KafkaCruiseControlMain.java:35) ~[cruise-control.jar:?]
Description
I am trying to run a cruise control pod in kubernetes connecting to an AWS MSK kafka cluster. The zookeeper access in my case is sealed for security reasons. I have followed the wiki article https://github.com/linkedin/cruise-control/wiki/Run-without-ZooKeeper to run the cruise control without zookeeper. However the cruise control pod crashes with the following error complaining about the missing config
zookeeper.connect
which is against what is described in the wiki page,Other specifications
Kafka version: 2.6.2
Cruise-control properties file
Any help will be much appreciated to resolve this issue.