search

banzaicloud / koperator

Oh no! Yet another Apache Kafka operator for Kubernetes
Apache License 2.0
784 stars 195 forks source link

CruiseControl #821

Closed tony-chen1-rh closed 2 years ago

tony-chen1-rh commented 2 years ago

I see the following warnings in my kafka broker pod. How can I fix this? Does this prevent additional brokers from spinning up? I am installing https://github.com/banzaicloud/koperator/blob/v0.11.1/config/samples/simplekafkacluster.yaml with our own zookeeper cluster.

...
[2022-06-04 00:16:23,977] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17090 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,078] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17091 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,178] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17092 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,279] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17093 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,380] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17094 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,480] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17095 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,581] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17096 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,681] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17097 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,781] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17098 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,882] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17099 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
[2022-06-04 00:16:24,982] WARN [Producer clientId=CruiseControlMetricsReporter] Error while fetching metadata with correlation id 17100 : {__CruiseControlMetrics=UNKNOWN_TOPIC_OR_PARTITION} (org.apache.kafka.clients.NetworkClient)
...
stoader commented 2 years ago

Please use koperator version v0.21.2 (https://github.com/banzaicloud/koperator/releases/tag/v0.21.2) with https://github.com/banzaicloud/koperator/blob/v0.21.2/config/samples/simplekafkacluster.yaml

piotrzbq commented 2 years ago

First create topic for producer https://banzaicloud.com/docs/supertubes/kafka-operator/topics/

stoader commented 2 years ago

@piotrzbq can you provide more detail as from your comment is unclear what issue you're facing with.

piotrzbq commented 2 years ago

I have noticed same warnings for kafka producer when specific topic didn't exist, so try to create one as in example.

stoader commented 2 years ago

The UNKNOWN_TOPIC_OR_PARTITION usually means that the topic is missing or partition leader is not reachable (which can be caused by network issues). In case of CruiseControl the topic is created by CruiseControl itself in newer version that's why I suggested using the latest koperator version which deploys newer CC version.

stoader commented 2 years ago

Please use koperator version v0.21.2 (https://github.com/banzaicloud/koperator/releases/tag/v0.21.2) with https://github.com/banzaicloud/koperator/blob/v0.21.2/config/samples/simplekafkacluster.yaml

@tony-chen1-rh have you tried this?

tony-chen1-rh commented 2 years ago

@stoader with v0.11.1, I was able to get past this error after I set headlessServiceEnabled to false. This probably had something to do with how our kubernetes clusters were set up. Once every broker had their own ClusterIP, the brokers could communicate with each other and all 3 brokers in simplekafkacluster.yaml came up.

tony-chen1-rh commented 2 years ago

I'll close this issue since no further action is needed. Thanks.