linkedin / cruise-control

Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.
https://github.com/linkedin/cruise-control/tags
BSD 2-Clause "Simplified" License
2.77k stars 595 forks source link

Collected 0 broker metric samples for 0 brokers. #2188

Closed manishchet closed 3 months ago

manishchet commented 3 months ago

Hi i am using cruise control with apache kafka 3.4.0, i have placed the cruise-control-metrics jar in libs folder. but still getting [2024-08-23 16:15:36,822] INFO Finished sampling from topic __CruiseControlMetrics for partitions [0, 1, 2] in time range [1724409811814,1724409931814]. Collected 0 metrics. (com.linkedin.kafka.cruisecontrol.monitor.sampling.CruiseControlMetricsReporterSampler) [2024-08-23 16:15:36,822] INFO Collected 0 partition metric samples for 0 partitions. Total partition assigned: 70. (com.linkedin.kafka.cruisecontrol.monitor.sampling.SamplingFetcher) [2024-08-23 16:15:36,822] INFO Collected 0 broker metric samples for 0 brokers. (com.linkedin.kafka.cruisecontrol.monitor.sampling.SamplingFetcher) [2024-08-23 16:15:36,822] INFO Finished sampling in 5007 ms. (com.linkedin.kafka.cruisecontrol.monitor.sampling.MetricFetcherManager)

following are the server.properties config file listeners=SASL_SSL://0.0.0.0:6667,CLIENT://0.0.0.0:9005,CLIENT_GCP://0.0.0.0:9105 listener.security.protocol.map=SASL_SSL:SASL_SSL,CLIENT:SASL_SSL,CLIENT_GCP:SASL_SSL advertised.listeners=SASL_SSL://abc:6667,CLIENT://abc:9005,CLIENT_GCP://abc:9105 authorizer.class.name=kafka.security.authorizer.AclAuthorizer sasl.enabled.mechanisms=SCRAM-SHA-512 sasl.mechanism.inter.broker.protocol=SCRAM-SHA-512 security.inter.broker.protocol=SASL_SSL ssl.client.auth=required ssl.endpoint.identification.algorithm= ssl.key.password=7ecETGlHjzs ssl.keystore.location=/data/kafka_certs/keystore.jks ssl.keystore.password=7ecETGlHjzs ssl.truststore.location=/data/kafka_certs/truststore.jks ssl.truststore.password=7ecETGlHjzs super.users=User:admin metrics.reporter=com.linkedin.kafka.cruisecontrol.metricsreporter.CruiseControlMetricsReporter

cruise.control.metrics.reporter.bootstrap.servers=0.0.0.0:6667

cruise.control.metrics.topic.auto.create=true cruise.control.metrics.topic.num.partitions=1 cruise.control.metrics.topic.replication.factor=1

i have tried 0.0.0.0:6667 but its not working also with hostIP and port

i am using SASL_SSL SCRAM SHA -512 kafka security

mhratson commented 3 months ago

Check if data is being produced into the topic, if not make sure metrics reporter is configured properly

manishchet commented 3 months ago

data is not beeing produced in the topic