search

redpanda-data / kminion

KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.
MIT License
620 stars 122 forks source link

KMinion topic check fails if topic does not exist #114

Closed weeco closed 3 years ago

weeco commented 3 years ago

Hi I tried with the latest version: master-1e3a1d5. I got the following issue with the last message repeating. The Errors after "Starting to consume end to end topic" appeared after 15 min.

image

Originally posted by @JordnL in https://github.com/cloudhut/kminion/issues/112#issuecomment-920334498

rmb938 commented 3 years ago

@weeco Just to comment on your reply.

You can temporarily fix this by either creating the topic on your own - or enabling the topic creation. Basically the problem there is just that a proper error code is not printed. The topic simply does not exist and the kminion configuration says that KMinion is not allowed to create that topic apparently.

Topic creation flag is enabled. We are also giving Kafka Minion (for this test) super user credentials for Kafka so it should have access to create the topic, but it never does and then prints the error above.

weeco commented 3 years ago

@rmb938 Could you check whether this issue is still existent in the latest version? This code portion has been kind of rewritten and successfully tested in multiple setups and configurations nowadays.