search

redpanda-data / kminion

KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.
MIT License
620 stars 122 forks source link

No releases since April? #130

Closed jutley closed 2 years ago

jutley commented 2 years ago

I just found this project and it seems extremely valuable for my use case. In particular, I'd like to use the endToEnd testing to measure client-side latencies.

It looks like there hasn't been any releases since April, and the latest release does not have the features I would like to use. Are there any plans to create a new release anytime soon? I can consider using a non-stable build, though this is typically not a good idea.

weeco commented 2 years ago

Hey @jutley , I'm glad KMinion helps you with your work. It's right that the last release has been created long time ago. The biggest change since then is definetely the addition of the e2e feature. I'm not entirely convinced yet that this feature works exactly the way it is supposed to, because I had some issues during rolling broker updates / restarts, but generally I think you can use a docker image that is built against master.

The main purpose of that feature was to have some end to end testing of a Kafka cluster for the purpose of measuring SLA/SLOs. Therefore it is somewhat crtical that KMinion properly handles broker restarts / leader reelections because we don't want to get paged if the cluster is still fine. But if you are primarily interested in latencies I think you can already rely on KMinion:

image

jutley commented 2 years ago

Thanks for the clarification! I'll do some testing to determine whether the current state is good enough for our needs.

jutley commented 2 years ago

For what it's worth, we've been running kminion during some rolling restarts and broker replacements, and the kminion pods have been connecting to all Kafka brokers correctly along the way.