vectordotdev / vector

A high-performance observability data pipeline.
https://vector.dev
Mozilla Public License 2.0
17.93k stars 1.59k forks source link

New `jmx_metrics` source #870

Open ghost opened 5 years ago

ghost commented 5 years ago

Users of Java and other JVM-based languages might appreciate ability to collect JMX metrics from their apps using Vector. For example, JMX is the default metrics reporter for Kafka.

lukesteensen commented 5 years ago

This is a great idea. We always ran jmxtrans with Kafka to bridge the gap with our normal monitoring tools. Would be great to cover that use case as well.

bruceg commented 4 years ago

The only crate I have found that can handle JMX connections within Rust actually does so by calling out to Java, which means it will be pulling in a full JVM and all the dependencies that entails. From my reading, Prometheus similarly depends on a Java sidecar program, such as jmx_exporter or jmxtrans.

We can probably develop a protocol module for this, but it will likely be from scratch, which means the implementation time may be much longer. As such, @jamtur01 has recommended we park this for now.

spencergilbert commented 3 years ago

It would certainly be useful to help provide users visibility into Kafka as it seems to be a common deployment with Vector

Prior art outside of the JVM: kafka-exporter kminion