python-diamond / Diamond

Diamond is a python daemon that collects system metrics and publishes them to Graphite (and others). It is capable of collecting cpu, memory, network, i/o, load and disk metrics. Additionally, it features an API for implementing custom collectors for gathering metrics from almost any source.
http://diamond.readthedocs.org/
MIT License
1.74k stars 601 forks source link

Custom metrics kafka #694

Closed acampoh closed 2 years ago

acampoh commented 6 years ago

As we are having problems of timeouts of the processing time of the collector when having thousands of topics in our kafka cluster, we would like to add a new config option to be able of process only the metrics we are interested, so we can speed up the process.

by default the collector will export all the metrics availables in kafka.

coveralls commented 6 years ago

Coverage Status

Coverage increased (+0.04%) to 24.703% when pulling 9b2b3dfaf1fd5a9870d26b1ac29dd0f69bf9f384 on acampoh:custom_metrics_kafka into f2bece462577a7c557be8a9f90f6b9340c3db571 on python-diamond:master.