Open paulcichonski opened 7 years ago
Note: I get the same Failed to load the check class for
log line when trying to use service discovery for the cassandra.yaml
integration. I'm guessing thats also related to the jmx usage.
I can post more details of my cassandra setup if it helps (looks very similar to above).
Thanks!
I think the core issue is that this is simply unimplemented. Kafka monitoring is a JMX monitor, which uses a standalone jmxfetch
binary (rather than collector
). That binary only looks in conf.d and ignores any service autodiscovery settings.
For now, I'm monitoring Kafka via packaging up the jmxfetch jar into a docker container and running that as a sidecar to kafka.
Thanks @mikekap , I did not realize the jmxfetch
was a separate binary. Will experiment with the sidecar approach.
Hi @paulcichonski As @mikekap mentioned this is not implemented yet, sorry for the confusion. I'll consider this issue as a feature request though (as it's not the first time it is asked). Stay tuned :)
_Output of the info page _
Additional environment details (Operating System, Cloud provider, etc): I have replicated this using the following local setup:
docker-compose.yml:
./auto_conf/kafka.yaml:
./dd-agent/Dockerfile:
./kafka/Dockerfile:
./zookeeper/Dockerfile:
./zookeeper/zoo.cfg:
Steps to reproduce the issue:
API_KEY=<dd-token> docker-compose up -d dd-agent
Describe the results you received: Kafka check is not configured.
Describe the results you expected: Kafka check should be configured and healthy
Additional information you deem important (e.g. issue happens only occasionally): Here is the output of
service datadog-agent configcheck
from within the container:The key line being:
I'm guessing this is because under the covers the kafka check uses https://github.com/DataDog/dd-agent/blob/master/jmxfetch.py#L165 to configure the jmx metrics pulling and the service discovery stuff doesn't seem to support that yet (just a guess though).
Any ideas how to make this work with the service discovery mechanism?
Note that I've verified this works fine if I change my setup to use the static
/conf.d
mechanism:docker-compose.yml:
./auto_conf/kakfa.yaml: