elastic / beats

:tropical_fish: Beats - Lightweight shippers for Elasticsearch & Logstash
https://www.elastic.co/products/beats
Other
12.06k stars 4.89k forks source link

Kerberos auth used by filebeat input, ignored by metricbeat input #39677

Open fearful-symmetry opened 1 month ago

fearful-symmetry commented 1 month ago

Right now, the kafka filebeat input allows the user to specify a Kerberos config:

https://github.com/elastic/beats/blob/18a7e5447a3b474f3f09f98932ff124d210067a5/filebeat/input/kafka/config.go#L52-L53

but there's no kerberos config in the metricbeat kafka config:

https://github.com/elastic/beats/blob/18a7e5447a3b474f3f09f98932ff124d210067a5/metricbeat/module/kafka/config.go#L28-L36

This is (obviously) a bit confusing for users, as the support for kerberos is a bit inconsistent.

elasticmachine commented 1 month ago

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

nimarezainia commented 1 month ago

This user is actually using Elastic Agent with the Kafka integration (custom logs variant as well). So ideally those integrations are modified to allow kerberos auth.

This is issue needs to be resolved before that happens however.