From my expereince to integrate Kafka with Elasticsearch in your setup you'd typically use Logstash as the intermediary. Logstash would act as a consumer of Kafka messages process or transform them and send the processed data to Elasticsearch.
[ ] Data pipeline diagram or Data flow diagram - Kafka included
[ ] Add Kafka profile to the compose yaml file examples.yml
[ ] updating logstash conf files to reflect the addition of Kafka
From my expereince to integrate Kafka with Elasticsearch in your setup you'd typically use Logstash as the intermediary. Logstash would act as a consumer of Kafka messages process or transform them and send the processed data to Elasticsearch.
examples.yml