search

Telefonica / prometheus-kafka-adapter

Use Kafka as a remote storage database for Prometheus (remote write only)
Apache License 2.0
364 stars 135 forks source link

How to read data from kafka and push via remote_write #97

Closed bkslash closed 2 years ago

bkslash commented 2 years ago

Hi, how to achieve opposite data flow - if data is already in kafka topic, how can I send it to remote storage using remote_write? So something like this:

some_metric_source->remote_write->prometheus-kafka-adapter->kafka_topic->???????->remote_write->some_remote_storage

I don't want to scrape data using prometheus pull mechanism, I'd like to have all data to be pushed in realtime...

palmerabollo commented 2 years ago

Thanks for asking @bkslash. Prometheus-kafka-adapter doesn't support it. Not sure if this issue https://github.com/Telefonica/prometheus-kafka-adapter/issues/55 is related.