prombench: Remote Write receiver tester CLI

prometheus / test-infra

Prometheus E2E benchmarking tool

Apache License 2.0

156 stars 67 forks source link

prombench: Remote Write receiver tester CLI #766

Closed bwplotka closed 2 days ago

bwplotka commented 2 weeks ago

I propose we created dedicated testing CLI that will allow us:

Test basic remote write expectation (shape of the data sent, or only if it's parsable)
It will allow injecting different ingestion errors or behavior (different err codes, fake "delays", partial writes)
It will be fast enough, so if needed we benchmark Prometheus sending not the performance of the receiver trying to catch up with the load.

One could use Prometheus with receive enabled, but it won't solve all the above goals.

bwplotka commented 1 week ago

I wrote some quick sink for PRW benchmarking, in personal repo for now, but contributors welcome (can give you access). The idea is that it will work against other protocols too, but we could consider moving it to Prometheus org if useful for Prom scope only.

https://github.com/bwplotka/sink

I am not saying we have to use for prombench, but something useful and to consider for some remote-write mode.

bwplotka commented 2 days ago

I assume https://github.com/bwplotka/sink fixes this issue, until we find otherwise (e.g. that we have to have it outside of my personal repo)

kushalShukla-web commented 2 days ago

@bwplotka, has this issue been closed?

bwplotka commented 2 days ago

Have you seen this comment? https://github.com/prometheus/test-infra/issues/766#issuecomment-2441742445