Extend Prombench for scalability tests

sipian commented 6 years ago

At promcon, people were interested in knowing on how to use prombench for scalability tests for their Prometheus infrastructures.

krasi-georgiev commented 6 years ago

Frederic’s idea for the scalability test (probably doesn't fit with our design) https://github.com/brancz/prometheus-scalability

a recent blog post on the topic https://www.percona.com/blog/2018/09/20/prometheus-2-times-series-storage-performance-analyses/

bwplotka commented 3 days ago

Revisiting old bugs...

So prombench is focused on Prometheus development, where we simulate real world scenarios. This means this issue could go to other place (e.g. mailing list/prometheus discussion) for wider feedback. I believe it's out of scope for this project.

For your own load testing / scalability testing of Prometheus setups, you might need to tailor it to your architecture (daemonset? single replica? hashmod? prometheus operator enhanced? agent mode? special Prom features?).

However there are definitely things one could reuse like:

https://github.com/prometheus-community/avalanche for metric generation
query load generator https://github.com/prometheus/test-infra/tree/master/tools/load-generator
Prometheus or potential remote write receiver tester

prometheus / test-infra

Extend Prombench for scalability tests #128