opensearch-project / opensearch-benchmark

OpenSearch Benchmark - a community driven, open source project to run performance tests for OpenSearch
https://opensearch.org/docs/latest/benchmark/
Apache License 2.0
111 stars 78 forks source link

Red-line and adjustable load-intensity performance testing #618

Open gkamat opened 3 months ago

gkamat commented 3 months ago

Is your feature request related to a problem? Please describe

OSB should have a capability to increase the intensity of a workload against a system-under-test to investigate how it performs under duress. When errors or issues are encountered, it should scale back the load to an appropriate level.

Related to this, as a preamble, there should be a simple way a user can specify the level of load, which would be mapped to an appropriate target throughput and/or number of clients. Similarly, the feedback mechanism should be configurable -- it could be error count, a step increase in latency or a sudden drop in throughput.

This feature is contingent upon OSB being able to scale well, and perhaps employ DWG to achieve this objective.