opensearch-project / opensearch-benchmark-workloads

Official workloads used by OpenSearch Benchmark (OSB)
https://opensearch.org/docs/latest/benchmark/
11 stars 58 forks source link

Verify stability of test runs with the `big5` workload and its 1 TB data corpus #296

Open gkamat opened 1 month ago

gkamat commented 1 month ago

Description

The big5 workload now features a 1 TB data corpus that can be optionally used. However, there are stability issues when the workload is run at high rates of ingestion and/or search.

This issue pertains to investigating this further and developing a strategy to resolve related problems and limitations.