opensearch-project / opensearch-benchmark

OpenSearch Benchmark - a community driven, open source project to run performance tests for OpenSearch
https://opensearch.org/docs/latest/benchmark/
Apache License 2.0
112 stars 79 forks source link

[DOCUMENTATION] Updated results from `aggregate` command #700

Open OVI3D0 opened 3 days ago

OVI3D0 commented 3 days ago

Please provide details on how and where the documentation can be improved

Recently, OSB's new aggregate command was updated so the results' it produces provide both the relative standard deviation (RSD), as well as the overall minimum/maximum values across all test executions, rather than the averages of the mininums/maximums. Example:

    "throughput": {
     "overall_min": 29056.890292903263,
     "mean": 50115.8603858536,
     "median": 50099.54349684457,
     "overall_max": 72255.15946248993,
     "unit": "docs/s",
     "mean_rsd": 59.426059705973664
    },

Also, aggregated results are stored in a separate aggregated_results folder, alongside the test_executions folder used for normal OSB test executions.

Provide references

693 #692 #683

Additional context

No response