OVI3D0 commented 2 months ago

Description

Adds the aggregate feature, allowing users to aggregate multiple test executions into one aggregated test result. Also compatible with other features such as compare

Usage

To aggregate multiple test executions, you can use the aggregate command like so: opensearch-benchmark aggregate --test-executions=<test_execution_id1>,<test_execution_id2>,...

Sample output:

   ____                  _____                      __       ____                  __                         __
  / __ \____  ___  ____ / ___/___  ____ ___________/ /_     / __ )___  ____  _____/ /_  ____ ___  ____ ______/ /__
 / / / / __ \/ _ \/ __ \\__ \/ _ \/ __ `/ ___/ ___/ __ \   / __  / _ \/ __ \/ ___/ __ \/ __ `__ \/ __ `/ ___/ //_/
/ /_/ / /_/ /  __/ / / /__/ /  __/ /_/ / /  / /__/ / / /  / /_/ /  __/ / / / /__/ / / / / / / / / /_/ / /  / ,<
\____/ .___/\___/_/ /_/____/\___/\__,_/_/   \___/_/ /_/  /_____/\___/_/ /_/\___/_/ /_/_/ /_/ /_/\__,_/_/  /_/|_|
    /_/

Aggregate test execution ID:  aggregate_results_geonames_9aafcfb8-d3b7-4583-864e-4598b5886c4f

-------------------------------
[INFO] SUCCESS (took 1 seconds)
-------------------------------

The results will then be aggregated into one test execution and stored under the ID shown.

Additional feature flags:

--test-execution-id: Define a unique ID for the aggregated test execution.
--results-file: Write the aggregated results to the provided file.
--workload-repository: Define the repository from where OSB will load workloads (default: default).

Issues Resolved

629 #630

Testing

Tested using make it and make test

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.

IanHoang commented 2 months ago

It'd be nice to include a sample output of how this command is used in the PR description.