This is a WIP script that allows you to take a crafted configuration file (including one generated by the test controller), and execute a benchmark against that configuration using one process-per-component.
Needed before merging:
[X] Support configurable test runtime
[X] Preserve test artifacts out-of-tree
[X] Cache and reuse preseeds (depends on a <commit_hash,preseed_count,shard_count> triple for uniqueness)
[X] Generate basic performance plots
[X] Support debugging and performance tooling
[X] Support arbitrary configuration files from 2PC and Atomizer (including those generated by the test controller for large-scale tests)
[x] Expose a pleasant command-line interface for easy feature-discovery and use
This is a WIP script that allows you to take a crafted configuration file (including one generated by the test controller), and execute a benchmark against that configuration using one process-per-component.
Needed before merging:
<commit_hash,preseed_count,shard_count>triple for uniqueness)