redis / redis-benchmarks-specification

The Redis benchmarks specification describes the cross-language/tools requirements and expectations to foster performance and observability standards around redis related technologies. Members from both industry and academia, including organizations and individuals are encouraged to contribute.
Apache License 2.0
30 stars 11 forks source link

Request to add functionality to retrigger testing for each specific host / host type #217

Open markovamaria opened 1 year ago

markovamaria commented 1 year ago

Improvement

I'd like to have an option to retrigger testing on one particular host. Example:

Basically I need to retrigger:

To be able use such scenario some extra key , like "--retrigger_host" is required. It should identify host, where you need to retrigger testing. It can be identified via name ip or other way (depends on how code is communicating with hosts). E.g.:

$ redis-benchmarks-spec-cli --use-branch --from-date 2023-02-03 --retrigger_host [name1 or ip1 or ...] --redis_port ***  --redis_host *** --redis_pass *** 
$ redis-benchmarks-spec-cli --use-branch --from-date 2023-02-10 --retrigger_host [name2 or ip2 or ...] --redis_port ***  --redis_host *** --redis_pass *** 

Implementation of such functionality will add flexibility to system and help in restoring of testing system from failures w/o extra load for other testing hosts.

filipecosta90 commented 1 year ago

Totally agree, let's add a new argument to the cli (that needs to be included on the buidler STREAM metadata ) to filter based upon platform name. So, potentially something like: --platform