search

trinodb / benchto

Framework for running macro benchmarks in a clustered environment
Apache License 2.0
28 stars 29 forks source link

Don't ignore values from overrides not present in base benchmark #54

Closed nineinchnick closed 2 years ago

nineinchnick commented 2 years ago

This allows adding custom attributes to benchmark runs, like the description of the cluster on which the System Under Test is running. Such a description might be specific to a single execution of the benchmark, so it can't be stored in environment attributes.

nineinchnick commented 2 years ago

@sopel39 PTAL, maybe we can get this into 0.20?

sopel39 commented 2 years ago

Is it possible to add test @nineinchnick ?

nineinchnick commented 2 years ago

@sopel39 I modified an existing test to show that new attributes are not ignored.