It's likely to be common for a user to want to have a benchmark instance for each of a list of possible argument values (or, more generally, for each combination of possible values from lists for multiple arguments): for example, c1b14cdd772f3d6acae60659ac17fcac13862603.
Perhaps this should be a utility function in the Benchmark class (to be called within a derived class's generate_benchmarks).
We may also want to extend GenericBenchmark config with options to make use of it.
It's likely to be common for a user to want to have a benchmark instance for each of a list of possible argument values (or, more generally, for each combination of possible values from lists for multiple arguments): for example, c1b14cdd772f3d6acae60659ac17fcac13862603.
Perhaps this should be a utility function in the Benchmark class (to be called within a derived class's
generate_benchmarks).We may also want to extend GenericBenchmark config with options to make use of it.