bencheeorg / benchee

Easy and extensible benchmarking in Elixir providing you with lots of statistics!
MIT License
1.41k stars 66 forks source link

Introduce `BenchmarkConfig` to selectively use config in benchmark #414

Closed PragTob closed 9 months ago

PragTob commented 9 months ago

Fixes #412 - but basically the Config holds inputs and that can be a hell loat of data to send along with every benchmark.

In a benchmark with 16 scenarios and huge inputs we now save ourselves copying that potentially huge data structure a whopping 16 times to our benchmarking processes for no reason whatsoever (the scenarios already hold the input).