tinylibs / tinybench

🔎 A simple, tiny and lightweight benchmarking library!
MIT License
1.73k stars 36 forks source link

setup hook not awaited during warmup #36

Closed HlustikP closed 1 year ago

HlustikP commented 1 year ago

Currently, the setup method is awaited during normal benchmark runs, however it is not awaited during warmup, even though the setup method is per it's signature marked as potentially asynchronous. Awaiting setup during warmup will create consistent behaviour for both the warmup and the actual benchmarking stage.