search

LilithHafner / Chairmarks.jl

Benchmarks with back support
GNU General Public License v3.0
81 stars 8 forks source link

Support `Chairmarks.DEFAULTS.seconds` #121

Open LilithHafner opened 2 weeks ago

LilithHafner commented 2 weeks ago

Implements and closes #71 by providing a global default mechanism: Chairmarks.DEFAULTS.seconds = 1.

LilithHafner commented 2 weeks ago

RegressionTests found that ttfx_excl_load_time nearly doubles from about 120ms to 180ms.

LilithHafner commented 2 weeks ago

Worth considering how this behaves when DEFAULTS.seconds and DEFAULTS.samples are both set, keeping in mind the default behavior of 10x-ing seconds when samples is set.

LilithHafner commented 2 weeks ago

Maybe we should stop multiplying runtime budget by 10 when when samples is specified.