Feature request: allow limiting very long-running tests

haskell / criterion

A powerful but simple library for measuring the performance of Haskell code.

http://www.serpentine.com/criterion

BSD 2-Clause "Simplified" License

503 stars 86 forks source link

Feature request: allow limiting very long-running tests #218

Open jberryman opened 4 years ago

jberryman commented 4 years ago

I would like a flag that lets me say "never spend more than X seconds on a benchmark; if the time limit is exceeded compile statistics with runs you've done".

I assumed from help that this was what -L did, but I was wrong (I think those docs could be improved too; -L seems to run a benchmark for some fixed amount of time which we wouldn't normally call a "time limit"... I wonder if it was originally meant to do what I thought it did...).

jberryman commented 4 years ago

maybe dupe of https://github.com/bos/criterion/issues/210

daberg commented 4 years ago

Hello there, I have the same problem as @jberryman. Are there any news about this enhancement? Any possible workarounds? Thanks.

RyanGlScott commented 4 years ago

I'm not actively working on this, but I would welcome a PR that implemented it.