search

tinylibs / tinybench

🔎 A simple, tiny and lightweight benchmarking library!
MIT License
1.73k stars 36 forks source link

When used with Vitest, tinybench produces results too different from other tools like mitata #70

Closed sheremet-va closed 7 months ago

sheremet-va commented 7 months ago

Mitata shows a x15 diff with the slowest option, vitest only a x2.

Reproduction: https://stackblitz.com/edit/node-odkzk5?file=package.json,tests%2Fexample.bench.ts Related: https://github.com/vitest-dev/vitest/issues/2220

sirenkovladd commented 7 months ago

https://github.com/vitest-dev/vitest/issues/2220#issuecomment-1949889895

Aslemammad commented 7 months ago

@sirenkovladd Thank you so much for the exploration!

sheremet-va commented 7 months ago

Thank you for investigating this issue! I will close it then.