With Mix.install/2, there is an increased odd that someone will invoke Benchee from IEx or from a Livebook. The problem is that evaluated functions are much slower. I suggest emit warnings if the benchmark functions are evaluating.
You can check if a function is evaluating like this:
warning: the benchmark "foobar" is using an evaluated function. Evaluated functions perform slower than compiled functions. Consider moving all of the Benchee caller to a function in a module and invoking the `Mod.fun()` instead.
With
Mix.install/2
, there is an increased odd that someone will invoke Benchee from IEx or from a Livebook. The problem is that evaluated functions are much slower. I suggest emit warnings if the benchmark functions are evaluating.You can check if a function is evaluating like this:
The warning could look like this:
Thank you for the project and congrats on v1.0!