lf-lang / benchmarks-lingua-franca

2 stars 4 forks source link

Rust benchmark timing is off for Sorted List #7

Open jhaye opened 2 years ago

jhaye commented 2 years ago

The benchmark timing of the Sorted List benchmark is off. When the list is cleared between iterations, the benchmark runner should stop and only resume once clearing finished. This is not the case here, meaning that the clearing of the list is included in the timing.

The effect of this can be directly seen when comparing the runtime of the first iteration of the benchmark with the rest.