A new benchmark suite is indicated in the navigation, but then doesn't seem to be in the actual comparison. Here for the example of the interpreter suite:
Since this does not rely on the baseline commit version, the executor comparison should really include it.
This is super useful when introducing a new suite, and possibly individual benchmarks.
And since the executor comparison might even be the main focus, it seems like a bug not having the comparison show up here.
A new benchmark suite is indicated in the navigation, but then doesn't seem to be in the actual comparison. Here for the example of the
interpretersuite:Since this does not rely on the baseline commit version, the executor comparison should really include it. This is super useful when introducing a new suite, and possibly individual benchmarks. And since the executor comparison might even be the main focus, it seems like a bug not having the comparison show up here.