smarr / ReBenchDB

ReBenchDB records benchmark results and provides customizable reporting to track and analyze run-time performance of software programs.
MIT License
12 stars 6 forks source link

Comparison View: shows 0.00 instead of correct value in executor comparison #183

Open smarr opened 6 months ago

smarr commented 6 months ago

Example https://rebench.dev/TruffleSOM/compare/4267a835bbfd0ed2153d651bcd0cbe0707c722bc..12bedc02f43f1ee700f64c117c1d71a3cc61a489#exe-comparisons

Here we do not have baseline values for some executors. And these executors are not shown correctly in the executor comparison. Of course, this doesn't involve the "baseline" commit at all, so should be shown correctly.