search

smarr / ReBenchDB

ReBenchDB records benchmark results and provides customizable reporting to track and analyze run-time performance of software programs.
MIT License
13 stars 6 forks source link

New Comparison View: Need to support multiple trials contributing data to an experiment #158

Closed smarr closed 1 year ago

smarr commented 1 year ago

Generally, we currently assume for instance when ordering measurements and asserting the properties of the ordering, that there's only a single trial.

However, there can be multiple trials in a single experiment. And we want to be able to use all that data.

Example: http://localhost:33333/GraalPython/compare-new/3e044a1610417acfe720720746aabbd9938e3648..1c6243e88f81d42d698d2da403be4fcd5b3cb8ec

This is related to #157, which should be finished first.