hobbit-project / platform

HOBBIT benchmarking platform
GNU General Public License v2.0
23 stars 9 forks source link

Estimate the runtime of experiments #486

Open denkv opened 4 years ago

denkv commented 4 years ago

User story

There are several possible useful hints which can be displayed in UI:

Solution

When there already are successful experiments for the same combination of the benchmark and the system instance, we can use their results to roughly estimate how long an experiment will take. It's okay for some hints to be missing due to nonexisting data, we can just display what's available. Failed and timed out experiments should not be considered.

Later we can also take into account docker image hashes in case there are a lot of experiment data available.

Problems

MichaelRoeder commented 4 years ago

With respect to the runtime KPI issue: the HOBBIT ontology defines hobbit:startTime and hobbit:endTime. The platform adds them to each experiment.