hobbit-project / platform

HOBBIT benchmarking platform
GNU General Public License v2.0
24 stars 9 forks source link

Highlight achieved perfect KPI values #460

Open denkv opened 5 years ago

denkv commented 5 years ago

User story

When viewing experiment results, users may want to quickly find out whether a perfect score for KPI was achieved or not.

Solution

Benchmark definition file can include "perfect values" for KPIs (if applicable), which can be used to display a highlight in UI.

For example, 1.0 would be the perfect value for recall.

Needs to be defined in ontology.

Maybe also benchmarks can define ranges for properties like recall to help the platform present the data better. For example, defining 0.0 and 1.0 as the worst and the best cases, UI can color the value range using a gradient, and also scale the corresponding plots correctly.