openml / OpenML

Open Machine Learning
https://openml.org
BSD 3-Clause "New" or "Revised" License
668 stars 91 forks source link

Better organize the 'measures' index #623

Open joaquinvanschoren opened 6 years ago

joaquinvanschoren commented 6 years ago

As per https://github.com/openml/OpenML/issues/616, it is confusing that evaluation metrics, estimation procedures, data qualities, flow qualities show up in the same list.

We could create individual indexes. I didn't do this initially because building a whole search index for 30-40 items seems overkill. Plus it clutters the navigation sidebar.

What I can do is show one type by default (e.g. evaluation measures), and add clear buttons for listing the other ones, so that they never mix.

amueller commented 6 years ago

flow qualities are not implemented, right? Having a "never mix" would be fine by me, but I think the evaluation metrics are by far the most common to look at. But maybe if we directly link to the descriptions from the runs as I suggested in https://github.com/openml/OpenML/issues/617#issuecomment-363947943

joaquinvanschoren commented 6 years ago

Links are added: https://github.com/openml/OpenML/commit/af6e07f0cdf5a045507a53baa563266578d47ee4 Running on the test server now

amueller commented 6 years ago

Sweet! I think this closes #590 because it makes it much easier to find.

amueller commented 6 years ago

ping @hildeweerts - adding the links is done! Maybe work on improving the explanation, starting with AUC?