openml / automlbenchmark

OpenML AutoML Benchmarking Framework
https://openml.github.io/automlbenchmark
MIT License
396 stars 132 forks source link

Website with results? #101

Open pplonski opened 4 years ago

pplonski commented 4 years ago

Thank you for this package! I'm working on my AutoML python package and this benchmark suite is very needed.

I have a question, is there any website that publishes results of benchmarking from available frameworks?

sebhrusen commented 4 years ago

Hi @pplonski, currently the only published results are 1 year old: you can find them on the application website, and in the reports folder. Those same results are also available as an OpenML Study.

@PGijsbers do you have any update about the new website to explore results?

PGijsbers commented 4 years ago

The plan is to use OpenML to publish the benchmark results. We are currently working on a new front-end, but our plan for a hackathon for the final push unfortunately got postponed due to the pandemic. You can see the results here (click on "Analysis").

The other part of the project is making the results of this benchmark (almost) automatically upload to OpenML. When that's done it will be easier to keep results up to date.