Update tests & runner - Githubissues

automl / DACBench

A benchmark library for Dynamic Algorithm Configuration.

https://automl.github.io/DACBench/

Apache License 2.0

27 stars 14 forks source link

Closed TheEimer closed 3 years ago

TheEimer commented 3 years ago

Look through both, make sure all new benchmarks are covered and old ones are removed. Make runner more userfriendly.

maximilianreimer commented 3 years ago

More information needed:

What are old (to be removed) what are new ones? All benchmarks have at least 80% coverage
What are you missing for the runners? A cli?

maximilianreimer commented 3 years ago

Remove dacbench.runner.run_dacbench
Create new issue for imporvements for run_baselines
- DISCRETE_ACTIONS define based on action spaces of benchmark, (resultion maybe as parameter)
- Opimal policies
- ...

TheEimer commented 3 years ago

We want to remove benchmarks and update test respecitvely after merging branches (specifically cma)