automl / jahs_bench_201

The first collection of surrogate benchmarks for Joint Architecture and Hyperparameter Search.
https://automl.github.io/jahs_bench_201/
MIT License
15 stars 7 forks source link

Provide a fixed tag version once stable #2

Closed eddiebergman closed 1 year ago

eddiebergman commented 1 year ago

Not sure if the benchmark is stable yet but having a tag to version of would be ideal.

It would also be good to provide an option in the download module rather then to use fixed versioned surrogates/data once possible: https://github.com/automl/jahs_bench_201/blob/c1e92dd92a0c4906575c4e3e4ee9e7420efca5f1/jahs_bench/download.py#L5-L6

NeoChaos12 commented 1 year ago

This is indeed a feature that we have planned but must hold off on until our hosting has been stabilized. I'll keep this issue updated!

NeoChaos12 commented 1 year ago

After revisiting this issue, we have decided that we will drop this feature once the final data and models have been uploaded to Figshare since there will be no further updates to the links after that.