search

automl / DEHB

https://automl.github.io/DEHB/
Apache License 2.0
71 stars 16 forks source link

Checkpointing optimization run #31

Closed Bronzila closed 6 months ago

Bronzila commented 1 year ago

A nice addition to the package could be checkpointing the state of the optimizer in order to restart the optimization e.g. when an optimization run has finished or crashed.

This could also be interesting for issue #30 in order to restart the optimization with a higher computational budget.

PR #6 has already touched this topic and it might make sense to get some inspiration form there.

We could then also adjust the pytorch example to feature this.

Neeratyoy commented 1 year ago

Could we perhaps link this as TODOs post the ask-tell and config ID changes?

eddiebergman commented 1 year ago

I would add that the tell() part of ask() and tell() makes this functionality easy to implement (assuming tell() supports this) for both DEHB or external users #36. It's likely a better stepping stone towards this goal.