Suggestion fails because pareto groups is empty

imbue-ai / carbs

Cost aware hyperparameter tuning algorithm

MIT License

53 stars 1 forks source link

Suggestion fails because pareto groups is empty #6

Open jsuarez5341 opened 1 week ago

jsuarez5341 commented 1 week ago

Got CARBS working on a toy env. Went to throw it on something larger and it's failing after a few trials because the pareto front is empty. Any idea what would cause this?

abefetterman commented 1 week ago

Did you set num_random_samples in your config to 0? That's the only thing that I imagine could cause it -- we recommend setting it to at least 3 (if you are running without any parallel suggestions, set it to at least the number of dimensions you have)

jsuarez5341 commented 1 week ago

Hmm, no, but I was editing the suggestions returned by CARBS. There's a round function for linear spaces but not for exponential ones, so I was postprocessing values to make minibatches powers of 2. Will see if I repro it in the cleaned up version