search

automl / neps

Neural Pipeline Search (NePS): Helps deep learning experts find the best neural pipeline.
https://automl.github.io/neps/
Apache License 2.0
61 stars 13 forks source link

fix(runtime): filelock issues #161

Open eddiebergman opened 2 days ago

eddiebergman commented 2 days ago

Fixes issues with larger scale runs of NePS.

  1. A condition that was expected but there was a local variable not defined error which fixes issues for multiple worker contention.
  2. Reporting a trial no longer needs to lock the optimizer state, instead the values for budget are computed directly during the sampling procedure, where the lock and trials are already loaded in.
  3. Allow retring or creating/loading the NePS state, as there is no locking mechanism that will work reliably, until the directory is fully created. e.g. Imagine 100 workers all thinking they're the first and trying to create the directory at once.