automl / neps

Neural Pipeline Search (NePS): Helps deep learning experts find the best neural pipeline.
https://automl.github.io/neps/
Apache License 2.0
44 stars 11 forks source link

Potential issues if multiple checkpoints for one config #19

Open eddiebergman opened 9 months ago

eddiebergman commented 9 months ago

https://github.com/automl/neps/blob/61103dbd113723edd0b612d66769976db0a2601d/src/neps/utils/common.py#L119-L124

This just grabs the last checkpoint found by glob which gives no guaranteed order of what it returns. For now it might be safer to just error if multiple are found. Not sure about a long term solution