microsoft / nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
https://nni.readthedocs.io
MIT License
13.88k stars 1.81k forks source link

Fix 2 issues #5779

Open TimSchim opened 1 month ago

TimSchim commented 1 month ago

Description

HPO with GPTuner is not working with current versions of SciPy

Issue 1:

Starting from SciPy v1.11.0 the shape of argument x0 for scipy.optimize.minimize() should be of shape (n,). The current NNI implementation assumes shape (1, n). Related issues:

Issue 2:

scipy.optimize.minimize() returns a scipy.optimize.OptimizeResult object. The current NNI implementation assumes the "fun" item to be an array, when the type should actually be a float. Related issues:

Test Options

Checklist

How to test