search

microsoft / FLAML

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
https://microsoft.github.io/FLAML/
MIT License
3.75k stars 495 forks source link

Update Optuna #1280

Open bbudescu opened 4 months ago

bbudescu commented 4 months ago

setup.py specifies that the required version of Optuna to be 2.8.0. However, according to ray docs (check out the second warning on this page) :

Please note that with Optuna 2.10.0 and earlier default MOTPESampler/TPESampler suffer from performance issues when dealing with a large number of completed trials (approx. >100). This will manifest as a delay when suggesting new configurations. This is an Optuna issue and may be fixed in a future Optuna release.

In my own experience, I have also observed the slowdown they mention.

Is there any reason for this version requirement for Optuna? And, if yes, how hard would it be update to the latest version?

Programmer-RD-AI commented 1 month ago

Before transitioning to newer versions, it typically involves a substantial amount of effort. I'm planning to submit a pull request to update Optuna to version 2.10.0, but the rationale behind this decision needs to be verified by Microsoft employees who are actively involved with FLAML.