microsoft / FLAML

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
https://microsoft.github.io/FLAML/
MIT License
3.86k stars 506 forks source link

Isolate the ensemble part and expose it to users #807

Open sonichi opened 1 year ago

sonichi commented 1 year ago

Right now the ensemble part is not isolated from hyperparameter search. Sometimes the ensemble part fails due to OOM. Users would like to use a more powerful machine to finish the ensemble part using a pickled automl object. #801

Suggestion: put the ensemble part in a separate function and expose it to users.

coffepowered commented 1 year ago

Can you provide some hints on where you would start? I am evaluating if I'm able to contribute on this

sonichi commented 1 year ago

Can you provide some hints on where you would start? I am evaluating if I'm able to contribute on this

The ensemble part is located in https://github.com/microsoft/FLAML/blob/63d350d4c8cae5f5bdd686a97e737013fbd9641d/flaml/automl/automl.py#L3625-L3746