mindsdb / lightwood

Lightwood is Legos for Machine Learning.
GNU General Public License v3.0
450 stars 94 forks source link

[feat] add special dispatch for bestof ensemble #1107

Closed paxcema closed 1 year ago

paxcema commented 1 year ago

Helps with mixers that are very expensive to run, e.g. GluonTS.

This way, we can override model prediction on a (potentially huge) validation dataset and simply report the validation loss as a proxy, for example. It's up to the provided function that will override the specified mixer within the ensemble.