search

microsoft / FLAML

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
https://microsoft.github.io/FLAML/
MIT License
3.91k stars 508 forks source link

Is there a way to use a custom evaluation metric? #69

Closed bnriiitb closed 3 years ago

bnriiitb commented 3 years ago

I would like to define & use a custom evaluation metric.

qingyun-wu commented 3 years ago

Hi @bnriiitb

You can set a customized metric in FLAML through the 'metric' argument: https://github.com/microsoft/FLAML/blob/06045703bf90f58f3b89acb01b50c8fe2c65b93b/flaml/automl.py#L811

You can find an example of such a customized metric here: https://github.com/microsoft/FLAML/blob/06045703bf90f58f3b89acb01b50c8fe2c65b93b/test/test_automl.py#L92

Let us know if you need more help! Thanks!

I would like to define & use a custom evaluation metric.

bnriiitb commented 3 years ago

Thank you @qingyun-wu this is helpful.