Guideline on changing the number of folds in the `evaluate_pipeline()` function

openml-labs / gama

An automated machine learning tool aimed to facilitate AutoML research.

https://openml-labs.github.io/gama/master/

Apache License 2.0

92 stars 30 forks source link

Guideline on changing the number of folds in the `evaluate_pipeline()` function #123

Open iXanthos opened 3 years ago

iXanthos commented 3 years ago

Greetings,

I would like to know if it is possible to change the number of folds in the (stratified) cross validation internally for each generated model. Currently, this parameter has a default value of 5 and I found it is used in the evaluate_pipeline() function. Ideally, I would like to be able to input different values of k.

Regards, Iordanis

PGijsbers commented 3 years ago

It looks like I forgot to forward this parameter to an external interface. Unfortunately it's also hard to monkey patch, which means it's currently not really possible (technically it is if you patch the fit function). I'll see if I can push an update to master tomorrow. Thanks for bringing this to our attention.