zachmayer / caretEnsemble

caret models all the way down :turtle:
Other
226 stars 75 forks source link

CaretEnsemble with pretrained models #258

Closed KhalilM94 closed 1 year ago

KhalilM94 commented 1 year ago

Hello I have already pre-trained a few models using rfe (recursive feature elimination) in caret. Is there any way to use CaretEnsemble with my models to stack them into a single random forest predictor?

zachmayer commented 1 year ago

I think caretEnsemble works ok with custom caret models. Write a custom model where the "train" step does nothing but the predict step makes predictions. Provide some data (be sure it is NOT the training data you used for pretraining) and caretEnsemble can make predictions on that data and then use those predictions to make an ensemble.

The key element is out-of-sample predictions, so you'll need a custom model to make predictions and data to predict on.