deel-ai / puncc

👋 Puncc is a python library for predictive uncertainty quantification using conformal prediction.
https://deel-ai.github.io/puncc/
252 stars 14 forks source link

API: conformalizing a pretrained underlying model with no splitter #45

Closed M-Mouhcine closed 6 months ago

M-Mouhcine commented 6 months ago

In case we want to conformalize a pretrained model using the API, the current ConformalPredictor class requires a splitter even when X_fit and y_fit are not necessary.

In such situation, the correct behavior would be to pass a None splitter argument for the ConformalPredictor's constructor and use calibration data in the call for fit. The ConformalPredictor should allow a None splitter only when train argument is False.