scikit-learn-contrib / MAPIE

A scikit-learn-compatible module to estimate prediction intervals and control risks based on conformal predictions.
https://mapie.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
1.3k stars 111 forks source link

This video suggests there might be a bug in implementation due to coverage dropping for ICP #451

Closed valeman closed 6 months ago

valeman commented 6 months ago

https://www.youtube.com/watch?v=k6k_bUYyUNg&ab_channel=MLBoost

thibaultcordier commented 6 months ago

Thank you for sharing the video link which suggests a bug in the coverage validity. I have initiated a new issue that explains the reason for the bug as well as additional material that allows users to reproduce the bug.