JuliaTrustworthyAI / ConformalPrediction.jl

Predictive Uncertainty Quantification through Conformal Prediction for Machine Learning models trained in MLJ.
https://juliatrustworthyai.github.io/ConformalPrediction.jl/
MIT License
135 stars 12 forks source link

Cqr #96

Closed MojiFarmanbar closed 5 months ago

MojiFarmanbar commented 10 months ago

This is a draft pull request

PR might fail, as I didn't merge main into this branch. After removing .vscode setting from main, I can fix it.

pat-alt commented 10 months ago

I think this branch was out-of-date? Have now merged updates from main

pat-alt commented 10 months ago

Notes from chat:

"Union type for quantile models."
const QuantileModel = Union{MLJModels.QuantileRegressor, MLJ.QuantileClassifier, ScikitLearn.QuantileTrees}

"Constructor for `ConformalQuantileRegressor`."
mutable struct ConformalQuantileRegressor{Model<:QuantileModel} <: ConformalInterval
MojiFarmanbar commented 6 months ago

@pat-alt , I have adjusted based on above checklist, please review and check the PR. at the moment, it is only for one model (QuantileRegression). I will extend it to more models in another PR.

pat-alt commented 6 months ago

Hey @MojiFarmanbar, I'm a bit confused that when I'm trying to add a review it shows so many files changed. Have just removed the merge conflicts so that we can see if tests pass. Once they pass, I'm happy to merge this based on what we discussed and contingent on the check list items being done (as you mentioned).

codecov[bot] commented 6 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 72.34%. Comparing base (c4ef89a) to head (9293cc8). Report is 2 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #96 +/- ## ========================================== + Coverage 69.15% 72.34% +3.18% ========================================== Files 19 21 +2 Lines 749 799 +50 ========================================== + Hits 518 578 +60 + Misses 231 221 -10 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

pat-alt commented 6 months ago

Hi @MojiFarmanbar, only missing thing here is the error in docs. Other errors are unrelated to this PR, will have a crack at that next week hopefully