search

evalclass / precrec

An R library for accurate and fast calculations of Precision-Recall and ROC curves
https://evalclass.github.io/precrec
GNU General Public License v3.0
45 stars 5 forks source link

how to use precrec_auc_ci to calculate 95%CI of PR curve during prediction model #20

Open LINGLLIU opened 1 month ago

LINGLLIU commented 1 month ago

precrec_obj <- evalmod(scores = trainset$train_pred,labels=trainset$outcome,mode="prcroc")

plot(precrec_obj) auc_ci(precrec_obj) error: 'curves' must contain multiple datasets.

takayasaito commented 1 month ago

You can see #13 for the CI calculation with precrec. Basically, you can't calculate a 95% CI when only one sample is provided as precrec doesn't support bootstrapping.

LINGLLIU commented 1 month ago

Okay i got it. Thanks very much.

---- Replied Message ---- | From | Takaya @.> | | Date | 05/27/2024 22:25 | | To | @.> | | Cc | @.>@.> | | Subject | Re: [evalclass/precrec] how to use precrec_auc_ci to calculate 95%CI of PR curve during prediction model (Issue #20) |

You can see #13 for the CI calculation with precrec. Basically, you can't calculate a 95% CI when only one sample is provided as precrec doesn't support bootstrapping.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>