search

lgessl / patroklos

An R package pipelining binary classification of survival
https://lgessl.github.io/patroklos/
Other
0 stars 0 forks source link

Add precision confidence interval to assessment suite #6

Closed lgessl closed 9 months ago

lgessl commented 9 months ago

For every possible risk-score cutoff and for all splits, calculate the $\gamma$ confidence interval (CI). Make a scatter plot of the upper and lower limit of the CI versus some other measure of the classifier (most prominently prevalence). This includes the theoretical foundations of calculating the CI.

lgessl commented 9 months ago

PerfPlotSpec can do this now for the lower boundary of the $\gamma$ CI. Via PerfPlotSpec you can also add a text label, a vertical and finally a horizontal line. The last you can use for a benchmark precision (like IPI group 4-5).