deepskies / DeepDiagnostics

Inference diagnostics for mostly SBI
MIT License
1 stars 0 forks source link

New Metric: Area under CDF #37

Open bnord opened 9 months ago

bnord commented 8 months ago

integrate the area under CDF curve to produce a single number that represents the relative expected confidence of the model.

voetberg commented 6 months ago

Do you have an example of this or a rigorous definition of how the cdf curve should be generated?

bnord commented 6 months ago

regarding the integration ... Same as AUC for the ROC Link to issue for CDF curve generation -- #34