search

deepskies / DeepDiagnostics

Inference diagnostics for mostly SBI
MIT License
1 stars 0 forks source link

New Plot: Rank Statistic Histogram #32

Closed bnord closed 3 months ago

bnord commented 6 months ago

can be found in SBI or in STAN code

bnord commented 6 months ago

definition of rank statistic histogram: Rank histograms are a tool for evaluating ensemble forecasts. They are useful for determining the reliability of ensemble forecasts and for diagnosing errors in its mean and spread. Rank histograms are generated by repeatedly tallying the rank of the verification (usually an observation) relative to values from an ensemble sorted from lowest to highest

https://psl.noaa.gov/people/tom.hamill/rankh_mwr.pdf

bnord commented 6 months ago

sbc code in macke lab sbi

https://github.com/sbi-dev/sbi/blob/main/sbi/diagnostics/sbc.py

i think Becky also has some calls in her code for this already.

voetberg commented 5 months ago

Should have looked at this issue closer - yes this is already there: https://github.com/deepskies/DeepDiagnostics/blob/main/src/plots/ranks.py