dtcenter / MET

Model Evaluation Tools
https://dtcenter.org/community-code/model-evaluation-tools-met
Apache License 2.0
78 stars 24 forks source link

Enhance MET statistics tools for climatological data. #549

Closed dwfncar closed 9 years ago

dwfncar commented 9 years ago

Enhance MET statistics tools for climatological data by doing the following:



Also need to determine how Economic Value should be calculated and where it should go in the output.


Questions...


(1) The NCEP climo data is monthly. When searching for a match, only consider records where the climo month matches the forecast month. What is users have climo data that's seasonal or daily? How to instruct MET to match those? [MET-549] created by johnhg

dwfncar commented 9 years ago

I just took a look at the 1.0 degree climatology data and it's daily GRIB files instead of monthly as in the 2.5 degree data:
  dakota:/d3/projects/MET/NCEP_unification/climdata_1deg

To handle that, we'll need a flag in the config file to specify "daily" vs "monthly" to control the matching logic. Should we support "seasonal" as well, or not until it comes up and we'd have something with which to test? by johnhg

dwfncar commented 9 years ago

The link to Yuejian's ensemble verification description can be found at: http://www.emc.ncep.noaa.gov/gmb/yzhu/naefs/ENS_VERIFICATION_short.pdf
This defines the calculation of RPSS, CRPSS, and to some extent Economic Value (which follows Murphy 1977) by jensen