search

dtcenter / MET

Model Evaluation Tools
https://dtcenter.org/community-code/model-evaluation-tools-met
Apache License 2.0
74 stars 22 forks source link

Enhance gsid2mpr and gsidens2orank tools to filter pairs before writing them. #810

Open dwfncar opened 7 years ago

dwfncar commented 7 years ago

This request came from Michelle Harrold in her application of MET to GMTB. They're running the GSI tools on global gdas diagnostic files and need to compute summary statistics.


In met-6.0, gsid2mpr reads a 10mb binary files and writes a 100mb output ASCII file. Michelle would like to be able to filter the paired data prior to writing it to the output. She'd like to filter by message type, time, and space. This is basically like running the reformatting tool and stat-analysis at the same time. We'd need to add a config file.


We could also consider deriving summaries, like SL1L2, VL1L2, and CTC lines, but that'd be one more level of complexity. Supporting simple filters is a pretty reasonable request though.


Could even implement this directly as a STAT-Analysis filter job within the GSI tools themselves. [MET-810] created by johnhg

dwfncar commented 7 years ago

Consider passing in a STAT-Analysis config file to support whatever job types are requested. by johnhg