search

JCSDA-internal / eva

Evaluation and Verification of the Analysis
Apache License 2.0
5 stars 12 forks source link

Add ability to read CSV data files #163

Closed EdwardSafford-NOAA closed 11 months ago

EdwardSafford-NOAA commented 11 months ago

In the eva/data sub-directory add a module to enable reading in CSV formatted text files named csv_space.py. This is needed in order to generate the MinMon summary plots.

The idea is to read the data in a generic fashion so any CSV file could be read into eva. The input yaml file will indicate which field(s) in the file are to be to incorporated in the resulting dataset, as well as the names of the corresponding variables.

EdwardSafford-NOAA commented 11 months ago

Just about there. This plot is taken from the gnorm_data.txt file, which is in CSV format. This 3 figure plot is the MinMon summary plot and includes the initial gradient over the past 120 cycles, the final gnorm value (over 120 cycles), and the minimum and maximum values of the last 10 iterations (over 120 cycles).

image

EdwardSafford-NOAA commented 11 months ago

Closed by #164 .