NOAA-EMC / GDASApp

Global Data Assimilation System Application
GNU Lesser General Public License v2.1
14 stars 28 forks source link

Save basic stats in csv at each cycle #1040

Closed guillaumevernieres closed 3 months ago

guillaumevernieres commented 3 months ago

Work done

Computes basic stats (count, bias and rmse of omb's and oma's) for different ocean basins, this assumes the obs were flagged with the ocean mask from RECCAP2_region_masks_all_v20221025.nc.

Work left to do

We're not flagging the obs currently, so that code will do nothing until we update the prep ocean obs yaml to point to RECCAP2_region_masks_all_v20221025.nc (it's been copied to the soca fix dir on hera and orion). To have the obs flagged in develop will require the ioda converters to not fail if the RECCAP2_region_masks_all_v20221025 isn't found.

emcbot commented 3 months ago

Automated Global-Workflow GDASApp Testing Results: Machine: orion

Start: Fri Apr 12 16:06:15 CDT 2024 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Build:                                  *FAILED*
Build: Failed at Fri Apr 12 17:16:44 CDT 2024
Build: see output at /work2/noaa/stmp/cmartin/CI/GDASApp/workflow/PR/1040/global-workflow/sorc/log.build
emcbot commented 3 months ago

Automated Global-Workflow GDASApp Testing Results: Machine: hera

Start: Fri Apr 12 21:13:55 UTC 2024 on hfe07
---------------------------------------------------
Build:                                 *SUCCESS*
Build: Completed at Fri Apr 12 22:05:26 UTC 2024
---------------------------------------------------
Tests:                                  *Failed*
Tests: Failed at Fri Apr 12 22:33:55 UTC 2024
Tests: 92% tests passed, 4 tests failed out of 53
    1742 - test_gdasapp_fv3jedi_fv3inc (Failed)
    1763 - test_gdasapp_soca_JGDAS_GLOBAL_OCEAN_ANALYSIS_VRFY (Failed)
    1776 - test_gdasapp_atm_jjob_var_run (Failed)
    1777 - test_gdasapp_atm_jjob_var_final (Failed)
Tests: see output at /scratch1/NCEPDEV/da/Cory.R.Martin/CI/GDASApp/workflow/PR/1040/global-workflow/sorc/gdas.cd/build/log.ctest