NOAA-PSL / land-offline_workflow

Creative Commons Zero v1.0 Universal
1 stars 9 forks source link

Update the JEDI versions. #7

Closed jiaruidong2017 closed 1 year ago

jiaruidong2017 commented 2 years ago
  1. Provide details under all headings below.
  2. Assign the issue to the relevant people (Clara and Mike should be included on most issues).

Describe the issue.

Describe the problem and why it matters. There are some updates on land related DA applications, which require the changes in the configurations of yaml files. The new yaml configurations require the updates of the JEDI package.

If there is a proposed solution, descibe it below as individual steps

Test output

Will addressing this issue change the DA_IMS_test output? If not, what are the expected changes?

ClaraDraper-NOAA commented 1 year ago

@jiaruidong2017 I've updated the jedi fv3-bundle included in the workflow. Can you please check that the GTS yaml works with the version of JEDI that the workflow now uses. If not, can you please update the yaml?

jiaruidong2017 commented 1 year ago

@ClaraDraper-NOAA When I tried to clone the submodel by using "git submodule update --init --recursive", I got the following errors from IMS_proc package as:

Cloning into '/scratch1/NCEPDEV/global/Jiarui.Dong/JEDI/workflow/experiment/land-offline_workflow/DA_update/IMS_proc'...
fatal: remote error: upload-pack: not our ref 9ae55f5963b7783f17d8ecc2d357f9c0103e765e
fatal: The remote end hung up unexpectedly
Fetched in submodule path 'DA_update/IMS_proc', but it did not contain 9ae55f5963b7783f17d8ecc2d357f9c0103e765e. Direct fetching of that commit failed.

Any idea? Thanks.

ClaraDraper-NOAA commented 1 year ago

Jiarui - it should work now (I had forgotten to push the latest commit to the IMS submodule).

jiaruidong2017 commented 1 year ago

The workflow run worked at three cycles: t00z, t12z and t18z, but collapsed at the t06z cycle with the following error message:

ObsErrorDiag covariance updated 1647
Observer::finalize QC =
Simulate totalSnowDepth nlocs = 1997, nobs = 1996, min = 0, max = 22, avg = 2
QC Simulate totalSnowDepth: 286 out of bounds.
QC Simulate totalSnowDepth: 50 out of domain of use.
QC Simulate totalSnowDepth: 2 black-listed.
QC Simulate totalSnowDepth: 4 rejected by first-guess check.
QC Simulate totalSnowDepth: 7 removed by buddy check.
QC Simulate totalSnowDepth: 1647 passed out of 1997 observations.
Exception: Assertion failed: numRecognizedFlags == gnlocs in print, line 194 of /scratch1/NCEPDEV/global/Jiarui.Dong/JEDI/workflow/fv3-bundle_20220812/ufo/src/ufo/filters/QCmanager.cc
Assertion failed: numRecognizedFlags == gnlocs in print, line 194 of /scratch1/NCEPDEV/global/Jiarui.Dong/JEDI/workflow/fv3-bundle_20220812/ufo/src/ufo/filters/QCmanager.cc
jiaruidong2017 commented 1 year ago

The observation file at 20191003 t06z:

netcdf adpsfc_snow_2019100306 {
dimensions:
        ndatetime = 20 ;
        nlocs = 2340 ;
        nstring = 50 ;
        nvars = 1 ;
variables:
jiaruidong2017 commented 1 year ago

@ClaraDraper-NOAA The GTS yaml file has been updated, and a PR was created for merging.

ClaraDraper-NOAA commented 1 year ago

re-opening, until I've merged the PR.

jiaruidong2017 commented 1 year ago

Sorry. Closed it by accident.