ufs-community / regional_workflow

THIS REPOSITORY IS NOW DEPRECATED; SEE UFS SRW APP FOR CURRENT CODE
https://github.com/ufs-community/ufs-srweather-app
Other
10 stars 86 forks source link

get_extrn_lbcs fails when FCST_LEN_HRS>=40 with netcdf #813

Closed chan-hoo closed 2 years ago

chan-hoo commented 2 years ago

Description

The 'get_extrn_lbcs' task fails when FCST_LEN_HRS >= 40 and FV3GFS_FILE_FMT_ICS="netcdf". This is because the python script 'ush/retrieve_data.py' does not check the 'b' file:

Steps to Reproduce

In config.sh: EXTRN_MDL_NAME_ICS="FV3GFS" FV3GFS_FILE_FMT_LBCS="netcdf" EXTRN_MDL_NAME_LBCS="FV3GFS" FV3GFS_FILE_FMT_ICS="netcdf" DATE_FIRST_CYCL="20220601" DATE_LAST_CYCL="20220601" CYCL_HRS=( "12" ) FCST_LEN_HRS="48" LBC_SPEC_INTVL_HRS="12"

Output

In get_extrnlbcs*.log:

HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf012.nc, 6805861027 bytes, 13292699 media blocks HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf024.nc, 6795416811 bytes, 13272300 media blocks HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf036.nc, 6873962865 bytes, 13425710 media blocks HTAR: Extract complete for /NCEPPROD/hpssprod/runhistory/rh2022/202206/20220601/com_gfs_prod_gfs.20220601_12.gfs_nca.tar, 3 files. total bytes read: 20475243008 in 93.007 seconds (220.147 MB/s average) wallclock/user/sys: 94.865 0.214 33.755 seconds HTAR: HTAR SUCCESSFUL INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf012.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf012.nc

INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf024.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf024.nc

INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf036.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf036.nc

INFO: File does not exist: /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf048.nc