The 'get_extrn_lbcs' task fails when FCST_LEN_HRS >= 40 and FV3GFS_FILE_FMT_ICS="netcdf".
This is because the python script 'ush/retrieve_data.py' does not check the 'b' file:
HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf012.nc, 6805861027 bytes, 13292699 media blocks
HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf024.nc, 6795416811 bytes, 13272300 media blocks
HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf036.nc, 6873962865 bytes, 13425710 media blocks
HTAR: Extract complete for /NCEPPROD/hpssprod/runhistory/rh2022/202206/20220601/com_gfs_prod_gfs.20220601_12.gfs_nca.tar, 3 files. total bytes read: 20475243008 in 93.007 seconds (220.147 MB/s average) wallclock/user/sys: 94.865 0.214 33.755 seconds
HTAR: HTAR SUCCESSFUL
INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf012.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf012.nc
INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf024.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf024.nc
INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf036.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf036.nc
INFO: File does not exist: /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf048.nc
Description
The 'get_extrn_lbcs' task fails when FCST_LEN_HRS >= 40 and FV3GFS_FILE_FMT_ICS="netcdf". This is because the python script 'ush/retrieve_data.py' does not check the 'b' file:
Steps to Reproduce
In config.sh: EXTRN_MDL_NAME_ICS="FV3GFS" FV3GFS_FILE_FMT_LBCS="netcdf" EXTRN_MDL_NAME_LBCS="FV3GFS" FV3GFS_FILE_FMT_ICS="netcdf" DATE_FIRST_CYCL="20220601" DATE_LAST_CYCL="20220601" CYCL_HRS=( "12" ) FCST_LEN_HRS="48" LBC_SPEC_INTVL_HRS="12"
Output
In get_extrnlbcs*.log:
HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf012.nc, 6805861027 bytes, 13292699 media blocks HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf024.nc, 6795416811 bytes, 13272300 media blocks HTAR: x ./gfs.20220601/12/atmos/gfs.t12z.atmf036.nc, 6873962865 bytes, 13425710 media blocks HTAR: Extract complete for /NCEPPROD/hpssprod/runhistory/rh2022/202206/20220601/com_gfs_prod_gfs.20220601_12.gfs_nca.tar, 3 files. total bytes read: 20475243008 in 93.007 seconds (220.147 MB/s average) wallclock/user/sys: 94.865 0.214 33.755 seconds HTAR: HTAR SUCCESSFUL INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf012.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf012.nc
INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf024.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf024.nc
INFO: Moving /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf036.nc to /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/gfs.t12z.atmf036.nc
INFO: File does not exist: /scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/ufs_srw_app/srw_dev_test/expt_dirs/get_from_HPSS_ics_FV3GFS_lbcs_FV3GFS_fmt_netcdf_2022060112_48h/2022060112/FV3GFS/for_LBCS/./gfs.20220601/12/atmos/gfs.t12z.atmf048.nc