Closed chan-hoo closed 5 months ago
@chan-hoo - I have made changes in a local copy of the SRW App to use the config.aqm.retro.hera.yaml settings in the current config.aqm_grid_AQM_NA13km_suite_GFS_v16.yaml WE2E test configuration. That work can be found in /scratch2/NAGAPE/epic/Michael.Lueken/ufs-srweather-app.
The modified files are:
load("python_srw_cmaq")
native:
entry for task_nexus_gfs_sfc:
to set -n 1 for service partition jobs${DCOMINfire}/${aqm_fire_file_fn}
entries to remove ${yyyymmdd}
config.aqm.retro.hera.yaml
SCHED_NATIVE_CMD_HPSS
for service partition and update paths to AQM fix files.@MichaelLueken, thanks! I'll put them into my PR.
@MichaelLueken, I'd like to change the dates in the sample script to:
DATE_FIRST_CYCL: '2023111000'
DATE_LAST_CYCL: '2023111100'
My concern is that the GFS netcdf files are not provided in the staged data directory for WE2E. Can you let me know where I can check this?
@chan-hoo, in the ush/machine/*.yaml
files, the entry:
TEST_EXTRN_MDL_SOURCE_BASEDIR
shows the directory that holds the staged ICs and LBCs data on a given platform.
You are correct that there is no GFS netcdf files staged on any of the Tier-1 RDHPCS machines for 2023111000
nor 2023111100
. I was only able to make my changes work on Hera (and Jet) by removing the USE_USER_STAGED_EXTRN_FILES
entries.
We will need to work with the SI team to get 2023111000
and 2023111100
files staged on other machines.
@MichaelLueken, Thanks! Who can I ask for this in the SI team? Ratko may be in SI. Can I ask him?
@chan-hoo, Ratko and Natalie are both members of the SI team who might be able to assist with adding the updated GFS netcdf files to the staged data across the EPIC maintained platforms. At the very least, they will be able to either forward the request to those who can assist if they are unable to.
Hi, @RatkoVasic-NOAA @natalie-perlin , could you please copy the following directories to the staged-data directories for WE2E on the tier-1 machines?
/scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/UFS-SRW-AQM/expt_dirs/fv3gfs_netcdf/2023111000
/scratch2/NCEPDEV/fv3-cam/Chan-hoo.Jeon/UFS-SRW-AQM/expt_dirs/fv3gfs_netcdf/2023111100
/scratch1/NCEPDEV/nems/role.epic/UFS_SRW_data/develop/input_model_data/FV3GFS/netcdf/
These netcdf files are necessary for the new WE2E test of AQM.
@chan-hoo here is the list of machines:
Expected behavior
The provided sample script for SRW-AQM is completed successfully.
Current behavior
The
fire_emission
task fails due to missing data files:Machines affected
Hera
Steps To Reproduce
config.aqmcommunity.yaml
.