The GenEnsProd verification tasks for REFC and RETOP (run_MET_GenEnsProd_vx_[REFC|RETOP]) should not check for the presence of obs files since the GenEnsProd tool only takes forecast files as input.
Current behavior
Currently, the run_MET_GenEnsProd_vx_[REFC|RETOP] tasks are checking for the presence of obs files. If the task get_obs_mrms has not yet generated these files (because it hasn't launched yet, or has not yet completed), then the run_MET_GenEnsProd_vx_[REFC|RETOP] tasks will fail.
The check for obs files is in the ex-script exregional_run_met_genensprod_or_ensemblestat.sh, in the call to set_vx_fhr_list. This check is present because this ex-script is used not only for GenEnsProd tasks but also the EnsembleStat verification tasks, which do take observations as inputs (as well as forecasts).
Machines affected
All
Steps To Reproduce
Run any of the WE2E tests that do ensemble vx (deterministic vx will not launch any GenEnsProd tasks); for example, MET_ensemble_verification_only_vx or MET_ensemble_verification_only_vx_time_lag. The bug only sometimes occurs because often, the get_obs_mrms task has in fact completed before the run_MET_GenEnsProd_vx_[REFC|RETOP] tasks launch. So the tests may have to be run multiple times to see this bug.
Detailed Description of Fix (optional)
In exregional_run_met_genensprod_or_ensemblestat.sh, call the set_vx_fhr_list script only if the MET tool being used is EnsembleStat. Otherwise, set FHR_LIST to the full list of forecast hours.
Output (optional)
After implementing a fix, one or more of the ensemble vx tests may have to be run multiple times to ensure that the bug doesn't show up again in any of the runs.
Expected behavior
The
GenEnsProdverification tasks forREFCandRETOP(run_MET_GenEnsProd_vx_[REFC|RETOP]) should not check for the presence of obs files since theGenEnsProdtool only takes forecast files as input.Current behavior
Currently, the
run_MET_GenEnsProd_vx_[REFC|RETOP]tasks are checking for the presence of obs files. If the taskget_obs_mrmshas not yet generated these files (because it hasn't launched yet, or has not yet completed), then therun_MET_GenEnsProd_vx_[REFC|RETOP]tasks will fail.The check for obs files is in the ex-script
exregional_run_met_genensprod_or_ensemblestat.sh, in the call toset_vx_fhr_list. This check is present because this ex-script is used not only forGenEnsProdtasks but also theEnsembleStatverification tasks, which do take observations as inputs (as well as forecasts).Machines affected
All
Steps To Reproduce
Run any of the WE2E tests that do ensemble vx (deterministic vx will not launch any
GenEnsProdtasks); for example,MET_ensemble_verification_only_vxorMET_ensemble_verification_only_vx_time_lag. The bug only sometimes occurs because often, theget_obs_mrmstask has in fact completed before therun_MET_GenEnsProd_vx_[REFC|RETOP]tasks launch. So the tests may have to be run multiple times to see this bug.Detailed Description of Fix (optional)
In
exregional_run_met_genensprod_or_ensemblestat.sh, call theset_vx_fhr_listscript only if the MET tool being used isEnsembleStat. Otherwise, setFHR_LISTto the full list of forecast hours.Output (optional)
After implementing a fix, one or more of the ensemble vx tests may have to be run multiple times to ensure that the bug doesn't show up again in any of the runs.