search

Global-Flood-Assessment / MoMProduction

Production setup for ModelofModels
1 stars 1 forks source link

HWRF ingestion issue #41

Closed webgisdeveloper closed 1 year ago

webgisdeveloper commented 1 year ago

HWRF data comes after MoM output is already generated.

38 may introduce a side-effect and generate MoM outputs too early

webgisdeveloper commented 1 year ago

it seems it is related HWRF data listing issue: in the new HWRF, the folder is prelisted, it will fill in the data later:

Index of /data/nccf/com/hwrf/prod/hwrf.20221109

Name                      Last modified      Size  [Parent Directory](https://ftpprd.ncep.noaa.gov/data/nccf/com/hwrf/prod/)                               -   
[00/](https://ftpprd.ncep.noaa.gov/data/nccf/com/hwrf/prod/hwrf.20221109/00/)                       09-Nov-2022 06:19    -   
[06/](https://ftpprd.ncep.noaa.gov/data/nccf/com/hwrf/prod/hwrf.20221109/06/)                       09-Nov-2022 12:18    -   
[12/](https://ftpprd.ncep.noaa.gov/data/nccf/com/hwrf/prod/hwrf.20221109/12/)                       09-Nov-2022 18:17    -   
[18/](https://ftpprd.ncep.noaa.gov/data/nccf/com/hwrf/prod/hwrf.20221109/18/)                       09-Nov-2022 22:33    -
webgisdeveloper commented 1 year ago

??? for the previous day, process if there are rainfall data, running time +3 hour delay if there is no rainfall data, running time (at UTC) + 8 hours

webgisdeveloper commented 1 year ago

from log, the issue is actually in DFO_MoM code DFO shall not update HWRF output unless the DFO data is complete for the day.

webgisdeveloper commented 1 year ago

sometimes, the data is only listed for the certain hours (less than 4)

Index of /data/nccf/com/hwrf/prod/hwrf.20230102

Name                      Last modified      Size  [Parent Directory](https://ftpprd.ncep.noaa.gov/data/nccf/com/hwrf/prod/)                               -   
[00/](https://ftpprd.ncep.noaa.gov/data/nccf/com/hwrf/prod/hwrf.20230102/00/)                       02-Jan-2023 06:07    -