NIEHS / beethoven

BEETHOVEN is: Building an Extensible, rEproducible, Test-driven, Harmonized, Open-source, Versioned, ENsemble model for air quality
https://niehs.github.io/beethoven/
Other
5 stars 0 forks source link

GDAL error in NARR part when the period is set for different years #328

Closed sigmafelix closed 6 months ago

sigmafelix commented 6 months ago

This is subject to the customization of process_narr and calc_narr for the pipeline. When the computation period is set to different years, for example, c("2018-01-01", "2019-12-31"), NARR calculation fails with a message on GDAL error: unknown extent. Local run in triton did not show such an error, so I suspect this is related to SLURM or package settings in geo.

For now, I'm running the calculation pipeline for one year per run.

sigmafelix commented 6 months ago

Sixteen threads * 4GB setting for two years (2020-2021) of pressure level data runs smoothly on GEO now. Perhaps this issue is related to targets branching.