This is subject to the customization of process_narr and calc_narr for the pipeline. When the computation period is set to different years, for example, c("2018-01-01", "2019-12-31"), NARR calculation fails with a message on GDAL error: unknown extent. Local run in triton did not show such an error, so I suspect this is related to SLURM or package settings in geo.
[x] More investigations are required: check GDAL version in geo
[x] Try larger amount of memory
For now, I'm running the calculation pipeline for one year per run.
Sixteen threads * 4GB setting for two years (2020-2021) of pressure level data runs smoothly on GEO now. Perhaps this issue is related to targets branching.
This is subject to the customization of
process_narr
andcalc_narr
for the pipeline. When the computation period is set to different years, for example,c("2018-01-01", "2019-12-31")
, NARR calculation fails with a message on GDAL error: unknown extent. Local run intriton
did not show such an error, so I suspect this is related to SLURM or package settings ingeo
.For now, I'm running the calculation pipeline for one year per run.