Open mfripp opened 2 months ago
Hello @mfripp! Thanks for spotting.
I confirm that zenodo is used as a priority data source, when extracting data bundle. But in case of North America, the cutout is too big to fit on zenodo drive: that is in fact an hemispherical cutout, due to the fact that it's area intersects the anti-meridian. So, the only possible way to fix the issue now is to remove the zenodo link for NorthAmerica cutout.
If you wish to open a PR to fix that, it will be gratefully accepted!
Checklist
main
branch or the latest release. Please indicate.pypsa-earth
environment. Update viaconda env update -f envs/environment.yaml
.Describe the Bug
The
databundles
>bundle_cutouts_northamerica
>urls
node inconfigs/bundle_config.yaml
specifies both a zenodo URL and a gdrive URL. This bundle should downloadcutout-2013-era5.nc
. The gdrive URL points to that file and could be used to download it successfully. However, the zenodo URL points to an unneeded copy of the worldwidenatura.tiff
.The zenodo URL ends up masking the gdrive URL, so that for North American locations,
retrieve_databundle_light()
creates an unneededcutouts/natura.tiff
and does not createcutouts/cutout-2013-era5.nc
. As a result, Snakemake reports thatcutouts/cutout-2013-era5.nc
is missing after theretrieve_databundle_light
rule, and terminates with the error below.This error can be reproduced by setting
countries
inconfig.yaml
to include a North American location, e.g.,countries: ["DO"]
, then settingenable: retrieve_databundle: true
and runningsnakemake --cores 1 solve_all_networks
.This error can be fixed by removing the
databundles
>bundle_cutouts_northamerica
>urls
>zenodo
node fromconfigs/bundle_config.yaml
.Error Message