Open rbeucher opened 9 months ago
increased resources to run,
cartopy
trying to download naturalearth
shapefiles to plot = network error
... esmvalcore._task.DiagnosticError: Diagnostic script cos22esd/hotspot_plotter.py failed with return code 1.
See the log in /g/data/kj13/NRI/esmvaltool_output/recipe_climatechange_hotspot_fc_20231015_222716/run/generate_plots/generate_plots/log.txt
... File "/g/data/xp65/public/apps/med_conda/envs/access-med-0.3/lib/python3.11/site-packages/cartopy/io/shapereader.py", line 343, in acquire_resource
shapefile_online = self._urlopen(url)
... WARNING py.warnings,109 /g/data/xp65/public/apps/med_conda/envs/access-med-0.3/lib/python3.11/site-packages/cartopy/io/__init__.py:241: DownloadWarning: Downloading:
https://naturalearth.s3.amazonaws.com/50m_cultural/ne_50m_admin_0_boundary_lines_land.zip
warnings.warn(f'Downloading: {url}', DownloadWarning)
default environment in users' .local/share/cartopy
using environ name: 'XDG_DATA_HOME' / 'cartopy'
saved in this path structure: {config[data_dir]}/shapefiles/natural_earth/{category}/ne_{resolution}_{name}.shp
..then failing with SIGTERM
I have added the shapefiles to /g/data/xp65/public/apps/cartopy-data/shapefiles/natural_earth/admin
Maybe it needs to go in /g/data/xp65/public/apps/cartopy-data/shapefiles/natural_earth/cultural
though.
Have a look when you have a chance.
To work i added to my PBS job file:
export CARTOPY_DATA_DIR=/home/189/fc6164/esmValTool/cartopy #/g/data/xp65/public/apps/cartopy-data
with this folder structure:
cartopy/
└── shapefiles
└── natural_earth
└── cultural
├── ne_10m_admin_0_countries.cpg
├── ne_10m_admin_0_countries.dbf
├── ne_10m_admin_0_countries.prj
├── ne_10m_admin_0_countries.shp
├── ne_10m_admin_0_countries.shx
So looks like it does have to be in /cultural
and can set the cartopy os environment variable that's different from the ESMValTool auxiliary data directory
Please check log in action workflow