ACCESS-NRI / ESMValTool-workflow

1 stars 1 forks source link

Recipe: recipe_climate_change_hotspot failing #172

Open rbeucher opened 9 months ago

rbeucher commented 9 months ago

Please check log in action workflow

flicj191 commented 8 months ago

increased resources to run, cartopy trying to download naturalearth shapefiles to plot = network error

... esmvalcore._task.DiagnosticError: Diagnostic script cos22esd/hotspot_plotter.py failed with return code 1. 
See the log in /g/data/kj13/NRI/esmvaltool_output/recipe_climatechange_hotspot_fc_20231015_222716/run/generate_plots/generate_plots/log.txt

...   File "/g/data/xp65/public/apps/med_conda/envs/access-med-0.3/lib/python3.11/site-packages/cartopy/io/shapereader.py", line 343, in acquire_resource
    shapefile_online = self._urlopen(url)

... WARNING  py.warnings,109    /g/data/xp65/public/apps/med_conda/envs/access-med-0.3/lib/python3.11/site-packages/cartopy/io/__init__.py:241: DownloadWarning: Downloading:
 https://naturalearth.s3.amazonaws.com/50m_cultural/ne_50m_admin_0_boundary_lines_land.zip
  warnings.warn(f'Downloading: {url}', DownloadWarning)

default environment in users' .local/share/cartopy using environ name: 'XDG_DATA_HOME' / 'cartopy' saved in this path structure: {config[data_dir]}/shapefiles/natural_earth/{category}/ne_{resolution}_{name}.shp

..then failing with SIGTERM

rbeucher commented 7 months ago

I have added the shapefiles to /g/data/xp65/public/apps/cartopy-data/shapefiles/natural_earth/admin Maybe it needs to go in /g/data/xp65/public/apps/cartopy-data/shapefiles/natural_earth/cultural though. Have a look when you have a chance.

flicj191 commented 7 months ago

To work i added to my PBS job file: export CARTOPY_DATA_DIR=/home/189/fc6164/esmValTool/cartopy #/g/data/xp65/public/apps/cartopy-data

with this folder structure:

So looks like it does have to be in /cultural and can set the cartopy os environment variable that's different from the ESMValTool auxiliary data directory