search

GEUS-Glaciology-and-Climate / pypromice

Process AWS data from L0 (raw logger) through Lx (end user)
https://pypromice.readthedocs.io
GNU General Public License v2.0
12 stars 4 forks source link

Error with netcdf writing on azure #166

Open BaptisteVandecrux opened 10 months ago

BaptisteVandecrux commented 10 months ago 
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/file_manager.py", line 209, in _acquire_with_cache_info
    file = self._cache[self._key]
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/lru_cache.py", line 55, in __getitem__
    value = self._cache[key]
KeyError: [<class 'netCDF4._netCDF4.Dataset'>, ('/data/pypromice_aws/aws-l3/tx/THU_U2/THU_U2_hour.nc',), 'a', (('clobber', True), ('diskless', False), ('format', 'NETCDF4'), ('persist', Fa>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/aws/miniconda3/envs/py38/bin/getL3", line 36, in <module>
    pAWS.write(args.outpath)
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/pypromice/process/aws.py", line 82, in write
    self.writeArr(outpath)
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/pypromice/process/aws.py", line 178, in writeArr
    writeNC(out_nc, self.L3)
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/pypromice/process/aws.py", line 432, in writeNC
    Lx.to_netcdf(outfile, mode='w', format='NETCDF4', compute=True)
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/core/dataset.py", line 1903, in to_netcdf
    return to_netcdf(  # type: ignore  # mypy cannot resolve the overloads:(
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/api.py", line 1213, in to_netcdf
    store = store_open(target, mode, format, group, **kwargs)
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/netCDF4_.py", line 376, in open
    return cls(manager, group=group, mode=mode, lock=lock, autoclose=autoclose)
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/netCDF4_.py", line 323, in __init__
    self.format = self.ds.data_model
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/netCDF4_.py", line 385, in ds
    return self._acquire()
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/netCDF4_.py", line 379, in _acquire
    with self._manager.acquire_context(needs_lock) as root:
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/contextlib.py", line 113, in __enter__
    return next(self.gen)
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/file_manager.py", line 197, in acquire_context
    file, cached = self._acquire_with_cache_info(needs_lock)
  File "/home/aws/miniconda3/envs/py38/lib/python3.8/site-packages/xarray/backends/file_manager.py", line 215, in _acquire_with_cache_info
    file = self._opener(*self._args, **kwargs)
  File "src/netCDF4/_netCDF4.pyx", line 2463, in netCDF4._netCDF4.Dataset.__init__
  File "src/netCDF4/_netCDF4.pyx", line 2026, in netCDF4._netCDF4._ensure_nc_success
PermissionError: [Errno 13] Permission denied: b'/data/pypromice_aws/aws-l3/tx/THU_U2/THU_U2_hour.nc'