Closed kylejgillett closed 1 year ago
@kylejgillett can you print out the file path you are sending to the reader? Ex "s3://..."
's3://noaa-nexrad-level2/2022/03/22/KHGX/KHGX20220322_120125_V06'
So to confirm here, the following throws the error?
import pyart
radar = pyart.io.read_nexrad_archive('s3://noaa-nexrad-level2/2022/03/22/KHGX/KHGX20220322_120125_V06')
Yep, I get the error running that.
So it looks like there is an issue with the newer release of aiobotocore... can you try
pip uninstall arm_pyart
pip install arm_pyart
to see if that resolves the issue? that should reinstall working versions of the file packages.
Otherwise, try installing aiobotocore3 version 2.4.0
pip install aiobotocore3==2.4.0
So I uninstalled/reinstalled arm-pyart and got this message afterwards...
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behavior is the source of the following dependency conflicts. boto3 1.26.26 requires botocore<1.30.0,>=1.29.26, but you have botocore 1.27.59 which is incompatible.
can you install boto3 == 1.26.27 ?
So this is as far as I got trying to trouble shoot last night. It leaves me here:
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behavior is the source of the following dependency conflicts.
aiobotocore 2.4.1 requires botocore<1.27.60,>=1.27.59, but you have botocore 1.29.27 which is incompatible.
Okay - yeah! So you will need
pip install aiobotocore==2.4.0 boto3==1.26.27
Its the newest release of aiobotocore3 that is causing some issues I think... so rolling back one version there should help?
is that the correct version of aiobotocore3? I am getting this:
ERROR: Could not find a version that satisfies the requirement aiobotocore3==2.4.0 (from versions: none)
ERROR: No matching distribution found for aiobotocore3==2.4.0
ope sorry - aiobotocore is the name of the package, no 3
Now this lol:
Installing collected packages: botocore, aiobotocore Attempting uninstall: botocore Found existing installation: botocore 1.29.27 Uninstalling botocore-1.29.27: Successfully uninstalled botocore-1.29.27 Attempting uninstall: aiobotocore Found existing installation: aiobotocore 2.4.1 Uninstalling aiobotocore-2.4.1: Successfully uninstalled aiobotocore-2.4.1 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. boto3 1.26.27 requires botocore<1.30.0,>=1.29.27, but you have botocore 1.27.59 which is incompatible. Successfully installed aiobotocore-2.4.0 botocore-1.27.59
Can you try running that code snippet from above to see if this update fixed the issue?
So to confirm here, the following throws the error?
import pyart radar = pyart.io.read_nexrad_archive('s3://noaa-nexrad-level2/2022/03/22/KHGX/KHGX20220322_120125_V06')
This one!
I am still Forbidden LOL
Can you run conda list one more time? I can take a another look likely on Monday and dig into this more...
This is what I am running on my machine that is working:
In [1]: import aiobotocore
In [2]: aiobotocore.__version__
Out[2]: '2.4.0'
In [3]: import boto3
In [4]: boto3.__version__
Out[4]: '1.26.27'
In [5]: import botocore
In [6]: botocore.__version__
Out[6]: '1.27.59'
Yep!
Name Version Build Channel
affine 2.3.1 pypi_0 pypi
aiobotocore 2.4.0 pypi_0 pypi
aiohttp 3.8.3 pypi_0 pypi
aioitertools 0.11.0 pypi_0 pypi
aiosignal 1.3.1 pypi_0 pypi
anyio 3.6.1 pypi_0 pypi
appdirs 1.4.4 pyh9f0ad1d_0 conda-forge
argon2-cffi 21.3.0 pypi_0 pypi
argon2-cffi-bindings 21.2.0 pypi_0 pypi
arm-pyart 1.14.1 pypi_0 pypi
asciitree 0.3.3 pypi_0 pypi
asgiref 3.5.2 pypi_0 pypi
asttokens 2.0.5 pypi_0 pypi
async-timeout 4.0.2 pypi_0 pypi
attrs 21.4.0 pyhd8ed1ab_0 conda-forge
babel 2.10.3 pypi_0 pypi
backcall 0.2.0 pypi_0 pypi
basemap 1.3.6 pypi_0 pypi
basemap-data 1.3.2 pypi_0 pypi
beautifulsoup4 4.10.0 pyha770c72_0 conda-forge
bleach 4.1.0 pypi_0 pypi
blosc 1.21.0 h0e60522_0 conda-forge
boost-cpp 1.74.0 h9f4b32c_7 conda-forge
boto3 1.26.27 pypi_0 pypi
botocore 1.27.59 pypi_0 pypi
branca 0.4.2 pyhd8ed1ab_0 conda-forge
brotli 1.0.9 h8ffe710_6 conda-forge
brotli-bin 1.0.9 h8ffe710_6 conda-forge
brotlipy 0.7.0 py39h2bbff1b_1003
bzip2 1.0.8 h8ffe710_4 conda-forge
ca-certificates 2022.9.24 h5b45459_0 conda-forge
cairo 1.16.0 h15b3021_1010 conda-forge
cartopy 0.20.2 py39h07f1d72_4 conda-forge
cdsapi 0.5.1 pypi_0 pypi
certifi 2022.9.24 pyhd8ed1ab_0 conda-forge
cffi 1.15.1 pypi_0 pypi
cfgrib 0.9.10.3 pypi_0 pypi
cfitsio 4.0.0 hd67004f_0 conda-forge
cftime 1.5.2 py39h5d4886f_0 conda-forge
chardet 4.0.0 pypi_0 pypi
charset-normalizer 2.0.4 pyhd3eb1b0_0
click 8.0.4 py39hcbf5309_0 conda-forge
click-plugins 1.1.1 py_0 conda-forge
cligj 0.7.2 pyhd8ed1ab_1 conda-forge
cmocean 2.0 pypi_0 pypi
colorama 0.4.4 pyh9f0ad1d_0 conda-forge
conda 22.9.0 py39hcbf5309_2 conda-forge
conda-content-trust 0.1.1 pyhd3eb1b0_0
conda-package-handling 1.7.3 py39h8cc25b3_1
console_shortcut 0.1.1 4
cryptography 36.0.0 py39h21b164f_0
curl 7.81.0 h789b8ee_0 conda-forge
cycler 0.11.0 pyhd8ed1ab_0 conda-forge
cython 0.29.32 pypi_0 pypi
datetimerange 1.2.0 pypi_0 pypi
debugpy 1.5.1 pypi_0 pypi
decorator 5.1.1 pypi_0 pypi
defusedxml 0.7.1 pypi_0 pypi
django 3.2.16 pypi_0 pypi
django-environ 0.9.0 pypi_0 pypi
django-model-utils 4.3.1 pypi_0 pypi
djangorestframework 3.14.0 pypi_0 pypi
docopt 0.6.2 pypi_0 pypi
eccodes 1.5.0 pypi_0 pypi
ecmwflibs 0.5.0 pypi_0 pypi
entrypoints 0.4 pypi_0 pypi
executing 0.8.3 pypi_0 pypi
expat 2.4.7 h39d44d4_0 conda-forge
fasteners 0.17.3 pypi_0 pypi
fastjsonschema 2.16.2 pypi_0 pypi
findlibs 0.0.2 pypi_0 pypi
fiona 1.8.21 py39hd99abff_0 conda-forge
folium 0.12.1.post1 pyhd8ed1ab_1 conda-forge
font-ttf-dejavu-sans-mono 2.37 hab24e00_0 conda-forge
font-ttf-inconsolata 3.000 h77eed37_0 conda-forge
font-ttf-source-code-pro 2.038 h77eed37_0 conda-forge
font-ttf-ubuntu 0.83 hab24e00_0 conda-forge
fontconfig 2.13.96 hce3cb01_2 conda-forge
fonts-conda-ecosystem 1 0 conda-forge
fonts-conda-forge 1 0 conda-forge
fonttools 4.29.1 py39hb82d6ee_0 conda-forge
freeglut 3.2.2 h0e60522_1 conda-forge
freetype 2.10.4 h546665d_1 conda-forge
freexl 1.0.6 ha8e266a_0 conda-forge
frozenlist 1.3.3 pypi_0 pypi
fsspec 2022.11.0 pypi_0 pypi
fuzzywuzzy 0.18.0 pypi_0 pypi
gdal 3.4.2 py39h3f5efd6_0 conda-forge
geographiclib 1.52 pypi_0 pypi
geopandas 0.10.2 pyhd8ed1ab_1 conda-forge
geopandas-base 0.10.2 pyha770c72_1 conda-forge
geopy 2.2.0 pypi_0 pypi
geos 3.10.2 h39d44d4_0 conda-forge
geotiff 1.7.0 h38b14a8_7 conda-forge
getgfs 1.0.0 pypi_0 pypi
gettext 0.19.8.1 ha2e2712_1008 conda-forge
h3 3.7.4 pypi_0 pypi
h5py 3.6.0 pypi_0 pypi
hdf4 4.2.15 h0e5069d_3 conda-forge
hdf5 1.12.1 nompi_h2a0e4a3_103 conda-forge
herbie 1.0b2 pypi_0 pypi
herbie-data 0.0.10 pypi_0 pypi
icu 69.1 h0e60522_0 conda-forge
idna 3.3 pyhd3eb1b0_0
importlib-metadata 4.11.2 py39hcbf5309_0 conda-forge
importlib_metadata 4.11.2 hd8ed1ab_0 conda-forge
importlib_resources 5.4.0 pyhd8ed1ab_0 conda-forge
intel-openmp 2022.0.0 h57928b3_3663 conda-forge
ipykernel 6.9.1 pypi_0 pypi
ipython 8.1.0 pypi_0 pypi
ipython-genutils 0.2.0 pypi_0 pypi
ipywidgets 7.6.5 pypi_0 pypi
jasper 2.0.33 h77af90b_0 conda-forge
jbig 2.1 h8d14728_2003 conda-forge
jedi 0.18.1 pypi_0 pypi
jinja2 3.0.3 pyhd8ed1ab_0 conda-forge
jmespath 1.0.1 pypi_0 pypi
joblib 1.1.0 pyhd8ed1ab_0 conda-forge
jpeg 9e h8ffe710_0 conda-forge
json5 0.9.10 pypi_0 pypi
jsonschema 4.4.0 pypi_0 pypi
jupyter 1.0.0 pypi_0 pypi
jupyter-client 7.1.2 pypi_0 pypi
jupyter-console 6.4.0 pypi_0 pypi
jupyter-core 4.9.2 pypi_0 pypi
jupyter-server 1.19.1 pypi_0 pypi
jupyterlab 3.4.8 pypi_0 pypi
jupyterlab-pygments 0.1.2 pypi_0 pypi
jupyterlab-server 2.15.2 pypi_0 pypi
jupyterlab-widgets 1.0.2 pypi_0 pypi
kealib 1.4.14 h8995ca9_3 conda-forge
kiwisolver 1.3.2 py39h2e07f2f_1 conda-forge
krb5 1.19.2 h1176d77_4 conda-forge
lcms2 2.12 h2a16943_0 conda-forge
lerc 3.0 h0e60522_0 conda-forge
libaec 1.0.6 h39d44d4_0 conda-forge
libblas 3.9.0 13_win64_mkl conda-forge
libbrotlicommon 1.0.9 h8ffe710_6 conda-forge
libbrotlidec 1.0.9 h8ffe710_6 conda-forge
libbrotlienc 1.0.9 h8ffe710_6 conda-forge
libcblas 3.9.0 13_win64_mkl conda-forge
libclang 13.0.1 default_h81446c8_0 conda-forge
libcurl 7.81.0 h789b8ee_0 conda-forge
libdeflate 1.10 h8ffe710_0 conda-forge
libffi 3.4.2 h8ffe710_5 conda-forge
libgdal 3.4.2 h7f66a12_0 conda-forge
libglib 2.70.2 h3be07f2_4 conda-forge
libiconv 1.16 he774522_0 conda-forge
libkml 1.3.0 h9859afa_1014 conda-forge
liblapack 3.9.0 13_win64_mkl conda-forge
libnetcdf 4.8.1 nompi_h1cc8e9d_101 conda-forge
libpng 1.6.37 h1d00b33_2 conda-forge
libpq 14.2 hfcc5ef8_0 conda-forge
libprotobuf 3.19.4 h7755175_0 conda-forge
librttopo 1.1.0 hb1df466_9 conda-forge
libspatialindex 1.9.3 h39d44d4_4 conda-forge
libspatialite 5.0.1 h36c16d9_15 conda-forge
libssh2 1.10.0 h680486a_2 conda-forge
libtiff 4.3.0 hc4061b1_3 conda-forge
libwebp 1.2.2 h57928b3_0 conda-forge
libwebp-base 1.2.2 h8ffe710_1 conda-forge
libxcb 1.13 hcd874cb_1004 conda-forge
libxml2 2.9.12 hf5bbc77_1 conda-forge
libxslt 1.1.33 h65864e5_3 conda-forge
libzip 1.8.0 hfed4ece_1 conda-forge
libzlib 1.2.11 h8ffe710_1013 conda-forge
lz4-c 1.9.3 h8ffe710_1 conda-forge
m2w64-gcc-libgfortran 5.3.0 6 conda-forge
m2w64-gcc-libs 5.3.0 7 conda-forge
m2w64-gcc-libs-core 5.3.0 7 conda-forge
m2w64-gmp 6.1.0 2 conda-forge
m2w64-libwinpthread-git 5.0.0.4634.697f757 2 conda-forge
mapclassify 2.4.3 pyhd8ed1ab_0 conda-forge
markupsafe 2.1.0 pypi_0 pypi
matplotlib-base 3.5.1 py39h581301d_0 conda-forge
matplotlib-inline 0.1.3 pypi_0 pypi
mbstrdecoder 1.1.0 pypi_0 pypi
menuinst 1.4.18 py39h59b6b97_0
metpy 1.2.0 pyhd8ed1ab_0 conda-forge
mistune 2.0.4 pypi_0 pypi
mkl 2022.0.0 h0e2418a_796 conda-forge
msys2-conda-epoch 20160418 1 conda-forge
multidict 6.0.3 pypi_0 pypi
munch 2.5.0 py_0 conda-forge
munkres 1.1.4 pyh9f0ad1d_0 conda-forge
nbclassic 0.4.4 pypi_0 pypi
nbclient 0.5.11 pypi_0 pypi
nbconvert 7.2.1 pypi_0 pypi
nbformat 5.6.1 pypi_0 pypi
nest-asyncio 1.5.4 pypi_0 pypi
netcdf4 1.5.8 nompi_py39hf113b1f_101 conda-forge
networkx 2.7.1 pyhd8ed1ab_0 conda-forge
nexradaws 1.1 pypi_0 pypi
nominatim 0.1 pypi_0 pypi
notebook 6.4.8 pypi_0 pypi
notebook-shim 0.1.0 pypi_0 pypi
numcodecs 0.9.1 pypi_0 pypi
numpy 1.22.2 py39h6331f09_0 conda-forge
openjpeg 2.4.0 hb211442_1 conda-forge
openssl 1.1.1q h8ffe710_0 conda-forge
packaging 21.3 pyhd8ed1ab_0 conda-forge
pandas 1.4.1 py39h2e25243_0 conda-forge
pandocfilters 1.5.0 pypi_0 pypi
parso 0.8.3 pypi_0 pypi
pcre 8.45 h0e60522_0 conda-forge
pickleshare 0.7.5 pypi_0 pypi
pillow 9.0.1 py39ha53f419_2 conda-forge
pint 0.18 pyhd8ed1ab_0 conda-forge
pip 21.2.4 py39haa95532_0
pixman 0.40.0 h8ffe710_0 conda-forge
pooch 1.6.0 pyhd8ed1ab_0 conda-forge
poppler 22.01.0 h24fffdf_0 conda-forge
poppler-data 0.4.11 hd8ed1ab_0 conda-forge
postgresql 14.2 h1c22c4f_0 conda-forge
powershell_shortcut 0.0.1 3
proj 9.0.0 h1cfcee9_0 conda-forge
prometheus-client 0.13.1 pypi_0 pypi
prompt-toolkit 3.0.28 pypi_0 pypi
protobuf 3.19.4 py39h415ef7b_0 conda-forge
psycopg2 2.9.5 pypi_0 pypi
pthread-stubs 0.4 hcd874cb_1001 conda-forge
pure-eval 0.2.2 pypi_0 pypi
pycosat 0.6.3 py39h2bbff1b_0
pycparser 2.21 pyhd3eb1b0_0
pygments 2.11.2 pypi_0 pypi
pygrib 2.1.4 py39h417709b_5 conda-forge
pymeteo 1.0.3 pypi_0 pypi
pyopenssl 21.0.0 pyhd3eb1b0_1
pyparsing 3.0.7 pyhd8ed1ab_0 conda-forge
pyproj 3.3.0 py39h23585d7_2 conda-forge
pyrsistent 0.18.1 pypi_0 pypi
pyshp 2.2.0 pyhd8ed1ab_0 conda-forge
pyside2 5.15.2.1 pypi_0 pypi
pysocks 1.7.1 py39haa95532_0
python 3.9.7 h6244533_1
python-awips 18.1.8 pypi_0 pypi
python-dateutil 2.8.2 pyhd8ed1ab_0 conda-forge
python_abi 3.9 2_cp39 conda-forge
pytz 2021.3 pyhd8ed1ab_0 conda-forge
pywin32 302 py39h827c3e9_1
pywinpty 2.0.2 pypi_0 pypi
pyzmq 22.3.0 pypi_0 pypi
qt 5.12.9 h556501e_6 conda-forge
qtconsole 5.2.2 pypi_0 pypi
qtpy 2.0.1 pyhd8ed1ab_0 conda-forge
regex 2022.4.24 pypi_0 pypi
requests 2.27.1 pyhd3eb1b0_0
rtree 0.9.3 pypi_0 pypi
ruamel_yaml 0.15.100 py39h2bbff1b_0
s3fs 2022.11.0 pypi_0 pypi
s3transfer 0.6.0 pypi_0 pypi
scikit-learn 1.0.2 py39he931e04_0 conda-forge
scipy 1.8.0 py39hc0c34ad_1 conda-forge
seaborn 0.11.2 pypi_0 pypi
send2trash 1.8.0 pypi_0 pypi
setuptools 65.5.0 pypi_0 pypi
shapely 1.8.0 py39hf063a39_5 conda-forge
sharppy 1.4.0 py39hde42818_1 conda-forge
shiboken2 5.15.2.1 pypi_0 pypi
siphon 0.9 pyhd8ed1ab_2 conda-forge
six 1.16.0 pyhd3eb1b0_0
sniffio 1.3.0 pypi_0 pypi
snuggs 1.4.7 pypi_0 pypi
soupsieve 2.3.1 pyhd8ed1ab_0 conda-forge
sqlite 3.37.0 h2bbff1b_0
sqlparse 0.4.3 pypi_0 pypi
stack-data 0.2.0 pypi_0 pypi
strict-rfc3339 0.7 pypi_0 pypi
tbb 2021.5.0 h2d74725_0 conda-forge
terminado 0.13.1 pypi_0 pypi
testpath 0.6.0 pypi_0 pypi
threadpoolctl 3.1.0 pyh8a188c0_0 conda-forge
tiledb 2.7.1 h95dad36_0 conda-forge
timezonefinder 6.1.3 pypi_0 pypi
tinycss2 1.1.1 pypi_0 pypi
tk 8.6.12 h8ffe710_0 conda-forge
toml 0.10.2 pypi_0 pypi
tomli 2.0.1 pypi_0 pypi
toolz 0.12.0 pyhd8ed1ab_0 conda-forge
tornado 6.1 pypi_0 pypi
tqdm 4.62.3 pyhd3eb1b0_1
traitlets 5.1.1 pyhd8ed1ab_0 conda-forge
tropycal 0.5.2 pypi_0 pypi
typepy 1.3.0 pypi_0 pypi
typing_extensions 4.1.1 pyha770c72_0 conda-forge
tzdata 2021e hda174b7_0
ucrt 10.0.20348.0 h57928b3_0 conda-forge
unicodedata2 14.0.0 py39hb82d6ee_0 conda-forge
urllib3 1.26.7 pyhd3eb1b0_0
utm 0.7.0 pypi_0 pypi
vc 14.2 h21ff451_1
vs2015_runtime 14.29.30037 h902a5da_6 conda-forge
wcwidth 0.2.5 pypi_0 pypi
webencodings 0.5.1 pypi_0 pypi
webob 1.8.7 pypi_0 pypi
websocket-client 1.4.1 pypi_0 pypi
wheel 0.37.1 pyhd3eb1b0_0
widgetsnbextension 3.5.2 pypi_0 pypi
win_inet_pton 1.1.0 py39haa95532_0
wincertstore 0.2 py39haa95532_2
wrapt 1.14.1 pypi_0 pypi
xarray 0.21.1 pyhd8ed1ab_0 conda-forge
xerces-c 3.2.3 h0e60522_4 conda-forge
xorg-libxau 1.0.9 hcd874cb_0 conda-forge
xorg-libxdmcp 1.1.3 hcd874cb_0 conda-forge
xyzservices 2022.3.0 pyhd8ed1ab_0 conda-forge
xz 5.2.5 h62dcd97_1 conda-forge
yaml 0.2.5 he774522_0
yarl 1.8.2 pypi_0 pypi
zarr 2.11.1 pypi_0 pypi
zipp 3.7.0 pyhd8ed1ab_1 conda-forge
zlib 1.2.11 h8ffe710_1013 conda-forge
zstd 1.5.2 h6255e5f_0 conda-forge
Mine is:
2.4.1 1.26.26 1.29.26
So there is a mismatch in the environment you listed there, and the environment you are running your notebook or kernel? That first one should be 2.4.0 according to your environment listing
You would need to restart the kernel in order for the environment to update where you are executing the code
Ha, smh, duh.
It is running now! Thanks a bunch, Max!
Thanks for letting us know about this issue!
Per the request of @mgrover1.
This occurs when running AWS data access example in the PyArt documentation.
Error message: `ClientError Traceback (most recent call last) File ~\miniconda3\lib\site-packages\s3fs\core.py:112, in _error_wrapper(func, args, kwargs, retries) 111 try: --> 112 return await func(*args, **kwargs) 113 except S3_RETRYABLE_ERRORS as e:
File ~\miniconda3\lib\site-packages\aiobotocore\client.py:358, in AioBaseClient._make_api_call(self, operation_name, api_params) 357 error_class = self.exceptions.from_code(error_code) --> 358 raise error_class(parsed_response, operation_name) 359 else:
ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden
The above exception was the direct cause of the following exception:
PermissionError Traceback (most recent call last) Input In [15], in <cell line: 85>() 81 scans = conn.get_avail_scans_in_range(start_dt,end_dt,nexrad_site) 83 scan = str(scans[int(np.floor(round(len(scans)-1)/2))]).split('- ')[1][0:-1] ---> 85 radar = pyart.io.read_nexrad_archive("s3://noaa-nexrad-level2/"+str(scan))
File ~\miniconda3\lib\site-packages\pyart\io\nexrad_archive.py:106, in read_nexrad_archive(filename, field_names, additional_metadata, file_field_names, exclude_fields, include_fields, delay_field_loading, station, scans, linear_interp, storage_options, **kwargs) 101 filemetadata = FileMetadata('nexrad_archive', field_names, 102 additional_metadata, file_field_names, 103 exclude_fields, include_fields) 105 # open the file and retrieve scan information --> 106 nfile = NEXRADLevel2File(prepare_for_read(filename, storage_options=storage_options)) 107 scan_info = nfile.scan_info(scans) 109 # time
File ~\miniconda3\lib\site-packages\pyart\io\common.py:42, in prepare_for_read(filename, storage_options) 39 return filename 41 # look for compressed data by examining the first few bytes ---> 42 fh = fsspec.open(filename, 43 mode='rb', 44 compression="infer", 45 **storage_options).open() 46 magic = fh.read(3) 47 fh.close()
File ~\miniconda3\lib\site-packages\fsspec\core.py:135, in OpenFile.open(self) 128 def open(self): 129 """Materialise this as a real open file without context 130 131 The OpenFile object should be explicitly closed to avoid enclosed file 132 instances persisting. You must, therefore, keep a reference to the OpenFile 133 during the life of the file-like it generates. 134 """ --> 135 return self.enter()
File ~\miniconda3\lib\site-packages\fsspec\core.py:103, in OpenFile.enter(self) 100 def enter(self): 101 mode = self.mode.replace("t", "").replace("b", "") + "b" --> 103 f = self.fs.open(self.path, mode=mode) 105 self.fobjects = [f] 107 if self.compression is not None:
File ~\miniconda3\lib\site-packages\fsspec\spec.py:1106, in AbstractFileSystem.open(self, path, mode, block_size, cache_options, compression, kwargs) 1104 else: 1105 ac = kwargs.pop("autocommit", not self._intrans) -> 1106 f = self._open( 1107 path, 1108 mode=mode, 1109 block_size=block_size, 1110 autocommit=ac, 1111 cache_options=cache_options, 1112 kwargs, 1113 ) 1114 if compression is not None: 1115 from fsspec.compression import compr
File ~\miniconda3\lib\site-packages\s3fs\core.py:640, in S3FileSystem._open(self, path, mode, block_size, acl, version_id, fill_cache, cache_type, autocommit, requester_pays, cache_options, **kwargs) 637 if cache_type is None: 638 cache_type = self.default_cache_type --> 640 return S3File( 641 self, 642 path, 643 mode, 644 block_size=block_size, 645 acl=acl, 646 version_id=version_id, 647 fill_cache=fill_cache, 648 s3_additional_kwargs=kw, 649 cache_type=cache_type, 650 autocommit=autocommit, 651 requester_pays=requester_pays, 652 cache_options=cache_options, 653 )
File ~\miniconda3\lib\site-packages\s3fs\core.py:1989, in S3File.init(self, s3, path, mode, block_size, acl, version_id, fill_cache, s3_additional_kwargs, autocommit, cache_type, requester_pays, cache_options) 1987 self.details = s3.info(path) 1988 self.version_id = self.details.get("VersionId") -> 1989 super().init( 1990 s3, 1991 path, 1992 mode, 1993 block_size, 1994 autocommit=autocommit, 1995 cache_type=cache_type, 1996 cache_options=cache_options, 1997 ) 1998 self.s3 = self.fs # compatibility 2000 # when not using autocommit we want to have transactional state to manage
File ~\miniconda3\lib\site-packages\fsspec\spec.py:1462, in AbstractBufferedFile.init(self, fs, path, mode, block_size, autocommit, cache_type, cache_options, size, kwargs) 1460 self.size = size 1461 else: -> 1462 self.size = self.details["size"] 1463 self.cache = caches[cache_type]( 1464 self.blocksize, self._fetch_range, self.size, cache_options 1465 ) 1466 else:
File ~\miniconda3\lib\site-packages\fsspec\spec.py:1475, in AbstractBufferedFile.details(self) 1472 @property 1473 def details(self): 1474 if self._details is None: -> 1475 self._details = self.fs.info(self.path) 1476 return self._details
File ~\miniconda3\lib\site-packages\fsspec\asyn.py:113, in sync_wrapper..wrapper(*args, kwargs)
110 @functools.wraps(func)
111 def wrapper(*args, *kwargs):
112 self = obj or args[0]
--> 113 return sync(self.loop, func, args, kwargs)
File ~\miniconda3\lib\site-packages\fsspec\asyn.py:98, in sync(loop, func, timeout, *args, **kwargs) 96 raise FSTimeoutError from return_result 97 elif isinstance(return_result, BaseException): ---> 98 raise return_result 99 else: 100 return return_result
File ~\miniconda3\lib\site-packages\fsspec\asyn.py:53, in _runner(event, coro, result, timeout) 51 coro = asyncio.wait_for(coro, timeout=timeout) 52 try: ---> 53 result[0] = await coro 54 except Exception as ex: 55 result[0] = ex
File ~\miniconda3\lib\site-packages\s3fs\core.py:1210, in S3FileSystem._info(self, path, bucket, key, refresh, version_id) 1208 if key: 1209 try: -> 1210 out = await self._call_s3( 1211 "head_object", 1212 self.kwargs, 1213 Bucket=bucket, 1214 Key=key, 1215 version_id_kw(version_id), 1216 self.req_kw, 1217 ) 1218 return { 1219 "ETag": out.get("ETag", ""), 1220 "LastModified": out["LastModified"], (...) 1226 "ContentType": out.get("ContentType"), 1227 } 1228 except FileNotFoundError:
File ~\miniconda3\lib\site-packages\s3fs\core.py:339, in S3FileSystem._call_s3(self, method, *akwarglist, *kwargs) 337 logger.debug("CALL: %s - %s - %s", method.name, akwarglist, kw2) 338 additional_kwargs = self._get_s3_method_kwargs(method, akwarglist, **kwargs) --> 339 return await _error_wrapper( 340 method, kwargs=additional_kwargs, retries=self.retries 341 )
File ~\miniconda3\lib\site-packages\s3fs\core.py:139, in _error_wrapper(func, args, kwargs, retries) 137 err = e 138 err = translate_boto_error(err) --> 139 raise err
PermissionError: Forbidden`
CONDA LIST: