mgrover1
commented
1 year ago @kylejgillett can you print out the file path you are sending to the reader? Ex "s3://..."
Closed kylejgillett closed 1 year ago
mgrover1
commented
1 year ago @kylejgillett can you print out the file path you are sending to the reader? Ex "s3://..."
kylejgillett
commented
1 year ago 's3://noaa-nexrad-level2/2022/03/22/KHGX/KHGX20220322_120125_V06'
mgrover1
commented
1 year ago So to confirm here, the following throws the error?
import pyart
radar = pyart.io.read_nexrad_archive('s3://noaa-nexrad-level2/2022/03/22/KHGX/KHGX20220322_120125_V06')Yep, I get the error running that.
mgrover1
commented
1 year ago So it looks like there is an issue with the newer release of aiobotocore... can you try
pip uninstall arm_pyart
pip install arm_pyartto see if that resolves the issue? that should reinstall working versions of the file packages.
mgrover1
commented
1 year ago Otherwise, try installing aiobotocore3 version 2.4.0
pip install aiobotocore3==2.4.0So I uninstalled/reinstalled arm-pyart and got this message afterwards...
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behavior is the source of the following dependency conflicts. boto3 1.26.26 requires botocore<1.30.0,>=1.29.26, but you have botocore 1.27.59 which is incompatible.
mgrover1
commented
1 year ago can you install boto3 == 1.26.27 ?
kylejgillett
commented
1 year ago So this is as far as I got trying to trouble shoot last night. It leaves me here:
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behavior is the source of the following dependency conflicts.
aiobotocore 2.4.1 requires botocore<1.27.60,>=1.27.59, but you have botocore 1.29.27 which is incompatible.Okay - yeah! So you will need
pip install aiobotocore==2.4.0 boto3==1.26.27Its the newest release of aiobotocore3 that is causing some issues I think... so rolling back one version there should help?
kylejgillett
commented
1 year ago is that the correct version of aiobotocore3? I am getting this:
ERROR: Could not find a version that satisfies the requirement aiobotocore3==2.4.0 (from versions: none)
ERROR: No matching distribution found for aiobotocore3==2.4.0ope sorry - aiobotocore is the name of the package, no 3
kylejgillett
commented
1 year ago Now this lol:
Installing collected packages: botocore, aiobotocore Attempting uninstall: botocore Found existing installation: botocore 1.29.27 Uninstalling botocore-1.29.27: Successfully uninstalled botocore-1.29.27 Attempting uninstall: aiobotocore Found existing installation: aiobotocore 2.4.1 Uninstalling aiobotocore-2.4.1: Successfully uninstalled aiobotocore-2.4.1 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. boto3 1.26.27 requires botocore<1.30.0,>=1.29.27, but you have botocore 1.27.59 which is incompatible. Successfully installed aiobotocore-2.4.0 botocore-1.27.59
mgrover1
commented
1 year ago Can you try running that code snippet from above to see if this update fixed the issue?
mgrover1
commented
1 year ago So to confirm here, the following throws the error?
import pyart radar = pyart.io.read_nexrad_archive('s3://noaa-nexrad-level2/2022/03/22/KHGX/KHGX20220322_120125_V06')
This one!
kylejgillett
commented
1 year ago I am still Forbidden LOL
mgrover1
commented
1 year ago Can you run conda list one more time? I can take a another look likely on Monday and dig into this more...
mgrover1
commented
1 year ago This is what I am running on my machine that is working:
In [1]: import aiobotocore
In [2]: aiobotocore.__version__
Out[2]: '2.4.0'
In [3]: import boto3
In [4]: boto3.__version__
Out[4]: '1.26.27'
In [5]: import botocore
In [6]: botocore.__version__
Out[6]: '1.27.59'Yep!
Name Version Build Channel
affine 2.3.1 pypi_0 pypi
aiobotocore 2.4.0 pypi_0 pypi
aiohttp 3.8.3 pypi_0 pypi
aioitertools 0.11.0 pypi_0 pypi
aiosignal 1.3.1 pypi_0 pypi
anyio 3.6.1 pypi_0 pypi
appdirs 1.4.4 pyh9f0ad1d_0 conda-forge
argon2-cffi 21.3.0 pypi_0 pypi
argon2-cffi-bindings 21.2.0 pypi_0 pypi
arm-pyart 1.14.1 pypi_0 pypi
asciitree 0.3.3 pypi_0 pypi
asgiref 3.5.2 pypi_0 pypi
asttokens 2.0.5 pypi_0 pypi
async-timeout 4.0.2 pypi_0 pypi
attrs 21.4.0 pyhd8ed1ab_0 conda-forge
babel 2.10.3 pypi_0 pypi
backcall 0.2.0 pypi_0 pypi
basemap 1.3.6 pypi_0 pypi
basemap-data 1.3.2 pypi_0 pypi
beautifulsoup4 4.10.0 pyha770c72_0 conda-forge
bleach 4.1.0 pypi_0 pypi
blosc 1.21.0 h0e60522_0 conda-forge
boost-cpp 1.74.0 h9f4b32c_7 conda-forge
boto3 1.26.27 pypi_0 pypi
botocore 1.27.59 pypi_0 pypi
branca 0.4.2 pyhd8ed1ab_0 conda-forge
brotli 1.0.9 h8ffe710_6 conda-forge
brotli-bin 1.0.9 h8ffe710_6 conda-forge
brotlipy 0.7.0 py39h2bbff1b_1003
bzip2 1.0.8 h8ffe710_4 conda-forge
ca-certificates 2022.9.24 h5b45459_0 conda-forge
cairo 1.16.0 h15b3021_1010 conda-forge
cartopy 0.20.2 py39h07f1d72_4 conda-forge
cdsapi 0.5.1 pypi_0 pypi
certifi 2022.9.24 pyhd8ed1ab_0 conda-forge
cffi 1.15.1 pypi_0 pypi
cfgrib 0.9.10.3 pypi_0 pypi
cfitsio 4.0.0 hd67004f_0 conda-forge
cftime 1.5.2 py39h5d4886f_0 conda-forge
chardet 4.0.0 pypi_0 pypi
charset-normalizer 2.0.4 pyhd3eb1b0_0
click 8.0.4 py39hcbf5309_0 conda-forge
click-plugins 1.1.1 py_0 conda-forge
cligj 0.7.2 pyhd8ed1ab_1 conda-forge
cmocean 2.0 pypi_0 pypi
colorama 0.4.4 pyh9f0ad1d_0 conda-forge
conda 22.9.0 py39hcbf5309_2 conda-forge
conda-content-trust 0.1.1 pyhd3eb1b0_0
conda-package-handling 1.7.3 py39h8cc25b3_1
console_shortcut 0.1.1 4
cryptography 36.0.0 py39h21b164f_0
curl 7.81.0 h789b8ee_0 conda-forge
cycler 0.11.0 pyhd8ed1ab_0 conda-forge
cython 0.29.32 pypi_0 pypi
datetimerange 1.2.0 pypi_0 pypi
debugpy 1.5.1 pypi_0 pypi
decorator 5.1.1 pypi_0 pypi
defusedxml 0.7.1 pypi_0 pypi
django 3.2.16 pypi_0 pypi
django-environ 0.9.0 pypi_0 pypi
django-model-utils 4.3.1 pypi_0 pypi
djangorestframework 3.14.0 pypi_0 pypi
docopt 0.6.2 pypi_0 pypi
eccodes 1.5.0 pypi_0 pypi
ecmwflibs 0.5.0 pypi_0 pypi
entrypoints 0.4 pypi_0 pypi
executing 0.8.3 pypi_0 pypi
expat 2.4.7 h39d44d4_0 conda-forge
fasteners 0.17.3 pypi_0 pypi
fastjsonschema 2.16.2 pypi_0 pypi
findlibs 0.0.2 pypi_0 pypi
fiona 1.8.21 py39hd99abff_0 conda-forge
folium 0.12.1.post1 pyhd8ed1ab_1 conda-forge
font-ttf-dejavu-sans-mono 2.37 hab24e00_0 conda-forge
font-ttf-inconsolata 3.000 h77eed37_0 conda-forge
font-ttf-source-code-pro 2.038 h77eed37_0 conda-forge
font-ttf-ubuntu 0.83 hab24e00_0 conda-forge
fontconfig 2.13.96 hce3cb01_2 conda-forge
fonts-conda-ecosystem 1 0 conda-forge
fonts-conda-forge 1 0 conda-forge
fonttools 4.29.1 py39hb82d6ee_0 conda-forge
freeglut 3.2.2 h0e60522_1 conda-forge
freetype 2.10.4 h546665d_1 conda-forge
freexl 1.0.6 ha8e266a_0 conda-forge
frozenlist 1.3.3 pypi_0 pypi
fsspec 2022.11.0 pypi_0 pypi
fuzzywuzzy 0.18.0 pypi_0 pypi
gdal 3.4.2 py39h3f5efd6_0 conda-forge
geographiclib 1.52 pypi_0 pypi
geopandas 0.10.2 pyhd8ed1ab_1 conda-forge
geopandas-base 0.10.2 pyha770c72_1 conda-forge
geopy 2.2.0 pypi_0 pypi
geos 3.10.2 h39d44d4_0 conda-forge
geotiff 1.7.0 h38b14a8_7 conda-forge
getgfs 1.0.0 pypi_0 pypi
gettext 0.19.8.1 ha2e2712_1008 conda-forge
h3 3.7.4 pypi_0 pypi
h5py 3.6.0 pypi_0 pypi
hdf4 4.2.15 h0e5069d_3 conda-forge
hdf5 1.12.1 nompi_h2a0e4a3_103 conda-forge
herbie 1.0b2 pypi_0 pypi
herbie-data 0.0.10 pypi_0 pypi
icu 69.1 h0e60522_0 conda-forge
idna 3.3 pyhd3eb1b0_0
importlib-metadata 4.11.2 py39hcbf5309_0 conda-forge
importlib_metadata 4.11.2 hd8ed1ab_0 conda-forge
importlib_resources 5.4.0 pyhd8ed1ab_0 conda-forge
intel-openmp 2022.0.0 h57928b3_3663 conda-forge
ipykernel 6.9.1 pypi_0 pypi
ipython 8.1.0 pypi_0 pypi
ipython-genutils 0.2.0 pypi_0 pypi
ipywidgets 7.6.5 pypi_0 pypi
jasper 2.0.33 h77af90b_0 conda-forge
jbig 2.1 h8d14728_2003 conda-forge
jedi 0.18.1 pypi_0 pypi
jinja2 3.0.3 pyhd8ed1ab_0 conda-forge
jmespath 1.0.1 pypi_0 pypi
joblib 1.1.0 pyhd8ed1ab_0 conda-forge
jpeg 9e h8ffe710_0 conda-forge
json5 0.9.10 pypi_0 pypi
jsonschema 4.4.0 pypi_0 pypi
jupyter 1.0.0 pypi_0 pypi
jupyter-client 7.1.2 pypi_0 pypi
jupyter-console 6.4.0 pypi_0 pypi
jupyter-core 4.9.2 pypi_0 pypi
jupyter-server 1.19.1 pypi_0 pypi
jupyterlab 3.4.8 pypi_0 pypi
jupyterlab-pygments 0.1.2 pypi_0 pypi
jupyterlab-server 2.15.2 pypi_0 pypi
jupyterlab-widgets 1.0.2 pypi_0 pypi
kealib 1.4.14 h8995ca9_3 conda-forge
kiwisolver 1.3.2 py39h2e07f2f_1 conda-forge
krb5 1.19.2 h1176d77_4 conda-forge
lcms2 2.12 h2a16943_0 conda-forge
lerc 3.0 h0e60522_0 conda-forge
libaec 1.0.6 h39d44d4_0 conda-forge
libblas 3.9.0 13_win64_mkl conda-forge
libbrotlicommon 1.0.9 h8ffe710_6 conda-forge
libbrotlidec 1.0.9 h8ffe710_6 conda-forge
libbrotlienc 1.0.9 h8ffe710_6 conda-forge
libcblas 3.9.0 13_win64_mkl conda-forge
libclang 13.0.1 default_h81446c8_0 conda-forge
libcurl 7.81.0 h789b8ee_0 conda-forge
libdeflate 1.10 h8ffe710_0 conda-forge
libffi 3.4.2 h8ffe710_5 conda-forge
libgdal 3.4.2 h7f66a12_0 conda-forge
libglib 2.70.2 h3be07f2_4 conda-forge
libiconv 1.16 he774522_0 conda-forge
libkml 1.3.0 h9859afa_1014 conda-forge
liblapack 3.9.0 13_win64_mkl conda-forge
libnetcdf 4.8.1 nompi_h1cc8e9d_101 conda-forge
libpng 1.6.37 h1d00b33_2 conda-forge
libpq 14.2 hfcc5ef8_0 conda-forge
libprotobuf 3.19.4 h7755175_0 conda-forge
librttopo 1.1.0 hb1df466_9 conda-forge
libspatialindex 1.9.3 h39d44d4_4 conda-forge
libspatialite 5.0.1 h36c16d9_15 conda-forge
libssh2 1.10.0 h680486a_2 conda-forge
libtiff 4.3.0 hc4061b1_3 conda-forge
libwebp 1.2.2 h57928b3_0 conda-forge
libwebp-base 1.2.2 h8ffe710_1 conda-forge
libxcb 1.13 hcd874cb_1004 conda-forge
libxml2 2.9.12 hf5bbc77_1 conda-forge
libxslt 1.1.33 h65864e5_3 conda-forge
libzip 1.8.0 hfed4ece_1 conda-forge
libzlib 1.2.11 h8ffe710_1013 conda-forge
lz4-c 1.9.3 h8ffe710_1 conda-forge
m2w64-gcc-libgfortran 5.3.0 6 conda-forge
m2w64-gcc-libs 5.3.0 7 conda-forge
m2w64-gcc-libs-core 5.3.0 7 conda-forge
m2w64-gmp 6.1.0 2 conda-forge
m2w64-libwinpthread-git 5.0.0.4634.697f757 2 conda-forge
mapclassify 2.4.3 pyhd8ed1ab_0 conda-forge
markupsafe 2.1.0 pypi_0 pypi
matplotlib-base 3.5.1 py39h581301d_0 conda-forge
matplotlib-inline 0.1.3 pypi_0 pypi
mbstrdecoder 1.1.0 pypi_0 pypi
menuinst 1.4.18 py39h59b6b97_0
metpy 1.2.0 pyhd8ed1ab_0 conda-forge
mistune 2.0.4 pypi_0 pypi
mkl 2022.0.0 h0e2418a_796 conda-forge
msys2-conda-epoch 20160418 1 conda-forge
multidict 6.0.3 pypi_0 pypi
munch 2.5.0 py_0 conda-forge
munkres 1.1.4 pyh9f0ad1d_0 conda-forge
nbclassic 0.4.4 pypi_0 pypi
nbclient 0.5.11 pypi_0 pypi
nbconvert 7.2.1 pypi_0 pypi
nbformat 5.6.1 pypi_0 pypi
nest-asyncio 1.5.4 pypi_0 pypi
netcdf4 1.5.8 nompi_py39hf113b1f_101 conda-forge
networkx 2.7.1 pyhd8ed1ab_0 conda-forge
nexradaws 1.1 pypi_0 pypi
nominatim 0.1 pypi_0 pypi
notebook 6.4.8 pypi_0 pypi
notebook-shim 0.1.0 pypi_0 pypi
numcodecs 0.9.1 pypi_0 pypi
numpy 1.22.2 py39h6331f09_0 conda-forge
openjpeg 2.4.0 hb211442_1 conda-forge
openssl 1.1.1q h8ffe710_0 conda-forge
packaging 21.3 pyhd8ed1ab_0 conda-forge
pandas 1.4.1 py39h2e25243_0 conda-forge
pandocfilters 1.5.0 pypi_0 pypi
parso 0.8.3 pypi_0 pypi
pcre 8.45 h0e60522_0 conda-forge
pickleshare 0.7.5 pypi_0 pypi
pillow 9.0.1 py39ha53f419_2 conda-forge
pint 0.18 pyhd8ed1ab_0 conda-forge
pip 21.2.4 py39haa95532_0
pixman 0.40.0 h8ffe710_0 conda-forge
pooch 1.6.0 pyhd8ed1ab_0 conda-forge
poppler 22.01.0 h24fffdf_0 conda-forge
poppler-data 0.4.11 hd8ed1ab_0 conda-forge
postgresql 14.2 h1c22c4f_0 conda-forge
powershell_shortcut 0.0.1 3
proj 9.0.0 h1cfcee9_0 conda-forge
prometheus-client 0.13.1 pypi_0 pypi
prompt-toolkit 3.0.28 pypi_0 pypi
protobuf 3.19.4 py39h415ef7b_0 conda-forge
psycopg2 2.9.5 pypi_0 pypi
pthread-stubs 0.4 hcd874cb_1001 conda-forge
pure-eval 0.2.2 pypi_0 pypi
pycosat 0.6.3 py39h2bbff1b_0
pycparser 2.21 pyhd3eb1b0_0
pygments 2.11.2 pypi_0 pypi
pygrib 2.1.4 py39h417709b_5 conda-forge
pymeteo 1.0.3 pypi_0 pypi
pyopenssl 21.0.0 pyhd3eb1b0_1
pyparsing 3.0.7 pyhd8ed1ab_0 conda-forge
pyproj 3.3.0 py39h23585d7_2 conda-forge
pyrsistent 0.18.1 pypi_0 pypi
pyshp 2.2.0 pyhd8ed1ab_0 conda-forge
pyside2 5.15.2.1 pypi_0 pypi
pysocks 1.7.1 py39haa95532_0
python 3.9.7 h6244533_1
python-awips 18.1.8 pypi_0 pypi
python-dateutil 2.8.2 pyhd8ed1ab_0 conda-forge
python_abi 3.9 2_cp39 conda-forge
pytz 2021.3 pyhd8ed1ab_0 conda-forge
pywin32 302 py39h827c3e9_1
pywinpty 2.0.2 pypi_0 pypi
pyzmq 22.3.0 pypi_0 pypi
qt 5.12.9 h556501e_6 conda-forge
qtconsole 5.2.2 pypi_0 pypi
qtpy 2.0.1 pyhd8ed1ab_0 conda-forge
regex 2022.4.24 pypi_0 pypi
requests 2.27.1 pyhd3eb1b0_0
rtree 0.9.3 pypi_0 pypi
ruamel_yaml 0.15.100 py39h2bbff1b_0
s3fs 2022.11.0 pypi_0 pypi
s3transfer 0.6.0 pypi_0 pypi
scikit-learn 1.0.2 py39he931e04_0 conda-forge
scipy 1.8.0 py39hc0c34ad_1 conda-forge
seaborn 0.11.2 pypi_0 pypi
send2trash 1.8.0 pypi_0 pypi
setuptools 65.5.0 pypi_0 pypi
shapely 1.8.0 py39hf063a39_5 conda-forge
sharppy 1.4.0 py39hde42818_1 conda-forge
shiboken2 5.15.2.1 pypi_0 pypi
siphon 0.9 pyhd8ed1ab_2 conda-forge
six 1.16.0 pyhd3eb1b0_0
sniffio 1.3.0 pypi_0 pypi
snuggs 1.4.7 pypi_0 pypi
soupsieve 2.3.1 pyhd8ed1ab_0 conda-forge
sqlite 3.37.0 h2bbff1b_0
sqlparse 0.4.3 pypi_0 pypi
stack-data 0.2.0 pypi_0 pypi
strict-rfc3339 0.7 pypi_0 pypi
tbb 2021.5.0 h2d74725_0 conda-forge
terminado 0.13.1 pypi_0 pypi
testpath 0.6.0 pypi_0 pypi
threadpoolctl 3.1.0 pyh8a188c0_0 conda-forge
tiledb 2.7.1 h95dad36_0 conda-forge
timezonefinder 6.1.3 pypi_0 pypi
tinycss2 1.1.1 pypi_0 pypi
tk 8.6.12 h8ffe710_0 conda-forge
toml 0.10.2 pypi_0 pypi
tomli 2.0.1 pypi_0 pypi
toolz 0.12.0 pyhd8ed1ab_0 conda-forge
tornado 6.1 pypi_0 pypi
tqdm 4.62.3 pyhd3eb1b0_1
traitlets 5.1.1 pyhd8ed1ab_0 conda-forge
tropycal 0.5.2 pypi_0 pypi
typepy 1.3.0 pypi_0 pypi
typing_extensions 4.1.1 pyha770c72_0 conda-forge
tzdata 2021e hda174b7_0
ucrt 10.0.20348.0 h57928b3_0 conda-forge
unicodedata2 14.0.0 py39hb82d6ee_0 conda-forge
urllib3 1.26.7 pyhd3eb1b0_0
utm 0.7.0 pypi_0 pypi
vc 14.2 h21ff451_1
vs2015_runtime 14.29.30037 h902a5da_6 conda-forge
wcwidth 0.2.5 pypi_0 pypi
webencodings 0.5.1 pypi_0 pypi
webob 1.8.7 pypi_0 pypi
websocket-client 1.4.1 pypi_0 pypi
wheel 0.37.1 pyhd3eb1b0_0
widgetsnbextension 3.5.2 pypi_0 pypi
win_inet_pton 1.1.0 py39haa95532_0
wincertstore 0.2 py39haa95532_2
wrapt 1.14.1 pypi_0 pypi
xarray 0.21.1 pyhd8ed1ab_0 conda-forge
xerces-c 3.2.3 h0e60522_4 conda-forge
xorg-libxau 1.0.9 hcd874cb_0 conda-forge
xorg-libxdmcp 1.1.3 hcd874cb_0 conda-forge
xyzservices 2022.3.0 pyhd8ed1ab_0 conda-forge
xz 5.2.5 h62dcd97_1 conda-forge
yaml 0.2.5 he774522_0
yarl 1.8.2 pypi_0 pypi
zarr 2.11.1 pypi_0 pypi
zipp 3.7.0 pyhd8ed1ab_1 conda-forge
zlib 1.2.11 h8ffe710_1013 conda-forge
zstd 1.5.2 h6255e5f_0 conda-forgeMine is:
2.4.1 1.26.26 1.29.26
mgrover1
commented
1 year ago So there is a mismatch in the environment you listed there, and the environment you are running your notebook or kernel? That first one should be 2.4.0 according to your environment listing
mgrover1
commented
1 year ago You would need to restart the kernel in order for the environment to update where you are executing the code
kylejgillett
commented
1 year ago Ha, smh, duh.
It is running now! Thanks a bunch, Max!
mgrover1
commented
1 year ago Thanks for letting us know about this issue!
Per the request of @mgrover1.
This occurs when running AWS data access example in the PyArt documentation.
Error message: `ClientError Traceback (most recent call last) File ~\miniconda3\lib\site-packages\s3fs\core.py:112, in _error_wrapper(func, args, kwargs, retries) 111 try: --> 112 return await func(*args, **kwargs) 113 except S3_RETRYABLE_ERRORS as e:
File ~\miniconda3\lib\site-packages\aiobotocore\client.py:358, in AioBaseClient._make_api_call(self, operation_name, api_params) 357 error_class = self.exceptions.from_code(error_code) --> 358 raise error_class(parsed_response, operation_name) 359 else:
ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden
The above exception was the direct cause of the following exception:
PermissionError Traceback (most recent call last) Input In [15], in <cell line: 85>() 81 scans = conn.get_avail_scans_in_range(start_dt,end_dt,nexrad_site) 83 scan = str(scans[int(np.floor(round(len(scans)-1)/2))]).split('- ')[1][0:-1] ---> 85 radar = pyart.io.read_nexrad_archive("s3://noaa-nexrad-level2/"+str(scan))
File ~\miniconda3\lib\site-packages\pyart\io\nexrad_archive.py:106, in read_nexrad_archive(filename, field_names, additional_metadata, file_field_names, exclude_fields, include_fields, delay_field_loading, station, scans, linear_interp, storage_options, **kwargs) 101 filemetadata = FileMetadata('nexrad_archive', field_names, 102 additional_metadata, file_field_names, 103 exclude_fields, include_fields) 105 # open the file and retrieve scan information --> 106 nfile = NEXRADLevel2File(prepare_for_read(filename, storage_options=storage_options)) 107 scan_info = nfile.scan_info(scans) 109 # time
File ~\miniconda3\lib\site-packages\pyart\io\common.py:42, in prepare_for_read(filename, storage_options) 39 return filename 41 # look for compressed data by examining the first few bytes ---> 42 fh = fsspec.open(filename, 43 mode='rb', 44 compression="infer", 45 **storage_options).open() 46 magic = fh.read(3) 47 fh.close()
File ~\miniconda3\lib\site-packages\fsspec\core.py:135, in OpenFile.open(self) 128 def open(self): 129 """Materialise this as a real open file without context 130 131 The OpenFile object should be explicitly closed to avoid enclosed file 132 instances persisting. You must, therefore, keep a reference to the OpenFile 133 during the life of the file-like it generates. 134 """ --> 135 return self.enter()
File ~\miniconda3\lib\site-packages\fsspec\core.py:103, in OpenFile.enter(self) 100 def enter(self): 101 mode = self.mode.replace("t", "").replace("b", "") + "b" --> 103 f = self.fs.open(self.path, mode=mode) 105 self.fobjects = [f] 107 if self.compression is not None:
File ~\miniconda3\lib\site-packages\fsspec\spec.py:1106, in AbstractFileSystem.open(self, path, mode, block_size, cache_options, compression, kwargs) 1104 else: 1105 ac = kwargs.pop("autocommit", not self._intrans) -> 1106 f = self._open( 1107 path, 1108 mode=mode, 1109 block_size=block_size, 1110 autocommit=ac, 1111 cache_options=cache_options, 1112 kwargs, 1113 ) 1114 if compression is not None: 1115 from fsspec.compression import compr
File ~\miniconda3\lib\site-packages\s3fs\core.py:640, in S3FileSystem._open(self, path, mode, block_size, acl, version_id, fill_cache, cache_type, autocommit, requester_pays, cache_options, **kwargs) 637 if cache_type is None: 638 cache_type = self.default_cache_type --> 640 return S3File( 641 self, 642 path, 643 mode, 644 block_size=block_size, 645 acl=acl, 646 version_id=version_id, 647 fill_cache=fill_cache, 648 s3_additional_kwargs=kw, 649 cache_type=cache_type, 650 autocommit=autocommit, 651 requester_pays=requester_pays, 652 cache_options=cache_options, 653 )
File ~\miniconda3\lib\site-packages\s3fs\core.py:1989, in S3File.init(self, s3, path, mode, block_size, acl, version_id, fill_cache, s3_additional_kwargs, autocommit, cache_type, requester_pays, cache_options) 1987 self.details = s3.info(path) 1988 self.version_id = self.details.get("VersionId") -> 1989 super().init( 1990 s3, 1991 path, 1992 mode, 1993 block_size, 1994 autocommit=autocommit, 1995 cache_type=cache_type, 1996 cache_options=cache_options, 1997 ) 1998 self.s3 = self.fs # compatibility 2000 # when not using autocommit we want to have transactional state to manage
File ~\miniconda3\lib\site-packages\fsspec\spec.py:1462, in AbstractBufferedFile.init(self, fs, path, mode, block_size, autocommit, cache_type, cache_options, size, kwargs) 1460 self.size = size 1461 else: -> 1462 self.size = self.details["size"] 1463 self.cache = caches[cache_type]( 1464 self.blocksize, self._fetch_range, self.size, cache_options 1465 ) 1466 else:
File ~\miniconda3\lib\site-packages\fsspec\spec.py:1475, in AbstractBufferedFile.details(self) 1472 @property 1473 def details(self): 1474 if self._details is None: -> 1475 self._details = self.fs.info(self.path) 1476 return self._details
File ~\miniconda3\lib\site-packages\fsspec\asyn.py:113, in sync_wrapper..wrapper(*args, kwargs)
110 @functools.wraps(func)
111 def wrapper(*args, *kwargs):
112 self = obj or args[0]
--> 113 return sync(self.loop, func, args, kwargs)
File ~\miniconda3\lib\site-packages\fsspec\asyn.py:98, in sync(loop, func, timeout, *args, **kwargs) 96 raise FSTimeoutError from return_result 97 elif isinstance(return_result, BaseException): ---> 98 raise return_result 99 else: 100 return return_result
File ~\miniconda3\lib\site-packages\fsspec\asyn.py:53, in _runner(event, coro, result, timeout) 51 coro = asyncio.wait_for(coro, timeout=timeout) 52 try: ---> 53 result[0] = await coro 54 except Exception as ex: 55 result[0] = ex
File ~\miniconda3\lib\site-packages\s3fs\core.py:1210, in S3FileSystem._info(self, path, bucket, key, refresh, version_id) 1208 if key: 1209 try: -> 1210 out = await self._call_s3( 1211 "head_object", 1212 self.kwargs, 1213 Bucket=bucket, 1214 Key=key, 1215 version_id_kw(version_id), 1216 self.req_kw, 1217 ) 1218 return { 1219 "ETag": out.get("ETag", ""), 1220 "LastModified": out["LastModified"], (...) 1226 "ContentType": out.get("ContentType"), 1227 } 1228 except FileNotFoundError:
File ~\miniconda3\lib\site-packages\s3fs\core.py:339, in S3FileSystem._call_s3(self, method, *akwarglist, *kwargs) 337 logger.debug("CALL: %s - %s - %s", method.name, akwarglist, kw2) 338 additional_kwargs = self._get_s3_method_kwargs(method, akwarglist, **kwargs) --> 339 return await _error_wrapper( 340 method, kwargs=additional_kwargs, retries=self.retries 341 )
File ~\miniconda3\lib\site-packages\s3fs\core.py:139, in _error_wrapper(func, args, kwargs, retries) 137 err = e 138 err = translate_boto_error(err) --> 139 raise err
PermissionError: Forbidden`
CONDA LIST: