Connection error on exists

fsspec / s3fs

S3 Filesystem

http://s3fs.readthedocs.io/en/latest/

BSD 3-Clause "New" or "Revised" License

892 stars 274 forks source link

Connection error on exists #384

Open CrabbyPete opened 4 years ago

CrabbyPete commented 4 years ago

The files in the directory are huge. Some are a > 1G. What happened: Connection timed out What you expected to happen:

Minimal Complete Verifiable Example:

# Put your MCVE code here

Anything else we need to know?:

Environment:

Dask version:
Python version:3.4
Operating System:linux
Install method (conda, pip, source):pip

martindurant commented 4 years ago

Sorry, I don't have any suggestions from that information. I do notice that your python is rather old, so you might want to start with upgrading to at least py3.7 .

CrabbyPete commented 4 years ago

Unfortunately the server I am working on only has 3.4. Don't you support 3.4? This also happens with a S3.put if the file is larger than 1G

martindurant commented 4 years ago

No, python 3.4 is out of its support period, as is 3.5 ( 3.6 was released 2016-12-23; https://en.wikipedia.org/wiki/History_of_Python#Table_of_versions ), and the async implementation requires syntax that did not exist back then. You can, however, try older versions of s3fs.