search

fsspec / gcsfs

Pythonic file-system interface for Google Cloud Storage
http://gcsfs.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
320 stars 141 forks source link

Filename with slashes in the path are getting URL encoded, causing them to fail #600

Closed finbarrtimbers closed 6 months ago

finbarrtimbers commented 6 months ago

Hey folks,

I'm running into an issue where I can't open a file on GCS because the filename is being modified. The following fails:

gcsfs.GCSFileSystem().info('gs://my_bucket/v6/comparisons_diff_prompt.csv')

It gives the error FileNotFoundError: b/active-learning-comparisons/o/v6%2Fcomparisons_diff_prompt.csv. However, the file does exist, and can be read via Pandas (pd.read_csv('gs://my_bucket/v6/comparisons_diff_prompt.csv').

Am I doing something wrong with the path being provided to gcsfs?

finbarrtimbers commented 6 months ago

Sorry, I'm wrong. This is my mistake. URL does not, actually, exist.

martindurant commented 6 months ago

Thanks for updating :)