search

apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
https://arrow.apache.org/
Apache License 2.0
14.51k stars 3.53k forks source link

[Python] module 'pyarrow.fs' has no attribute 'GcsFileSystem' #38791

Open samos123 opened 11 months ago

samos123 commented 11 months ago

Platform: Linux using pip

Steps to reproduce:

  1. pip install google-cloud-storage pyarrow==14.0.1
  2. Run following code: 
    from pyarrow import fs
gcs = fs.GcsFileSystem()

This is following the official docs here: https://arrow.apache.org/docs/python/filesystems.html#google-cloud-storage-file-system

Component(s)

Python

jorisvandenbossche commented 3 months ago

Apologies for the lack of reply (cleaning up some old issues now).

The GCS filesystem should have been available since pyarrow 9.0 (and also in Linux wheels, for Windows wheels only since 13.0 (https://github.com/apache/arrow/issues/35193))

So one reason I can think of that for some reason you are importing another / older version of pyarrow (you could check that with pa.__version__)