apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
https://arrow.apache.org/
Apache License 2.0
14.46k stars 3.52k forks source link

[C++] Move fsspec FileSystem to a separate module #40344

Open bkietz opened 7 months ago

bkietz commented 7 months ago

Describe the enhancement requested

https://github.com/apache/arrow/issues/38309 adds the capability to register FileSystems not defined in libarrow. Python objects which satisfy fsspec are suitable for registration as such a filesystem.

Component(s)

C++, Python

pitrou commented 1 month ago

But is it actually useful to make it a separate C++ DLL? The C++ code footprint for it is probably minimal.