search

datafusion-contrib / datafusion-objectstore-hdfs

HDFS based on Java implementation as a remote ObjectStore for DataFusion
Apache License 2.0
8 stars 8 forks source link

feat: add support for AsyncWrite #17

Open yjshen opened 10 months ago

yjshen commented 10 months ago

Discovered the remarkable pull request https://github.com/apache/arrow-datafusion/pull/6987, which enables writing data through the Object Store API with AsyncWriter.

We can support writing directly to HDFS once we add support for the put_multipart and abort_multipart APIs.