dask-contrib / dask-deltatable

A Delta Lake reader for Dask
BSD 3-Clause "New" or "Revised" License
46 stars 15 forks source link

Support reading and writing to remote filesystems (s3, gcsfs, azure) #53

Open j-bennet opened 1 year ago

j-bennet commented 1 year ago

We need end-to end test cases that write to remote FS: s3, gcsfs, etc. Make sure this is done with distributed scheduler also.