search

Eventual-Inc / Daft

Distributed DataFrame for Python designed for the cloud, powered by Rust
https://getdaft.io
Apache License 2.0
1.79k stars 108 forks source link

[FEAT] Deltalakewriter #2073

Closed siddharth-gulia closed 1 week ago

siddharth-gulia commented 2 months ago

resolves #1967

ion-elgreco commented 1 month ago

You need to add the license, if you are reusing so much of the python code: https://github.com/delta-io/delta-rs/blob/main/python/licenses/deltalake_license.txt

avriiil commented 3 weeks ago

@samster25 @sherlockbeard - any ETA on when this might get merged? Would be nice to update the Delta x Daft integration page soon to show writing capabilities, versioning/time travel, etc.

siddharth-gulia commented 2 weeks ago

@kevinzwang I think the PR is ready for review now. The only problem is I'm unable to test test_deltalake_write_cloud. Do I need to set up some infrastructure locally to run it?

kevinzwang commented 1 week ago

@sherlockbeard let me know when you've resolved the test failures or if you need help looking into it!

jaychia commented 1 week ago

Congrats @siddharth-gulia on the big PR merge! 🎉 🎉 🎉

I really wish we could still call you @sherlockbeard 😋

samster25 commented 4 days ago

Thanks @siddharth-gulia for the contribution!!