search

ankane / ruby-polars

Blazingly fast DataFrames for Ruby
Other
860 stars 34 forks source link

Any plans to add Delta Lake support #87

Closed simpl1g closed 1 month ago

simpl1g commented 1 month ago

Python bindings support methods like read/scan/write_delta https://docs.pola.rs/api/python/dev/reference/api/polars.DataFrame.write_delta.html

Do you think it is possible to implement them for Ruby? Previously there were some Ruby bindings for delta-rs but they were unmaitened and eventually dropped https://github.com/delta-io/delta-rs/pull/1102

ankane commented 1 month ago

Hi @simpl1g, thanks for sharing. I don't have any plans for it, but someone could probably create a separate gem.

ankane commented 1 week ago

Hey @simpl1g, just created a separate gem for this that works with the latest release (0.15.0).

There aren't currently precompiled versions, but plan to add them in a future release. Also, it doesn't currently work with string columns, but should when the next release of the Rust library is out (https://github.com/delta-io/delta-rs/pull/2886). Feel free to create an issue if you need any missing functionality.

Will also add read/scan/write_delta methods to this library in a future release.

simpl1g commented 1 week ago

Wow, you are superhuman :) Do you have special LLM to convert Python bindings to Ruby?)