search

pola-rs / pyo3-polars

Plugins/extension for Polars
MIT License
238 stars 39 forks source link

Support LazyFrame #14

Closed dalcde closed 1 year ago

dalcde commented 1 year ago

This uses the cirobium ser/de of the logical plan to pass between python and rust. In particular, it copies if the lazyframe contains a dataframe.

(Should I expect this serialization to be roughly stable between polars versions? So that the python and rust versions can be slightly mismatched and still work)

This pulls in quite a few extra dependencies, and I'm happy to put them behind feature flags if desired.

Closes #9

ritchie46 commented 1 year ago

Thanks @dalcde. This is valuable to have. Could you feature flag this?

To answer your question, we do not guarantee stable serde between versions. It might work....

dalcde commented 1 year ago

Sorry for the delay. This is now behind a feature flag and rebased.