Open oersted opened 1 year ago
You can try this: https://github.com/DataEngineeringLabs/arrow2-convert
arrow2-convert works reasonably well, but is built on arrow2
directly, so its usage path now that Polars has vendored arrow2/parquet2 is unclear.
Problem description
Say we have a trait like this (there's probably a better name for it)
And we have its corresponding derive macro for structs.
It would be nice for a user to create a
DataFrame
like this:As opposed to having to parse the structs into
Row
s and manually specifying the schema.Let me know if I'm missing an existing API that does something similar already.
Perhaps it is possible to leverage the existing interop with
serve
? I'm not sure since theserde
andserde-lazy
features are not documented at the moment.