search

mt-caret / polars-ocaml

MIT License
50 stars 11 forks source link

Support `pl.from_arrow` #26

Open mt-caret opened 1 year ago

mt-caret commented 1 year ago

Database IO support (along with AWS and Bigquery support as well) mostly just uses Arrow + pl.from_arrow; a good OCaml Arrow transport story is most likely a blocker for this.

edwintorok commented 11 months ago

According to https://pola-rs.github.io/polars/user-guide/io/database/#connectorx the ConnectorX engine is written in Rust, can that be interfaces directly with Polars somehow without needing an OCaml Arrow library? (although that page only shows a Python API and not a Rust one, if ConnectorX is implemented in Rust shouldn't it be possible to use it there as well?)

mt-caret commented 11 months ago

I agree it's possible, though I haven't properly looked into it.