chdb-io / chdb

chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse
https://clickhouse.com/docs/en/chdb
Apache License 2.0
1.91k stars 71 forks source link

Polars support #126

Open sk2 opened 9 months ago

sk2 commented 9 months ago

Hi, I see many mentions of Pandas Dataframe integrations. It would be nice to have a simple api for Polars dataframe integration (or a simple code example). Polars uses Arrow underneath so this should hopefully not be too hard. DuckDB can read/write from Polars dataframes, which is nice for expressive sql, being able to do the same with Polars would be powerful.

Polars is a high performance upgrade on Pandas which is well suited to the performance in this project. Thanks!

auxten commented 9 months ago

Pandas 2.0 also uses Arrow as internal data format, we will support queries on memory Arrow format.