Switch to Parquet and ORC format using pyarrow

kszucs / pandahouse

Pandas interface for Clickhouse database

MIT License

228 stars 70 forks source link

Switch to Parquet and ORC format using pyarrow #29

Open kszucs opened 4 years ago

kszucs commented 4 years ago

More recent versions of clickhouse support Apache Parquet and Apache ORC format using Apache Arrow. Switching to these formats from csv/tsv would make the clickhouse <-> pandas conversions trivial and much faster.