search

chdb-io / chdb

chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse
https://clickhouse.com/chdb
Apache License 2.0
2.13k stars 75 forks source link

Enable S3 #16

Closed lmangani closed 1 year ago

lmangani commented 1 year ago

Discussion/Proposal to enable S3 features in builds for optimised remote S3 chunked reading, etc. and in particular needed for performance improvement dealing with large parquet files on S3. The already huge build size should not change significantly.

Changelog category (leave one):

lmangani commented 1 year ago

0.6.1 works great w/ S3 👍

https://chdb.fly.dev/?user=default#U0VMRUNUCiAgICB0b3duLAogICAgZGlzdHJpY3QsCiAgICBjb3VudCgpIEFTIGMsCiAgICByb3VuZChhdmcocHJpY2UpKSBBUyBwcmljZSAKRlJPTSBzMygnaHR0cHM6Ly9kYXRhc2V0cy1kb2N1bWVudGF0aW9uLnMzLmV1LXdlc3QtMy5hbWF6b25hd3MuY29tL2hvdXNlX3BhcnF1ZXQvaG91c2VfMC5wYXJxdWV0JykKR1JPVVAgQlkKICAgIHRvd24sCiAgICBkaXN0cmljdApMSU1JVCAxMA==