ClickHouse / ClickHouse

ClickHouse® is a real-time analytics DBMS
https://clickhouse.com
Apache License 2.0
35.69k stars 6.66k forks source link

Insert compressed protobufs or insert blocks with LZ4 compression #62347

Open romesful opened 3 months ago

romesful commented 3 months ago

I want to insert in Protobuf format, compressed in LZ4. There is a lot of data, now clickhouse-cpp client is used with compression enabled, sending TBlock's. I want to make up protobuffs and compress them, is this option really better than the current one? What are pros and cons?

avinzhang commented 1 month ago

Choosing between compressed Protobufs and LZ4 compression depends on your specific use case: