search

questdb / roadmap

QuestDB Public Roadmap
6 stars 0 forks source link

Data compression #13

Open bluestreak01 opened 2 years ago

bluestreak01 commented 2 years ago

Summary

We aim to provide a compression option for QuestDB Cloud instances.

Expected outcome

When selected, the same dataset will occupy 2-3x less disk space. As a nice side effect, more data should fit into available RAM improving page cache efficiency and overall query performance.

igor-suhorukov commented 1 year ago

Why not support existing column format with compression like Parquet with zstd, lz4, snappy, zlib, lzo, brotli ? Or ORC format with snappy, zlib?

puzpuzpuz commented 1 year ago

We're working on compression support in QuestDB Cloud. When enabled, it should yield a 2-3x compression ratio.

elix1er commented 1 year ago

wen?