We need to investigate new, more advanced compression scheme. Ideally, with decompression speed comparable to LZ4. Compression may be two stage:
first, when block is inserted - use fast/regular compression bq thread will be running and re-compressing blocks
Large block cache (10s-100sGB )can have hot-warm-cold zones. Each zone can have different compression schemes.
Another additional option is to try columnar representation of blocks in memory.
We need to investigate new, more advanced compression scheme. Ideally, with decompression speed comparable to LZ4. Compression may be two stage: first, when block is inserted - use fast/regular compression bq thread will be running and re-compressing blocks Large block cache (10s-100sGB )can have hot-warm-cold zones. Each zone can have different compression schemes. Another additional option is to try columnar representation of blocks in memory.