Reduce memory footprint - Githubissues

tikv / raft-engine

A persistent storage engine for Multi-Raft log

Apache License 2.0

565 stars 88 forks source link

Reduce memory footprint #205

Closed tabokie closed 2 years ago

tabokie commented 2 years ago

Memtables can take up a lot of memory when log entries are not compacted in time.

[x] Add memory tracing
[ ] Reuse file block handle for entry indexes inside the same log batch.
[x] Change entry offset and entry length to u32
[x] Store entry offset in file instead of in memory
[x] Implement a mmap-based allocator for memtable