tikv / raft-engine

A persistent storage engine for Multi-Raft log
Apache License 2.0
565 stars 88 forks source link

Recycle log files #214

Closed tabokie closed 2 years ago

tabokie commented 2 years ago

File allocation incurs big overhead, as #100 showed. We could reduce that overhead by reusing old log files. But directly recycling is not secure, because old log items could resurface under certain condition. One way to overcome this is to consider file id when calculating checksum for each log batch.

LykxSassinator commented 2 years ago

I'll try to handle it. To be continued.

LykxSassinator commented 2 years ago

As the related issues, #224 and #249 , both are merged, can we close this issue now?

tabokie commented 2 years ago

Will be released in v0.3.0 (TiKV v6.3).