sbtourist / Journal.IO

Journal.IO is a zero-dependency, fast and easy-to-use journal storage implementation.
Apache License 2.0
260 stars 39 forks source link

Make compaction multi-threaded #42

Open sbtourist opened 11 years ago

sbtourist commented 11 years ago

Currently, compaction goes over all data files and compacts them one-by-one on a single thread: given each data file is immutable and independent from each other, multiple threads could compact multiple data files at the same time, which would make the whole compaction process faster (even if IO would still be a bottleneck, so some performance numbers should be taken too).