fjall-rs / lsm-tree

K.I.S.S. LSM-tree implementation in safe Rust
https://fjall-rs.github.io/
Apache License 2.0
80 stars 5 forks source link

(Levelled-N) Optimize reading partially disjoint levels #32

Open marvin-j97 opened 5 months ago

marvin-j97 commented 5 months ago

Per sorted run in level: create segment multi reader, or even over multiple levels if levels are disjoint to each other -> if L0 is not disjoint, but L1+ is, it should not disqualify the optimization of grouping everything (L1+) into a single reader

!!! This is a blocker for L0 parallel Leveled compaction https://github.com/fjall-rs/lsm-tree/issues/48