Current the reaper opens a new iterator per table per shard every time it is invoked, this requires a seek which is a potentially expensive operation in an LSM esp. when there is a lot of data. We should consider keeping the pebble iterators open between invocations of the reaper to reduce the number of seeks.
Current the reaper opens a new iterator per table per shard every time it is invoked, this requires a seek which is a potentially expensive operation in an LSM esp. when there is a lot of data. We should consider keeping the pebble iterators open between invocations of the reaper to reduce the number of seeks.