srotya / sidewinder

Fast and scalable timeseries database
http://sidewinder.srotya.com
Apache License 2.0
25 stars 10 forks source link

Improve compaction #132

Open ambud opened 6 years ago

ambud commented 6 years ago

Compaction right now is a bit sensitive to running large number of buffer re-writes. Compaction's goal is to reduce the data size and reduce writer list sizes that saves heap and allows deletion of older files.

Enhancement would allow Sidewinder to reduce heap utilization while preventing dangling old data files that still require memory mapping.

pauljv92 commented 6 years ago

while autocorrelation w GPU takes it own sweet time, Im down to look at this! :) pls help to point me to the code I should be looking at