search

go-graphite / carbonmem

in-memory carbon-like store
BSD 2-Clause "Simplified" License
28 stars 3 forks source link

Add minutely aggregation periods #3

Closed dgryski closed 9 years ago

dgryski commented 9 years ago

Allow rollup periods to reduce memory usage.

In addition to memory reduction, the minutely data can also be used for TopK queries, reducing work by ~60x.

dgryski commented 9 years ago

Fixed in https://github.com/dgryski/carbonmem/commit/a243eabb3ebf6220eeba812c5778339cdc1a4294 . Speedup wasn't quite 60x as each minute now contains more metrics to scan through. However, sharded metric spaces (issue #2 ) and this both combined to speed up queries nicely.