search

graphite-project / carbon

Carbon is one of the components of Graphite, and is responsible for receiving metrics over the network and writing them down to disk using a storage backend.
http://graphite.readthedocs.org/
Apache License 2.0
1.5k stars 490 forks source link

Reduce disk I/O while doing aggregation #860

Closed LatinSuD closed 4 years ago

LatinSuD commented 5 years ago

Hi. We have graphite 0.9.15 and are getting like 30k metrics/s, which is generating a disk I/O of a bout 10MB/s. It is not too much but we'd like to reduce the disk load.

We first tried to reduce this value to this: MAX_UPDATES_PER_SECOND = 20

It effectively reduced disk I/O to 1MB/s. But it had a problem, that data aggregation gets delayed for hours on some metrics.

I am not sure what to do now. Should I try and play with write strategies?

Is there a way that metrics get aggregated when they are queried? It is queries what matter to us after all.

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.