m3db / m3

M3 monorepo - Distributed TSDB, Aggregator and Query Engine, Prometheus Sidecar, Graphite Compatible, Metrics Platform
https://m3db.io/
Apache License 2.0
4.75k stars 453 forks source link

Unable to find the resource limit for m3coordinator #2660

Open nagashreeharve opened 4 years ago

nagashreeharve commented 4 years ago

To reach 1M value of "rate(prometheus_remote_storage_sent_bytes_total[1m])" , what is a "LEAST" CPU/Memory resource limit required for m3coordinator so that its stable ?

When we are applying CPU max resource limit of 500M and memory max resource limit of 2000MI, "rate(prometheus_remote_storage_sent_bytes_total[1m])" is reaching 200K.

image

image

How to increase the m3db writes to disk ?

gibbscullen commented 4 years ago

Hi @nagashreeharve have you tried running more instances to increase writes? And you're trying to get your current limits down?