grafana / pyroscope

Continuous Profiling Platform. Debug performance issues down to a single line of code
https://grafana.com/oss/pyroscope/
GNU Affero General Public License v3.0
10.14k stars 614 forks source link

Compactor traffic shaping #3592

Open kolesnikovae opened 2 months ago

kolesnikovae commented 2 months ago

Due to the way merge-split compaction works, each compactor instance can put significant pressure on the network, especially if the number of compaction shards is high. To mitigate this, we should implement traffic shaping. We already have an option to limit the concurrency (compactor.block-sync-concurrency, which is set to 8 by default), but this isn't helpful – regardless of the number of concurrent threads, 100% of the network is utilized