banzaicloud / banzai-charts

Curated list of Banzai Cloud Helm charts used by the Pipeline Platform
Apache License 2.0
367 stars 278 forks source link

add sharding support for thanos compactor #1316

Open sockmister opened 2 years ago

sockmister commented 2 years ago
Q A
Bug fix? no
New feature? yes
API breaks? no
Deprecations? no
Related tickets no
License Apache 2.0

What's in this PR?

This add sharding support for the Thanos compactor. The implementation is mostly based on the existing sharding support for the store component, with the difference that this allows users to specify label, which is important when sharding compactors.

Why?

Big thanos deployments with huge number of blocks will not be able to keep up with the compaction, and sharding it is the only solution.

Additional context

Checklist