add rule for critical distributor inflight push request alert

grafana / cortex-jsonnet

Deprecated: see https://github.com/grafana/mimir/tree/main/operations/mimir instead

Apache License 2.0

74 stars 53 forks source link

add rule for critical distributor inflight push request alert #408

Closed treid314 closed 2 years ago

treid314 commented 2 years ago

What this PR does: This PR adds a critical alert for cortex_distributor_inflight_push_requests reaching a 90% of the set max_inflight_push_requests limits.

Checklist

[x] CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]
[x] Runbook changes