thaum-xyz / ankhmorpork

@paulfantom's GitOps managed kube cluster running in a cupboard. Built with fancy tools :sparkles:
https://ankhmorpork.thaum.xyz
MIT License
77 stars 10 forks source link

Alert: ThanosStoreObjstoreOperationLatencyHigh in datalake-metrics #159

Open paulfantom opened 1 year ago

paulfantom commented 1 year ago

Alert ThanosStoreObjstoreOperationLatencyHigh firing in datalake-metrics namespace

This is an automated issue created by the monitoring system. Please do not edit this message.

Alertmanager URL: https://alertmanager.ankhmorpork.thaum.xyz

Issue was last updated at 2024-11-06 08:30:59.881405293 +0000 UTC m=+535.259719225.

Common Labels

alertname ThanosStoreObjstoreOperationLatencyHigh
cluster ankhmorpork
job thanos-store
namespace datalake-metrics
prometheus monitoring/k8s
severity warning

Common Annotations

description Thanos Store thanos-store Bucket has a 99th percentile latency of 120 seconds for the bucket operations.
runbook_url https://github.com/thanos-io/thanos/tree/main/mixin/runbook.md#alert-name-thanosstoreobjstoreoperationlatencyhigh
summary Thanos Store is having high latency for bucket operations.

Alerts

StartsAt Links
2024-11-06 08:20:29.197 +0000 UTC GeneratorURL
paulfantom commented 1 year ago

Fixed with #201