search

suxess-it / kubriX

https://kubrix.io
18 stars 3 forks source link

[monitoring] monitoring the monitoring stack #353

Open jkleinlercher opened 3 months ago

jkleinlercher commented 3 months ago

https://grafana.com/docs/loki/latest/setup/install/helm/monitor-and-alert/with-local-monitoring/

be aware that multiple grafanaAgentOperator are conflicting each other (Mimir metamonitoring and Loki selfmonitoring)

jkleinlercher commented 3 months ago

with https://github.com/suxess-it/sx-cnp-oss/pull/378 we already enalbed mimir metamonitoring dashboards. and with https://github.com/suxess-it/sx-cnp-oss/commit/1d78269688f70ab37b291c779d8074ede73d8f8f we disabled GrafanaAgentOperator in mimir because we already have a GrafanaAgentOperator in loki. see https://github.com/suxess-it/sx-cnp-oss/issues/348

jkleinlercher commented 3 months ago

Because of https://github.com/suxess-it/sx-cnp-oss/issues/380 I came across https://github.com/suxess-it/sx-cnp-oss/issues/353#issue-2438422881 and https://github.com/grafana/meta-monitoring-chart and since monitoring loki got changed with https://github.com/grafana/loki/pull/13205 we should undo some configuration in https://github.com/suxess-it/sx-cnp-oss/blob/main/platform-apps/charts/kube-prometheus-stack/values-uibklab.yaml

maybe this reduces the cardenality? At least it makes configuration easier