grafana / loki

Like Prometheus, but for logs.
https://grafana.com/loki
GNU Affero General Public License v3.0
24k stars 3.46k forks source link

Loki-logs hang indefinitely when removing release #11985

Open thoefkens opened 9 months ago

thoefkens commented 9 months ago

Describe the bug I deploy loki via the official loki helm chart into our monitoring namespace. (using terraform provider with resource helm_release) When destroying the helm release, 2 pods called loki-logs remain active (in state Terminating) and prevent the destruction of the namespace.

In the container "config-reloader" I can only see level=info ts=2024-02-19T10:58:46.178981198Z caller=main.go:176 msg="Received SIGTERM, exiting gracefully..."

To Reproduce Deploy loki via hełm and try to deinstall the release. Loki-logs containers remain in "terminating" indefinitely.

Expected behavior I except the pods to disappear within minutes.

Environment: K8S on OVH.

kwinkel commented 9 months ago

See: https://github.com/grafana/loki/issues/9523