Open yk-zheng-zz opened 1 year ago
was this working before on v1.14.1 ? or is this the first time you try it?
it worked fine on v1.11.0 I didn't try this on other versions before v1.14.1
Hi @friedrichg, I am working with @yk-zheng-zz.
For more context, we were able to resolve the issue by adding in this to the alertmanager config. (seen in this issue https://github.com/cortexproject/cortex-helm-chart/issues/463)
configs:
alertmanager:
data_dir: /data
Describe the bug we configured alertmanager with a template and updated templates and configuration of alertmanager by api we uploaded successfully and I can find the template files in container but they are removed and recreated about every 15 seconds and it caused an error "template not defined"
[alertmanager-1] level=error ts=2023-07-18T06:43:14.625788498Z caller=dispatch.go:352 component=MultiTenantAlertmanager user=test component=dispatcher component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="alert-warning/slack[0]: notify retry canceled due to unrecoverable error after 1 attempts: template: :1:12: executing \"\" at <{{template \"slack.test.title\" .}}>: template \"slack.test.title\" not defined"
To Reproduce Steps to reproduce the behavior:
Expected behavior template file should keep persisting in container
Environment:
Additional Context
configuration related to alertmanager in cortex.yaml