search

prymitive / karma

Alert dashboard for Prometheus Alertmanager
https://demo.karma-dashboard.io/
Apache License 2.0
2.32k stars 175 forks source link

Trigger action at silence or vice versa #3065

Closed kubicgruenfeld closed 3 years ago

kubicgruenfeld commented 3 years ago

Hi,

we are currently using Icinga2 for monitoring and we have implemented to be able to acknowledge alerts in icingaweb2. At acknowledgement there is a ticket created in a ticket system to be able to work on it.

Now we are trying to implement something similar with Alertmanager and I wonder if karma already can be configured similar.

My idea was to use an annotation and the feature implemented in #2860 to be able to create a ticket within the dropdown action. But then you still would need to create a silence (with the ticket id) and i wonder if this can be done by a single click somehow?

prymitive commented 3 years ago

I don't think there's a way. If you want alerts to create tickets then you might want to look at something like https://github.com/prometheus-community/jiralert, or write a custom webhook receiver.

kubicgruenfeld commented 3 years ago

Thanks for the reply. Sure, we could configure a webhook in alertmanager or just use mail to create tickets. But we only want tickets for acknowledged alerts. That's something you can normally configure in services like opsgenie, but since we can't use us-based external services for this I have a hard time to find an open-source solution. Wouldn't it be feasible to trigger a link from an annotation at acknowledging?

prymitive commented 3 years ago

What do you mean by trigger a link? How does that give you a silence (with the ticket id)? Wouldn't that require having some integration with a ticketing system?

kubicgruenfeld commented 3 years ago

You're right, it would not. But you could at least create ticket and silence with a single click.

prymitive commented 3 years ago

I'm not really interested in maintaining integrations with 3rd party systems other than Alertmanager and Prometheus.

kubicgruenfeld commented 3 years ago

Understandable. But the way I was proposing would be quite general, since users can configure their own action at acknowledgment with links in annotations.

prymitive commented 3 years ago

I think you need to explain it a bit more for me to understand.

EpiqSty commented 3 years ago

We have a similar case between karma and OpsGenie, basically in case of alerts - both systems needs to be Ack'ed/Silenced and such feature could save some time in case if integration is possible.

github-actions[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.