search

inCaller / prometheus_bot

Telegram bot for prometheus alerting
MIT License
397 stars 183 forks source link

Mix of firing and resolved alerts is displayed incorrectly #45

Open laurvas opened 5 years ago

laurvas commented 5 years ago

I'm migrating all alerts from Slack to Telegram right now. My testing shows wrong output from prometheus_bot.

Slack: 2019-07-01-175238_1916x1016_scrot

Telegram: 2019-07-01-175733_1916x1616_scrot

How to reproduce. The easiest way to trigger an alert is to turn off an exporter (node exporter in my case).

  1. turn off some exporters.
  2. wait for an alert to come.
  3. turn on those exporters and turn off some other at the same time.
  4. wait for a wrong alert.

Expected behavior. Firing and resolved alerts are not mixed together. I don't see the way to achieve it with custom templates.

My environment. All running in docker:

slack alerts are configured using these custom templates.

hryamzik commented 5 years ago

Contributions are welcomed.