winglang / wing

A programming language for the cloud ☁️ A unified programming model, combining infrastructure and runtime code into one language ⚡
https://winglang.io
Other
4.94k stars 194 forks source link

(Ops) Monitoring auto-resolve causes false alarm for maintainer #3186

Closed Chriscbr closed 10 months ago

Chriscbr commented 1 year ago

Sometimes, a monitoring incident on BetterUptime getting auto-resolved results in a new PagerDuty incident getting created, resulting in a maintainer getting paged.

Example: https://uptime.betterstack.com/team/48207/incidents/416200671 (screenshot from BetterUptime)

Screenshot 2023-06-30 at 2 26 03 PM
staycoolcall911 commented 1 year ago

Thanks for reporting - we have plans to switch from BetterUptime to Sentry, so marking this as p3 for now

github-actions[bot] commented 1 year ago

Hi,

This issue hasn't seen activity in 60 days. Therefore, we are marking this issue as stale for now. It will be closed after 7 days. Feel free to re-open this issue when there's an update or relevant information to be added. Thanks!

github-actions[bot] commented 10 months ago

Hi,

This issue hasn't seen activity in 60 days. Therefore, we are marking this issue as stale for now. It will be closed after 7 days. Feel free to re-open this issue when there's an update or relevant information to be added. Thanks!

staycoolcall911 commented 10 months ago

@Chriscbr did you see that lately? I'm not sure if we should keep it

Chriscbr commented 10 months ago

I haven't ran into it lately, but I've been avoiding the problem by waiting a few hours before resolving incidents on PagerDuty

staycoolcall911 commented 10 months ago

Closing for now