grafana / oncall

Developer-friendly incident response with brilliant Slack integration
GNU Affero General Public License v3.0
3.46k stars 279 forks source link

Notify everyone "awake" #2960

Open simonc6372 opened 1 year ago

simonc6372 commented 1 year ago

What would you like to see!

We want to be able to notify everyone who could be considered as "awake" about an alert, before alerting the specific individual who is on call.

We're trying to arrange weekend coverage with the goal of it being minimally disruptive to the person on call. Due to team sizes we want one person covering the entirety of the weekend, but without waking them up unless we really need to. Frequently many of our team may be around at weekends, and perfectly happy to look at an incoming Alert and triaging it. If nobody is around then escalation chain would then escalate to the on-call person.

One (and possibly the most user friendly) way of this working would be to introduce the concept of a "low" importance notification, that could be treated differently in the mobile app. Users would set specific "ignore low importance notifications" schedules in the Mobile app.

Another way may be to create teams for each geo (i.e. an emea-foo and americas-foo team for squad foo), and attach notification policies to the team, (so they can change with time), but this may be more difficult to configure in the UI in more fine grained "follow the sun" models.

Another way could be to create the concept of "notification channels" where users subscribe to notifications in a time based way either from the mobile app, or the webapp UI, or via API calls. The mobile app could be further enhanced to add geo-location to subscription to notification channels. i.e something like "between the hours of 9am and 9pm, and if I am at "home" subscribe me to this notification channel. Unsubscribe be when I leave home"

Product Area

Mobile App, Schedules

Anything else to add?

the following feature requests are related to this area. https://github.com/grafana/oncall/issues/2700 https://github.com/grafana/oncall/issues/795

github-actions[bot] commented 1 year ago

The current version of Grafana OnCall, at the time this issue was opened, is v1.3.31. If your issue pertains to an older version of Grafana OnCall, please be sure to list it in the PR description. Thank you :smile:!