Since Team Turtles team is too small to do a regular team business hours on-call on our own, we would like to try occasional on-demand full-week business hours on-call shifts in order to improve overall operations/on-call experience.
Rough idea:
Once in X weeks/months, Turtles on-call engineer does a full week of business hours on-call (4 or 5 days, not sure because of P32).
All alerts for all components owned by Team Turtles are routed to Team Turtles business hours on-call.
During this week Turtles on-call engineer does not do Phoenix business hours on-call.
During this week alerts for Team Turtles' components are not routed to Phoenix business hours on-call.
Scheduling and switches would be done manually, without making changes to on-call scheduler.
[ ] Check if we can quickly make on-demand switches between Phoenix and Turtles BH on-calls (e.g. have everything pre-configured and do a switch in a single PR, or via OpsGenie interface, etc)
[ ] If the above is possible, use all the info from this issue to create a new issue to implement on-demand Team Turtles full-week business hours on-call.
Outcome
For Turtles
Team Turtles knows if it is possible to do on-demand full-week business hours on-call.
nprokopic
commented
1 year ago
Motivation
Since Team Turtles team is too small to do a regular team business hours on-call on our own, we would like to try occasional on-demand full-week business hours on-call shifts in order to improve overall operations/on-call experience.
Rough idea:
This issue is also related to https://github.com/giantswarm/roadmap/issues/2728, as we might need additional alert labels in order to implement on-demand quick switches of business hours on-call.
TODO
Outcome
For Turtles