elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.61k stars 8.22k forks source link

Create "Quiet Times" for Alerting Rules #153245

Open MakoWish opened 1 year ago

MakoWish commented 1 year ago

Describe the feature: Create "quiet times" for Rule alerting

Describe a specific use case for the feature: We are being asked by some of our internal teams to set "quiet times" for alerts to be sent from some of our metrics and uptime monitoring rules. The full use case is that they want to have SLA's for different groups of servers. For a "bronze" tier server, they only want to receive alerts between 08:00-17:00 M-F. For "silver" tier servers, they want alerts any time M-F. For "gold" tier servers they want alerts to send any time 24/7. Creating different rules for the identified tiers is simple enough, but I cannot find a way to restrict the alerting times. It would be nice to be able to set these "quiet times" from within the rules.

Eric

elasticmachine commented 1 year ago

Pinging @elastic/response-ops (Team:ResponseOps)

XavierM commented 1 year ago

@shanisagiv1, I think we should talk about this feature internally because we never thought about creating quiet time but most likely if an alert is detected during the weekend then we will use PagerDuty connector. Or if an alert is detected during my work hours, I would like to receive an email. I think this enhancement is a little bit different that the way we are thinking about it, it might be useful to get other inputs from different customers to see if they have the same kind of workflow.

shanisagiv1 commented 1 year ago

it seems like this "quiet time" request can be achieved by our maintenance window, so the user will be able to define a window that covers the Bronze tier for the time restriction (the schedule will be the opposite of "alerts between 08:00-17:00 M-F" AND the query should be the same as the rule query) Does it make sense?

MakoWish commented 1 year ago

it seems like this "quiet time" request can be achieved by our maintenance window

Where would I find that?

shanisagiv1 commented 1 year ago

The first release is planned for 8.8. so it will be available soon