getsentry / sentry

Developer-first error tracking and performance monitoring
https://sentry.io
Other
38.62k stars 4.13k forks source link

Unexpected Failure Rate Alert Trigger #76295

Open kpujjigit opened 1 month ago

kpujjigit commented 1 month ago

Environment

SaaS (https://sentry.io/)

What are you trying to accomplish?

An alert to check if Failure Rate exceeds 5% across a 2 hour interval. 5% denotes a warning state, and 7% denotes a critical state.

How are you getting stuck?

Alerts are firing when not supposed to. From the metric, we only see failure rate 3.77%, it is under 5%.

Image

Where in the product are you?

Alerts

Link

No response

DSN

No response

Version

No response

getsantry[bot] commented 1 month ago

Auto-routing to @getsentry/product-owners-alerts for triage ⏲️

rachrwang commented 1 month ago

@kpujjigit - thanks for filing! Is there a jira issue or place where we can get a link to the alert rule itself (realize that that's sensitive information and should not be captured here)

kpujjigit commented 1 week ago

Hi all, client has been waiting for insight on this for over a month; any progress/update?

mifu67 commented 1 week ago

Hi @kpujjigit, do you have the Jira ticket where we can access this alert rule?

kpujjigit commented 4 days ago

@mifu67 Here ya go: https://getsentry.atlassian.net/browse/FEEDBACK-2296

ceorourke commented 4 days ago

I'm looking into this, I might add some logging to figure out what's going on.