getsentry / sentry

Developer-first error tracking and performance monitoring
https://sentry.io
Other
39.09k stars 4.2k forks source link

Metrics alert limitation #71424

Open OmerCohenAviv opened 5 months ago

OmerCohenAviv commented 5 months ago

Problem Statement

As per the documentation (https://docs.sentry.io/product/alerts/alert-types/#metric-alerts) Metric alerts are limited to 1000 per organization, as our system requires a more fine tuned monitoring per client (b2c) and as https://github.com/getsentry/sentry/issues/71239#issuecomment-2125605414, we require a lot more monitoring alerts. Our system uses micro frontend, so each team needs to have alerts per client which increases the number of alerts exponentially.

Is there a reason why sentry limits to 1000.

Solution Brainstorm

Increasing the limit beyond 1000.

Product Area

Alerts

getsantry[bot] commented 5 months ago

Assigning to @getsentry/support for routing ⏲️

getsantry[bot] commented 5 months ago

Routing to @getsentry/product-owners-alerts for triage ⏲️

leedongwei commented 5 months ago

@OmerCohenAviv It's capped to 1000 per organization due to the cost of maintaining an alert. For each alert, we have to poll the OLAP DB even if you're not looking at it, so offering unlimited alerts will get expensive for us really quickly. It's fairly rare for organizations to hit that limit.

Can you send an email to support@sentry.io with your organization slug? We can help to figure out a path forward for your use-case.

OmerCohenAviv commented 5 months ago

Hey @leedongwei

Thanks for your response. I understand that offering unlimited alerts for free could lead to issues. However, since different organizations vary in size and use-case, the limit of 1000 alerts seems somewhat arbitrary. If it's possible to offer additional alerts beyond 1000 at a reasonable price, it could be beneficial for everyone.

rachrwang commented 5 months ago

@OmerCohenAviv - while we don't offer this now, I'd be happy to chat with you to learn more about your needs and get feedback on your Sentry experience. If you'd like to chat, you can book directly with me here: https://calendar.app.google/cmeMy6hVqHAvT4WR9