getsentry / relay

Sentry event forwarding and ingestion service.
https://docs.sentry.io/product/relay/
Other
313 stars 85 forks source link

[statsd] Relay's statsd take up 20% CPU #1763

Open jernejstrasner opened 1 year ago

jernejstrasner commented 1 year ago

Something in the way that we emit metrics is inefficient and fishy. I suspect we don't aggregate any metrics in-process, and as a result spend way too much CPU on emitting metrics.

Anton Ovchinnikov claimed 20% CPU increase by turning on metrics collection. More CPU usage than normal in both Relay and the statsd collector.

We also likely drop metrics as a result of that.

iker-barriocanal commented 1 year ago

What do we want to do with this? I think the best course of action at this point in time is to not emit many metrics, see investigation doc.

jernejstrasner commented 1 year ago

@jan-auer what's your take since this is metrics related?