search

Rungutan / sentry-fargate-cf-stack

AWS CloudFormation template to launch a highly-available Sentry 20 stack through ECS Fargate at the minimum cost possible
Apache License 2.0
60 stars 16 forks source link

RFE: use autoscaling for workers #14

Closed nodomain closed 3 years ago

nodomain commented 3 years ago

After some debugging my issue with Sentry being stuck processing events from a high traffic site where we use it for CSP reports and scaling Kafka, RDS and Redis during the process I found that the single worker was using 100% CPU. The template is not using autoscaling currently. What is the reason for this? I propose the same scaling rules like for all other tasks. I am happy to send a pull request if you agree. In my scenario I now temporarily scaled to 50 workers to let the queue be processed.

mariusmitrofan commented 3 years ago

The workers were not scaling or the actual cron ?

The cron itself doesn't have scaling as there was a problem in the past for running more than one cron.

Might not be an issue now though, so I'll just add it

mariusmitrofan commented 3 years ago

Oh, no, you're right. The actual workers don't have scaling. Seems I just missed that. Sorry. Adding it now.

mariusmitrofan commented 3 years ago

Released under 1.7.0