silverstripe / addons.silverstripe.org

Website hosting Silverstripe Framework extensions
BSD 3-Clause "New" or "Revised" License
13 stars 16 forks source link

Investigate RDS utilisation #252

Closed dnsl48 closed 4 years ago

dnsl48 commented 4 years ago

We've just hit the limit on space in RDS. As a remediation we increased the server size, but we need to investigate what takes up all the space and optimise.

P.S. as an example, it can be queuedjobDescriptor table

robbieaverill commented 4 years ago

It's highly likely to be related to the job queue processing addons every day. This spawns thousands of queued jobs which run regularly. We have run out of disk space on the server before (from cloning addon repositories to analyse them) but the DB is a new one... good luck.

chillu commented 4 years ago

I've nuked the QueuedJobDescriptor, it had 1m+ rows. Ideally we'd set up https://github.com/symbiote/silverstripe-queuedjobs#configuring-the-cleanupjob, but closing the "investigation" part here