search

getsentry / self-hosted

Sentry, feature-complete and packaged up for low-volume deployments and proofs-of-concept
https://develop.sentry.dev/self-hosted/
Other
7.75k stars 1.75k forks source link

No/low disk space warning. #3008

Open barisyild opened 4 months ago

barisyild commented 4 months ago

Problem Statement

When disk space becomes full or low, sentry starts to experience various problems, for example "envelope buffer capacity exceeded" occurs because sentry cannot process new issues.

Solution Brainstorm

A warning can be added where we can see the disk space or indicate that disk space is running low/full.

Product Area

Other

getsantry[bot] commented 4 months ago

Assigning to @getsentry/support for routing ⏲️

getsantry[bot] commented 4 months ago

Routing to @getsentry/product-owners-issues for triage ⏲️

roggenkemper commented 4 months ago

hi! thanks for writing a ticket about this. just to double check - is this about your self-hosted sentry instance?

barisyild commented 4 months ago

hi! thanks for writing a ticket about this. just to double check - is this about your self-hosted sentry instance?

Yes, and sentry stops error handling when disk space gets low, obviously there is a risk if disk space gets below a certain size and a warning system would be nice.

hubertdeng123 commented 4 months ago

It is unlikely we'll implement this feature, but something that may be helpful for you to do is set up some sort of cron monitor to ensure your disk space doesn't get too low. Or, you could set up some sort of external integration that can check the disk space on your cloud instance if you're using GCP or AWS.

brunis commented 4 months ago

You could also change the minimum requirements to the current recommended requirements.. and then double all the numbers in the Recommended.. for every release the demands keep going up .. I have a VM with recommended specs, I had to add 20GB of swap to avoid sentry crashing my VM on startup.. It seems bizarre my logging application (sentry) needs 2-3x the hardware of the application logging to it..

barisyild commented 4 months ago

It is unlikely we'll implement this feature, but something that may be helpful for you to do is set up some sort of cron monitor to ensure your disk space doesn't get too low. Or, you could set up some sort of external integration that can check the disk space on your cloud instance if you're using GCP or AWS.

Why can't implement this feature, after all the vm knows how many gb of free space is available, can't it alert the system when it is below a certain amount?

hubertdeng123 commented 4 months ago

Yes, we could implement this feature. However, it is not a priority at the moment. You could simply write a cronjob to check disk space on your VM and trigger an alert that way.