search

coollabsio / coolify

An open-source & self-hostable Heroku / Netlify / Vercel alternative.
https://coolify.io
Apache License 2.0
34.5k stars 1.88k forks source link

[Bug]: Automated cleanup not running with multiple servers #3241

Open ck-euan opened 2 months ago

ck-euan commented 2 months ago

Description

I have an automated cleanup threshold of 80% set on all my servers but not all of them run cleanup jobs. The Coolify and Build servers run cleanups fine but not my apps server.

As you can see the storage on my apps server has been slowly creeping up for weeks and today it finally hit max capacity.

image

Hover, I just ticked the Force Cleanup Docker Engine option and it freed up around 75% storage.

Minimal Reproduction (if possible, example repository)

N/A

Exception or Error

No response

Version

v4.0.0-beta.323

Cloud?

danielqba commented 2 months ago

Maybe related to this warning about metrics being disabled.

Screenshot_20240831_164943_Edge.jpg

peaklabs-dev commented 1 month ago

What operating system are you using?

ck-euan commented 1 month ago

I'm using Ubuntu, although this seems to be much better recently storage is getting cleaned up regularly. Not entirely sure but it may have been fixed?

image
peaklabs-dev commented 1 month ago

The fix was to enable force clenup via an update so now it basically always runs once a day not based on disk usage. I will investigate our methode of checking disk usage and improve it if needed.