sagemathinc / cocalc

CoCalc: Collaborative Calculation in the Cloud
https://CoCalc.com
Other
1.17k stars 216 forks source link

add a low disk warning to compute servers #7392

Open williamstein opened 7 months ago

williamstein commented 7 months ago

There is only so much that can be done, but at least make it clear when the disk on a compute server is running low on space, and make it clear how to easily fix the situation.

novoselt commented 7 months ago

One potential solution is to add another gauge bar to CPU and RAM (preferably stack them together). Another is a visible indicator on the server status page.

And for integrations that support live resizing - perhaps have an option in server configuration to automatically grow disk size? Parameters: minimum size left, amount of increment, limit on the size.

williamstein commented 7 months ago

Some comments:

You're implicitly referring to Jupyter, which is a good point, since I wasn't thinking of Jupyter at all for this. It could be instead in the current colored status bar (next to sync).

Always dangerous, but certainly possible. This is one of those things that seems like a good idea, but for some reason no cloud platform I investigated does it, as far as I can tell.

Note that in the one case that motivated me to create this issue, none of this would have helped at all, since somehow the root filesystem needed fsck (i.e., manual maintenance)...

novoselt commented 7 months ago

Ha, I've actually never realized that those gauges are Jupyter specific! I think they should not be - maybe I am working with some other document including LaTeX or Markdown where there is embedded computation, or in a terminal I can do anything and CPU/RAM behaviour is nice to be aware off. Yet another reason to move it to the general menu bar instead of the kernel status one.