runt1me / stormcloud

the best backup system
2 stars 0 forks source link

Server out-of-memory errors crashing apache #46

Closed runt1me closed 8 months ago

runt1me commented 1 year ago

It looks like out-of-memory errors on www2 are causing apache to crash and the service doesn't restart. Perhaps we will need to adjust the server code to make it more memory efficient, but we will probably also want to upgrade our server's resources before we go to production.

Stack trace from dmesg | egrep -vi "iptables dropped" | tail -50:

[3568377.240725] [ 725842] 0 725842 5145 1413 81920 0 0 apache2 [3568377.240730] [ 727302] 0 727302 184094 4389 249856 0 -900 snapd [3568377.240732] [ 796512] 33 796512 409974 320294 2699264 0 0 apache2 [3568377.240735] [ 796513] 33 796513 6369 2145 94208 0 0 apache2 [3568377.240737] [ 796514] 33 796514 6371 2231 94208 0 0 apache2 [3568377.240739] [ 796515] 33 796515 6409 2279 94208 0 0 apache2 [3568377.240741] [ 796516] 33 796516 6371 2218 94208 0 0 apache2 [3568377.240743] [ 796517] 33 796517 6373 2225 94208 0 0 apache2 [3568377.240745] [ 797040] 33 797040 6372 2235 94208 0 0 apache2 [3568377.240751] [ 797327] 0 797327 4321 1346 73728 0 0 sshd [3568377.240753] [ 797330] 0 797330 4291 1095 73728 0 0 systemd [3568377.240755] [ 797332] 0 797332 42701 1296 102400 0 0 (sd-pam) [3568377.240757] [ 797395] 0 797395 2298 1062 61440 0 0 bash [3568377.240759] [ 797505] 33 797505 6379 2270 94208 0 0 apache2 [3568377.240761] [ 797506] 33 797506 6372 2227 94208 0 0 apache2 [3568377.240763] [ 797507] 33 797507 6377 2172 94208 0 0 apache2 [3568377.240765] [ 797508] 33 797508 6394 2245 94208 0 0 apache2 [3568377.240767] [ 797549] 0 797549 3857 1067 65536 0 0 sshd [3568377.240777] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=apache2.service,mems_allowed=0,global_oom,task_memcg=/system.slice/apache2.service,task=apache2,pid=796512,uid=33 [3568377.240856] Out of memory: Killed process 796512 (apache2) total-vm:1639896kB, anon-rss:1278672kB, file-rss:2504kB, shmem-rss:0kB, UID:33 pgtables:2636kB oom_score_adj:0

EccentricKnight commented 10 months ago

@runt1me Is this one resolved now?

runt1me commented 8 months ago

Closing as complete.