david-allison / manx-corpus-search

MIT License
3 stars 1 forks source link

Investigate SIGKILL #60

Closed david-allison closed 1 year ago

david-allison commented 3 years ago
Jul 07 14:05:59 ubuntu-s-1vcpu-1gb-lon1-01 systemd[1]: manx-corpus.service: Main process exited, code=killed, status=9/KILL
Jul 07 14:05:59 ubuntu-s-1vcpu-1gb-lon1-01 systemd[1]: manx-corpus.service: Failed with result 'signal'.
Jul 07 14:06:09 ubuntu-s-1vcpu-1gb-lon1-01 systemd[1]: manx-corpus.service: Scheduled restart job, restart counter is at 1.
Jul 07 14:06:09 ubuntu-s-1vcpu-1gb-lon1-01 systemd[1]: Stopped Manx Corpus Search.
Jul 07 14:06:09 ubuntu-s-1vcpu-1gb-lon1-01 systemd[1]: Started Manx Corpus Search.
david-allison commented 3 years ago

OOM

[13419782.376576] Tasks state (memory values in pages):
[13419782.376576] [  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
[13419782.376580] [    328]     0   328    19106      990   126976        0          -250 systemd-journal
[13419782.376582] [    424]     0   424    70047     4495    86016        0         -1000 multipathd
[13419782.376584] [    446]   102   446    22599      967    81920        0             0 systemd-timesyn
[13419782.376586] [    491]   100   491     4670      874    77824        0             0 systemd-network
[13419782.376587] [    494]   101   494     6046     1570    90112        0             0 systemd-resolve
[13419782.376589] [    542]     0   542     4746      893    57344        0         -1000 systemd-udevd
[13419782.376590] [    658]     0   658     2134      505    53248        0             0 cron
[13419782.376592] [    659]   103   659     1949      922    49152        0          -900 dbus-daemon
[13419782.376593] [    668]     0   668     7314     2762    94208        0             0 networkd-dispat
[13419782.376594] [    671]   104   671    56083      584    86016        0             0 rsyslogd
[13419782.376596] [    673]     0   673     4252      729    65536        0             0 systemd-logind
[13419782.376598] [    675]     0   675      948      469    45056        0             0 atd
[13419782.376599] [    720]     0   720     1838      451    53248        0             0 agetty
[13419782.376600] [    731]     0   731     1457      373    45056        0             0 agetty
[13419782.376602] [    736]     0   736    27019     2747   110592        0             0 unattended-upgr
[13419782.376603] [   1919]     0  1919      622      146    40960        0             0 none
[13419782.376605] [  37850]     0 37850    60349      482   106496        0             0 accounts-daemon
[13419782.376606] [ 224012]     0 224012     3042      851    57344        0         -1000 sshd
[13419782.376608] [ 624431]   997 624431   253525     1729   167936        0          -900 do-agent
[13419782.376610] [ 866769]     0 866769    58177      234    90112        0             0 polkitd
[13419782.376612] [1043292]     0 1043292   160011     4416   225280        0          -900 snapd
[13419782.376613] [1072809]     0 1072809    16379      554    98304        0             0 nginx
[13419782.376614] [1072810]    33 1072810    16764     1126   114688        0             0 nginx
[13419782.376616] [1116765]  1001 1116765   919039   181556  1953792        0             0 dotnet
[13419782.376618] [1124108]     0 1124108     2962      339    65536        0             0 sshd
[13419782.376619] [1124109]     0 1124109     2962      289    57344        0             0 sshd
[13419782.376632] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/manx-corpus.service,task=dotnet,pid=1116765,uid=1001
[13419782.376671] Out of memory: Killed process 1116765 (dotnet) total-vm:3676156kB, anon-rss:726224kB, file-rss:0kB, shmem-rss:0kB, UID:1001 pgtables:1908kB oom_score_adj:0
[13419782.458808] oom_reaper: reaped process 1116765 (dotnet), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
david-allison commented 1 year ago

Upgraded to a $12 droplet with double the RAM