search

tempesta-tech / tempesta

All-in-one solution for high performance web content delivery and advanced protection against DDoS and web attacks
https://tempesta-tech.com/
GNU General Public License v2.0
615 stars 103 forks source link

Memory leak in Tempesta FW #2221

Closed EvgeniiMekhanik closed 3 weeks ago

EvgeniiMekhanik commented 1 month ago

Kernel crashes after Tempesta FW works one or more days under load.

empesta login: [109066.781363] Out of memory: Killed process 1128 (networkd-dispat) total-vm:32740kB, anon-rss:0kB, file-rss:3352kB, shmem-rss:0kB, UID:0 pgtables:104kB oom_score_adj:0
[109066.795851] Out of memory: Killed process 1265 (unattended-upgr) total-vm:109756kB, anon-rss:0kB, file-rss:2968kB, shmem-rss:0kB, UID:0 pgtables:108kB oom_score_adj:0
[109075.183000] Out of memory: Killed process 860 (systemd-resolve) total-vm:25540kB, anon-rss:0kB, file-rss:1816kB, shmem-rss:0kB, UID:102 pgtables:88kB oom_score_adj:0
[109075.190862] Out of memory: Killed process 9638 (packagekitd) total-vm:295640kB, anon-rss:0kB, file-rss:2816kB, shmem-rss:0kB, UID:0 pgtables:164kB oom_score_adj:0
[109075.300950] Out of memory: Killed process 1179 (udisksd) total-vm:392492kB, anon-rss:0kB, file-rss:3400kB, shmem-rss:0kB, UID:0 pgtables:124kB oom_score_adj:0
[109075.477569] systemd-journald[569]: Failed to write entry (9 items, 509 bytes), ignoring: Cannot allocate memory
[109075.529409] systemd-journald[569]: Failed to write entry (9 items, 494 bytes), ignoring: Cannot allocate memory
[109077.001298] Out of memory: Killed process 1131 (polkitd) total-vm:239376kB, anon-rss:40kB, file-rss:2932kB, shmem-rss:0kB, UID:0 pgtables:96kB oom_score_adj:0
[109077.160935] Out of memory: Killed process 1132 (rsyslogd) total-vm:222404kB, anon-rss:0kB, file-rss:2380kB, shmem-rss:0kB, UID:107 pgtables:84kB oom_score_adj:0
[109077.258481] Out of memory: Killed process 1220 (ModemManager) total-vm:317964kB, anon-rss:0kB, file-rss:2388kB, shmem-rss:0kB, UID:0 pgtables:116kB oom_score_adj:0
[109077.358311] Out of memory: Killed process 2774 (upowerd) total-vm:239628kB, anon-rss:0kB, file-rss:2472kB, shmem-rss:0kB, UID:0 pgtables:92kB oom_score_adj:0
[109077.507424] Out of memory: Killed process 843 (systemd-timesyn) total-vm:89364kB, anon-rss:0kB, file-rss:2276kB, shmem-rss:0kB, UID:104 pgtables:72kB oom_score_adj:0
[109078.873332] Out of memory: Killed process 21833 ((resolved)) total-vm:168012kB, anon-rss:0kB, file-rss:1260kB, shmem-rss:0kB, UID:0 pgtables:92kB oom_score_adj:0
[109078.970707] Out of memory: Killed process 1165 (systemd-logind) total-vm:15532kB, anon-rss:0kB, file-rss:2412kB, shmem-rss:0kB, UID:0 pgtables:68kB oom_score_adj:0
[109078.976092] Out of memory: Killed process 9237 (irqbalance) total-vm:82916kB, anon-rss:0kB, file-rss:2628kB, shmem-rss:0kB, UID:0 pgtables:60kB oom_score_adj:0
[109079.069186] Out of memory: Killed process 857 (systemd-network) total-vm:16128kB, anon-rss:0kB, file-rss:1828kB, shmem-rss:0kB, UID:101 pgtables:64kB oom_score_adj:0
[109079.072994] Out of memory: Killed process 1116 (cron) total-vm:6896kB, anon-rss:0kB, file-rss:2136kB, shmem-rss:0kB, UID:0 pgtables:48kB oom_score_adj:0
[109079.163534] Out of memory: Killed process 1267 (agetty) total-vm:6176kB, anon-rss:0kB, file-rss:808kB, shmem-rss:0kB, UID:0 pgtables:44kB oom_score_adj:0
[109079.649798] Out of memory: Killed process 1257 (agetty) total-vm:5800kB, anon-rss:0kB, file-rss:552kB, shmem-rss:0kB, UID:0 pgtables:52kB oom_score_adj:0
[109079.657843] Out of memory: Killed process 569 (systemd-journal) total-vm:48404kB, anon-rss:0kB, file-rss:2528kB, shmem-rss:0kB, UID:0 pgtables:108kB oom_score_adj:-250
[109079.665087] Out of memory: Killed process 1140 (snapd) total-vm:2575456kB, anon-rss:0kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:392kB oom_score_adj:-900
[109079.718537] Out of memory: Killed process 1118 (dbus-daemon) total-vm:8872kB, anon-rss:0kB, file-rss:2924kB, shmem-rss:0kB, UID:103 pgtables:56kB oom_score_adj:-900
[109079.773190] Kernel panic - not syncing: System is deadlocked on memory
[109079.774410] CPU: 23 PID: 1 Comm: systemd Tainted: G           OE     5.10.35+ #6
[109079.775760] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.15.0-1 04/01/2014
[109079.784762] Call Trace:
[109079.792697]  dump_stack+0x96/0xc4
[109079.800650]  panic+0x241/0x453
[109080.146604]  ? __alloc_pages_slowpath.constprop.0+0x1400/0x1400
[109080.209084]  ? _raw_write_lock_irqsave+0xe0/0xe0

Also it is possible to memory leak usinf free

EvgeniiMekhanik commented 1 month ago

One hour work: was 5.2 after 6.3Gi used memory