search

raspberrypi / linux

Kernel source tree for Raspberry Pi-provided kernel builds. Issues unrelated to the linux kernel should be posted on the community forum at https://forums.raspberrypi.com/
Other
11.06k stars 4.97k forks source link

The 32-bit kernel frequently OOM when the memory is sufficient #5551

Open Oliv1a opened 1 year ago

Oliv1a commented 1 year ago

Describe the bug

In the case of sufficient memory, the latest version of Raspberry Pi OS (32-bit kernel) frequently OOM, the same configuration switch to 64-bit kernel is no problem.

Steps to reproduce the behaviour

It can be triggered by using Aria2 to download torrents or using samba to do a lot of disk writing and other behaviors that write to disk. The disk uses a USB high-speed solid-state U disk.

Device (s)

Raspberry Pi 4 Mod. B

System

cat /etc/rpi-issue Raspberry Pi reference 2022-09-22 Generated using pi-gen, https://github.com/RPi-Distro/pi-gen, 8a42abcd1dbd8c9c1fdfca4e0c3778255b2f9cc4, stage4

vcgencmd version Mar 17 2023 10:50:39 Copyright (c) 2012 Broadcom version 82f3750a65fadae9a38077e3c2e217ad158c8d54 (clean) (release) (start)

uname -a Linux raspberrypi.local 6.1.21-v7l+ #1642 SMP Mon Apr 3 17:22:30 BST 2023 armv7l GNU/Linux

Logs

Jul 18 08:02:26 raspberrypi kernel: [70748.273405] Out of memory: Killed process 13021 (kodi.bin) total-vm:1099788kB, anon-rss:148084kB, file-rss:113576kB, shmem-rss:0kB, UID:1000 pgtables:1484kB oom_score_adj:0 Jul 18 08:02:46 raspberrypi kernel: [70768.167299] Out of memory: Killed process 24355 (munin-cgi-graph) total-vm:77072kB, anon-rss:0kB, file-rss:12968kB, shmem-rss:0kB, UID:33 pgtables:124kB oom_score_adj:0 Jul 18 08:02:47 raspberrypi kernel: [70768.647556] Out of memory: Killed process 1031 (aria2c) total-vm:70912kB, anon-rss:11740kB, file-rss:8668kB, shmem-rss:0kB, UID:0 pgtables:104kB oom_score_adj:0 Jul 18 08:02:49 raspberrypi kodi-standalone[13011]: Killed Jul 18 11:26:11 raspberrypi kernel: [82972.736761] Out of memory: Killed process 15367 (kodi.bin) total-vm:1017624kB, anon-rss:114004kB, file-rss:51900kB, shmem-rss:0kB, UID:1000 pgtables:1356kB oom_score_adj:0 Jul 18 11:26:16 raspberrypi kodi-standalone[15357]: Killed Jul 18 13:37:12 raspberrypi kernel: [90833.744464] Out of memory: Killed process 17070 (kodi.bin) total-vm:1102172kB, anon-rss:166784kB, file-rss:43980kB, shmem-rss:0kB, UID:1000 pgtables:1504kB oom_score_adj:0 Jul 18 13:37:15 raspberrypi kernel: [90837.532773] Out of memory: Killed process 15369 (aria2c) total-vm:80656kB, anon-rss:21080kB, file-rss:7688kB, shmem-rss:0kB, UID:0 pgtables:132kB oom_score_adj:0 Jul 18 13:37:17 raspberrypi kodi-standalone[17060]: Killed Jul 18 13:40:16 raspberrypi kernel: [91018.242893] Out of memory: Killed process 29741 (kodi.bin) total-vm:1066208kB, anon-rss:135920kB, file-rss:107420kB, shmem-rss:0kB, UID:1000 pgtables:1408kB oom_score_adj:0 Jul 18 13:40:21 raspberrypi kernel: [91023.208866] Out of memory: Killed process 29743 (aria2c) total-vm:79732kB, anon-rss:26716kB, file-rss:8876kB, shmem-rss:0kB, UID:0 pgtables:132kB oom_score_adj:0 Jul 18 13:40:24 raspberrypi kodi-standalone[29731]: Killed Jul 18 14:13:35 raspberrypi kernel: [93016.708078] Out of memory: Killed process 30680 (kodi.bin) total-vm:1082940kB, anon-rss:142400kB, file-rss:83196kB, shmem-rss:0kB, UID:1000 pgtables:1432kB oom_score_adj:0 Jul 18 14:13:39 raspberrypi kodi-standalone[30665]: Killed Jul 18 14:14:12 raspberrypi kernel: [93053.948705] Out of memory: Killed process 11966 (kodi.bin) total-vm:999704kB, anon-rss:116900kB, file-rss:114020kB, shmem-rss:0kB, UID:1000 pgtables:1284kB oom_score_adj:0 Jul 18 14:14:24 raspberrypi kernel: [93065.611504] Out of memory: Killed process 30667 (aria2c) total-vm:72736kB, anon-rss:18888kB, file-rss:7912kB, shmem-rss:0kB, UID:0 pgtables:120kB oom_score_adj:0 Jul 18 14:14:25 raspberrypi kodi-standalone[11952]: Killed Jul 18 14:15:21 raspberrypi kernel: [93123.315630] Out of memory: Killed process 12216 (kodi.bin) total-vm:1102164kB, anon-rss:150520kB, file-rss:131112kB, shmem-rss:0kB, UID:1000 pgtables:1448kB oom_score_adj:0 Jul 18 14:15:29 raspberrypi kodi-standalone[12206]: Killed Jul 18 14:16:07 raspberrypi kernel: [93169.488209] Out of memory: Killed process 13145 (kodi.bin) total-vm:1039936kB, anon-rss:146560kB, file-rss:129664kB, shmem-rss:0kB, UID:1000 pgtables:1360kB oom_score_adj:0 Jul 18 14:16:21 raspberrypi kernel: [93183.212129] Out of memory: Killed process 12218 (aria2c) total-vm:73628kB, anon-rss:20532kB, file-rss:8604kB, shmem-rss:0kB, UID:0 pgtables:120kB oom_score_adj:0 Jul 18 14:16:23 raspberrypi kodi-standalone[13135]: Killed Jul 18 14:45:54 raspberrypi kernel: [ 663.895587] Out of memory: Killed process 872 (kodi.bin) total-vm:1071652kB, anon-rss:171160kB, file-rss:133532kB, shmem-rss:0kB, UID:1000 pgtables:1448kB oom_score_adj:0 Jul 18 14:45:57 raspberrypi kernel: [ 666.821000] Out of memory: Killed process 820 (alist) total-vm:787776kB, anon-rss:7856kB, file-rss:28028kB, shmem-rss:0kB, UID:0 pgtables:180kB oom_score_adj:0 Jul 18 14:45:58 raspberrypi kernel: [ 668.313825] Out of memory: Killed process 870 (aria2c) total-vm:78424kB, anon-rss:18864kB, file-rss:8920kB, shmem-rss:0kB, UID:0 pgtables:124kB oom_score_adj:0 Jul 18 14:45:59 raspberrypi kernel: [ 669.172900] Out of memory: Killed process 1921 (smbd) total-vm:126372kB, anon-rss:3236kB, file-rss:18316kB, shmem-rss:964kB, UID:0 pgtables:180kB oom_score_adj:0 Jul 18 14:46:00 raspberrypi kodi-standalone[837]: Killed Jul 18 14:48:44 raspberrypi kernel: [ 833.527741] Out of memory: Killed process 6423 (kodi.bin) total-vm:1058332kB, anon-rss:130920kB, file-rss:133856kB, shmem-rss:0kB, UID:1000 pgtables:1420kB oom_score_adj:0 Jul 18 14:49:18 raspberrypi kernel: [ 868.103263] Out of memory: Killed process 6387 (alist) total-vm:787776kB, anon-rss:7896kB, file-rss:28316kB, shmem-rss:0kB, UID:0 pgtables:172kB oom_score_adj:0 Jul 18 14:49:21 raspberrypi kodi-standalone[6413]: Killed Jul 18 14:53:41 raspberrypi kernel: [ 1130.988357] Out of memory: Killed process 7344 (kodi.bin) total-vm:1071784kB, anon-rss:115428kB, file-rss:134700kB, shmem-rss:0kB, UID:1000 pgtables:1428kB oom_score_adj:0 Jul 18 14:54:00 raspberrypi kernel: [ 1150.429616] Out of memory: Killed process 7294 (alist) total-vm:779324kB, anon-rss:8388kB, file-rss:27740kB, shmem-rss:0kB, UID:0 pgtables:172kB oom_score_adj:0 Jul 18 14:54:01 raspberrypi kernel: [ 1150.537114] Out of memory: Killed process 6427 (aria2c) total-vm:73272kB, anon-rss:19048kB, file-rss:9100kB, shmem-rss:0kB, UID:0 pgtables:112kB oom_score_adj:0 Jul 18 14:54:02 raspberrypi kodi-standalone[7334]: Killed

Additional context

This problem has been going on since I started using Raspberry Pi 4 until now. Every time I expect a new kernel upgrade to solve it, but the problem has not been solved, which makes the Raspberry Pi completely unusable.

whitslack commented 1 year ago

If you're really certain you're not simply trying to use more RAM than the system has, then maybe there's a kernel memory leak. Have you tried slabtop to see how the kernel is using memory? (Note, that list won't be entirely accurate since the kernel merges same-sized slabs by default, but you can turn off that merging by adding slab_nomerge to your kernel command line.)