Open josh7 opened 5 months ago
starrocks版本:2.5.10 集群：5台be，每台be配置16C64G
这是我们服务器挂掉前的可疑日志/var/log/mesaage
May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: Out of memory: Kill process 26549 (starrocks_be) score 927 or sacrifice child May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: Killed process 26549 (starrocks_be), UID 0, total-vm:374863012kB, anon-rss:61316024kB, file-rss:0kB, shmem-rss:0kB May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: juicefs invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0 May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: juicefs cpuset=/ mems_allowed=0 May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: CPU: 0 PID: 16672 Comm: juicefs Tainted: G OE ------------ T 3.10.0-1160.108.1.el7.x86_64 #1 May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: Hardware name: Alibaba Cloud Alibaba Cloud ECS, BIOS 2221b89 04/01/2014
通过阿里云进程监控，看到的内存变化
josh7
commented
5 months ago
starrocks版本:2.5.10 集群：5台be，每台be配置16C64G
这是我们服务器挂掉前的可疑日志/var/log/mesaage
May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: Out of memory: Kill process 26549 (starrocks_be) score 927 or sacrifice child May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: Killed process 26549 (starrocks_be), UID 0, total-vm:374863012kB, anon-rss:61316024kB, file-rss:0kB, shmem-rss:0kB May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: juicefs invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0 May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: juicefs cpuset=/ mems_allowed=0 May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: CPU: 0 PID: 16672 Comm: juicefs Tainted: G OE ------------ T 3.10.0-1160.108.1.el7.x86_64 #1 May 3 11:32:41 iZuf685abnr4y8ajmo1a5zZ kernel: Hardware name: Alibaba Cloud Alibaba Cloud ECS, BIOS 2221b89 04/01/2014