search

gluster / gluster-health-report

Gluster Health Report Tool
GNU Lesser General Public License v3.0
23 stars 20 forks source link

kernel-issues-report: Check gluster processes were blocked for 120 sec #19

Closed pdvian closed 6 years ago

pdvian commented 6 years ago

The gluster processes might hung/blocked due to storage driver, n/w driver or kernel issue.

Signed-off-by: Prashant D pdhange@gmail.com

pdvian commented 6 years ago

Here is the calltrace for glusterfsd process hung/blocked:

Oct 11 06:07:26 glustern1 kernel: INFO: task glusterfsd:26120 blocked for more than 120 seconds. Oct 11 06:07:26 glustern1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Oct 11 06:07:26 glustern1 kernel: bptm D ffff8817dddf80b0 0 26120 26119 0x00000080 Oct 11 06:07:26 glustern1 kernel: ffff882fd0627c70 0000000000000086 ffff880844fe8fb0 ffff882fd0627fd8 Oct 11 06:07:26 glustern1 kernel: ffff882fd0627fd8 ffff882fd0627fd8 ffff880844fe8fb0 ffff8817dddf80a8 Oct 11 06:07:26 glustern1 kernel: ffff8817dddf80ac ffff880844fe8fb0 00000000ffffffff ffff8817dddf80b0 Oct 11 06:07:26 glustern1 kernel: Call Trace: Oct 11 06:07:26 glustern1 kernel: [] schedule_preempt_disabled+0x29/0x70 Oct 11 06:07:26 glustern1 kernel: [] mutex_lock_slowpath+0xc5/0x1c0 Oct 11 06:07:26 glustern1 kernel: [] mutex_lock+0x1f/0x2f Oct 11 06:07:26 glustern1 kernel: [] do_last+0x28f/0x12a0 Oct 11 06:07:26 glustern1 kernel: [] path_openat+0xc2/0x490 Oct 11 06:07:26 glustern1 kernel: [] ? unlock_page+0x2b/0x30 Oct 11 06:07:26 glustern1 kernel: [] do_filp_open+0x4b/0xb0 Oct 11 06:07:26 glustern1 kernel: [] ? alloc_fd+0xa7/0x130 Oct 11 06:07:26 glustern1 kernel: [] do_sys_open+0xf3/0x1f0 Oct 11 06:07:26 glustern1 kernel: [] ? do_page_fault+0x35/0x90 Oct 11 06:07:26 glustern1 kernel: [] SyS_open+0x1e/0x20 Oct 11 06:07:26 glustern1 kernel: [] system_call_fastpath+0x16/0x1b