search

openzfs / zfs

OpenZFS on Linux and FreeBSD
https://openzfs.github.io/openzfs-docs
Other
10.69k stars 1.76k forks source link

Use-after-free read at kfence? (spa_read_history/arc_read) #15068

Open dioni21 opened 1 year ago

dioni21 commented 1 year ago

System information

Type Version/Name
Distribution Name fedora
Distribution Version fc38
Kernel Version 6.3.12-200.fc38.x86_64
Architecture x86_64
OpenZFS Version 2.1.99-1 (master branch, commit: ca960ce56ce1bfe207e4d80ba6e5ab67ea41b32f, AFAIR)

Describe the problem you're observing

Dmesg reports errors, some processes freeze, system unstable

Describe how to reproduce the problem

Don't know. I just use this host daily. It's my desktop/home server.

Here's the last dmesg:

[Fri Jul 14 09:22:52 2023] BUG: KFENCE: use-after-free read in spa_read_history_add+0xea/0x200 [zfs]

[Fri Jul 14 09:22:52 2023] Use-after-free read at 0x00000000da8c07ab (in kfence-#222):
[Fri Jul 14 09:22:52 2023]  spa_read_history_add+0xea/0x200 [zfs]
[Fri Jul 14 09:22:52 2023]  arc_read+0xbe9/0x16d0 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_issue_final_prefetch+0xcc/0x120 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_prefetch_indirect_done+0x251/0x270 [zfs]
[Fri Jul 14 09:22:52 2023]  arc_read+0x10a7/0x16d0 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_prefetch_impl+0x589/0x830 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_prefetch+0x13/0x20 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_prefetch+0x1c9/0x210 [zfs]
[Fri Jul 14 09:22:52 2023]  zap_prefetch_uint64+0xd6/0x1b0 [zfs]
[Fri Jul 14 09:22:52 2023]  ddt_prefetch+0xb3/0xf0 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_dirty+0x300/0x9d0 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_write_uio_dnode+0x9e/0x190 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_write_uio_dbuf+0x4e/0x70 [zfs]
[Fri Jul 14 09:22:52 2023]  zfs_write+0x4ea/0xc70 [zfs]
[Fri Jul 14 09:22:52 2023]  zpl_iter_write+0x113/0x190 [zfs]
[Fri Jul 14 09:22:52 2023]  vfs_write+0x236/0x3f0
[Fri Jul 14 09:22:52 2023]  ksys_write+0x6f/0xf0
[Fri Jul 14 09:22:52 2023]  do_syscall_64+0x5d/0x90
[Fri Jul 14 09:22:52 2023]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Jul 14 09:22:52 2023] kfence-#222: 0x00000000061205b6-0x0000000000141f18, size=96, cache=kmalloc-96

[Fri Jul 14 09:22:52 2023] allocated by task 1191 on cpu 2 at 117217.504428s:
[Fri Jul 14 09:22:52 2023]  spl_kmem_zalloc+0x10e/0x120 [spl]
[Fri Jul 14 09:22:52 2023]  dbuf_prefetch_impl+0x459/0x830 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_prefetch+0x13/0x20 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_prefetch+0x1c9/0x210 [zfs]
[Fri Jul 14 09:22:52 2023]  zap_prefetch_uint64+0xd6/0x1b0 [zfs]
[Fri Jul 14 09:22:52 2023]  ddt_prefetch+0xb3/0xf0 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_dirty+0x300/0x9d0 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_write_uio_dnode+0x9e/0x190 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_write_uio_dbuf+0x4e/0x70 [zfs]
[Fri Jul 14 09:22:52 2023]  zfs_write+0x4ea/0xc70 [zfs]
[Fri Jul 14 09:22:52 2023]  zpl_iter_write+0x113/0x190 [zfs]
[Fri Jul 14 09:22:52 2023]  vfs_write+0x236/0x3f0
[Fri Jul 14 09:22:52 2023]  ksys_write+0x6f/0xf0
[Fri Jul 14 09:22:52 2023]  do_syscall_64+0x5d/0x90
[Fri Jul 14 09:22:52 2023]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Jul 14 09:22:52 2023] freed by task 1191 on cpu 2 at 117217.504476s:
[Fri Jul 14 09:22:52 2023]  arc_read+0x10a7/0x16d0 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_issue_final_prefetch+0xcc/0x120 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_prefetch_indirect_done+0x251/0x270 [zfs]
[Fri Jul 14 09:22:52 2023]  arc_read+0x10a7/0x16d0 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_prefetch_impl+0x589/0x830 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_prefetch+0x13/0x20 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_prefetch+0x1c9/0x210 [zfs]
[Fri Jul 14 09:22:52 2023]  zap_prefetch_uint64+0xd6/0x1b0 [zfs]
[Fri Jul 14 09:22:52 2023]  ddt_prefetch+0xb3/0xf0 [zfs]
[Fri Jul 14 09:22:52 2023]  dbuf_dirty+0x300/0x9d0 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_write_uio_dnode+0x9e/0x190 [zfs]
[Fri Jul 14 09:22:52 2023]  dmu_write_uio_dbuf+0x4e/0x70 [zfs]
[Fri Jul 14 09:22:52 2023]  zfs_write+0x4ea/0xc70 [zfs]
[Fri Jul 14 09:22:52 2023]  zpl_iter_write+0x113/0x190 [zfs]
[Fri Jul 14 09:22:52 2023]  vfs_write+0x236/0x3f0
[Fri Jul 14 09:22:52 2023]  ksys_write+0x6f/0xf0
[Fri Jul 14 09:22:52 2023]  do_syscall_64+0x5d/0x90
[Fri Jul 14 09:22:52 2023]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Jul 14 09:22:52 2023] CPU: 2 PID: 1191 Comm: mozStorage #1 Tainted: P    B D W  OE      6.3.12-200.fc38.x86_64 #1
[Fri Jul 14 09:22:52 2023] Hardware name: Gigabyte Technology Co., Ltd. To be filled by O.E.M./970A-D3P, BIOS FD 02/26/2016
[Fri Jul 14 09:22:52 2023] ==================================================================
dioni21 commented 1 year ago

Forgot to add compilation parameters:

./configure --enable-silent-rules --enable-dependency-tracking --config-cache --enable-linux-builtin --disable-nls --with-config=all --enable-asan --enable-ubsan --enable-debuginfo --enable-debug --enable-debug-kmem --enable-debug-kmem-tracking CFLAGS=-Wno-stringop-overflow

Also, temporarily:

sed -i '/ DEBUG_CFLAGS="-Werror"/s/^/#/' config/zfs-build.m4

As I could not compile since a few recent Fedora upgrades and could not yet get time to fix and send PRs. Sorry... :-(

ThalesBarretto commented 5 months ago

I would also add to this bug report, that i am facing the same issues on arch.

Happened with lts and rolling release kernels. The report focus just on LTS.

Here is the DMESG error.

[ 2758.058252] ==================================================================
[ 2758.058271] BUG: KFENCE: use-after-free read in spa_read_history_add+0xe8/0x200 [zfs]
[ 2758.058467] Use-after-free read at 0x0000000060207b0d (in kfence-#160):
[ 2758.061284] CPU: 2 PID: 6577 Comm: .NET TP Worker Tainted: P           OE      6.6.32-1-lts #1 ee405f31cc2370c66e95bb51982e71a894d4c0fd
[ 2758.061301] Hardware name: ASUS All Series/VANGUARD B85, BIOS 2202 04/01/2015
[ 2758.061310] ==================================================================

zfs version

zfs-2.2.4-1
zfs-kmod-2.2.4-

kernel:

Linux pc 6.6.32-1-lts #1 SMP PREEMPT_DYNAMIC Sat, 25 May 2024 20:20:51 +0000 x86_64 GNU/Linux

I can help but would like to see some interest of the upstream in debugging and fixing it.

@dioni21 could you update on this issue please?

h1z1 commented 3 weeks ago

Think I hit this on one of our nodes, not sure why. One of the pools were intentionally filled to test but no one noticed the exception until later. $ zfs -V zfs-2.2.99-268_g86e115e21 zfs-kmod-2.2.99-268_g86e115e21

$ uname -r 5.14.0-362.8.1.el9_3.x86_64

[Fri Nov  1 03:34:35 2024] ==================================================================
[Fri Nov  1 03:34:35 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Fri Nov  1 03:34:35 2024] Use-after-free read at 0x00000000cce6b9fc (in kfence-#47):
[Fri Nov  1 03:34:35 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Fri Nov  1 03:34:35 2024]  arc_read+0xd53/0x16d0 [zfs]
[Fri Nov  1 03:34:35 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 03:34:35 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 03:34:35 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 03:34:35 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 03:34:35 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 03:34:35 2024]  kthread+0xdd/0x100
[Fri Nov  1 03:34:35 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 03:34:35 2024] kfence-#47: 0x00000000465fae4b-0x0000000046594e1f, size=96, cache=kmalloc-96

[Fri Nov  1 03:34:35 2024] allocated by task 3815274 on cpu 1 at 4398440.685527s:
[Fri Nov  1 03:34:35 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Fri Nov  1 03:34:35 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 03:34:35 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 03:34:35 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 03:34:35 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 03:34:35 2024]  kthread+0xdd/0x100
[Fri Nov  1 03:34:35 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 03:34:35 2024] freed by task 3815274 on cpu 1 at 4398440.685537s:
[Fri Nov  1 03:34:35 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Fri Nov  1 03:34:35 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 03:34:35 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 03:34:35 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 03:34:35 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 03:34:35 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 03:34:35 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 03:34:35 2024]  kthread+0xdd/0x100
[Fri Nov  1 03:34:35 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 03:34:35 2024] CPU: 1 PID: 3815274 Comm: zvol Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Fri Nov  1 03:34:35 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Fri Nov  1 03:34:35 2024] ==================================================================
[Fri Nov  1 05:15:28 2024] ==================================================================
[Fri Nov  1 05:15:28 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Fri Nov  1 05:15:28 2024] Use-after-free read at 0x0000000041f41eaa (in kfence-#170):
[Fri Nov  1 05:15:28 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Fri Nov  1 05:15:28 2024]  arc_read+0xd53/0x16d0 [zfs]
[Fri Nov  1 05:15:28 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 05:15:28 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 05:15:28 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 05:15:28 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 05:15:28 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 05:15:28 2024]  kthread+0xdd/0x100
[Fri Nov  1 05:15:28 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 05:15:28 2024] kfence-#170: 0x000000004e7f8657-0x00000000374a73d2, size=96, cache=kmalloc-96

[Fri Nov  1 05:15:28 2024] allocated by task 2350642 on cpu 3 at 4404493.619173s:
[Fri Nov  1 05:15:28 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Fri Nov  1 05:15:28 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 05:15:28 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 05:15:28 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 05:15:28 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 05:15:28 2024]  kthread+0xdd/0x100
[Fri Nov  1 05:15:28 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 05:15:28 2024] freed by task 2350642 on cpu 3 at 4404493.619181s:
[Fri Nov  1 05:15:28 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Fri Nov  1 05:15:28 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 05:15:28 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 05:15:28 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 05:15:28 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 05:15:28 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 05:15:28 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 05:15:28 2024]  kthread+0xdd/0x100
[Fri Nov  1 05:15:28 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 05:15:28 2024] CPU: 3 PID: 2350642 Comm: zvol Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Fri Nov  1 05:15:28 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Fri Nov  1 05:15:28 2024] ==================================================================
[Fri Nov  1 05:38:53 2024]  zd912: p1 p9
[Fri Nov  1 06:58:39 2024] ==================================================================
[Fri Nov  1 06:58:39 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Fri Nov  1 06:58:39 2024] Use-after-free read at 0x00000000f5c33926 (in kfence-#211):
[Fri Nov  1 06:58:39 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Fri Nov  1 06:58:39 2024]  arc_read+0xd53/0x16d0 [zfs]
[Fri Nov  1 06:58:39 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 06:58:39 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 06:58:39 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 06:58:39 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 06:58:39 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 06:58:39 2024]  kthread+0xdd/0x100
[Fri Nov  1 06:58:39 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 06:58:39 2024] kfence-#211: 0x0000000022cb5922-0x000000005f728cc1, size=96, cache=kmalloc-96

[Fri Nov  1 06:58:39 2024] allocated by task 2350644 on cpu 21 at 4410684.043600s:
[Fri Nov  1 06:58:39 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Fri Nov  1 06:58:39 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 06:58:39 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 06:58:39 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 06:58:39 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 06:58:39 2024]  kthread+0xdd/0x100
[Fri Nov  1 06:58:39 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 06:58:39 2024] freed by task 2350644 on cpu 21 at 4410684.043606s:
[Fri Nov  1 06:58:39 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Fri Nov  1 06:58:39 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 06:58:39 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_zfetch_run+0x173/0x290 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_buf_hold_array_by_dnode+0x27a/0x600 [zfs]
[Fri Nov  1 06:58:39 2024]  dmu_read_uio_dnode+0x4b/0x130 [zfs]
[Fri Nov  1 06:58:39 2024]  zvol_read+0x115/0x420 [zfs]
[Fri Nov  1 06:58:39 2024]  zvol_read_task+0xe/0x20 [zfs]
[Fri Nov  1 06:58:39 2024]  taskq_thread+0x28e/0x4a0 [spl]
[Fri Nov  1 06:58:39 2024]  kthread+0xdd/0x100
[Fri Nov  1 06:58:39 2024]  ret_from_fork+0x29/0x50

[Fri Nov  1 06:58:39 2024] CPU: 21 PID: 2350644 Comm: zvol Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Fri Nov  1 06:58:39 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Fri Nov  1 06:58:39 2024] ==================================================================
[Fri Nov  1 07:59:24 2024] ==================================================================
[Fri Nov  1 07:59:24 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Fri Nov  1 07:59:24 2024] Use-after-free read at 0x00000000781d412b (in kfence-#46):
[Fri Nov  1 07:59:24 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Fri Nov  1 07:59:24 2024]  arc_read+0xd53/0x16d0 [zfs]
[Fri Nov  1 07:59:24 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 07:59:24 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 07:59:24 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 07:59:24 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 07:59:24 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 07:59:24 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 07:59:24 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 07:59:24 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 07:59:24 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 07:59:24 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 07:59:24 2024] kfence-#46: 0x000000000f89f766-0x00000000eac1ebb4, size=96, cache=kmalloc-96

[Fri Nov  1 07:59:24 2024] allocated by task 3404194 on cpu 18 at 4414329.000932s:
[Fri Nov  1 07:59:24 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Fri Nov  1 07:59:24 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Fri Nov  1 07:59:24 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 07:59:24 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 07:59:24 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 07:59:24 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 07:59:24 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 07:59:24 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 07:59:24 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 07:59:24 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 07:59:24 2024] freed by task 3404194 on cpu 18 at 4414329.000937s:
[Fri Nov  1 07:59:24 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Fri Nov  1 07:59:24 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 07:59:24 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 07:59:24 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 07:59:24 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 07:59:24 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 07:59:24 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 07:59:24 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 07:59:24 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 07:59:24 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 07:59:24 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 07:59:24 2024] CPU: 18 PID: 3404194 Comm: du Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Fri Nov  1 07:59:24 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Fri Nov  1 07:59:24 2024] ==================================================================
[Fri Nov  1 08:21:55 2024] ==================================================================
[Fri Nov  1 08:21:55 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Fri Nov  1 08:21:55 2024] Use-after-free read at 0x000000000ef0c8e4 (in kfence-#136):
[Fri Nov  1 08:21:55 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Fri Nov  1 08:21:55 2024]  arc_read+0xd53/0x16d0 [zfs]
[Fri Nov  1 08:21:55 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 08:21:55 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 08:21:55 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:21:55 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:21:55 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:21:55 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:21:55 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:21:55 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:21:55 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:21:55 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:21:55 2024] kfence-#136: 0x00000000430c5d8d-0x000000000da13447, size=96, cache=kmalloc-96

[Fri Nov  1 08:21:55 2024] allocated by task 3406716 on cpu 2 at 4415680.049521s:
[Fri Nov  1 08:21:55 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Fri Nov  1 08:21:55 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Fri Nov  1 08:21:55 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:21:55 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:21:55 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:21:55 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:21:55 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:21:55 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:21:55 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:21:55 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:21:55 2024] freed by task 3406716 on cpu 2 at 4415680.049525s:
[Fri Nov  1 08:21:55 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Fri Nov  1 08:21:55 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 08:21:55 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 08:21:55 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:21:55 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:21:55 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:21:55 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:21:55 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:21:55 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:21:55 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:21:55 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:21:55 2024] CPU: 2 PID: 3406716 Comm: find Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Fri Nov  1 08:21:55 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Fri Nov  1 08:21:55 2024] ==================================================================
[Fri Nov  1 08:50:14 2024] ==================================================================
[Fri Nov  1 08:50:14 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Fri Nov  1 08:50:14 2024] Use-after-free read at 0x00000000602a17b3 (in kfence-#38):
[Fri Nov  1 08:50:14 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Fri Nov  1 08:50:14 2024]  arc_read+0xd53/0x16d0 [zfs]
[Fri Nov  1 08:50:14 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 08:50:14 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 08:50:14 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:50:14 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:50:14 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:50:14 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:50:14 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:50:14 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:50:14 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:50:14 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:50:14 2024] kfence-#38: 0x000000004462ada3-0x000000003f860ce8, size=96, cache=kmalloc-96

[Fri Nov  1 08:50:14 2024] allocated by task 3408828 on cpu 0 at 4417379.390782s:
[Fri Nov  1 08:50:14 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Fri Nov  1 08:50:14 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Fri Nov  1 08:50:14 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:50:14 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:50:14 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:50:14 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:50:14 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:50:14 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:50:14 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:50:14 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:50:14 2024] freed by task 3408828 on cpu 0 at 4417379.390790s:
[Fri Nov  1 08:50:14 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Fri Nov  1 08:50:14 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 08:50:14 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 08:50:14 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:50:14 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:50:14 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:50:14 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:50:14 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:50:14 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:50:14 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:50:14 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:50:14 2024] CPU: 0 PID: 3408828 Comm: find Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Fri Nov  1 08:50:14 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Fri Nov  1 08:50:14 2024] ==================================================================
[Fri Nov  1 08:50:22 2024] ==================================================================
[Fri Nov  1 08:50:22 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Fri Nov  1 08:50:22 2024] Use-after-free read at 0x0000000072c90c8f (in kfence-#208):
[Fri Nov  1 08:50:22 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Fri Nov  1 08:50:22 2024]  arc_read+0xd53/0x16d0 [zfs]
[Fri Nov  1 08:50:22 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 08:50:22 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 08:50:22 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:50:22 2024]  dmu_prefetch+0x1e2/0x260 [zfs]
[Fri Nov  1 08:50:22 2024]  fzap_cursor_retrieve+0x293/0x320 [zfs]
[Fri Nov  1 08:50:22 2024]  zap_cursor_retrieve+0x143/0x340 [zfs]
[Fri Nov  1 08:50:22 2024]  zfs_readdir+0x125/0x470 [zfs]
[Fri Nov  1 08:50:22 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:50:22 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:50:22 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:50:22 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:50:22 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:50:22 2024] kfence-#208: 0x00000000e9ed4f6f-0x000000005bef8a16, size=96, cache=kmalloc-96

[Fri Nov  1 08:50:22 2024] allocated by task 3408829 on cpu 0 at 4417387.190680s:
[Fri Nov  1 08:50:22 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Fri Nov  1 08:50:22 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Fri Nov  1 08:50:22 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:50:22 2024]  dmu_prefetch+0x1e2/0x260 [zfs]
[Fri Nov  1 08:50:22 2024]  fzap_cursor_retrieve+0x293/0x320 [zfs]
[Fri Nov  1 08:50:22 2024]  zap_cursor_retrieve+0x143/0x340 [zfs]
[Fri Nov  1 08:50:22 2024]  zfs_readdir+0x125/0x470 [zfs]
[Fri Nov  1 08:50:22 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:50:22 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:50:22 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:50:22 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:50:22 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:50:22 2024] freed by task 3408829 on cpu 0 at 4417387.190684s:
[Fri Nov  1 08:50:22 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Fri Nov  1 08:50:22 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 08:50:22 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 08:50:22 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:50:22 2024]  dmu_prefetch+0x1e2/0x260 [zfs]
[Fri Nov  1 08:50:22 2024]  fzap_cursor_retrieve+0x293/0x320 [zfs]
[Fri Nov  1 08:50:22 2024]  zap_cursor_retrieve+0x143/0x340 [zfs]
[Fri Nov  1 08:50:22 2024]  zfs_readdir+0x125/0x470 [zfs]
[Fri Nov  1 08:50:22 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:50:22 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:50:22 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:50:22 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:50:22 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:50:22 2024] CPU: 0 PID: 3408829 Comm: find Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Fri Nov  1 08:50:22 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Fri Nov  1 08:50:22 2024] ==================================================================
[Fri Nov  1 08:56:12 2024] ==================================================================
[Fri Nov  1 08:56:12 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Fri Nov  1 08:56:12 2024] Use-after-free read at 0x000000002e04bbbe (in kfence-#144):
[Fri Nov  1 08:56:12 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Fri Nov  1 08:56:12 2024]  arc_read+0xd53/0x16d0 [zfs]
[Fri Nov  1 08:56:12 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 08:56:12 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 08:56:12 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:56:12 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:56:12 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:56:12 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:56:12 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:56:12 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:56:12 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:56:12 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:56:12 2024] kfence-#144: 0x00000000823e0b79-0x0000000065993d58, size=96, cache=kmalloc-96

[Fri Nov  1 08:56:12 2024] allocated by task 3409264 on cpu 16 at 4417737.042770s:
[Fri Nov  1 08:56:12 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Fri Nov  1 08:56:12 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Fri Nov  1 08:56:12 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:56:12 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:56:12 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:56:12 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:56:12 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:56:12 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:56:12 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:56:12 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:56:12 2024] freed by task 3409264 on cpu 16 at 4417737.042774s:
[Fri Nov  1 08:56:12 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Fri Nov  1 08:56:12 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Fri Nov  1 08:56:12 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Fri Nov  1 08:56:12 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Fri Nov  1 08:56:12 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Fri Nov  1 08:56:12 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Fri Nov  1 08:56:12 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Fri Nov  1 08:56:12 2024]  iterate_dir+0x179/0x1c0
[Fri Nov  1 08:56:12 2024]  __x64_sys_getdents64+0x80/0x120
[Fri Nov  1 08:56:12 2024]  do_syscall_64+0x59/0x90
[Fri Nov  1 08:56:12 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Fri Nov  1 08:56:12 2024] CPU: 16 PID: 3409264 Comm: find Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Fri Nov  1 08:56:12 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Fri Nov  1 08:56:12 2024] ==================================================================
[Fri Nov  1 17:39:57 2024]  zd208: p1 p2 < p5 > p3 p4
[Sun Nov  3 13:51:21 2024] ==================================================================
[Sun Nov  3 13:51:21 2024] BUG: KFENCE: use-after-free read in spa_read_history_add+0xf4/0x1e0 [zfs]

[Sun Nov  3 13:51:21 2024] Use-after-free read at 0x0000000095732e96 (in kfence-#71):
[Sun Nov  3 13:51:21 2024]  spa_read_history_add+0xf4/0x1e0 [zfs]
[Sun Nov  3 13:51:21 2024]  arc_read+0xd53/0x16d0 [zfs]
[Sun Nov  3 13:51:21 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Sun Nov  3 13:51:21 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Sun Nov  3 13:51:21 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Sun Nov  3 13:51:21 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Sun Nov  3 13:51:21 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Sun Nov  3 13:51:21 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Sun Nov  3 13:51:21 2024]  iterate_dir+0x179/0x1c0
[Sun Nov  3 13:51:21 2024]  __x64_sys_getdents64+0x80/0x120
[Sun Nov  3 13:51:21 2024]  do_syscall_64+0x59/0x90
[Sun Nov  3 13:51:21 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Sun Nov  3 13:51:21 2024] kfence-#71: 0x00000000ebde8185-0x00000000ae20187c, size=96, cache=kmalloc-96

[Sun Nov  3 13:51:21 2024] allocated by task 1510422 on cpu 28 at 4611846.913613s:
[Sun Nov  3 13:51:21 2024]  spl_kmem_zalloc+0xed/0x110 [spl]
[Sun Nov  3 13:51:21 2024]  dbuf_prefetch_impl+0x3f2/0x770 [zfs]
[Sun Nov  3 13:51:21 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Sun Nov  3 13:51:21 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Sun Nov  3 13:51:21 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Sun Nov  3 13:51:21 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Sun Nov  3 13:51:21 2024]  iterate_dir+0x179/0x1c0
[Sun Nov  3 13:51:21 2024]  __x64_sys_getdents64+0x80/0x120
[Sun Nov  3 13:51:21 2024]  do_syscall_64+0x59/0x90
[Sun Nov  3 13:51:21 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Sun Nov  3 13:51:21 2024] freed by task 1510422 on cpu 28 at 4611846.913617s:
[Sun Nov  3 13:51:21 2024]  arc_read+0xdcd/0x16d0 [zfs]
[Sun Nov  3 13:51:21 2024]  dbuf_issue_final_prefetch+0xbe/0x110 [zfs]
[Sun Nov  3 13:51:21 2024]  dbuf_prefetch_impl+0x6ed/0x770 [zfs]
[Sun Nov  3 13:51:21 2024]  dbuf_prefetch+0xf/0x20 [zfs]
[Sun Nov  3 13:51:21 2024]  dmu_prefetch_dnode.part.0+0x42/0x80 [zfs]
[Sun Nov  3 13:51:21 2024]  zfs_readdir+0x2cc/0x470 [zfs]
[Sun Nov  3 13:51:21 2024]  zpl_iterate+0x4c/0x80 [zfs]
[Sun Nov  3 13:51:21 2024]  iterate_dir+0x179/0x1c0
[Sun Nov  3 13:51:21 2024]  __x64_sys_getdents64+0x80/0x120
[Sun Nov  3 13:51:21 2024]  do_syscall_64+0x59/0x90
[Sun Nov  3 13:51:21 2024]  entry_SYSCALL_64_after_hwframe+0x72/0xdc

[Sun Nov  3 13:51:21 2024] CPU: 28 PID: 1510422 Comm: find Kdump: loaded Tainted: P    B   W  OE     -------  ---  5.14.0-362.8.1.el9_3.x86_64 #1
[Sun Nov  3 13:51:21 2024] Hardware name: Gigabyte Technology Co., Ltd. B650 AORUS ELITE AX/B650 AORUS ELITE AX, BIOS FB 07/10/2023
[Sun Nov  3 13:51:21 2024] ==================================================================