koverstreet / bcachefs

Other
660 stars 70 forks source link

mount stuck during journal replay after an unclean shutdown #708

Closed g2p closed 3 weeks ago

g2p commented 1 month ago

This is for /tmp, which should be a mostly empty filesystem. Shutdown takes a long time for unclear reasons (may not be related to bcachefs), and I just reset the machine. I'm on d11e1164d85f6d6e08942edc0f5d14f9e9c6a8a0 with the usual rebasing over linus/master (e091caf99f3a5006c95baec24330bac6f7f17193). The following hangs (during journal replay?): mount -t bcachefs -o verbose,noatime /dev/mapper/... /tmp

In dmesg I have:

juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): starting version 1.9: disk_accounting_v2 opts=metadata_checksum=xxhash,data_checksum=xxhash,compression=lz4,background_compression=zstd,verbose
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): recovering from unclean shutdown
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): starting journal read
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): journal read done on device dm-19, ret 0
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): journal read done, replaying entries 19494-19504
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): Journal keys: 828 read, 381 after sorting and compacting
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): accounting_read... done
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): alloc_read... done
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): stripes_read... done
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): snapshots_read... done
juil. 12 17:42:26 moulinex kernel: bcachefs (dm-19): going read-write
juil. 12 17:46:11 moulinex kernel: bcachefs (dm-19): journal_replay...
juil. 12 17:46:11 moulinex kernel: INFO: task mount:4990 blocked for more than 120 seconds.
juil. 12 17:46:11 moulinex kernel:       Tainted: G            E      6.10.0-rc7-g2p #26
juil. 12 17:46:11 moulinex kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
juil. 12 17:46:11 moulinex kernel: task:mount           state:D stack:0     pid:4990  tgid:4990  ppid:3489   flags:0x00004002
juil. 12 17:46:11 moulinex kernel: Call Trace:
juil. 12 17:46:11 moulinex kernel:  <TASK>
juil. 12 17:46:11 moulinex kernel:  __schedule+0x42e/0x1920
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? __bch2_time_stats_update+0x121/0x380
juil. 12 17:46:11 moulinex kernel:  schedule+0x2d/0x130
juil. 12 17:46:11 moulinex kernel:  __closure_sync+0x6d/0xb0
juil. 12 17:46:11 moulinex kernel:  bch2_btree_update_start+0x863/0x8d0
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? irq_cpu_rmap_add+0x180/0x180
juil. 12 17:46:11 moulinex kernel:  bch2_btree_split_leaf+0x5e/0x240
juil. 12 17:46:11 moulinex kernel:  bch2_trans_commit_error+0x227/0x500
juil. 12 17:46:11 moulinex kernel:  ? bch2_journal_replay+0x534/0x7f0
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? bch2_trans_unlock_write+0x119/0x270
juil. 12 17:46:11 moulinex kernel:  ? bch2_trans_lock_write+0xfc/0x2c0
juil. 12 17:46:11 moulinex kernel:  __bch2_trans_commit+0x19d4/0x1b90
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  bch2_journal_replay+0x534/0x7f0
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? bch2_journal_replay+0x534/0x7f0
juil. 12 17:46:11 moulinex kernel:  bch2_run_recovery_pass+0x3e/0xd0
juil. 12 17:46:11 moulinex kernel:  bch2_run_recovery_passes+0xc6/0x1f0
juil. 12 17:46:11 moulinex kernel:  ? bch2_sb_set_upgrade_extra+0x69/0xb0
juil. 12 17:46:11 moulinex kernel:  bch2_fs_recovery+0xf6c/0x1560
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? __closure_wake_up+0x22/0x170
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? bch2_recalc_capacity+0x1bd/0x3c0
juil. 12 17:46:11 moulinex kernel:  bch2_fs_start+0x180/0x2a0
juil. 12 17:46:11 moulinex kernel:  bch2_fs_get_tree+0x685/0x860
juil. 12 17:46:11 moulinex kernel:  vfs_get_tree+0x2e/0x100
juil. 12 17:46:11 moulinex kernel:  path_mount+0x4ee/0xb30
juil. 12 17:46:11 moulinex kernel:  ? putname+0x5f/0x80
juil. 12 17:46:11 moulinex kernel:  __x64_sys_mount+0x12b/0x170
juil. 12 17:46:11 moulinex kernel:  x64_sys_call+0x1e8c/0x25e0
juil. 12 17:46:11 moulinex kernel:  do_syscall_64+0x68/0x120
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? syscall_exit_to_user_mode+0x79/0x180
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? do_syscall_64+0x74/0x120
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? putname+0x5f/0x80
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? __x64_sys_statx+0x75/0xa0
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? syscall_exit_to_user_mode+0x79/0x180
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? syscall_exit_to_user_mode+0x79/0x180
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? do_syscall_64+0x74/0x120
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? do_syscall_64+0x74/0x120
juil. 12 17:46:11 moulinex kernel:  ? irqentry_exit+0x47/0x60
juil. 12 17:46:11 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
juil. 12 17:46:11 moulinex kernel:  ? exc_page_fault+0x8d/0x1a0
juil. 12 17:46:11 moulinex kernel:  entry_SYSCALL_64_after_hwframe+0x55/0x5d
juil. 12 17:46:11 moulinex kernel: RIP: 0033:0x7f523552af0e
juil. 12 17:46:11 moulinex kernel: RSP: 002b:00007fff49c9a6e8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
juil. 12 17:46:11 moulinex kernel: RAX: ffffffffffffffda RBX: 000055eb92558940 RCX: 00007f523552af0e
juil. 12 17:46:11 moulinex kernel: RDX: 000055eb92558e10 RSI: 000055eb92558e50 RDI: 000055eb92559ae0
juil. 12 17:46:11 moulinex kernel: RBP: 00007fff49c9a750 R08: 000055eb92559c00 R09: 0000000000000020
juil. 12 17:46:11 moulinex kernel: R10: 0000000000000400 R11: 0000000000000246 R12: 000055eb92559ae0
juil. 12 17:46:11 moulinex kernel: R13: 000055eb92558e50 R14: 000055eb92558e10 R15: 000055eb92558aa0
juil. 12 17:46:11 moulinex kernel:  </TASK>

With faddr2line this becomes

__schedule+0x42e/0x1920:
context_switch at kernel/sched/core.c:5408
(inlined by) __schedule at kernel/sched/core.c:6745

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

__bch2_time_stats_update+0x121/0x380:
__bch2_time_stats_update at fs/bcachefs/time_stats.c:152

schedule+0x2d/0x130:
__preempt_count_sub at arch/x86/include/asm/preempt.h:84 (discriminator 13)
(inlined by) __schedule_loop at kernel/sched/core.c:6823 (discriminator 13)
(inlined by) schedule at kernel/sched/core.c:6837 (discriminator 13)

__closure_sync+0x6d/0xb0:
__closure_sync at lib/closure.c:143 (discriminator 4)

bch2_btree_update_start+0x863/0x8d0:
closure_sync at include/linux/closure.h:195
(inlined by) bch2_btree_update_start at fs/bcachefs/btree_update_interior.c:1267

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

irq_cpu_rmap_add+0x180/0x180:
closure_sync_fn at lib/closure.c:123

bch2_btree_split_leaf+0x5e/0x240:
bch2_btree_split_leaf at fs/bcachefs/btree_update_interior.c:1851

bch2_trans_commit_error+0x227/0x500:
bch2_trans_commit_error at fs/bcachefs/btree_trans_commit.c:947

bch2_journal_replay+0x534/0x7f0:
bch2_trans_commit at fs/bcachefs/btree_update.h:184
(inlined by) bch2_journal_replay at fs/bcachefs/recovery.c:343

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

bch2_trans_unlock_write+0x119/0x270:
six_unlock_write at fs/bcachefs/six.h:367 (discriminator 1)
(inlined by) bch2_btree_node_unlock_write_inlined at fs/bcachefs/btree_locking.h:187 (discriminator 1)
(inlined by) bch2_trans_unlock_write at fs/bcachefs/btree_trans_commit.c:142 (discriminator 1)

bch2_trans_lock_write+0xfc/0x2c0:
__btree_node_lock_write at fs/bcachefs/btree_locking.h:323
(inlined by) bch2_btree_node_lock_write at fs/bcachefs/btree_locking.h:331
(inlined by) bch2_trans_lock_write at fs/bcachefs/btree_trans_commit.c:125

__bch2_trans_commit+0x19d4/0x1b90:
__bch2_trans_commit at fs/bcachefs/btree_trans_commit.c:1175 (discriminator 1)

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

bch2_journal_replay+0x534/0x7f0:
bch2_trans_commit at fs/bcachefs/btree_update.h:184
(inlined by) bch2_journal_replay at fs/bcachefs/recovery.c:343

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

bch2_journal_replay+0x534/0x7f0:
bch2_trans_commit at fs/bcachefs/btree_update.h:184
(inlined by) bch2_journal_replay at fs/bcachefs/recovery.c:343

bch2_run_recovery_pass+0x3e/0xd0:
bch2_run_recovery_pass at fs/bcachefs/recovery_passes.c:184

bch2_run_recovery_passes+0xc6/0x1f0:
bch2_run_recovery_passes at fs/bcachefs/recovery_passes.c:230

bch2_sb_set_upgrade_extra+0x69/0xb0:
bch2_sb_set_upgrade_extra at fs/bcachefs/sb-downgrade.c:135

bch2_fs_recovery+0xf6c/0x1560:
bch2_fs_recovery at fs/bcachefs/recovery.c:853

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

__closure_wake_up+0x22/0x170:
__closure_wake_up at lib/closure.c:89 (discriminator 1)

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

bch2_recalc_capacity+0x1bd/0x3c0:
bch2_recalc_capacity at fs/bcachefs/alloc_background.c:2394

bch2_fs_start+0x180/0x2a0:
bch2_fs_start at fs/bcachefs/super.c:1036

bch2_fs_get_tree+0x685/0x860:
bch2_fs_get_tree at fs/bcachefs/fs.c:1947

vfs_get_tree+0x2e/0x100:
vfs_get_tree at fs/super.c:1790

path_mount+0x4ee/0xb30:
do_new_mount at fs/namespace.c:3353
(inlined by) path_mount at fs/namespace.c:3679

putname+0x5f/0x80:
putname at fs/namei.c:274

__x64_sys_mount+0x12b/0x170:
do_mount at fs/namespace.c:3693
(inlined by) __do_sys_mount at fs/namespace.c:3898
(inlined by) __se_sys_mount at fs/namespace.c:3875
(inlined by) __x64_sys_mount at fs/namespace.c:3875

x64_sys_call+0x1e8c/0x25e0:
x64_sys_call at arch/x86/entry/syscall_64.c:33

do_syscall_64+0x68/0x120:
do_syscall_x64 at arch/x86/entry/common.c:52 (discriminator 1)
(inlined by) do_syscall_64 at arch/x86/entry/common.c:83 (discriminator 1)

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

syscall_exit_to_user_mode+0x79/0x180:
syscall_exit_to_user_mode at kernel/entry/common.c:221

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

do_syscall_64+0x74/0x120:
do_syscall_64 at arch/x86/entry/common.c:102

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

putname+0x5f/0x80:
putname at fs/namei.c:274

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

__x64_sys_statx+0x75/0xa0:
__do_sys_statx at fs/stat.c:712
(inlined by) __se_sys_statx at fs/stat.c:700
(inlined by) __x64_sys_statx at fs/stat.c:700

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

syscall_exit_to_user_mode+0x79/0x180:
syscall_exit_to_user_mode at kernel/entry/common.c:221

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

syscall_exit_to_user_mode+0x79/0x180:
syscall_exit_to_user_mode at kernel/entry/common.c:221

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

do_syscall_64+0x74/0x120:
do_syscall_64 at arch/x86/entry/common.c:102

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

do_syscall_64+0x74/0x120:
do_syscall_64 at arch/x86/entry/common.c:102

irqentry_exit+0x47/0x60:
irqentry_exit at kernel/entry/common.c:367

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

exc_page_fault+0x8d/0x1a0:
exc_page_fault at arch/x86/mm/fault.c:1543

entry_SYSCALL_64_after_hwframe+0x55/0x5d:
entry_SYSCALL_64_after_hwframe at arch/x86/entry/entry_64.S:130
g2p commented 1 month ago
dev-0/alloc_debug:                     buckets         sectors      fragmented
dev-0/alloc_debug:free                       0               0               0
dev-0/alloc_debug:sb                        13            6152             504
dev-0/alloc_debug:journal                  640          327680               0
dev-0/alloc_debug:btree                     32           16384               0
dev-0/alloc_debug:user                       0               0               0
dev-0/alloc_debug:cached                     0               0               0
dev-0/alloc_debug:parity                     0               0               0
dev-0/alloc_debug:stripe                     0               0               0
dev-0/alloc_debug:need_gc_gens               0               0               0
dev-0/alloc_debug:need_discard               0               0               0
dev-0/alloc_debug:unstriped                  0               0               0
dev-0/alloc_debug:reserves:
dev-0/alloc_debug:stripe                  2616
dev-0/alloc_debug:normal                  1336
dev-0/alloc_debug:copygc                    56
dev-0/alloc_debug:btree                     28
dev-0/alloc_debug:btree_copygc               0
dev-0/alloc_debug:reclaim                    0
dev-0/alloc_debug:interior_updates           0
dev-0/alloc_debug:open buckets               0
dev-0/alloc_debug:buckets to invalidate      0
internal/alloc_debug:capacity               38587597
internal/alloc_debug:reserved               3355443
internal/alloc_debug:hidden                 334336
internal/alloc_debug:btree                  16384
internal/alloc_debug:data                   0
internal/alloc_debug:cached                 0
internal/alloc_debug:reserved               0
internal/alloc_debug:online_reserved        1024
internal/alloc_debug:nr_inodes              0
internal/alloc_debug:freelist_wait          waiting
internal/alloc_debug:open buckets allocated 1
internal/alloc_debug:open buckets total     1024
internal/alloc_debug:open_buckets_wait      empty
internal/alloc_debug:open_buckets_btree     0
internal/alloc_debug:open_buckets_user      0
internal/alloc_debug:btree reserve cache    0
g2p commented 1 month ago

In dev-0/alloc_debug, free at zero seems strange. Whereas user at zero seems correct (I guess systemd clears the fs before shutdown).

koverstreet commented 1 month ago

Try mounting with -o fsck,fix_errors; that looks like an upgrade from 1.7 that didn't regenerate accounting info

g2p commented 1 month ago

fsck,fix_errors still gets stuck. The backtrace from dmesg is almost identical, just a difference around bch2_journal_replay_key.

__schedule+0x42e/0x1920:
context_switch at kernel/sched/core.c:5408
(inlined by) __schedule at kernel/sched/core.c:6745

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

__bch2_time_stats_update+0x121/0x380:
__bch2_time_stats_update at fs/bcachefs/time_stats.c:152

schedule+0x2d/0x130:
__preempt_count_sub at arch/x86/include/asm/preempt.h:84 (discriminator 13)
(inlined by) __schedule_loop at kernel/sched/core.c:6823 (discriminator 13)
(inlined by) schedule at kernel/sched/core.c:6837 (discriminator 13)

__closure_sync+0x6d/0xb0:
__closure_sync at lib/closure.c:143 (discriminator 4)

bch2_btree_update_start+0x863/0x8d0:
closure_sync at include/linux/closure.h:195
(inlined by) bch2_btree_update_start at fs/bcachefs/btree_update_interior.c:1267

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

bch2_journal_keys_peek_slot+0x57/0x80:
bch2_journal_keys_peek_slot at fs/bcachefs/btree_journal_iter.c:116

irq_cpu_rmap_add+0x180/0x180:
closure_sync_fn at lib/closure.c:123

bch2_btree_split_leaf+0x5e/0x240:
bch2_btree_split_leaf at fs/bcachefs/btree_update_interior.c:1851

bch2_trans_commit_error+0x227/0x500:
bch2_trans_commit_error at fs/bcachefs/btree_trans_commit.c:947

bch2_journal_replay+0x534/0x7f0:
bch2_trans_commit at fs/bcachefs/btree_update.h:184
(inlined by) bch2_journal_replay at fs/bcachefs/recovery.c:343

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

bch2_trans_unlock_write+0x119/0x270:
six_unlock_write at fs/bcachefs/six.h:367 (discriminator 1)
(inlined by) bch2_btree_node_unlock_write_inlined at fs/bcachefs/btree_locking.h:187 (discriminator 1)
(inlined by) bch2_trans_unlock_write at fs/bcachefs/btree_trans_commit.c:142 (discriminator 1)

bch2_trans_lock_write+0xfc/0x2c0:
__btree_node_lock_write at fs/bcachefs/btree_locking.h:323
(inlined by) bch2_btree_node_lock_write at fs/bcachefs/btree_locking.h:331
(inlined by) bch2_trans_lock_write at fs/bcachefs/btree_trans_commit.c:125

__bch2_trans_commit+0x19d4/0x1b90:
__bch2_trans_commit at fs/bcachefs/btree_trans_commit.c:1175 (discriminator 1)

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

bch2_journal_replay_key+0x160/0x310:
bch2_journal_replay_key at fs/bcachefs/recovery.c:237

bch2_journal_replay+0x534/0x7f0:
bch2_trans_commit at fs/bcachefs/btree_update.h:184
(inlined by) bch2_journal_replay at fs/bcachefs/recovery.c:343

bch2_journal_replay+0x534/0x7f0:
bch2_trans_commit at fs/bcachefs/btree_update.h:184
(inlined by) bch2_journal_replay at fs/bcachefs/recovery.c:343

bch2_run_recovery_pass+0x3e/0xd0:
bch2_run_recovery_pass at fs/bcachefs/recovery_passes.c:184

bch2_run_recovery_passes+0xc6/0x1f0:
bch2_run_recovery_passes at fs/bcachefs/recovery_passes.c:230

bch2_sb_set_upgrade_extra+0x69/0xb0:
bch2_sb_set_upgrade_extra at fs/bcachefs/sb-downgrade.c:135

bch2_fs_recovery+0xf6c/0x1560:
bch2_fs_recovery at fs/bcachefs/recovery.c:853

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

__closure_wake_up+0x22/0x170:
__closure_wake_up at lib/closure.c:89 (discriminator 1)

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

bch2_recalc_capacity+0x1bd/0x3c0:
bch2_recalc_capacity at fs/bcachefs/alloc_background.c:2394

bch2_fs_start+0x180/0x2a0:
bch2_fs_start at fs/bcachefs/super.c:1036

bch2_fs_get_tree+0x685/0x860:
bch2_fs_get_tree at fs/bcachefs/fs.c:1947

vfs_get_tree+0x2e/0x100:
vfs_get_tree at fs/super.c:1790

path_mount+0x4ee/0xb30:
do_new_mount at fs/namespace.c:3353
(inlined by) path_mount at fs/namespace.c:3679

putname+0x5f/0x80:
putname at fs/namei.c:274

__x64_sys_mount+0x12b/0x170:
do_mount at fs/namespace.c:3693
(inlined by) __do_sys_mount at fs/namespace.c:3898
(inlined by) __se_sys_mount at fs/namespace.c:3875
(inlined by) __x64_sys_mount at fs/namespace.c:3875

x64_sys_call+0x1e8c/0x25e0:
x64_sys_call at arch/x86/entry/syscall_64.c:33

do_syscall_64+0x68/0x120:
do_syscall_x64 at arch/x86/entry/common.c:52 (discriminator 1)
(inlined by) do_syscall_64 at arch/x86/entry/common.c:83 (discriminator 1)

srso_return_thunk+0x5/0x5f:
srso_return_thunk at arch/x86/lib/retpoline.S:224

Should I send you the filesystem dump? Or just drop/recreate the fs, in this case there's no useful data I would like to keep.

koverstreet commented 1 month ago

Is alloc_debug any different this time?

g2p commented 1 month ago

alloc_debug is identical:

dev-0/alloc_debug:                     buckets         sectors      fragmented
dev-0/alloc_debug:free                       0               0               0
dev-0/alloc_debug:sb                        13            6152             504
dev-0/alloc_debug:journal                  640          327680               0
dev-0/alloc_debug:btree                     32           16384               0
dev-0/alloc_debug:user                       0               0               0
dev-0/alloc_debug:cached                     0               0               0
dev-0/alloc_debug:parity                     0               0               0
dev-0/alloc_debug:stripe                     0               0               0
dev-0/alloc_debug:need_gc_gens               0               0               0
dev-0/alloc_debug:need_discard               0               0               0
dev-0/alloc_debug:unstriped                  0               0               0
dev-0/alloc_debug:reserves:
dev-0/alloc_debug:stripe                  2616
dev-0/alloc_debug:normal                  1336
dev-0/alloc_debug:copygc                    56
dev-0/alloc_debug:btree                     28
dev-0/alloc_debug:btree_copygc               0
dev-0/alloc_debug:reclaim                    0
dev-0/alloc_debug:interior_updates           0
dev-0/alloc_debug:open buckets               0
dev-0/alloc_debug:buckets to invalidate      0
internal/alloc_debug:capacity               38587597
internal/alloc_debug:reserved               3355443
internal/alloc_debug:hidden                 334336
internal/alloc_debug:btree                  16384
internal/alloc_debug:data                   0
internal/alloc_debug:cached                 0
internal/alloc_debug:reserved               0
internal/alloc_debug:online_reserved        1024
internal/alloc_debug:nr_inodes              0
internal/alloc_debug:freelist_wait          waiting
internal/alloc_debug:open buckets allocated 1
internal/alloc_debug:open buckets total     1024
internal/alloc_debug:open_buckets_wait      empty
internal/alloc_debug:open_buckets_btree     0
internal/alloc_debug:open_buckets_user      0
internal/alloc_debug:btree reserve cache    0
g2p commented 1 month ago

(Probably a botched accounting migration issue as you say, as I used /tmp to bisect #707. I'll send a metadata dump on request)

g2p commented 4 weeks ago

This one did journal replay and got stuck within check_allocations with a lockdep warning (decode_stacktrace will come after a reboot):

2024-08-08T08:37:09.769273+00:00 moulinex kernel: bcachefs (dm-19): starting version 1.9: disk_accounting_v2 opts=metadata_checksum=xxhash,data_checksum=xxhash,compression=lz4,background_compression=zstd,verbose,fsck,fix_errors=yes
2024-08-08T08:37:09.789246+00:00 moulinex kernel: bcachefs (dm-19): recovering from unclean shutdown
2024-08-08T08:37:09.789348+00:00 moulinex kernel: bcachefs (dm-19): starting journal read
2024-08-08T08:37:09.825253+00:00 moulinex kernel: bcachefs (dm-19): journal read done on device dm-19, ret 0
2024-08-08T08:37:09.825373+00:00 moulinex kernel: bcachefs (dm-19): journal read done, replaying entries 19494-19544
2024-08-08T08:37:09.829884+00:00 moulinex kernel: bcachefs (dm-19): Journal keys: 868 read, 387 after sorting and compacting
2024-08-08T08:37:09.905255+00:00 moulinex kernel: bcachefs (dm-19): accounting_read... done
2024-08-08T08:37:09.905397+00:00 moulinex kernel: bcachefs (dm-19): alloc_read... done
2024-08-08T08:37:09.905446+00:00 moulinex kernel: bcachefs (dm-19): stripes_read... done
2024-08-08T08:37:09.905493+00:00 moulinex kernel: bcachefs (dm-19): snapshots_read... done
2024-08-08T08:37:09.913225+00:00 moulinex kernel: bcachefs (dm-19): check_allocations...
2024-08-08T08:37:09.913278+00:00 moulinex kernel: 
2024-08-08T08:37:09.913311+00:00 moulinex kernel: ======================================================
2024-08-08T08:37:09.913353+00:00 moulinex kernel: WARNING: possible circular locking dependency detected
2024-08-08T08:37:09.913379+00:00 moulinex kernel: 6.11.0-rc2-g2p #41 Tainted: G            E     
2024-08-08T08:37:09.913405+00:00 moulinex kernel: ------------------------------------------------------
2024-08-08T08:37:09.913430+00:00 moulinex kernel: kswapd0/126 is trying to acquire lock:
2024-08-08T08:37:09.913457+00:00 moulinex kernel: ffff98e6fd8a17a0 (&xfs_nondir_ilock_class#3){++++}-{3:3}, at: xfs_ilock+0xca/0x2d0 [xfs]
2024-08-08T08:37:09.913479+00:00 moulinex kernel: 
                                                  but task is already holding lock:
2024-08-08T08:37:09.913506+00:00 moulinex kernel: ffffffffa96b8140 (fs_reclaim){+.+.}-{0:0}, at: balance_pgdat+0x424/0xac0
2024-08-08T08:37:09.913531+00:00 moulinex kernel: 
                                                  which lock already depends on the new lock.
2024-08-08T08:37:09.913557+00:00 moulinex kernel: 
                                                  the existing dependency chain (in reverse order) is:
2024-08-08T08:37:09.913583+00:00 moulinex kernel: 
                                                  -> #2 (fs_reclaim){+.+.}-{0:0}:
2024-08-08T08:37:09.913608+00:00 moulinex kernel:        fs_reclaim_acquire+0xc9/0x120
2024-08-08T08:37:09.913640+00:00 moulinex kernel:        __kmalloc_cache_noprof+0x5c/0x390
2024-08-08T08:37:09.913662+00:00 moulinex kernel:        __kthread_create_on_node+0xa1/0x1b0
2024-08-08T08:37:09.913683+00:00 moulinex kernel:        kthread_create_on_node+0x55/0x80
2024-08-08T08:37:09.913705+00:00 moulinex kernel:        bch_btree_check+0x2a1/0x510 [bcache]
2024-08-08T08:37:09.913733+00:00 moulinex kernel:        run_cache_set+0x7d2/0x9a0 [bcache]
2024-08-08T08:37:09.913751+00:00 moulinex kernel:        register_cache_worker+0x95b/0xb10 [bcache]
2024-08-08T08:37:09.913773+00:00 moulinex kernel:        process_one_work+0x21d/0x740
2024-08-08T08:37:09.913790+00:00 moulinex kernel:        worker_thread+0x1c1/0x3b0
2024-08-08T08:37:09.913811+00:00 moulinex kernel:        kthread+0xeb/0x120
2024-08-08T08:37:09.913833+00:00 moulinex kernel:        ret_from_fork+0x4b/0x70
2024-08-08T08:37:09.913854+00:00 moulinex kernel:        ret_from_fork_asm+0x11/0x20
2024-08-08T08:37:09.913875+00:00 moulinex kernel: 
                                                  -> #1 (&b->lock){++++}-{3:3}:
2024-08-08T08:37:09.913903+00:00 moulinex kernel:        down_read+0x3b/0x2e0
2024-08-08T08:37:09.913925+00:00 moulinex kernel:        bch_btree_map_keys+0xf9/0x200 [bcache]
2024-08-08T08:37:09.913948+00:00 moulinex kernel:        cache_lookup+0xa7/0x180 [bcache]
2024-08-08T08:37:09.913971+00:00 moulinex kernel:        cached_dev_submit_bio+0x94f/0xf00 [bcache]
2024-08-08T08:37:09.913994+00:00 moulinex kernel:        __submit_bio+0xe5/0x190
2024-08-08T08:37:09.914017+00:00 moulinex kernel:        submit_bio_noacct_nocheck+0x1c7/0x430
2024-08-08T08:37:09.914040+00:00 moulinex kernel:        submit_bio_noacct+0x22c/0x680
2024-08-08T08:37:09.914063+00:00 moulinex kernel:        submit_bio+0x3c/0x110
2024-08-08T08:37:09.914086+00:00 moulinex kernel:        _xfs_buf_ioapply+0x2b4/0x440 [xfs]
2024-08-08T08:37:09.914116+00:00 moulinex kernel:        __xfs_buf_submit+0x9a/0x2d0 [xfs]
2024-08-08T08:37:09.914138+00:00 moulinex kernel:        _xfs_buf_read+0x49/0xa0 [xfs]
2024-08-08T08:37:09.914162+00:00 moulinex kernel:        xfs_buf_read_map+0x149/0x380 [xfs]
2024-08-08T08:37:09.914185+00:00 moulinex kernel:        xfs_trans_read_buf_map+0x1fa/0x630 [xfs]
2024-08-08T08:37:09.914208+00:00 moulinex kernel:        xfs_alloc_read_agfl+0xc7/0x140 [xfs]
2024-08-08T08:37:09.914229+00:00 moulinex kernel:        xfs_alloc_fix_freelist+0x265/0x6c0 [xfs]
2024-08-08T08:37:09.914247+00:00 moulinex kernel:        xfs_alloc_vextent_prepare_ag+0x36/0x200 [xfs]
2024-08-08T08:37:09.914269+00:00 moulinex kernel:        xfs_alloc_vextent_iterate_ags.constprop.0+0x9f/0x300 [xfs]
2024-08-08T08:37:09.914291+00:00 moulinex kernel:        xfs_alloc_vextent_start_ag+0x127/0x290 [xfs]
2024-08-08T08:37:09.914308+00:00 moulinex kernel:        xfs_bmap_btalloc+0x42e/0x690 [xfs]
2024-08-08T08:37:09.914326+00:00 moulinex kernel:        xfs_bmapi_allocate+0xa6/0x450 [xfs]
2024-08-08T08:37:09.914352+00:00 moulinex kernel:        xfs_bmapi_write+0x3e4/0xa50 [xfs]
2024-08-08T08:37:09.914376+00:00 moulinex kernel:        xfs_alloc_file_space+0x1df/0x360 [xfs]
2024-08-08T08:37:09.914394+00:00 moulinex kernel:        xfs_file_fallocate+0x4a3/0x560 [xfs]
2024-08-08T08:37:09.914417+00:00 moulinex kernel:        vfs_fallocate+0x156/0x4e0
2024-08-08T08:37:09.914440+00:00 moulinex kernel:        __x64_sys_fallocate+0x4b/0x80
2024-08-08T08:37:09.914459+00:00 moulinex kernel:        x64_sys_call+0x1774/0x25f0
2024-08-08T08:37:09.914477+00:00 moulinex kernel:        do_syscall_64+0x86/0x140
2024-08-08T08:37:09.914500+00:00 moulinex kernel:        entry_SYSCALL_64_after_hwframe+0x55/0x5d
2024-08-08T08:37:09.914523+00:00 moulinex kernel: 
                                                  -> #0 (&xfs_nondir_ilock_class#3){++++}-{3:3}:
2024-08-08T08:37:09.914547+00:00 moulinex kernel:        __lock_acquire+0x1513/0x24d0
2024-08-08T08:37:09.914565+00:00 moulinex kernel:        lock_acquire+0xba/0x300
2024-08-08T08:37:09.914588+00:00 moulinex kernel:        down_read_nested+0x3f/0x2b0
2024-08-08T08:37:09.914614+00:00 moulinex kernel:        xfs_ilock+0xca/0x2d0 [xfs]
2024-08-08T08:37:09.914637+00:00 moulinex kernel:        xfs_can_free_eofblocks+0x147/0x220 [xfs]
2024-08-08T08:37:09.914659+00:00 moulinex kernel:        xfs_inode_needs_inactive+0xb7/0xe0 [xfs]
2024-08-08T08:37:09.914677+00:00 moulinex kernel:        xfs_inode_mark_reclaimable+0xb0/0x520 [xfs]
2024-08-08T08:37:09.914691+00:00 moulinex kernel:        xfs_fs_destroy_inode+0x102/0x230 [xfs]
2024-08-08T08:37:09.914709+00:00 moulinex kernel:        destroy_inode+0x41/0x80
2024-08-08T08:37:09.914731+00:00 moulinex kernel:        evict+0x17d/0x1d0
2024-08-08T08:37:09.914753+00:00 moulinex kernel:        prune_icache_sb+0x83/0xd0
2024-08-08T08:37:09.914771+00:00 moulinex kernel:        super_cache_scan+0x155/0x1f0
2024-08-08T08:37:09.914790+00:00 moulinex kernel:        do_shrink_slab+0x167/0x7a0
2024-08-08T08:37:09.914812+00:00 moulinex kernel:        shrink_slab+0x587/0x960
2024-08-08T08:37:09.914834+00:00 moulinex kernel:        shrink_node+0x3f0/0x1310
2024-08-08T08:37:09.914859+00:00 moulinex kernel:        balance_pgdat+0x3ae/0xac0
2024-08-08T08:37:09.915075+00:00 moulinex kernel:        kswapd+0x232/0x4a0
2024-08-08T08:37:09.915095+00:00 moulinex kernel:        kthread+0xeb/0x120
2024-08-08T08:37:09.915113+00:00 moulinex kernel:        ret_from_fork+0x4b/0x70
2024-08-08T08:37:09.915131+00:00 moulinex kernel:        ret_from_fork_asm+0x11/0x20
2024-08-08T08:37:09.915143+00:00 moulinex kernel: 
                                                  other info that might help us debug this:
2024-08-08T08:37:09.915165+00:00 moulinex kernel: Chain exists of:
                                                    &xfs_nondir_ilock_class#3 --> &b->lock --> fs_reclaim
2024-08-08T08:37:09.915178+00:00 moulinex kernel:  Possible unsafe locking scenario:
2024-08-08T08:37:09.915200+00:00 moulinex kernel:        CPU0                    CPU1
2024-08-08T08:37:09.915221+00:00 moulinex kernel:        ----                    ----
2024-08-08T08:37:09.915238+00:00 moulinex kernel:   lock(fs_reclaim);
2024-08-08T08:37:09.915260+00:00 moulinex kernel:                                lock(&b->lock);
2024-08-08T08:37:09.915283+00:00 moulinex kernel:                                lock(fs_reclaim);
2024-08-08T08:37:09.915309+00:00 moulinex kernel:   rlock(&xfs_nondir_ilock_class#3);
2024-08-08T08:37:09.915332+00:00 moulinex kernel: 
                                                   *** DEADLOCK ***
2024-08-08T08:37:09.915355+00:00 moulinex kernel: 2 locks held by kswapd0/126:
2024-08-08T08:37:09.915378+00:00 moulinex kernel:  #0: ffffffffa96b8140 (fs_reclaim){+.+.}-{0:0}, at: balance_pgdat+0x424/0xac0
2024-08-08T08:37:09.915401+00:00 moulinex kernel:  #1: ffff98e50b6a60e8 (&type->s_umount_key#72){++++}-{3:3}, at: super_cache_scan+0x3d/0x1f0
2024-08-08T08:37:09.915420+00:00 moulinex kernel: 
                                                  stack backtrace:
2024-08-08T08:37:09.915442+00:00 moulinex kernel: CPU: 11 UID: 0 PID: 126 Comm: kswapd0 Tainted: G            E      6.11.0-rc2-g2p #41
2024-08-08T08:37:09.915463+00:00 moulinex kernel: Tainted: [E]=UNSIGNED_MODULE
2024-08-08T08:37:09.915479+00:00 moulinex kernel: Hardware name: To Be Filled By O.E.M. X570 Phantom Gaming 4/X570 Phantom Gaming 4, BIOS P5.61 02/22/2024
2024-08-08T08:37:09.915496+00:00 moulinex kernel: Call Trace:
2024-08-08T08:37:09.915512+00:00 moulinex kernel:  <TASK>
2024-08-08T08:37:09.915532+00:00 moulinex kernel:  dump_stack_lvl+0x7b/0xd0
2024-08-08T08:37:09.915555+00:00 moulinex kernel:  dump_stack+0x14/0x20
2024-08-08T08:37:09.915575+00:00 moulinex kernel:  print_circular_bug+0x27d/0x350
2024-08-08T08:37:09.915596+00:00 moulinex kernel:  check_noncircular+0x152/0x170
2024-08-08T08:37:09.915616+00:00 moulinex kernel:  __lock_acquire+0x1513/0x24d0
2024-08-08T08:37:09.915632+00:00 moulinex kernel:  lock_acquire+0xba/0x300
2024-08-08T08:37:09.915652+00:00 moulinex kernel:  ? xfs_ilock+0xca/0x2d0 [xfs]
2024-08-08T08:37:09.915673+00:00 moulinex kernel:  down_read_nested+0x3f/0x2b0
2024-08-08T08:37:09.915693+00:00 moulinex kernel:  ? xfs_ilock+0xca/0x2d0 [xfs]
2024-08-08T08:37:09.915709+00:00 moulinex kernel:  xfs_ilock+0xca/0x2d0 [xfs]
2024-08-08T08:37:09.915729+00:00 moulinex kernel:  xfs_can_free_eofblocks+0x147/0x220 [xfs]
2024-08-08T08:37:09.915757+00:00 moulinex kernel:  ? lock_release+0x2bc/0x410
2024-08-08T08:37:09.915777+00:00 moulinex kernel:  xfs_inode_needs_inactive+0xb7/0xe0 [xfs]
2024-08-08T08:37:09.915799+00:00 moulinex kernel:  xfs_inode_mark_reclaimable+0xb0/0x520 [xfs]
2024-08-08T08:37:09.915822+00:00 moulinex kernel:  xfs_fs_destroy_inode+0x102/0x230 [xfs]
2024-08-08T08:37:09.915845+00:00 moulinex kernel:  destroy_inode+0x41/0x80
2024-08-08T08:37:09.915868+00:00 moulinex kernel:  evict+0x17d/0x1d0
2024-08-08T08:37:09.915887+00:00 moulinex kernel:  prune_icache_sb+0x83/0xd0
2024-08-08T08:37:09.915917+00:00 moulinex kernel:  super_cache_scan+0x155/0x1f0
2024-08-08T08:37:09.915936+00:00 moulinex kernel:  do_shrink_slab+0x167/0x7a0
2024-08-08T08:37:09.915953+00:00 moulinex kernel:  shrink_slab+0x587/0x960
2024-08-08T08:37:09.915975+00:00 moulinex kernel:  ? shrink_slab+0x3c0/0x960
2024-08-08T08:37:09.915998+00:00 moulinex kernel:  ? shrink_slab+0x463/0x960
2024-08-08T08:37:09.916021+00:00 moulinex kernel:  shrink_node+0x3f0/0x1310
2024-08-08T08:37:09.916039+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:37:09.916062+00:00 moulinex kernel:  ? lock_acquire+0xba/0x300
2024-08-08T08:37:09.916080+00:00 moulinex kernel:  ? zone_watermark_ok+0x20/0x40
2024-08-08T08:37:09.916110+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:37:09.916128+00:00 moulinex kernel:  balance_pgdat+0x3ae/0xac0
2024-08-08T08:37:09.916151+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:37:09.916164+00:00 moulinex kernel:  ? lock_acquire+0xba/0x300
2024-08-08T08:37:09.916182+00:00 moulinex kernel:  kswapd+0x232/0x4a0
2024-08-08T08:37:09.916200+00:00 moulinex kernel:  ? destroy_sched_domains_rcu+0x40/0x40
2024-08-08T08:37:09.916219+00:00 moulinex kernel:  ? balance_pgdat+0xac0/0xac0
2024-08-08T08:37:09.916242+00:00 moulinex kernel:  kthread+0xeb/0x120
2024-08-08T08:37:09.916264+00:00 moulinex kernel:  ? kthread_insert_work_sanity_check+0x70/0x70
2024-08-08T08:37:09.916286+00:00 moulinex kernel:  ret_from_fork+0x4b/0x70
2024-08-08T08:37:09.916304+00:00 moulinex kernel:  ? kthread_insert_work_sanity_check+0x70/0x70
2024-08-08T08:37:09.916322+00:00 moulinex kernel:  ret_from_fork_asm+0x11/0x20
2024-08-08T08:37:09.916340+00:00 moulinex kernel:  </TASK>
2024-08-08T08:37:10.061242+00:00 moulinex kernel: bcachefs (dm-19): going read-write
2024-08-08T08:39:14.849272+00:00 moulinex kernel: bcachefs (dm-19): journal_replay...
2024-08-08T08:39:14.849468+00:00 moulinex kernel: INFO: task mount:23263 blocked for more than 120 seconds.
2024-08-08T08:39:14.849505+00:00 moulinex kernel:       Tainted: G            E      6.11.0-rc2-g2p #41
2024-08-08T08:39:14.849529+00:00 moulinex kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
2024-08-08T08:39:14.849554+00:00 moulinex kernel: task:mount           state:D stack:0     pid:23263 tgid:23263 ppid:23103  flags:0x00004002
2024-08-08T08:39:14.849578+00:00 moulinex kernel: Call Trace:
2024-08-08T08:39:14.849602+00:00 moulinex kernel:  <TASK>
2024-08-08T08:39:14.849623+00:00 moulinex kernel:  __schedule+0x534/0x1c40
2024-08-08T08:39:14.849646+00:00 moulinex kernel:  ? trace_hardirqs_on+0x22/0xe0
2024-08-08T08:39:14.849670+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:39:14.849698+00:00 moulinex kernel:  ? lock_acquire+0x288/0x300
2024-08-08T08:39:14.849721+00:00 moulinex kernel:  schedule+0x48/0x1e0
2024-08-08T08:39:14.849763+00:00 moulinex kernel:  __closure_sync+0x6d/0xb0
2024-08-08T08:39:14.849787+00:00 moulinex kernel:  bch2_btree_update_start+0x8d4/0x940
2024-08-08T08:39:14.849805+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:39:14.849824+00:00 moulinex kernel:  ? bch2_journal_keys_peek_slot+0x57/0x80
2024-08-08T08:39:14.849847+00:00 moulinex kernel:  ? closure_wait+0x50/0x50
2024-08-08T08:39:14.849871+00:00 moulinex kernel:  bch2_btree_split_leaf+0x5e/0x240
2024-08-08T08:39:14.849895+00:00 moulinex kernel:  bch2_trans_commit_error+0x23f/0x5c0
2024-08-08T08:39:14.849918+00:00 moulinex kernel:  ? bch2_journal_replay+0x534/0x7f0
2024-08-08T08:39:14.849937+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:39:14.849956+00:00 moulinex kernel:  ? bch2_trans_unlock_write+0x11c/0x270
2024-08-08T08:39:14.849979+00:00 moulinex kernel:  ? bch2_trans_lock_write+0xff/0x2d0
2024-08-08T08:39:14.850003+00:00 moulinex kernel:  ? __bch2_trans_commit+0xcfa/0x1fb0
2024-08-08T08:39:14.850034+00:00 moulinex kernel:  __bch2_trans_commit+0x1ea8/0x1fb0
2024-08-08T08:39:14.850057+00:00 moulinex kernel:  bch2_journal_replay+0x534/0x7f0
2024-08-08T08:39:14.850081+00:00 moulinex kernel:  ? bch2_journal_replay+0x534/0x7f0
2024-08-08T08:39:14.850100+00:00 moulinex kernel:  bch2_run_recovery_pass+0x3e/0xd0
2024-08-08T08:39:14.850123+00:00 moulinex kernel:  bch2_run_recovery_passes+0xc6/0x1f0
2024-08-08T08:39:14.850141+00:00 moulinex kernel:  ? bch2_sb_set_upgrade_extra+0x6b/0xc0
2024-08-08T08:39:14.850165+00:00 moulinex kernel:  bch2_fs_recovery+0xf6e/0x16a0
2024-08-08T08:39:14.850188+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:39:14.850206+00:00 moulinex kernel:  ? lock_release+0x2bc/0x410
2024-08-08T08:39:14.850225+00:00 moulinex kernel:  ? bch2_get_next_online_dev+0x1e4/0x400
2024-08-08T08:39:14.850249+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:39:14.850267+00:00 moulinex kernel:  ? __closure_wake_up+0x22/0x1a0
2024-08-08T08:39:14.850291+00:00 moulinex kernel:  bch2_fs_start+0x182/0x2a0
2024-08-08T08:39:14.850314+00:00 moulinex kernel:  bch2_fs_get_tree+0x655/0x880
2024-08-08T08:39:14.850344+00:00 moulinex kernel:  vfs_get_tree+0x31/0x110
2024-08-08T08:39:14.850368+00:00 moulinex kernel:  path_mount+0x4f1/0xc00
2024-08-08T08:39:14.850391+00:00 moulinex kernel:  ? putname+0x5f/0x80
2024-08-08T08:39:14.850414+00:00 moulinex kernel:  __x64_sys_mount+0x128/0x170
2024-08-08T08:39:14.850437+00:00 moulinex kernel:  x64_sys_call+0x1ada/0x25f0
2024-08-08T08:39:14.850460+00:00 moulinex kernel:  do_syscall_64+0x86/0x140
2024-08-08T08:39:14.850483+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:39:14.850497+00:00 moulinex kernel:  ? irqentry_exit+0x7b/0xb0
2024-08-08T08:39:14.850520+00:00 moulinex kernel:  ? srso_return_thunk+0x5/0x5f
2024-08-08T08:39:14.850537+00:00 moulinex kernel:  ? exc_page_fault+0x9d/0x2c0
2024-08-08T08:39:14.850560+00:00 moulinex kernel:  entry_SYSCALL_64_after_hwframe+0x55/0x5d
2024-08-08T08:39:14.850579+00:00 moulinex kernel: RIP: 0033:0x7f816792af0e
2024-08-08T08:39:14.850604+00:00 moulinex kernel: RSP: 002b:00007ffd9147f508 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
2024-08-08T08:39:14.850632+00:00 moulinex kernel: RAX: ffffffffffffffda RBX: 0000563ae460b940 RCX: 00007f816792af0e
2024-08-08T08:39:14.850653+00:00 moulinex kernel: RDX: 0000563ae460bed0 RSI: 0000563ae460bf10 RDI: 0000563ae460cba0
2024-08-08T08:39:14.850669+00:00 moulinex kernel: RBP: 00007ffd9147f570 R08: 0000563ae460d000 R09: 0000000000000020
2024-08-08T08:39:14.850689+00:00 moulinex kernel: R10: 0000000000000400 R11: 0000000000000246 R12: 0000563ae460cba0
2024-08-08T08:39:14.850707+00:00 moulinex kernel: R13: 0000563ae460bf10 R14: 0000563ae460bed0 R15: 0000563ae460baa0
2024-08-08T08:39:14.850726+00:00 moulinex kernel:  </TASK>
g2p commented 4 weeks ago

No lockdep warning this time, but a list of stuck locks. alloc_info same as ususal.

2024-08-08T09:36:52.393483+00:00 moulinex kernel: bcachefs (dm-19): starting version 1.9: disk_accounting_v2 opts=metadata_checksum=xxhash,data_checksum=xxhash,compression=lz4,background_compression=zstd,verbose,fsck,fix_errors=yes
2024-08-08T09:36:52.393715+00:00 moulinex kernel: bcachefs (dm-19): recovering from unclean shutdown
2024-08-08T09:36:52.393779+00:00 moulinex kernel: bcachefs (dm-19): starting journal read
2024-08-08T09:36:52.445476+00:00 moulinex kernel: bcachefs (dm-19): journal read done on device dm-19, ret 0
2024-08-08T09:36:52.445534+00:00 moulinex kernel: bcachefs (dm-19): journal read done, replaying entries 19494-19554
2024-08-08T09:36:52.445572+00:00 moulinex kernel: bcachefs (dm-19): Journal keys: 878 read, 387 after sorting and compacting
2024-08-08T09:36:52.489689+00:00 moulinex kernel: bcachefs (dm-19): accounting_read... done
2024-08-08T09:36:52.489760+00:00 moulinex kernel: bcachefs (dm-19): alloc_read... done
2024-08-08T09:36:52.489796+00:00 moulinex kernel: bcachefs (dm-19): stripes_read... done
2024-08-08T09:36:52.489831+00:00 moulinex kernel: bcachefs (dm-19): snapshots_read... done
2024-08-08T09:36:52.789480+00:00 moulinex kernel: bcachefs (dm-19): check_allocations... done
2024-08-08T09:36:52.793478+00:00 moulinex kernel: bcachefs (dm-19): going read-write
2024-08-08T09:37:25.261700+00:00 moulinex kernel: bcachefs (dm-19): journal_replay...
2024-08-08T09:37:25.262072+00:00 moulinex kernel: Allocator stuck? Waited for 30 seconds
2024-08-08T09:37:25.262223+00:00 moulinex kernel: Allocator debug:
2024-08-08T09:37:25.262293+00:00 moulinex kernel:   capacity38587597
2024-08-08T09:37:25.262354+00:00 moulinex kernel:   reserved             3355443
2024-08-08T09:37:25.262418+00:00 moulinex kernel:   hidden               334336
2024-08-08T09:37:25.262528+00:00 moulinex kernel:   btree                16384
2024-08-08T09:37:25.262588+00:00 moulinex kernel:   data                 0
2024-08-08T09:37:25.262642+00:00 moulinex kernel:   cached               0
2024-08-08T09:37:25.262697+00:00 moulinex kernel:   reserved             0
2024-08-08T09:37:25.262745+00:00 moulinex kernel:   online_reserved      1024
2024-08-08T09:37:25.262798+00:00 moulinex kernel:   nr_inodes            0
2024-08-08T09:37:25.262851+00:00 moulinex kernel:
2024-08-08T09:37:25.262905+00:00 moulinex kernel:   freelist_wait        waiting
2024-08-08T09:37:25.262957+00:00 moulinex kernel:   open buckets allocated1
2024-08-08T09:37:25.263032+00:00 moulinex kernel:   open buckets total   1024
2024-08-08T09:37:25.263090+00:00 moulinex kernel:   open_buckets_wait    empty
2024-08-08T09:37:25.263136+00:00 moulinex kernel:   open_buckets_btree   0
2024-08-08T09:37:25.263171+00:00 moulinex kernel:   open_buckets_user    0
2024-08-08T09:37:25.263206+00:00 moulinex kernel:   btree reserve cache  0
2024-08-08T09:37:25.263240+00:00 moulinex kernel:
2024-08-08T09:37:25.263292+00:00 moulinex kernel: Dev 0:
2024-08-08T09:37:25.263341+00:00 moulinex kernel:                      buckets         sectors      fragmented
2024-08-08T09:37:25.263395+00:00 moulinex kernel:   free                     0               0               0
2024-08-08T09:37:25.263451+00:00 moulinex kernel:   sb                      13            6152             504
2024-08-08T09:37:25.263502+00:00 moulinex kernel:   journal                640          327680               0
2024-08-08T09:37:25.263552+00:00 moulinex kernel:   btree                   32           16384               0
2024-08-08T09:37:25.264047+00:00 moulinex kernel:   user                     0               0               0
2024-08-08T09:37:25.264168+00:00 moulinex kernel:   cached                   0               0               0
2024-08-08T09:37:25.264229+00:00 moulinex kernel:   parity                   0               0               0
2024-08-08T09:37:25.264286+00:00 moulinex kernel:   stripe                   0               0               0
2024-08-08T09:37:25.264343+00:00 moulinex kernel:   need_gc_gens             0               0               0
2024-08-08T09:37:25.264399+00:00 moulinex kernel:   need_discard             0               0               0
2024-08-08T09:37:25.264441+00:00 moulinex kernel:   unstriped                0               0               0
2024-08-08T09:37:25.264477+00:00 moulinex kernel:
2024-08-08T09:37:25.264502+00:00 moulinex kernel:   reserves:
2024-08-08T09:37:25.264537+00:00 moulinex kernel:   stripe                2616
2024-08-08T09:37:25.264578+00:00 moulinex kernel:   normal                1336
2024-08-08T09:37:25.264627+00:00 moulinex kernel:   copygc                  56
2024-08-08T09:37:25.264706+00:00 moulinex kernel:   btree                   28
2024-08-08T09:37:25.264759+00:00 moulinex kernel:   btree_copygc             0
2024-08-08T09:37:25.264808+00:00 moulinex kernel:   reclaim                  0
2024-08-08T09:37:25.264858+00:00 moulinex kernel:   interior_updates         0
2024-08-08T09:37:25.264911+00:00 moulinex kernel:
2024-08-08T09:37:25.264948+00:00 moulinex kernel:   open buckets             0
2024-08-08T09:37:25.265000+00:00 moulinex kernel:   buckets to invalidate    0
2024-08-08T09:37:25.265039+00:00 moulinex kernel:
2024-08-08T09:37:25.265064+00:00 moulinex kernel: Copygc debug:
2024-08-08T09:37:25.265114+00:00 moulinex kernel:   running: 0
2024-08-08T09:37:25.265163+00:00 moulinex kernel:   copygc_wait:0
2024-08-08T09:37:25.265210+00:00 moulinex kernel:   copygc_wait_at:0
2024-08-08T09:37:25.265257+00:00 moulinex kernel:   Currently waiting for:0 B
2024-08-08T09:37:25.265328+00:00 moulinex kernel:   Currently waiting since:2.16 GiB
2024-08-08T09:37:25.265384+00:00 moulinex kernel:   Currently calculated wait:0 B
2024-08-08T09:37:25.265435+00:00 moulinex kernel:
2024-08-08T09:37:25.265587+00:00 moulinex kernel: Journal debug:
2024-08-08T09:37:25.265670+00:00 moulinex kernel:   flags:                   running,may_skip_flush
2024-08-08T09:37:25.265724+00:00 moulinex kernel:   dirty journal entries:   71/32768
2024-08-08T09:37:25.265774+00:00 moulinex kernel:   seq:                     19564
2024-08-08T09:37:25.265808+00:00 moulinex kernel:   seq_ondisk:              19564
2024-08-08T09:37:25.265843+00:00 moulinex kernel:   last_seq:                19494
2024-08-08T09:37:25.265882+00:00 moulinex kernel:   last_seq_ondisk:         19494
2024-08-08T09:37:25.265921+00:00 moulinex kernel:   flushed_seq_ondisk:      19564
2024-08-08T09:37:25.265971+00:00 moulinex kernel:   watermark:               stripe
2024-08-08T09:37:25.266052+00:00 moulinex kernel:   each entry reserved:     321
2024-08-08T09:37:25.266110+00:00 moulinex kernel:   nr flush writes:         2
2024-08-08T09:37:25.266151+00:00 moulinex kernel:   nr noflush writes:       0
2024-08-08T09:37:25.266200+00:00 moulinex kernel:   average write size:      3.00 KiB
2024-08-08T09:37:25.266252+00:00 moulinex kernel:   nr direct reclaim:       0
2024-08-08T09:37:25.266302+00:00 moulinex kernel:   nr background reclaim:   12
2024-08-08T09:37:25.266354+00:00 moulinex kernel:   reclaim kicked:          0
2024-08-08T09:37:25.266407+00:00 moulinex kernel:   reclaim runs in:         96 ms
2024-08-08T09:37:25.266457+00:00 moulinex kernel:   blocked:                 0
2024-08-08T09:37:25.266499+00:00 moulinex kernel:   current entry sectors:   512
2024-08-08T09:37:25.266537+00:00 moulinex kernel:   current entry error:     ok
2024-08-08T09:37:25.266577+00:00 moulinex kernel:   current entry:           closed
2024-08-08T09:37:25.266625+00:00 moulinex kernel:   unwritten entries:
2024-08-08T09:37:25.266698+00:00 moulinex kernel:   last buf closed
2024-08-08T09:37:25.266752+00:00 moulinex kernel:   space:
2024-08-08T09:37:25.266777+00:00 moulinex kernel:     discarded              512:326144
2024-08-08T09:37:25.266825+00:00 moulinex kernel:     clean ondisk           512:326144
2024-08-08T09:37:25.266875+00:00 moulinex kernel:     clean                  512:326144
2024-08-08T09:37:25.266913+00:00 moulinex kernel:     total                  512:327680
2024-08-08T09:37:25.266959+00:00 moulinex kernel:   dev 0:
2024-08-08T09:37:25.267009+00:00 moulinex kernel:     nr                     640
2024-08-08T09:37:25.267060+00:00 moulinex kernel:     bucket size            512
2024-08-08T09:37:25.267102+00:00 moulinex kernel:     available              637:385
2024-08-08T09:37:25.267127+00:00 moulinex kernel:     discard_idx            276
2024-08-08T09:37:25.267161+00:00 moulinex kernel:     dirty_ondisk           276 (seq 19500)
2024-08-08T09:37:25.267231+00:00 moulinex kernel:     dirty_idx              276 (seq 19500)
2024-08-08T09:37:25.267295+00:00 moulinex kernel:     cur_idx                277 (seq 19564)
2024-08-08T09:37:25.267348+00:00 moulinex kernel:
2024-08-08T09:39:34.281535+00:00 moulinex kernel: INFO: task mount:5971 blocked for more than 120 seconds.
2024-08-08T09:39:34.281960+00:00 moulinex kernel:       Tainted: G            E      6.11.0-rc2-g2p #43
2024-08-08T09:39:34.282008+00:00 moulinex kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
2024-08-08T09:39:34.282052+00:00 moulinex kernel: task:mount           state:D stack:0     pid:5971  tgid:5971  ppid:5345   flags:0x00004002
2024-08-08T09:39:34.282109+00:00 moulinex kernel: Call Trace:
2024-08-08T09:39:34.282138+00:00 moulinex kernel:  <TASK>
2024-08-08T09:39:34.282175+00:00 moulinex kernel: __schedule (kernel/sched/core.c:5188 kernel/sched/core.c:6529) 
2024-08-08T09:39:34.282240+00:00 moulinex kernel: ? sched_clock_noinstr (arch/x86/kernel/tsc.c:267) 
2024-08-08T09:39:34.282275+00:00 moulinex kernel: ? local_clock_noinstr (kernel/sched/clock.c:301 (discriminator 1)) 
2024-08-08T09:39:34.282311+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.282346+00:00 moulinex kernel: schedule (./arch/x86/include/asm/preempt.h:84 (discriminator 13) kernel/sched/core.c:6607 (discriminator 13) kernel/sched/core.c:6621 (discriminator 13)) 
2024-08-08T09:39:34.282380+00:00 moulinex kernel: __closure_sync (lib/closure.c:143 (discriminator 4)) 
2024-08-08T09:39:34.282415+00:00 moulinex kernel: __bch2_wait_on_allocator (fs/bcachefs/alloc_foreground.c:1813) 
2024-08-08T09:39:34.282450+00:00 moulinex kernel: bch2_btree_update_start (fs/bcachefs/alloc_foreground.h:238 fs/bcachefs/btree_update_interior.c:1267) 
2024-08-08T09:39:34.282484+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.282509+00:00 moulinex kernel: ? __lock_acquire (kernel/locking/lockdep.c:4598 (discriminator 1) kernel/locking/lockdep.c:5096 (discriminator 1)) 
2024-08-08T09:39:34.282534+00:00 moulinex kernel: ? closure_wait (lib/closure.c:123) 
2024-08-08T09:39:34.282569+00:00 moulinex kernel: bch2_btree_split_leaf (fs/bcachefs/btree_update_interior.c:1851) 
2024-08-08T09:39:34.282603+00:00 moulinex kernel: bch2_trans_commit_error (fs/bcachefs/btree_trans_commit.c:947) 
2024-08-08T09:39:34.282628+00:00 moulinex kernel: ? bch2_journal_replay (fs/bcachefs/btree_update.h:184 fs/bcachefs/recovery.c:343) 
2024-08-08T09:39:34.282677+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.282702+00:00 moulinex kernel: ? bch2_trans_unlock_write (fs/bcachefs/six.h:367 (discriminator 1) fs/bcachefs/btree_locking.h:181 (discriminator 1) fs/bcachefs/btree_trans_commit.c:142 (discriminator 1)) 
2024-08-08T09:39:34.282737+00:00 moulinex kernel: ? bch2_trans_lock_write (fs/bcachefs/btree_locking.h:320 fs/bcachefs/btree_locking.h:328 fs/bcachefs/btree_trans_commit.c:125) 
2024-08-08T09:39:34.282772+00:00 moulinex kernel: ? __bch2_trans_commit (./include/linux/rcupdate.h:336 (discriminator 1) ./include/linux/rcupdate.h:869 (discriminator 1) ./include/linux/percpu-refcount.h:312 (discriminator 1) fs/bcachefs/bcachefs.h:1129 (discriminator 1) fs/bcachefs/btree_trans_commit.c:1102 (discriminator 1)) 
2024-08-08T09:39:34.282807+00:00 moulinex kernel: __bch2_trans_commit (fs/bcachefs/btree_trans_commit.c:1175 (discriminator 1)) 
2024-08-08T09:39:34.282842+00:00 moulinex kernel: bch2_journal_replay (fs/bcachefs/btree_update.h:184 fs/bcachefs/recovery.c:343) 
2024-08-08T09:39:34.282876+00:00 moulinex kernel: ? bch2_journal_replay (fs/bcachefs/btree_update.h:184 fs/bcachefs/recovery.c:343) 
2024-08-08T09:39:34.282901+00:00 moulinex kernel: bch2_run_recovery_pass (fs/bcachefs/recovery_passes.c:184) 
2024-08-08T09:39:34.282935+00:00 moulinex kernel: bch2_run_recovery_passes (fs/bcachefs/recovery_passes.c:230) 
2024-08-08T09:39:34.282970+00:00 moulinex kernel: ? bch2_sb_set_upgrade_extra (fs/bcachefs/sb-downgrade.c:135) 
2024-08-08T09:39:34.283004+00:00 moulinex kernel: bch2_fs_recovery (fs/bcachefs/recovery.c:853) 
2024-08-08T09:39:34.283039+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283054+00:00 moulinex kernel: ? lock_release (kernel/locking/lockdep.c:349 (discriminator 1) kernel/locking/lockdep.c:5441 (discriminator 1) kernel/locking/lockdep.c:5780 (discriminator 1)) 
2024-08-08T09:39:34.283103+00:00 moulinex kernel: ? bch2_get_next_online_dev (./include/linux/rcupdate.h:336 (discriminator 1) ./include/linux/rcupdate.h:869 (discriminator 1) fs/bcachefs/sb-members.h:157 (discriminator 1)) 
2024-08-08T09:39:34.283138+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283162+00:00 moulinex kernel: ? __closure_wake_up (lib/closure.c:89 (discriminator 1)) 
2024-08-08T09:39:34.283197+00:00 moulinex kernel: bch2_fs_start (fs/bcachefs/super.c:1037) 
2024-08-08T09:39:34.283231+00:00 moulinex kernel: bch2_fs_get_tree (fs/bcachefs/fs.c:1980) 
2024-08-08T09:39:34.283266+00:00 moulinex kernel: vfs_get_tree (fs/super.c:1801) 
2024-08-08T09:39:34.283301+00:00 moulinex kernel: path_mount (fs/namespace.c:3473 fs/namespace.c:3799) 
2024-08-08T09:39:34.283326+00:00 moulinex kernel: ? putname (fs/namei.c:281) 
2024-08-08T09:39:34.283360+00:00 moulinex kernel: __x64_sys_mount (fs/namespace.c:3813 fs/namespace.c:4020 fs/namespace.c:3997 fs/namespace.c:3997) 
2024-08-08T09:39:34.283395+00:00 moulinex kernel: x64_sys_call (arch/x86/entry/syscall_64.c:36) 
2024-08-08T09:39:34.283429+00:00 moulinex kernel: do_syscall_64 (arch/x86/entry/common.c:52 (discriminator 1) arch/x86/entry/common.c:83 (discriminator 1)) 
2024-08-08T09:39:34.283464+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283488+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283527+00:00 moulinex kernel: ? sched_clock_noinstr (arch/x86/kernel/tsc.c:267) 
2024-08-08T09:39:34.283551+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283566+00:00 moulinex kernel: ? sched_clock_noinstr (arch/x86/kernel/tsc.c:267) 
2024-08-08T09:39:34.283591+00:00 moulinex kernel: ? local_clock_noinstr (kernel/sched/clock.c:301 (discriminator 1)) 
2024-08-08T09:39:34.283615+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283640+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283665+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283679+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283704+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283729+00:00 moulinex kernel: ? __lock_acquire (kernel/locking/lockdep.c:4598 (discriminator 1) kernel/locking/lockdep.c:5096 (discriminator 1)) 
2024-08-08T09:39:34.283753+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283778+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283803+00:00 moulinex kernel: ? __lock_acquire (kernel/locking/lockdep.c:4598 (discriminator 1) kernel/locking/lockdep.c:5096 (discriminator 1)) 
2024-08-08T09:39:34.283827+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283852+00:00 moulinex kernel: ? reacquire_held_locks (kernel/locking/lockdep.c:5284) 
2024-08-08T09:39:34.283886+00:00 moulinex kernel: ? do_user_addr_fault (./include/linux/rcupdate.h:326 (discriminator 1) ./include/linux/rcupdate.h:838 (discriminator 1) ./include/linux/mm.h:713 (discriminator 1) arch/x86/mm/fault.c:1340 (discriminator 1)) 
2024-08-08T09:39:34.283921+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283960+00:00 moulinex kernel: ? sched_clock_noinstr (arch/x86/kernel/tsc.c:267) 
2024-08-08T09:39:34.283985+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.283999+00:00 moulinex kernel: ? local_clock_noinstr (kernel/sched/clock.c:301 (discriminator 1)) 
2024-08-08T09:39:34.284024+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.284039+00:00 moulinex kernel: ? local_clock (./arch/x86/include/asm/preempt.h:94 (discriminator 1) kernel/sched/clock.c:316 (discriminator 1)) 
2024-08-08T09:39:34.284075+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.284103+00:00 moulinex kernel: ? lock_release (kernel/locking/lockdep.c:349 (discriminator 1) kernel/locking/lockdep.c:5441 (discriminator 1) kernel/locking/lockdep.c:5780 (discriminator 1)) 
2024-08-08T09:39:34.284128+00:00 moulinex kernel: ? do_user_addr_fault (./include/linux/rcupdate.h:336 (discriminator 1) ./include/linux/rcupdate.h:869 (discriminator 1) ./include/linux/mm.h:715 (discriminator 1) arch/x86/mm/fault.c:1340 (discriminator 1)) 
2024-08-08T09:39:34.284162+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.284187+00:00 moulinex kernel: ? do_user_addr_fault (arch/x86/mm/fault.c:1342) 
2024-08-08T09:39:34.284221+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.284246+00:00 moulinex kernel: ? irqentry_exit_to_user_mode (kernel/entry/common.c:234) 
2024-08-08T09:39:34.284280+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.284295+00:00 moulinex kernel: ? irqentry_exit (kernel/entry/common.c:367) 
2024-08-08T09:39:34.284330+00:00 moulinex kernel: ? srso_return_thunk (arch/x86/lib/retpoline.S:224) 
2024-08-08T09:39:34.284354+00:00 moulinex kernel: ? exc_page_fault (arch/x86/mm/fault.c:1543) 
2024-08-08T09:39:34.284403+00:00 moulinex kernel: entry_SYSCALL_64_after_hwframe (arch/x86/entry/entry_64.S:130) 
2024-08-08T09:39:34.284437+00:00 moulinex kernel: RIP: 0033:0x7ff10eb2af0e
2024-08-08T09:39:34.284472+00:00 moulinex kernel: RSP: 002b:00007ffede0edb78 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
2024-08-08T09:39:34.284497+00:00 moulinex kernel: RAX: ffffffffffffffda RBX: 0000562ab243e940 RCX: 00007ff10eb2af0e
2024-08-08T09:39:34.284532+00:00 moulinex kernel: RDX: 0000562ab243eed0 RSI: 0000562ab243ef10 RDI: 0000562ab243fba0
2024-08-08T09:39:34.284557+00:00 moulinex kernel: RBP: 00007ffede0edbe0 R08: 0000562ab2440000 R09: 0000000000000020
2024-08-08T09:39:34.284582+00:00 moulinex kernel: R10: 0000000000000400 R11: 0000000000000246 R12: 0000562ab243fba0
2024-08-08T09:39:34.284617+00:00 moulinex kernel: R13: 0000562ab243ef10 R14: 0000562ab243eed0 R15: 0000562ab243eaa0
2024-08-08T09:39:34.284651+00:00 moulinex kernel:  </TASK>
2024-08-08T09:39:34.284685+00:00 moulinex kernel:
Showing all locks held in the system:
2024-08-08T09:39:34.284721+00:00 moulinex kernel: 1 lock held by khungtaskd/95:
2024-08-08T09:39:34.284746+00:00 moulinex kernel: #0: ffffffff8cb82f80 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks (./include/linux/rcupdate.h:326 (discriminator 1) ./include/linux/rcupdate.h:838 (discriminator 1) kernel/locking/lockdep.c:6626 (discriminator 1)) 
2024-08-08T09:39:34.284786+00:00 moulinex kernel: 3 locks held by mount/5971:
2024-08-08T09:39:34.284810+00:00 moulinex kernel: #0: ffff97baa0e00288 (&c->state_lock){+.+.}-{3:3}, at: bch2_fs_start (./arch/x86/include/asm/bitops.h:206 (discriminator 1) ./arch/x86/include/asm/bitops.h:238 (discriminator 1) ./include/asm-generic/bitops/instrumented-non-atomic.h:142 (discriminator 1) fs/bcachefs/super.c:1009 (discriminator 1)) 
2024-08-08T09:39:34.284845+00:00 moulinex kernel: #1: ffff97baa0e043e8 (&c->btree_trans_barrier){.+.+}-{0:0}, at: bch2_btree_path_traverse_one (./include/linux/srcu.h:151 (discriminator 1) ./include/linux/srcu.h:250 (discriminator 1) fs/bcachefs/btree_iter.c:3015 (discriminator 1) fs/bcachefs/btree_iter.c:1132 (discriminator 1)) 
2024-08-08T09:39:34.284880+00:00 moulinex kernel: #2: ffff97baa0e288c8 (&c->gc_lock){++++}-{3:3}, at: bch2_btree_update_start (fs/bcachefs/btree_update_interior.c:1195 (discriminator 1)) 
2024-08-08T09:39:34.284914+00:00 moulinex kernel:
2024-08-08T09:39:34.284949+00:00 moulinex kernel: =============================================
g2p commented 3 weeks ago

Okay that appears fixed with 1.10: disk_accounting_v3!