ticpu
commented
11 months ago Might or might not be related, but this morning on Kernel 6.5.1.arch1.r1204718.59180b370b79, it remounted read-only and qemu was stuck in Zombie state, which usually never happens. I see it is related to nocow and locking in the stack which correlates with qemu (the only nocow folder in the whole FS). I'll move back my VM to Btrfs for now.
[84166.479789] invalid journal entry, version=1.2: deleted_inodes type=btree_keys seq=451665 offset=866/2789:
[84166.479791] u64s 11 type extent 268757858:105368:4294967291 len 8 ver 8786712: durability: 2 crc: c_size 8 size 8 offset 0 nonce 72 csum chacha20_poly1305_80 compress incompre
ssible ptr: 4:392330:328 gen 0 crc: c_size 8 size 8 offset 0 nonce 0 csum chacha20_poly1305_80 compress incompressible ptr: 3:298653:344 gen 4
[84166.479792] incorrect nonce, shutting down
[84166.479796] bcachefs (d0337b38-cbe7-4c3c-90f7-4305fbe05171): inconsistency detected - emergency read only
❯ pstree -t -p 5865
qemu-system-x86(5865)─┬─{vhost-5865}(5871)
└─{worker}(5987)
❯ cat /proc/5987/stack
[<0>] __bch2_bucket_nocow_lock+0xdf/0x140 [bcachefs]
[<0>] bch2_nocow_write+0x7a6/0x11d0 [bcachefs]
[<0>] __bch2_write+0xd03/0x1360 [bcachefs]
[<0>] __bch2_writepage+0x34e/0x710 [bcachefs]
[<0>] write_cache_pages+0x1de/0x450
[<0>] bch2_writepages+0x88/0xe0 [bcachefs]
[<0>] do_writepages+0xcf/0x1e0
[<0>] filemap_fdatawrite_wbc+0x63/0x90
[<0>] __filemap_fdatawrite_range+0x9b/0xc0
[<0>] file_write_and_wait_range+0x51/0xc0
[<0>] bch2_fsync+0x27/0x80 [bcachefs]
[<0>] __x64_sys_fdatasync+0x52/0xa0
[<0>] do_syscall_64+0x5d/0x90
[<0>] entry_SYSCALL_64_after_hwframe+0x6e/0xd8
koverstreet
Version 6.4.4.arch1.r1189971.a96f1dd35d3d
Generic info Provide the output of:
Kernel bugs Current config:
Kernel log with hung tasks and lock debug info dmesg.txt
Optional Advanced
bcachefs list_journal -a <list of devices> | zstd -f -T0 -o ../journal.log.zst: file is ready and available on request.metdata.dump.*files from: bcachefs dump -o metadata.dump: file is ready and available on request.
PS: I'm on IRC as TiCPU but you'll have to tag @tiky for the notification to show in my Discord.