search

koverstreet / bcachefs

Other
692 stars 72 forks source link

Kernel panic on mount in btree_path_overflow: 30d4735 #494

Open MoraFermi opened 1 year ago

MoraFermi commented 1 year ago

Version: 30d4735

this is using mount.bcachefs.sh -o fix_errors,version_upgrade

I also attempted bcachefs fsck on this system, but that hangs after "Going read-write" 

[ 1346.946274] bcachefs (9910bf9e-b68c-46ec-83de-a598679f4616): recovering from unclean shutdown
[ 1405.804600] bcachefs (9910bf9e-b68c-46ec-83de-a598679f4616): journal read done, replaying entries 6552483-6552732
[ 1407.797169] bcachefs (9910bf9e-b68c-46ec-83de-a598679f4616): going read-write
[ 1407.827134] path: idx  0 ref 1:1 P S btree=extents l=0 pos 56542:5824:U32_MAX locks 0
[ 1407.827136] path: idx  1 ref 0:0 P   btree=freespace l=0 pos POS_MIN locks 0
[ 1407.827137] path: idx  3 ref 0:0 P   btree=freespace l=0 pos 1:0:0 locks 0
[ 1407.827138] path: idx 63 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 1
[ 1407.827138] path: idx 62 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 1
[ 1407.827139] path: idx 61 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 1
[ 1407.827140] path: idx 60 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827140] path: idx 59 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827141] path: idx 58 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827141] path: idx 57 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827142] path: idx 56 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827142] path: idx 55 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827143] path: idx 54 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827144] path: idx 53 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827144] path: idx 52 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827145] path: idx 51 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827145] path: idx 50 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827146] path: idx 49 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827146] path: idx 48 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827147] path: idx 47 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827148] path: idx 46 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827148] path: idx 45 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827149] path: idx 44 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827149] path: idx 43 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827150] path: idx 42 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827150] path: idx 41 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827151] path: idx 40 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827151] path: idx 39 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827152] path: idx 38 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827153] path: idx 37 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827153] path: idx 36 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827154] path: idx 35 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827154] path: idx 34 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827155] path: idx 33 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827155] path: idx 32 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827156] path: idx 31 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827156] path: idx 30 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827157] path: idx 29 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827158] path: idx 28 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827158] path: idx 27 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827159] path: idx 26 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827159] path: idx 25 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827160] path: idx 24 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827160] path: idx 23 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827161] path: idx 22 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827162] path: idx 21 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827162] path: idx 20 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827163] path: idx 19 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827163] path: idx 18 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827164] path: idx 17 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827164] path: idx 16 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827165] path: idx 15 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827165] path: idx 14 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827166] path: idx 13 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827167] path: idx 12 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827167] path: idx 11 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827168] path: idx 10 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827168] path: idx  9 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827169] path: idx  8 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827169] path: idx  5 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827170] path: idx  4 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
[ 1407.827170] path: idx  2 ref 0:0 P S btree=freespace l=0 pos 2:0:0 locks 0
[ 1407.827171] path: idx  6 ref 0:0 P S btree=freespace l=0 pos 3:0:0 locks 0
[ 1407.827172] path: idx  7 ref 0:0 P S btree=freespace l=0 pos 4:0:0 locks 0
[ 1407.827172] transaction updates for bch2_journal_replay journal seq 0
[ 1407.827173]   update: btree=extents cached=0 bch2_journal_replay+0x25c/0x369
[ 1407.827173]     old u64s 7 type extent 56542:5824:U32_MAX len 128 ver 0: crc: c_size 128 size 128 offset 0 nonce 0 csum crc32c compress none ptr: 2:38390:2880 gen 1
[ 1407.827174]     new u64s 7 type extent 56542:5824:U32_MAX len 128 ver 0: crc: c_size 128 size 128 offset 0 nonce 0 csum crc32c compress none ptr: 2:38390:2880 gen 1
[ 1407.827175]
[ 1407.829078] Kernel panic - not syncing: trans path oveflow
[ 1407.829081] CPU: 4 PID: 5000 Comm: mount Not tainted 6.1.0-edge #1
[ 1407.829086] Hardware name: Gigabyte Technology Co., Ltd. X570 I AORUS PRO WIFI/X570 I AORUS PRO WIFI, BIOS F36d 07/20/2022
[ 1407.829090] Call Trace:
[ 1407.829093]  <TASK>
[ 1407.829097]  dump_stack_lvl+0x49/0x63
[ 1407.829102]  dump_stack+0x10/0x16
[ 1407.829106]  panic+0x10c/0x2a0
[ 1407.829110]  ? __bch2_dump_trans_paths_updates+0x65/0x85
[ 1407.829115]  btree_path_overflow+0x1a/0x1a
[ 1407.829118]  __bch2_btree_path_make_mut.cold+0x5/0x17
[ 1407.829123]  __bch2_btree_path_set_pos+0x1ee/0x450
[ 1407.829127]  ? bch2_dev_usage_read+0x33/0x70
[ 1407.829131]  bch2_btree_iter_peek_upto+0x107/0xbe0
[ 1407.829136]  bch2_bucket_alloc_freelist+0x196/0x420
[ 1407.829141]  bch2_bucket_alloc_trans+0x1de/0x670
[ 1407.829145]  ? bch2_bucket_alloc_trans+0x1de/0x670
[ 1407.829149]  bch2_bucket_alloc_set_trans+0x13c/0x3a0
[ 1407.829155]  ? __finalise_sg.isra.0+0x109/0x150
[ 1407.829160]  ? get_page_from_freelist+0xd6a/0xf10
[ 1407.829165]  ? psi_group_change+0x15b/0x350
[ 1407.829170]  open_bucket_add_buckets+0x1f7/0x4f0
[ 1407.829174]  ? __bch2_fs_usage_read_short+0xfa/0x130
[ 1407.829178]  bch2_alloc_sectors_start_trans+0x234/0x990
[ 1407.829183]  ? mempool_free_slab+0x17/0x20
[ 1407.829187]  ? mempool_free+0x2f/0x90
[ 1407.829192]  __bch2_btree_node_alloc+0x292/0x400
[ 1407.829196]  ? __closure_wake_up+0x18/0xf0
[ 1407.829202]  bch2_btree_reserve_get+0xda/0x130
[ 1407.829206]  bch2_btree_update_start+0x79e/0x8f0
[ 1407.829210]  ? bch2_journal_keys_peek_upto+0x10e/0x1a0
[ 1407.829215]  bch2_btree_split_leaf+0x41/0x170
[ 1407.829219]  ? bch2_journal_replay+0x2a2/0x369
[ 1407.829223]  bch2_trans_commit_error+0x11d/0x530
[ 1407.829227]  ? six_trylock_write+0x31/0x120
[ 1407.829231]  __bch2_trans_commit+0xc3b/0x19b0
[ 1407.829235]  ? bch2_journal_replay+0x2a2/0x369
[ 1407.829239]  bch2_journal_replay+0x2a2/0x369
[ 1407.829244]  ? bch2_journal_replay+0x1d2/0x369
[ 1407.829251]  bch2_fs_recovery.cold+0x1354/0x1a86
[ 1407.829255]  ? __radix_tree_replace+0x4a/0xe0
[ 1407.829259]  ? radix_tree_iter_tag_clear+0x12/0x20
[ 1407.829263]  ? idr_alloc_u32+0x93/0xd0
[ 1407.829267]  ? idr_alloc_cyclic+0x53/0xb0
[ 1407.829270]  ? bdev_name+0xec/0x220
[ 1407.829274]  ? pointer+0x95/0x530
[ 1407.829277]  ? prt_vprintf+0x254/0x940
[ 1407.829281]  ? down_write+0x13/0x80
[ 1407.829285]  ? kernfs_activate+0x87/0xd0
[ 1407.829289]  ? __bch2_sb_field_resize+0x67/0x120
[ 1407.829293]  ? __closure_wake_up+0x18/0xf0
[ 1407.829297]  ? bch2_recalc_capacity+0x219/0x2e0
[ 1407.829301]  bch2_fs_start+0x3ba/0x440
[ 1407.829305]  bch2_fs_open+0x37b/0x4e0
[ 1407.829310]  bch2_mount+0x4bf/0x6e0
[ 1407.829316]  legacy_get_tree+0x2b/0x50
[ 1407.829320]  vfs_get_tree+0x2a/0xc0
[ 1407.829324]  path_mount+0x4a2/0xb80
[ 1407.829328]  ? putname+0x59/0x70
[ 1407.829332]  __x64_sys_mount+0x10c/0x150
[ 1407.829336]  do_syscall_64+0x5c/0x90
[ 1407.829340]  ? syscall_exit_to_user_mode+0x26/0x50
[ 1407.829344]  ? __do_sys_getuid+0x28/0x30
[ 1407.829348]  ? do_syscall_64+0x69/0x90
[ 1407.829351]  ? syscall_exit_to_user_mode+0x26/0x50
[ 1407.829355]  ? exit_to_user_mode_prepare+0x37/0x180
[ 1407.829360]  ? syscall_exit_to_user_mode+0x26/0x50
[ 1407.829363]  ? __do_sys_getegid+0x28/0x30
[ 1407.829367]  ? do_syscall_64+0x69/0x90
[ 1407.829370]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[ 1407.829374] RIP: 0033:0x7f0d3f78762a
[ 1407.829378] Code: 48 8b 0d 69 18 0d 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 36 18 0d 00 f7 d8 64 89 01 48
[ 1407.829384] RSP: 002b:00007ffd81c16d18 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
[ 1407.829389] RAX: ffffffffffffffda RBX: 00007f0d3f8bb264 RCX: 00007f0d3f78762a
[ 1407.829393] RDX: 000055a2938868e0 RSI: 000055a293886900 RDI: 000055a293886d00
[ 1407.829396] RBP: 000055a293886a40 R08: 000055a293886ca0 R09: 000055a293885010
[ 1407.829399] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[ 1407.829403] R13: 000055a293886d00 R14: 000055a2938868e0 R15: 000055a293886a40
[ 1407.829407]  </TASK>
[ 1407.829748] Kernel Offset: 0x32c00000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[ 1407.870525] ---[ end Kernel panic - not syncing: trans path oveflow ]---
MoraFermi commented 1 year ago 
bcachefs show-super /dev/nvme1n1
External UUID:                              9910bf9e-b68c-46ec-83de-a598679f4616
Internal UUID:                              43a5b7ad-f397-4694-b629-eb6df15ad4c7
Device index:                               0
Label:                                      SRV
Version:                                    lru_v2
Oldest version on disk:                     bucket_gens
Created:                                    Thu Dec  8 14:58:04 2022
Sequence number:                            219
Superblock size:                            6080
Clean:                                      0
Devices:                                    5
Sections:                                   members,replicas_v0,quota,disk_groups,clean,journal_seq_blacklist,journal_v2,counters
Features:                                   journal_seq_blacklist_v3,new_siphash,inline_data,new_extent_overwrite,btree_ptr_v2,extents_above_btree_updates,btree_updates_journalled,new_varint,journal_no_flush,alloc_v2,extents_across_btree_nodes
Compat features:                            alloc_info,alloc_metadata,extents_above_btree_updates_done,bformat_overflow_done

Options:
  block_size:                               4.00 KiB
  btree_node_size:                          256 KiB
  errors:                                   continue [ro] panic
  metadata_replicas:                        2
  data_replicas:                            1
  metadata_replicas_required:               1
  data_replicas_required:                   1
  encoded_extent_max:                       64.0 KiB
  metadata_checksum:                        none [crc32c] crc64 xxhash
  data_checksum:                            none [crc32c] crc64 xxhash
  compression:                              [none] lz4 gzip zstd
  background_compression:                   [none] lz4 gzip zstd
  str_hash:                                 crc32c crc64 [siphash]
  metadata_target:                          ssd
  foreground_target:                        none
  background_target:                        none
  promote_target:                           none
  erasure_code:                             0
  inodes_32bit:                             1
  shard_inode_numbers:                      1
  inodes_use_key_cache:                     1
  gc_reserve_percent:                       8
  gc_reserve_bytes:                         0 B
  root_reserve_percent:                     0
  wide_macs:                                0
  acl:                                      1
  usrquota:                                 1
  grpquota:                                 0
  prjquota:                                 0
  journal_flush_delay:                      1000
  journal_flush_disabled:                   0
  journal_reclaim_delay:                    100
  nocow:                                    0

members (size 288):
  Device:                                   0
    UUID:                                   ec41acd3-9a94-4174-ab20-4d1b8309abed
    Size:                                   1.86 TiB
    Bucket size:                            512 KiB
    First bucket:                           0
    Buckets:                                3907028
    Last mount:                             Sat Jan 28 13:10:21 2023
    State:                                  rw
    Label:                                  0 (1)
    Data allowed:                           journal,btree,user
    Has data:                               journal,btree,user,cached
    Discard:                                1
    Freespace initialized:                  1
  Device:                                   1
    UUID:                                   4337dc7f-668b-459f-84e8-f70fbc0d67e5
    Size:                                   1.46 TiB
    Bucket size:                            512 KiB
    First bucket:                           0
    Buckets:                                3052518
    Last mount:                             Sat Jan 28 13:10:21 2023
    State:                                  rw
    Label:                                  1 (2)
    Data allowed:                           journal,btree,user
    Has data:                               journal,btree,user,cached
    Discard:                                1
    Freespace initialized:                  1
  Device:                                   2
    UUID:                                   22fa55a4-1ad7-48fe-8ab4-65a03bca42f1
    Size:                                   3.64 TiB
    Bucket size:                            2.00 MiB
    First bucket:                           0
    Buckets:                                1907723
    Last mount:                             Sat Jan 28 13:10:21 2023
    State:                                  rw
    Label:                                  0 (4)
    Data allowed:                           journal,btree,user
    Has data:                               journal,btree,user
    Discard:                                1
    Freespace initialized:                  1
  Device:                                   3
    UUID:                                   38255993-b70a-4484-afbe-0cfa3dda20b0
    Size:                                   4.55 TiB
    Bucket size:                            2.00 MiB
    First bucket:                           0
    Buckets:                                2384653
    Last mount:                             Sat Jan 28 13:10:21 2023
    State:                                  rw
    Label:                                  1 (5)
    Data allowed:                           journal,btree,user
    Has data:                               journal,user
    Discard:                                1
    Freespace initialized:                  1
  Device:                                   4
    UUID:                                   c5cc273a-bea4-4bf4-bd22-c37e383c34cb
    Size:                                   4.55 TiB
    Bucket size:                            2.00 MiB
    First bucket:                           0
    Buckets:                                2384653
    Last mount:                             Sat Jan 28 13:10:21 2023
    State:                                  rw
    Label:                                  2 (6)
    Data allowed:                           journal,btree,user
    Has data:                               journal,user
    Discard:                                1
    Freespace initialized:                  1
MoraFermi commented 1 year ago

Hitting the same problem on 42dc767:

Jan 31 16:31:20 192.168.88.99  [  266.748992] bcachefs (9910bf9e-b68c-46ec-83de-a598679f4616): recovering from unclean shutdown
Jan 31 16:32:19 192.168.88.99  [  325.613960] bcachefs (9910bf9e-b68c-46ec-83de-a598679f4616): journal read done, replaying entries 6552493-6552787
Jan 31 16:32:20 192.168.88.99  [  327.584683] bcachefs (9910bf9e-b68c-46ec-83de-a598679f4616): going read-write
Jan 31 16:32:21 192.168.88.99  [  327.616692] path: idx  0 ref 1:1 P S btree=extents l=0 pos 56848:23072:U32_MAX locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616694] path: idx  1 ref 0:0 P   btree=freespace l=0 pos POS_MIN locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616694] path: idx  3 ref 0:0 P   btree=freespace l=0 pos 1:0:0 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616695] path: idx 63 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 1
Jan 31 16:32:21 192.168.88.99  [  327.616695] path: idx 62 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 1
Jan 31 16:32:21 192.168.88.99  [  327.616696] path: idx 61 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 1
Jan 31 16:32:21 192.168.88.99  [  327.616696] path: idx 60 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616697] path: idx 59 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616697] path: idx 58 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616698] path: idx 57 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616698] path: idx 56 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616699] path: idx 55 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616699] path: idx 54 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616700] path: idx 53 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616700] path: idx 52 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616701] path: idx 51 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616701] path: idx 50 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616702] path: idx 49 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616702] path: idx 48 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616702] path: idx 47 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616703] path: idx 46 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616703] path: idx 45 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616704] path: idx 44 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616704] path: idx 43 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616705] path: idx 42 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616705] path: idx 41 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616706] path: idx 40 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616706] path: idx 39 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616707] path: idx 38 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616707] path: idx 37 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616708] path: idx 36 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616708] path: idx 35 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616708] path: idx 34 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616709] path: idx 33 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616709] path: idx 32 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616710] path: idx 31 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616710] path: idx 30 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616711] path: idx 29 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616711] path: idx 28 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616712] path: idx 27 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616712] path: idx 26 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616713] path: idx 25 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616713] path: idx 24 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616714] path: idx 23 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616714] path: idx 22 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616715] path: idx 21 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616715] path: idx 20 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616715] path: idx 19 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616716] path: idx 18 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616716] path: idx 17 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616717] path: idx 16 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616717] path: idx 15 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616718] path: idx 14 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616718] path: idx 13 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616719] path: idx 12 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616719] path: idx 11 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616720] path: idx 10 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616720] path: idx  9 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616721] path: idx  8 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616721] path: idx  5 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616721] path: idx  4 ref 0:0   S btree=freespace l=0 pos 1:2965684:1 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616722] path: idx  2 ref 0:0 P S btree=freespace l=0 pos 2:0:0 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616722] path: idx  6 ref 0:0 P S btree=freespace l=0 pos 3:0:0 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616723] path: idx  7 ref 0:0 P S btree=freespace l=0 pos 4:0:0 locks 0
Jan 31 16:32:21 192.168.88.99  [  327.616723] transaction updates for bch2_journal_replay journal seq 0
Jan 31 16:32:21 192.168.88.99  [  327.616724]   update: btree=extents cached=0 bch2_journal_replay+0x25c/0x369
Jan 31 16:32:21 192.168.88.99  [  327.616724]     old u64s 7 type extent 56848:23072:U32_MAX len 120 ver 0: crc: c_size 120 size 120 offset 0 nonce 0 csum crc32c compress none ptr: 4:48771:152 gen 1
Jan 31 16:32:21 192.168.88.99  [  327.616725]     new u64s 7 type extent 56848:23072:U32_MAX len 120 ver 0: crc: c_size 120 size 120 offset 0 nonce 0 csum crc32c compress none ptr: 4:48771:152 gen 1
Jan 31 16:32:21 192.168.88.99  [  327.616726]
Jan 31 16:32:21 192.168.88.99  [  327.617194] Kernel panic - not syncing: trans path oveflow
Jan 31 16:32:21 192.168.88.99  [  327.617198] CPU: 10 PID: 2114 Comm: mount Not tainted 6.1.0-edge #1
Jan 31 16:32:21 192.168.88.99  [  327.617203] Hardware name: Gigabyte Technology Co., Ltd. X570 I AORUS PRO WIFI/X570 I AORUS PRO WIFI, BIOS F36d 07/20/2022
Jan 31 16:32:21 192.168.88.99  [  327.617207] Call Trace:
Jan 31 16:32:21 192.168.88.99  [  327.617210]  <TASK>
Jan 31 16:32:21 192.168.88.99  [  327.617214]  dump_stack_lvl+0x49/0x63
Jan 31 16:32:21 192.168.88.99  [  327.617219]  dump_stack+0x10/0x16
Jan 31 16:32:21 192.168.88.99  [  327.617223]  panic+0x10c/0x2a0
Jan 31 16:32:21 192.168.88.99  [  327.617226]  ? __bch2_dump_trans_paths_updates+0x65/0x85
Jan 31 16:32:21 192.168.88.99  [  327.617231]  btree_path_overflow+0x1a/0x1a
Jan 31 16:32:21 192.168.88.99  [  327.617235]  __bch2_btree_path_make_mut.cold+0x5/0x17
Jan 31 16:32:21 192.168.88.99  [  327.617239]  __bch2_btree_path_set_pos+0x1ee/0x450
Jan 31 16:32:21 192.168.88.99  [  327.617243]  ? bch2_dev_usage_read+0x33/0x70
Jan 31 16:32:21 192.168.88.99  [  327.617247]  bch2_btree_iter_peek_upto+0x107/0xbe0
Jan 31 16:32:21 192.168.88.99  [  327.617252]  bch2_bucket_alloc_freelist+0x196/0x420
Jan 31 16:32:21 192.168.88.99  [  327.617257]  bch2_bucket_alloc_trans+0x1de/0x670
Jan 31 16:32:21 192.168.88.99  [  327.617261]  ? bch2_bucket_alloc_trans+0x1de/0x670
Jan 31 16:32:21 192.168.88.99  [  327.617265]  bch2_bucket_alloc_set_trans+0x13c/0x3a0
Jan 31 16:32:21 192.168.88.99  [  327.617271]  ? bch2_btree_node_read_done+0x84e/0x11c0
Jan 31 16:32:21 192.168.88.99  [  327.617276]  ? kmem_cache_free+0x1a/0x370
Jan 31 16:32:21 192.168.88.99  [  327.617280]  ? mempool_free_slab+0x17/0x20
Jan 31 16:32:21 192.168.88.99  [  327.617285]  ? mempool_free+0x2f/0x90
Jan 31 16:32:21 192.168.88.99  [  327.617289]  open_bucket_add_buckets+0x1f7/0x4f0
Jan 31 16:32:21 192.168.88.99  [  327.617293]  ? __bch2_fs_usage_read_short+0xfa/0x130
Jan 31 16:32:21 192.168.88.99  [  327.617297]  bch2_alloc_sectors_start_trans+0x234/0x990
Jan 31 16:32:21 192.168.88.99  [  327.617302]  __bch2_btree_node_alloc+0x292/0x400
Jan 31 16:32:21 192.168.88.99  [  327.617307]  ? __closure_wake_up+0x18/0xf0
Jan 31 16:32:21 192.168.88.99  [  327.617311]  bch2_btree_reserve_get+0xda/0x130
Jan 31 16:32:21 192.168.88.99  [  327.617315]  bch2_btree_update_start+0x79e/0x8f0
Jan 31 16:32:21 192.168.88.99  [  327.617319]  ? bch2_journal_keys_peek_upto+0x10e/0x1a0
Jan 31 16:32:21 192.168.88.99  [  327.617324]  bch2_btree_split_leaf+0x41/0x170
Jan 31 16:32:21 192.168.88.99  [  327.617328]  ? bch2_journal_replay+0x2a2/0x369
Jan 31 16:32:21 192.168.88.99  [  327.617331]  bch2_trans_commit_error+0x11d/0x530
Jan 31 16:32:21 192.168.88.99  [  327.617335]  ? six_trylock_write+0x31/0x120
Jan 31 16:32:21 192.168.88.99  [  327.617340]  __bch2_trans_commit+0xc3b/0x19b0
Jan 31 16:32:21 192.168.88.99  [  327.617344]  ? bch2_journal_replay+0x2a2/0x369
Jan 31 16:32:21 192.168.88.99  [  327.617348]  bch2_journal_replay+0x2a2/0x369
Jan 31 16:32:21 192.168.88.99  [  327.617353]  ? bch2_journal_replay+0x1d2/0x369
Jan 31 16:32:21 192.168.88.99  [  327.617357]  bch2_fs_recovery.cold+0x1354/0x1a86
Jan 31 16:32:21 192.168.88.99  [  327.617361]  ? __radix_tree_replace+0x4a/0xe0
Jan 31 16:32:21 192.168.88.99  [  327.617365]  ? radix_tree_iter_tag_clear+0x12/0x20
Jan 31 16:32:21 192.168.88.99  [  327.617368]  ? idr_alloc_u32+0x93/0xd0
Jan 31 16:32:21 192.168.88.99  [  327.617372]  ? idr_alloc_cyclic+0x53/0xb0
Jan 31 16:32:21 192.168.88.99  [  327.617376]  ? bdev_name+0xec/0x220
Jan 31 16:32:21 192.168.88.99  [  327.617379]  ? pointer+0x95/0x530
Jan 31 16:32:21 192.168.88.99  [  327.617383]  ? prt_vprintf+0x254/0x940
Jan 31 16:32:21 192.168.88.99  [  327.617387]  ? down_write+0x13/0x80
Jan 31 16:32:21 192.168.88.99  [  327.617391]  ? kernfs_activate+0x87/0xd0
Jan 31 16:32:21 192.168.88.99  [  327.617394]  ? __bch2_sb_field_resize+0x67/0x120
Jan 31 16:32:21 192.168.88.99  [  327.617398]  ? __closure_wake_up+0x18/0xf0
Jan 31 16:32:21 192.168.88.99  [  327.617401]  ? bch2_recalc_capacity+0x219/0x2e0
Jan 31 16:32:21 192.168.88.99  [  327.617405]  bch2_fs_start+0x3ba/0x440
Jan 31 16:32:21 192.168.88.99  [  327.617409]  bch2_fs_open+0x37b/0x4e0
Jan 31 16:32:21 192.168.88.99  [  327.617412]  bch2_mount+0x4bf/0x6e0
Jan 31 16:32:21 192.168.88.99  [  327.617418]  legacy_get_tree+0x2b/0x50
Jan 31 16:32:21 192.168.88.99  [  327.617423]  vfs_get_tree+0x2a/0xc0
Jan 31 16:32:21 192.168.88.99  [  327.617427]  path_mount+0x4a2/0xb80
Jan 31 16:32:21 192.168.88.99  [  327.617431]  ? putname+0x59/0x70
Jan 31 16:32:21 192.168.88.99  [  327.617435]  __x64_sys_mount+0x10c/0x150
Jan 31 16:32:21 192.168.88.99  [  327.617439]  do_syscall_64+0x5c/0x90
Jan 31 16:32:21 192.168.88.99  [  327.617442]  ? handle_mm_fault+0xe6/0x2d0
Jan 31 16:32:21 192.168.88.99  [  327.617446]  ? exit_to_user_mode_prepare+0x37/0x180
Jan 31 16:32:21 192.168.88.99  [  327.617450]  ? irqentry_exit_to_user_mode+0x9/0x20
Jan 31 16:32:21 192.168.88.99  [  327.617454]  ? irqentry_exit+0x3b/0x50
Jan 31 16:32:21 192.168.88.99  [  327.617457]  ? exc_page_fault+0x87/0x180
Jan 31 16:32:21 192.168.88.99  [  327.617461]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
Jan 31 16:32:21 192.168.88.99  [  327.617465] RIP: 0033:0x7f342701b62a
Jan 31 16:32:21 192.168.88.99  [  327.617469] Code: 48 8b 0d 69 18 0d 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 36 18 0d 00 f7 d8 64 89 01 48
Jan 31 16:32:21 192.168.88.99  [  327.617475] RSP: 002b:00007ffcc5a1e048 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
Jan 31 16:32:21 192.168.88.99  [  327.617480] RAX: ffffffffffffffda RBX: 00007f342714f264 RCX: 00007f342701b62a
Jan 31 16:32:21 192.168.88.99  [  327.617483] RDX: 000055eea89668e0 RSI: 000055eea8966900 RDI: 000055eea8966d00
Jan 31 16:32:21 192.168.88.99  [  327.617486] RBP: 000055eea8966a40 R08: 000055eea8966ca0 R09: 000055eea8965010
Jan 31 16:32:21 192.168.88.99  [  327.617489] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
Jan 31 16:32:21 192.168.88.99  [  327.617492] R13: 000055eea8966d00 R14: 000055eea89668e0 R15: 000055eea8966a40
Jan 31 16:32:21 192.168.88.99  [  327.617496]  </TASK>
Jan 31 16:32:21 192.168.88.99  [  327.617820] Kernel Offset: 0x30000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
Jan 31 16:32:21 192.168.88.99  [  327.659845] ---[ end Kernel panic - not syncing: trans path oveflow ]---
koverstreet commented 1 year ago

Could you send me a dump of your filesystem? 'bcachefs dump' command, zstd compress the output, and then magic wormhole https://github.com/magic-wormhole/magic-wormhole is what we usually use for transferring dumps - hit me up on IRC

MoraFermi commented 1 year ago

hit me up on IRC

Which server/channel? Still irc.oftc.net and #bcache ?

koverstreet commented 1 year ago

Yep!

On Wed, Feb 1, 2023 at 12:07 PM MoraFermi @.***> wrote:

hit me up on IRC

Which server/channel? Still irc.oftc.net and #bcache ?

— Reply to this email directly, view it on GitHub https://github.com/koverstreet/bcachefs/issues/494#issuecomment-1412409673, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAPGX3TAUUUJZCGZTDG4KPDWVKJ5TANCNFSM6AAAAAAUJTXHEY . You are receiving this because you commented.Message ID: @.***>