koverstreet / bcachefs

Other
670 stars 69 forks source link

Deadlock on rebalance [f4be62da5f34] #555

Closed ojab closed 1 year ago

ojab commented 1 year ago

Please search for duplicates

Version

f4be62da5f34

  1. Format new bcachefs FS on a single disk
  2. Start copying data
  3. Add another disk
  4. sudo bcachefs data rereplicate

Generic info

$ bcachefs fs usage
Filesystem: 360fc60c-8c44-4f3e-9cc4-fbaeee9e7c3b
Size:                 37735901298688
Used:                 18769219458048
Online reserved:          7731990528

Data type       Required/total  Devices
btree:          1/1             [sda1]                   54251487232
btree:          1/2             [sda1 sdc1]              12026642432
user:           1/1             [sda1]                16821671907328
user:           1/1             [sdc1]                 1860523851776

hdd.hdd1 (device 0):            sda1              rw
                                data         buckets    fragmented
  free:                            0         5583300
  sb:                        3149824               7        520192
  journal:                4294967296            8192
  btree:                 60264808448          197444   43252711424
  user:               16821671907328        32092878    4238913536
  cached:                          0               0
  parity:                          0               0
  stripe:                          0               0
  need_gc_gens:                    0               0
  need_discard:                    0              32
  erasure coded:                   0               0
  capacity:           19861000945664        37881853

hdd.hdd2 (device 1):            sdc1              rw
                                data         buckets    fragmented
  free:                            0        17147897
  sb:                        3149824               4       1044480
  journal:                8589934592            8192
  btree:                  6013321216           10487    4983095296
  user:                1860523851776         1774346      12779520
  cached:                          0               0
  parity:                          0               0
  stripe:                          0               0
  need_gc_gens:                    0               0
  need_discard:                    0               0
  erasure coded:                   0               0
  capacity:           19861000421376        18940926
$ bcachefs show-super
External UUID:                              360fc60c-8c44-4f3e-9cc4-fbaeee9e7c3b
Internal UUID:                              bc05affd-9fd1-4eb5-b497-3f7956ac57d2
Device index:                               0
Label:                                      
Version:                                    snapshot_trees
Oldest version on disk:                     snapshot_trees
Created:                                    Fri Jun 16 22:38:16 2023
Sequence number:                            28
Superblock size:                            4208
Clean:                                      0
Devices:                                    2
Sections:                                   members,replicas_v0,quota,disk_groups,clean,journal_v2,counters
Features:                                   zstd,new_siphash,inline_data,new_extent_overwrite,btree_ptr_v2,extents_above_btree_updates,btree_updates_journalled,new_varint,journal_no_flush,alloc_v2,extents_across_btree_nodes
Compat features:                            alloc_info,alloc_metadata,extents_above_btree_updates_done,bformat_overflow_done

Options:
  block_size:                               4.00 KiB
  btree_node_size:                          256 KiB
  errors:                                   continue [ro] panic 
  metadata_replicas:                        2
  data_replicas:                            1
  metadata_replicas_required:               1
  data_replicas_required:                   1
  encoded_extent_max:                       64.0 KiB
  metadata_checksum:                        none crc32c [crc64] xxhash 
  data_checksum:                            none [crc32c] crc64 xxhash 
  compression:                              [none] lz4 gzip zstd 
  background_compression:                   none lz4 gzip [zstd] 
  str_hash:                                 crc32c crc64 [siphash] 
  metadata_target:                          none
  foreground_target:                        none
  background_target:                        hdd
  promote_target:                           none
  erasure_code:                             0
  inodes_32bit:                             1
  shard_inode_numbers:                      1
  inodes_use_key_cache:                     1
  gc_reserve_percent:                       5
  gc_reserve_bytes:                         0 B
  root_reserve_percent:                     0
  wide_macs:                                0
  acl:                                      1
  usrquota:                                 1
  grpquota:                                 1
  prjquota:                                 1
  journal_flush_delay:                      1000
  journal_flush_disabled:                   0
  journal_reclaim_delay:                    100
  journal_transaction_names:                1
  nocow:                                    0

members (size 120):
  Device:                                   0
    UUID:                                   62f3139c-4515-4e6a-9aa3-24f598263ece
    Size:                                   18.1 TiB
    Bucket size:                            512 KiB
    First bucket:                           0
    Buckets:                                37881853
    Last mount:                             Fri Jun 16 22:38:32 2023
    State:                                  rw
    Label:                                  hdd1 (1)
    Data allowed:                           journal,btree,user
    Has data:                               journal,btree,user
    Discard:                                0
    Freespace initialized:                  1
  Device:                                   1
    UUID:                                   4c1c7eff-f1e9-44b8-bcac-186fb4aa2367
    Size:                                   18.1 TiB
    Bucket size:                            1.00 MiB
    First bucket:                           0
    Buckets:                                18940926
    Last mount:                             Fri Jun 23 07:30:14 2023
    State:                                  rw
    Label:                                  hdd2 (2)
    Data allowed:                           journal,btree,user
    Has data:                               journal,btree,user
    Discard:                                0
    Freespace initialized:                  1

Kernel bugs Backtrace with faddr2line output interleaved https://gist.github.com/ojab/86ac3df02d5f0f59f66953b6e871d8a6 list_journal output: https://ojab.ru/bcachefs/