happyfish100 / fastdfs

FastDFS is an open source high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs
GNU General Public License v3.0
9.06k stars 1.99k forks source link

版本 4.0.6 从节点状态一直WAIT_SYNC #723

Open xxdeye opened 1 month ago

xxdeye commented 1 month ago

11 那个节点是正常状态,12 那个节点一直是WAIT_SYNC,重启后状态没变,12 的last_synced_timestamp 持续变大。但抽看了几个文件,11 新上传的文件,12 上也存在。 看解决方案是,停掉 12 那个节点的 storage 服务,delete 后再起服务。 问题是这个 group 数据量巨大,会不会导致重新加入group初始化同步时间过长,校验之前的所有文件?

`group name = group12 disk total space = 47259085 MB disk free space = 1830165 MB trunk free space = 0 MB storage server count = 2 active server count = 1 storage server port = 60002 storage HTTP port = 8888 store path count = 1 subdir count per path = 256 current write server index = 0 current trunk file id = 0

    Storage 1:
            id = xxx.xxx.xxx.11
            ip_addr = xxx.xxx.xxx.11  ACTIVE
            http domain = 
            version = 4.06
            join time = 2023-01-05 22:10:17
            up time = 2023-01-05 22:11:40
            total storage = 47259085 MB
            free storage = 1830165 MB
            upload priority = 10
            store_path_count = 1
            subdir_count_per_path = 256
            storage_port = 60002
            storage_http_port = 8888
            current_write_path = 0
            source storage id= 
            if_trunk_server= 0
            total_upload_count = 231264761
            success_upload_count = 231264761
            total_append_count = 10952585
            success_append_count = 10952585
            total_modify_count = 0
            success_modify_count = 0
            total_truncate_count = 0
            success_truncate_count = 0
            total_set_meta_count = 7138148
            success_set_meta_count = 7138148
            total_delete_count = 28801247
            success_delete_count = 28753433
            total_download_count = 394916689
            success_download_count = 394916687
            total_get_meta_count = 0
            success_get_meta_count = 0
            total_create_link_count = 0
            success_create_link_count = 0
            total_delete_link_count = 0
            success_delete_link_count = 0
            total_upload_bytes = 59549682752307
            success_upload_bytes = 59549682752307
            total_append_bytes = 182446316250
            success_append_bytes = 182446316250
            total_modify_bytes = 0
            success_modify_bytes = 0
            stotal_download_bytes = 96137602374174
            success_download_bytes = 96137602374174
            total_sync_in_bytes = 0
            success_sync_in_bytes = 0
            total_sync_out_bytes = 54018710426503
            success_sync_out_bytes = 53888908225397
            total_file_open_count = 637138616
            success_file_open_count = 637138614
            total_file_read_count = 626841680
            success_file_read_count = 626841680
            total_file_write_count = 398620973
            success_file_write_count = 398620973
            last_heart_beat_time = 2024-09-30 10:19:20
            last_source_update = 2024-09-30 10:18:53
            last_sync_update = 1970-01-01 08:00:00
            last_synced_timestamp = 1970-01-01 08:00:00 (never synced)
    Storage 2:
            id = xxx.xxx.xxx.12
            ip_addr = xxx.xxx.xxx.12 (fastdfs-xxx-12.local)  WAIT_SYNC
            http domain = 
            version = 4.06
            join time = 2023-01-05 22:14:28
            up time = 2024-09-20 00:51:36
            total storage = 47259085 MB
            free storage = 1897149 MB
            upload priority = 10
            store_path_count = 1
            subdir_count_per_path = 256
            storage_port = 60002
            storage_http_port = 8888
            current_write_path = 0
            source storage id= 172.28.48.11
            if_trunk_server= 0
            total_upload_count = 1
            success_upload_count = 1
            total_append_count = 0
            success_append_count = 0
            total_modify_count = 0
            success_modify_count = 0
            total_truncate_count = 0
            success_truncate_count = 0
            total_set_meta_count = 0
            success_set_meta_count = 0
            total_delete_count = 0
            success_delete_count = 0
            total_download_count = 1
            success_download_count = 1
            total_get_meta_count = 0
            success_get_meta_count = 0
            total_create_link_count = 0
            success_create_link_count = 0
            total_delete_link_count = 0
            success_delete_link_count = 0
            total_upload_bytes = 3
            success_upload_bytes = 3
            total_append_bytes = 0
            success_append_bytes = 0
            total_modify_bytes = 0
            success_modify_bytes = 0
            stotal_download_bytes = 10208
            success_download_bytes = 10208
            total_sync_in_bytes = 54019431134506
            success_sync_in_bytes = 53888943545643
            total_sync_out_bytes = 0
            success_sync_out_bytes = 0
            total_file_open_count = 226312592
            success_file_open_count = 226312592
            total_file_read_count = 1
            success_file_read_count = 1
            total_file_write_count = 367751670
            success_file_write_count = 367751670
            last_heart_beat_time = 2024-09-30 10:19:24
            last_source_update = 2024-09-29 10:55:46
            last_sync_update = 2024-09-30 10:18:57
            last_synced_timestamp = 2024-09-19 23:11:20 (10 days 11h:07m:33s delay)`
happyfish100 commented 1 month ago

使用的版本太低了,强烈建议升级到最新的v6.12.1

xxdeye commented 1 month ago

使用的版本太低了,强烈建议升级到最新的v6.12.1

你好,我打算先处理问题后,再考虑升级的事。请问storage 重新加入节点,会全量校验所有的文件么,还是根据 binlog 里继续同步未同步的数据