happyfish100 / fastdfs

FastDFS is an open source high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs
GNU General Public License v3.0
8.91k stars 1.97k forks source link

V5.11版本storage同步异常导致程序异常退出问题 #681

Open nihaomatmat opened 6 months ago

nihaomatmat commented 6 months ago

您好,我使用的版本是V5.11,2个tracker,3个storage 在存储数据量达到一定量级后,会出现同步失败的问题,具体报错如下: ERROR - file: storage_sync.c, line: 241, sync data to storage server XX.XX.XX.XX:23000 fail, errno: 1, error info: Operation not permitted DEBUG - file: storage_sync.c, line: 2969, binlog index: 2, current record offset: 662788862, next record offset: 662788920 刚开始出现报错无法定位问题,打开debug日志后,提示同步文件的下一行的数据,此时我需要修改sync目录下的mark文件调整为推荐的额行数,同步继续;但是当数据量存储至14T以上后,出现的概率变高; 之后,出现该报错后,会报如下的错误: ERROR - file: ini_file_reader.c, line: 1254, malloc dynamic annotations fail ERROR - file: storage_sync.c, line: 1970, load from mark file "/fdfsfile/fastdfs/storage/data/sync/XXXXXX_23000.mark" fail, error code: 12 CRIT - file: storage_sync.c, line: 2794, storage_reader_init fail, errno=12, program exit! 进而导致sorage异常退出,请问是什么问题?****

happyfish100 commented 6 months ago

版本太旧了,建议升级到最新的 V6.11。

happyfish100 commented 6 months ago

FastDFS server、client 和 nginx扩展模块都需要同步升级。

nihaomatmat commented 6 months ago

您好,请问client和nginx扩展模块有没有版本建议呢?客户端是java版;还有目前是集群,,能否升级一个server,另一个保持不变?

happyfish100 commented 6 months ago

FastDFS server、client 和 nginx扩展模块都需要同步升级到最新版本。

happyfish100 commented 6 months ago

您好,请问client和nginx扩展模块有没有版本建议呢?客户端是java版;还有目前是集群,,能否升级一个server,另一个保持不变?

必须整个集群以及 client SDK 和 nginx 扩展模块同步升级。

nihaomatmat commented 6 months ago

好的,谢谢大佬