happyfish100 / fastdfs

FastDFS is an open source high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs
GNU General Public License v3.0
8.99k stars 1.98k forks source link

生产环境存在不稳定的tracker集群,执行/usr/local/bin/fdfs_monitor偶尔会导致tracker有Bad file descriptor报错 #583

Closed LinZhenLin closed 1 year ago

LinZhenLin commented 2 years ago

背景: 1) 某日,生产环境的某个tracker集群(副本数为2,版本为v5.0.5),开始爆大量的Bad file descriptor报错,日志量非常大,一旦触发,能写满整个磁盘 具体日志如下所示: tracker日志: 图片 linux var log日志 图片 我这边也有对应的core.dump文件,如果需要,请反馈给我 2) 此时,此类报错是偶发的,在进行对storage server的tracker_server配置从旧集群直接改成新的tracker的过程,发现storage迁移重启后,只要触发 /usr/local/bin/fdfs_monitor <config_file> [-h <tracker_server>] list ps:这里的命令tracker是旧的tracker集群,此时还关联着其他未迁移的storage_server 结果正常返回,但是等待一会,其tracker日志开始报错刷屏。 3) 迁移完成后,我个人对其场景模拟,但是结果一切正常,怀疑是对应的tracker集群存在着问题。

happyfish100 commented 2 years ago

版本太旧了,建议升级到最新版本。