search

alibaba / MongoShake

MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具，可以满足迁移和同步的需求，进一步实现灾备和多活功能。
GNU General Public License v3.0
1.73k stars 445 forks source link

全量+增量同步，差不多全量同步完异常退出 #868

Open 0521ak47 opened 8 months ago

0521ak47 commented 8 months ago

源数据库大小144G mongo-shake版本v2.8.2 源副本集mongo4.2.x，目的单机mongo版本4.2.x 报错日志 024/03/20 02:01:28 CST] [EROR] incr sync ts[7347913952182927620[1710819535, 260]] is less than current oldest ts[7348028189723066973[1710846133, 605]], this error means user's oplog collection size is too small or full sync continues too long [2024/03/20 02:01:28 CST] [CRIT] run replication failed: incr sync ts[7347913952182927620[1710819535, 260]] is less than current oldest ts[7348028189723066973[1710846133, 605]], this error means user's oplog collection size is too small or full sync continues too long

0521ak47 commented 8 months ago

我操作了两次，每次都发觉越到后面，同步就越慢，观察目的mongo负载 io 也没变高多少