tair-opensource / RedisShake

RedisShake is a Redis data processing and migration tool.
https://tair-opensource.github.io/RedisShake/
MIT License
3.86k stars 700 forks source link

最新的4.10版本,设置了scan = false不起作用 #812

Open xcjing opened 6 months ago

xcjing commented 6 months ago

问题描述(Issue Description)

在最新的4.10版本,设置了scan = false, 并且设置了ksn = true,但是源端新增的记录并没有被同步到目标端。

请在这里简要描述你遇到的问题。 scan = false只是不SCAN了,也就是不同步全量,但增量也没有被同步。

Please provide a brief description of the issue you encountered.

环境信息(Environment)

日志信息(Logs)

024-05-29 04:02:11 INF read_count=[0], read_ops=[0.00], write_count=[0], write_ops=[0.00], src-1, scan_dbid=[0], scan_percent=[], need_update_count=[0] 2024-05-29 04:02:16 INF read_count=[0], read_ops=[0.00], write_count=[0], write_ops=[0.00], src-2, scan_dbid=[0], scan_percent=[], need_update_count=[0] 2024-05-29 04:02:21 INF read_count=[0], read_ops=[0.00], write_count=[0], write_ops=[0.00], src-0, scan_dbid=[0], scan_percent=[], need_update_count=[0] 2024-05-29 04:02:26 INF read_count=[0], read_ops=[0.00], write_count=[0], write_ops=[0.00], src-1, scan_dbid=[0], scan_percent=[], need_update_count=[0] 2024-05-29 04:02:31 INF read_count=[0], read_ops=[0.00], write_count=[0], write_ops=[0.00], src-2, scan_dbid=[0], scan_percent=[], need_update_count=[0] 2024-05-29 04:02:36 INF read_count=[0], read_ops=[0.00], write_count=[0], write_ops=[0.00], src-0, scan_dbid=[0], scan_percent=[], need_update_count=[0]

如果有错误日志或其他相关日志,请在这里提供。

If there are any error logs or other relevant logs, please provide them here.

其他信息(Additional Information)

请提供任何其他相关的信息,如配置文件、错误信息或截图等。

Please provide any additional information, such as configuration files, error messages, or screenshots.

suxb201 commented 6 months ago

修改 redis 配置 notify-keyspace-events 为 AE

xcjing commented 5 months ago

您好,设置notify-keyspace-events 为 AE之后,同步第一条记录,就会报下面的错误: 2024-06-01 05:12:23 INF not set status port 2024-06-01 05:12:23 INF start syncing... 2024-06-01 05:12:28 INF read_count=[0], read_ops=[0.00], write_count=[0], write_ops=[0.00], src-1, scan_dbid=[0], scan_percent=[], need_update_count=[0] 2024-06-01 05:12:33 ERR [writer_10.0.1.123_6379] receive reply failed. cmd=[RESTORE c 0 ccc u 5 J], error=[ERR DUMP payload version or checksum are wrong] RedisShake/internal/writer/redis_standalone_writer.go:116 -> (*redisStandaloneWriter).processReply() runtime/asm_amd64.s:1598 -> goexit()

源端版本是7.014,目标端是7.07, 是不是这种模式下源端版本和目标端版本要严格一样,包括小版本

suxb201 commented 5 months ago

是的,版本不能降低。