tair-opensource / RedisShake

RedisShake is a Redis data processing and migration tool.
https://tair-opensource.github.io/RedisShake/
MIT License
3.77k stars 691 forks source link

receive reply failed #842

Open GoodspeedWong opened 1 month ago

GoodspeedWong commented 1 month ago

问题描述(Issue Description)

ERR [writerxxx.cache.amazonaws.com_6379] receive reply failed. cmd=[SET xxx:xxx:xxx:1234-578f-4321- 42206.3205176679 ...], error=[ERR syntax error]
            RedisShake/internal/writer/redis_standalone_writer.go:116 -> (*redisStandaloneWriter).processReply()
            runtime/asm_arm64.s:1222 -> goexit()

环境信息(Environment)

日志信息(Logs)

2024-07-16 09:41:25 INF load config from file: /RedisShake-4/bin/runtime.toml
2024-07-16 09:41:25 INF log_level: [info], log_file: [/RedisShake-4/data/shake.log]
2024-07-16 09:41:25 INF changed work dir. dir=[/RedisShake-4/data]
2024-07-16 09:41:25 INF GOMAXPROCS defaults to the value of runtime.NumCPU [2]
2024-07-16 09:41:25 INF not set pprof port
2024-07-16 09:41:25 INF create SyncStandaloneReader: readerxxx.cache.amazonaws.com:6379
2024-07-16 09:41:25 INF create RedisStandaloneWriter: writerxxx.cache.amazonaws.com:6379
2024-07-16 09:41:25 INF not set status port
2024-07-16 09:41:25 INF start syncing...
2024-07-16 09:41:30 INF read_count=[183887], read_ops=[63439.33], write_count=[183886], write_ops=[63439.33], syncing rdb, size=[2.2 MiB/124 MiB]
2024-07-16 09:41:35 INF read_count=[522237], read_ops=[67255.49], write_count=[522236], write_ops=[67255.49], syncing rdb, size=[7.6 MiB/124 MiB]
2024-07-16 09:41:40 INF read_count=[863195], read_ops=[65883.44], write_count=[863195], write_ops=[65883.44], syncing rdb, size=[13 MiB/124 MiB]
2024-07-16 09:41:45 INF read_count=[1197717], read_ops=[62840.77], write_count=[1197716], write_ops=[62839.77], syncing rdb, size=[18 MiB/124 MiB]
2024-07-16 09:41:50 INF read_count=[1535202], read_ops=[66696.73], write_count=[1535202], write_ops=[66697.74], syncing rdb, size=[24 MiB/124 MiB]
2024-07-16 09:41:55 INF read_count=[1872435], read_ops=[65086.77], write_count=[1872435], write_ops=[65086.77], syncing rdb, size=[29 MiB/124 MiB]
2024-07-16 09:42:00 INF read_count=[2201256], read_ops=[53599.46], write_count=[2201256], write_ops=[53600.46], syncing rdb, size=[35 MiB/124 MiB]
2024-07-16 09:42:05 INF read_count=[2533730], read_ops=[68018.71], write_count=[2533729], write_ops=[68018.71], syncing rdb, size=[40 MiB/124 MiB]
2024-07-16 09:42:10 INF read_count=[2870036], read_ops=[65454.26], write_count=[2870035], write_ops=[65454.26], syncing rdb, size=[46 MiB/124 MiB]
2024-07-16 09:42:15 INF read_count=[3207826], read_ops=[64425.48], write_count=[3207825], write_ops=[64425.48], syncing rdb, size=[51 MiB/124 MiB]
2024-07-16 09:42:20 INF read_count=[3546509], read_ops=[67310.41], write_count=[3546508], write_ops=[67310.41], syncing rdb, size=[56 MiB/124 MiB]
2024-07-16 09:42:25 INF read_count=[3885107], read_ops=[67412.19], write_count=[3885106], write_ops=[67412.19], syncing rdb, size=[62 MiB/124 MiB]
2024-07-16 09:42:30 INF read_count=[4221395], read_ops=[63040.77], write_count=[4221394], write_ops=[63041.77], syncing rdb, size=[67 MiB/124 MiB]
2024-07-16 09:42:35 INF read_count=[4563761], read_ops=[68260.58], write_count=[4563761], write_ops=[68261.58], syncing rdb, size=[73 MiB/124 MiB]
2024-07-16 09:42:40 INF read_count=[4899873], read_ops=[65473.29], write_count=[4899872], write_ops=[65472.29], syncing rdb, size=[78 MiB/124 MiB]
2024-07-16 09:42:45 INF read_count=[5231511], read_ops=[57793.33], write_count=[5231510], write_ops=[57793.33], syncing rdb, size=[83 MiB/124 MiB]
2024-07-16 09:42:50 INF read_count=[5571402], read_ops=[67195.49], write_count=[5571401], write_ops=[67196.49], syncing rdb, size=[89 MiB/124 MiB]
2024-07-16 09:42:55 INF read_count=[5913463], read_ops=[66440.54], write_count=[5913462], write_ops=[66440.54], syncing rdb, size=[95 MiB/124 MiB]
2024-07-16 09:43:00 INF read_count=[6243510], read_ops=[53661.11], write_count=[6243509], write_ops=[53661.11], syncing rdb, size=[100 MiB/124 MiB]
2024-07-16 09:43:05 INF read_count=[6576471], read_ops=[66211.75], write_count=[6576471], write_ops=[66212.75], syncing rdb, size=[106 MiB/124 MiB]
2024-07-16 09:43:10 INF read_count=[6917731], read_ops=[68431.22], write_count=[6917730], write_ops=[68431.22], syncing rdb, size=[111 MiB/124 MiB]
2024-07-16 09:43:15 INF read_count=[7257700], read_ops=[65460.47], write_count=[7257699], write_ops=[65460.47], syncing rdb, size=[116 MiB/124 MiB]
2024-07-16 09:43:20 INF read_count=[7603139], read_ops=[68650.95], write_count=[7603138], write_ops=[68650.95], syncing rdb, size=[122 MiB/124 MiB]
2024-07-16 09:43:22 ERR [writerxxx.cache.amazonaws.com_6379] receive reply failed. cmd=[SET xxx:xxx:xxx:1234-578f-4321- 42206.3205176679 ...], error=[ERR syntax error]
            RedisShake/internal/writer/redis_standalone_writer.go:116 -> (*redisStandaloneWriter).processReply()
            runtime/asm_arm64.s:1222 -> goexit()

其他信息(Additional Information)

N/A

suxb201 commented 1 month ago

Redis 5.0 不支持这个语法,不推荐降低版本。

GoodspeedWong commented 1 month ago

是set的语法么?

suxb201 commented 1 month ago

set 后面可能带了某些参数,5.0 不支持的

GoodspeedWong commented 1 month ago

有办法规避么?

GoodspeedWong commented 1 month ago

这个error是结束了rdb全量阶段,在aof增量阶段出现的我理解对么?

suxb201 commented 1 month ago

三个方案: