tair-opensource / RedisShake

RedisShake is a Redis data processing and migration tool.
https://tair-opensource.github.io/RedisShake/
MIT License
3.86k stars 700 forks source link

数据同步失败 #850

Open HiroC222 opened 3 months ago

HiroC222 commented 3 months ago

问题描述(Issue Description)

进程启动后一段时间直接异常退出,数据并未同步

环境信息(Environment)

日志信息(Logs)

{"level":"error","time":"2024-08-12T11:13:27+08:00","message":"EOF\n\t\t\tRedisShake/internal/reader/sync_standalone_reader.go:283 -> (syncStandaloneReader).receiveRDBWithoutDiskless()\n\t\t\tRedisShake/internal/reader/sync_standalone_reader.go:213 -> (syncStandaloneReader).receiveRDB()\n\t\t\tRedisShake/internal/reader/sync_standalone_reader.go:102 -> (*syncStandaloneReader).StartRead.func1()\n\t\t\truntime/asm_amd64.s:1598 -> goexit()"}

其他信息(Additional Information)

请提供任何其他相关的信息,如配置文件、错误信息或截图等。

function = ""

[sync_reader] cluster = false address = "x.x.x.x:3007" username = "" password = "xxxxxxxx" tls = false sync_rdb = true sync_aof = true

[redis_writer] cluster = false sentinel = false master = "master3007" address = "y.y.y.y:3007" username = "" password = "xxxxxxxx" tls = false off_reply = false

[advanced] dir = "data" ncpu = 2 pprof_port = 0 status_port = 0

log_file = "shake.log" log_level = "info" log_interval = 5

rdb_restore_command_behavior = "rewrite" pipeline_count_limit = 4096 target_redis_client_max_querybuf_len = 1024_000_000 target_redis_proto_max_bulk_len = 512_000_000 aws_psync = "" # example: aws_psync = "10.0.0.1:6379@nmfu2sl5osync,10.0.0.1:6379@xhma21xfkssync" empty_db_before_sync = false

[module] target_mbbloom_version = 20603

异常退出截图如下

1723433108626

suxb201 commented 3 months ago

源端断开连接,检查源端 Redis 日志

HiroC222 commented 3 months ago

源端断开连接,检查源端 Redis 日志

感谢回复,确实是redis源端导致,client-output-buffer-limit配置问题。 下面是原端日志截取,供大家参考。 scheduled to be closed ASAP for overcoming of output buffer limits