search

XiaoMi / rdsn

Has been migrated to https://github.com/apache/incubator-pegasus/tree/master/rdsn
Other
144 stars 58 forks source link

fix(dup_enhancement#21): add batch replay log to support batch send mutation #1080

Closed foreverneverer closed 2 years ago

foreverneverer commented 2 years ago

Ref-Issue

https://github.com/apache/incubator-pegasus/issues/892

Change

In the past, batch send may be not effective, since the log via single block replay that is too small to achieve target batch bytes, for example, single replay block just produce 1KB data In one loop, but we set the batch bytes = 4KB and expect send 4KB in one rpc , It will not meet expectations. this pr support batch read log and the batch bytes of reading will be also used for batch send

Config

[pegasus.server]
- duplicate_log_batch_megabytes = 4MB
[replication]
+ duplicate_log_batch_bytes = 4096
- max_concurrent_manual_emergency_checkpointing_count = 1
+ max_concurrent_manual_emergency_checkpointing_count = 10