[DocDB] Investigate raft WAL compression for xCluster traffic

yugabyte / yugabyte-db

YugabyteDB - the cloud native distributed SQL database for mission-critical applications.

https://www.yugabyte.com

Other

8.88k stars 1.05k forks source link

[DocDB] Investigate raft WAL compression for xCluster traffic #15730

Open bmatican opened 1 year ago

bmatican commented 1 year ago

Jira Link: DB-5085

Description

This could help with RBS speed, as well as reducing xcluster network communication, but potentially at the cost of some CPU, on read vs write of new WAL entries.

Potentially relevant work from Kudu https://github.com/apache/kudu/commit/45b7dba1ccf3c9ef455662d4b250c8e9e28fc79f https://github.com/apache/kudu/commit/cf20c0e59668b41a03341471dbe58964ef184389

rthallamko3 commented 1 year ago

Created https://github.com/yugabyte/yugabyte-db/issues/15834 to track the RBS speed. Will leave this for xCluster communication.