search

dragonflydb / dragonfly

A modern replacement for Redis and Memcached
https://www.dragonflydb.io/
Other
24.52k stars 885 forks source link

Cluster replication #2831

Open adiholden opened 3 months ago

chakaz commented 2 weeks ago

@adiholden can you please provide some context here? What exactly is not working / implemented currently? What is this task about? Thanks 🙏

romange commented 2 weeks ago

It's like in the old joke "Rabinovich, do you know to play on a Violin? Hmm, I do not know, I've never tried"

adiholden commented 2 weeks ago

We need to make sure that HA cluster works well while performing slot migration.

  1. need to make sure replica does not reject executing commands not in slot ownership, as migration can start between source and target and replica might did not get the new config yet.
  2. add tests for cluster with replicas, do slot migration and check data consistency
  3. support error flows in slot migration with replication, f.e if migraion connection is reset we restart the migration and do flush slots on master node, this flush slots needs to be replicated.