apache / kvrocks

Apache Kvrocks is a distributed key value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol.
https://kvrocks.apache.org/
Apache License 2.0
3.44k stars 442 forks source link

Track issues: improvements of the kvrocks2redis #1643

Open git-hulk opened 1 year ago

git-hulk commented 1 year ago

Many users would like to use kvrocks2redis to migrate the data from Kvrocks to Redis or other Kvrocks instances. But kvrocks2redis is hard to set up and use, we can improve it by making configurations more clear and simple.

caipengbo commented 1 year ago

Perhaps we could make kvrocks2redis a command-line tool.

In addition, the current single-threaded model uses files as queue, which is very inefficient. Generally, kvrocks has a large amount of data, and in practice, migration takes a very, very long time. Maybe we can provide a multi-threaded solution as an alternative?

git-hulk commented 1 year ago

@caipengbo Yes, that's a good idea. #1534 introduces the hiredis, I think we can switch to hiredis to send commands as well.