search

tradle / multi-hyperbee

A LevelUP compatible leaderless multi-master database with eventual consistency, using hyperbee + CRDT + HLC. Similarly CockroachDB achieves replication on top of RocksDB, but here it is a pure P2P **streaming** database, with zero central management. LevelDB compatibility allows to use Dynalite on top to achieve DynamoDB compatibility with sophisticated auto-updated secondary indexes, and fairly complex queries. Work on Dynalite is almost completed to remove HTTP server, to make this combination perfect for serverless.
36 stars 5 forks source link

Fast startup on new peer joining #2

Open pgmemk opened 3 years ago

pgmemk commented 3 years ago

In current implementation the wait time for new peer to catch up could be daunting. Use hypercore sparse magic to address that - check https://github.com/mafintosh/hypercore-multi-key to clone another peer's hyperbee and repossess with multi-key

pgmemk commented 3 years ago

It's fair also for the case when the device was dormant for a long time and then comes online and needs to download a copious amount of data.