search

superfly / litefs

FUSE-based file system for replicating SQLite databases across a cluster of machines
Apache License 2.0
4.02k stars 96 forks source link

Batch Replication #262

Open benbjohnson opened 1 year ago

benbjohnson commented 1 year ago

Per a discussion on the Fly.io Community forum, it could be useful to introduce a replication delay in order to reduce bandwidth costs. If replicas only need updates on an infrequent basis (e.g. every minute, hour, or day), changes could be batched up and compacted into a single LTX file. That means multiple changes to a single page over the course of that time period could be batched up into a single page being replicated.

nickchomey commented 1 year ago

Just adding a note that this seems related to #296