LTX Support - Githubissues

benbjohnson / litestream

Streaming replication for SQLite.

https://litestream.io

Apache License 2.0

10.34k stars 232 forks source link

LTX Support #458

Open benbjohnson opened 1 year ago

benbjohnson commented 1 year ago

The LiteFS project uses the LTX file format for storing change sets and there a lot of improvements that can be made to Litestream if it used the same format:

Compaction support
WAL offset & salt maintained in LTX header
Compression support can be moved to LTX
Encryption support (planned)

hifi commented 1 year ago

As the streaming replication support that was canned made changes to the file structure, will LTX support also keep the breaking change or allow restoring from legacy (0.3.x) WAL files and structure at least for one minor version (0.4.x) to make migration seamless and safe?

benbjohnson commented 1 year ago

@hifi I'm on the fence about backward compatibility. The new version will take a snapshot right away when it starts up so it'll be seamless and safe from that perspective. In theory, it could handle pulling in historic backups but that'd also be a fair bit of code to maintain that support as well.