rmusser01 / tldw

tl/dw (Too Long, Didn't Watch): Your Personal Research Multi-Tool - a naive attempt at 'A Young Lady's Illustrated Primer'
Apache License 2.0
330 stars 11 forks source link

Improvement: Improve SQLite DB reliability/Backup #49

Closed rmusser01 closed 1 month ago

rmusser01 commented 5 months ago

As a user, I would like my data to be 'safe', and 'secure'. As part of that, I would like to know that my data is being backed up in case of any issues that might arise during normal operations.

Also as a user, I would like to have little to no responsibility for managing this, and want it done invisibly, with as little friction as possible.

Ideas:

  1. Local shadow backup/copy - backup every X time, perform consistency/checks on backup, compress backups above Y size, keep Z sliding timescale of backups - painful as the DB gets bigger.
  2. Offline backups - integration with ?
  3. Online backups - ?

Links: https://www.sqlite.org/security.html https://github.com/benbjohnson/litestream

rmusser01 commented 1 month ago

Backups now work.

Online/offiste backups can be handled via litestream as noted in the README. Otherwise you can do snapshot backups via the VACUUM command via the "Create Backup" tab.