rmusser01 / tldw

Too Long, Didn't Watch(TL/DW): Your Personal Research Multi-Tool - Open Source NotebookLM
Apache License 2.0
44 stars 2 forks source link

Improvement: Improve SQLite DB reliability/Backup #49

Open rmusser01 opened 1 month ago

rmusser01 commented 1 month ago

As a user, I would like my data to be 'safe', and 'secure'. As part of that, I would like to know that my data is being backed up in case of any issues that might arise during normal operations.

Also as a user, I would like to have little to no responsibility for managing this, and want it done invisibly, with as little friction as possible.

Ideas:

  1. Local shadow backup/copy - backup every X time, perform consistency/checks on backup, compress backups above Y size, keep Z sliding timescale of backups - painful as the DB gets bigger.
  2. Offline backups - integration with ?
  3. Online backups - ?

Links: https://github.com/benbjohnson/litestream