athensresearch / handbook

https://athensresearch.gitbook.io/handbook/
Creative Commons Zero v1.0 Universal
5 stars 9 forks source link

new: Add a Features/Backups doc #60

Closed joelhans closed 3 years ago

joelhans commented 3 years ago

We have a lot of questions about how Athens uses backups (the .bkp files).

The underlying philosophy:

Questions to answer:

Some context and information that should help answer these questions:

Each backup looks like {TIMESTAMP}-index.transit.bkp . This means the user's db folder will eventually have many backups. This is obviously not space-efficient, and expects users to delete/manage their old backups, but this effectively removes any possibility of data loss. We will eventually come up with other approaches for writing and redundancy that are more performant and space-efficient, but the first principle should be no user data loss, which we've accomplished with this solution.