search

DDMAL / CantusDB

A new site for Cantus Database running under Django.
https://cantusdatabase.org
MIT License
5 stars 6 forks source link

Database backups need to be transferred to safe place off server #1250

Open dchiller opened 10 months ago

dchiller commented 10 months ago

Now that daily database back-ups are working, we need to have them stored somewhere in addition to the production server.

ao 8 April, this will be:

UPDATE: with https://github.com/dact-chant/ansible.cantus-db/pull/47, the storage on DRAC will be implemented. So doing this on a Google account will close this issue.

dchiller commented 7 months ago

As a location for these back-ups, I've created https://github.com/dact-chant/cantusdb-backup ... note: this is a private repository, because these back-ups contain sensitive data.

ahankinson commented 7 months ago

I wouldn't recommend GitHub for storing database dumps. You should at least be tar.gz'ing them, and then they become binary blobs which are not great in a version control system. You're also not really needing to know the diff between dumps, and adding a new dump every day.

Possible alternatives might be uploading to a Dropbox or a OneDrive account. You could also try moving them to the "Project" storage available on one of the other DRAC clusters:

https://alliancecan.ca/en/services/advanced-research-computing/national-services/storage https://docs.alliancecan.ca/wiki/Transferring_data

This also supports rsync, which could be handy.

dchiller commented 7 months ago

GH came up in the context of wanting a non-Alliance option. If DACT already has a Google account, maybe that's best.

Just looked too...we're well, well within the free tier of Google Cloud Storage, so maybe that....

dchiller commented 5 months ago

Update: for the alliance storage, which I am focusing on first, I am working on getting an unattended (ie. No 2FA) connection to prod storage.