search

multinet-app / multinet-server

Multinet server application
https://multinet-app.readthedocs.io
Apache License 2.0
4 stars 2 forks source link

Add CloudWatch Events to schedule a nightly backup of the database #504

Closed JackWilb closed 3 years ago

JackWilb commented 3 years ago

Relevant docs

We need to set up a nightly backup of the data so we can restore in case of emergency. This is especially important as we're planning to merge #492

JackWilb commented 3 years ago

I set this up with @AlmightyYakob to back up the db.multinet.app instance everyday. Backups are incremental (but deleting one backup shouldn't lose us any data, other than the unique data in that snapshot) so shouldn't cost too much.

We'll monitor for cost ,and if it's really high for some reason we'll revisit this to see if there's a better way to do the back ups.

I'm going to leave this issue open for a little while to test if the schedule works as intended.

waxlamp commented 3 years ago

Thank you both (@JackWilb and @AlmightyYakob) for setting this up. Don't forget to claim your joint credit at this week's group meeting!

What's the order of magnitude of cost we're expecting?

JackWilb commented 3 years ago

It's using S3 and the backup size is 50GB (+/- a little for the blocks that change). That should mean, at $0.023 per GB, $1.15 per month

waxlamp commented 3 years ago

"For less than the price of a cup of coffee..."

JackWilb commented 3 years ago

I've verified that it's working with the automated backup taking place at 1:19:29 PM UTC-7 each of the past 3 days. I'll monitor cost, but I don't think we need an issue for that.