Q2 Disaster Recovery Exercise

kiwix / operations

Kiwix Kubernetes Cluster

http://charts.k8s.kiwix.org/

7 stars 0 forks source link

Q2 Disaster Recovery Exercise #176

Closed kiwixbot closed 1 month ago

kiwixbot commented 7 months ago

In order to strengthen our infrastructure, we want to:

Document our Disaster Recovery Plan
Simulate a Disaster and recover the service to ensure documentation exists and is up to date

This ticket requests the assignees to:

[x] Pick a Service from Kiwix/openZIM/Offspot
[ ] Redeploy it completly using its backup, using the documentation or writing it.

See Zimfarm documentation.

Note: this is an automatic reminder intended for the assignee(s).

benoit74 commented 6 months ago

We've agreed we will do WP1 for Q2

benoit74 commented 6 months ago

@audiodude

kelson42 commented 6 months ago

Migration to Trove DB has been made succesfuly, therefore seems we can move forward.

audiodude commented 6 months ago

Forgot to switch over the borg-backup to the new database. Let's give that a couple of days to catch up.

I'm also worried about the amount of time it will take to restore the DB from back up. It took 8 - 12 hours to migrate the database and the bottleneck was reading the input into the new database.