search

2i2c-org / infrastructure

Infrastructure for configuring and deploying our community JupyterHubs.
https://infrastructure.2i2c.org
BSD 3-Clause "New" or "Revised" License
104 stars 63 forks source link

[EPIC] Ensure disaster recovery backups for home directories #4390

Open yuvipanda opened 3 months ago

yuvipanda commented 3 months ago

(Part of the new internal engineering roadmap, see https://github.com/2i2c-org/meta/issues/1234 for more information)

User home directories contain very important data, and we must have backups for disaster recovery. We currently have it for AWS (and it has saved us multiple times), but we need to have that for all cloud providers.

### Tasks
- [ ] https://github.com/2i2c-org/infrastructure/issues/624
- [ ] https://github.com/2i2c-org/infrastructure/issues/4391
- [ ] https://github.com/2i2c-org/infrastructure/issues/4291
- [ ] https://github.com/2i2c-org/infrastructure/issues/4424
- [ ] https://github.com/2i2c-org/infrastructure/issues/4425
- [ ] https://github.com/2i2c-org/infrastructure/issues/4487
- [ ] https://github.com/2i2c-org/infrastructure/issues/4426
sgibson91 commented 1 month ago

Are we tracking exploration for an Azure solution for this beyond the work already done?

I met with a Microsoft rep at UKRSECon24 who recommended snapshots as a DR solution for NFS. However, it is only available on the Premium storage tier.

yuvipanda commented 1 month ago

@sgibson91 I think we should let Azure be for now, and perhaps plan on moving people to jupyterhub-home-nfs eventually.