ovh / public-cloud-roadmap

Agile roadmap for OVHcloud Public Cloud services. Discover the features our product teams are working on, comment and influence our backlog.
https://www.ovhcloud.com/en/public-cloud/
185 stars 5 forks source link

Secondary backup in another region #335

Closed thild42 closed 1 year ago

thild42 commented 1 year ago

User Story

As a customer I want my data to be backup in another region that the service is deployed in So that I have a disaster recovery option for my service

Acceptance criterias

Note

This feature is already provided for MongoDB.

Vote and Feedback

Ask us anything here in the comments below, and vote with emojis ! 👍 to vote for this issue

Discuss on Discord

Feel free to discuss with us on https://discord.com/invite/PwPqWUpN8G

matmicro commented 1 year ago

What is the meaning of the "backup" ?

thild42 commented 1 year ago

Good question.

The full backups, the daily/nightly ones, are stored locally and in the secondary region. The real-time backups, the WAL files, are written every 5 minutes only locally and are used for point in time recovery.

thild42 commented 1 year ago

Removing the "MongoDB" label as MongoDB backups are already stored in a distant region.

thild42 commented 1 year ago

Good news, this feature is now released in production. You should be able to see the different location of your backups from the Control Panel.

The first is the local backup, and the second one is the remote backup. image

In this example the service is running in Gravelines, so the local backup is in Gravelines, and the remote backup in Strasbourg.

biapar commented 1 year ago

How to restore from the secondary region and how to choose another region where to restore? When will be available for the instances?

thild42 commented 1 year ago

Currently the restoration to another region is not permitted from the Control Panel and will be available soon. However the restoration to another region is permitted by the API, but there is a bug being resolved as we speak.

Piscenois commented 1 year ago

Hi ! Does this issue cover the last line in the table https://help.ovhcloud.com/csm/en-public-cloud-databases-postgresql-concept-high-availability?id=kb_article_view&sysparm_article=KB0049421#comparative-table ?

@thild42, when you said

The full backups, the daily/nightly ones, are stored locally and in the secondary region. The real-time backups, the WAL files, are written every 5 minutes only locally and are used for point in time recovery.

and I understand the secondary backup to another region is once a day, I wonder how RPO can be 5 minutes ?

Don't you need to backup the WAL every 5 minutes to another region ?

Regards

thild42 commented 1 year ago

Hey @Piscenois, really good question !

It seems I was wrong when I say that WAL files were only stored locally. Both backups and WAL/oplog/binlog are created locally and sync remotely. So no worries regarding the RPO

I am in touch with our partner Aiven to get some clarification regarding the sync between local and remote drive (probably some rclone shenanigans).

biapar commented 1 year ago

The function disappeared from the control panel. I don't see it anymore.

image
thild42 commented 1 year ago

Hello, @biapar I just check in the Control Panel and everything is fine on my end. Could you please send me your Public Cloud project identifier by email at thibaud.le-douarin@ovhcloud.com ?

thild42 commented 1 year ago

Hello again @Piscenois.

I manage to get some additional information regarding synchronization and RPO. I can confirm that both backups and WAL are synched remotely. The synchronization method differs from engine to engine, for PostgreSQL pghoard is used, for MySQL it is myhoard, etc.

Piscenois commented 1 year ago

Thank tou @thild42