Corsinvest / cv4pve-barc

Backup And Restore Ceph for Proxmox VE
https://www.cv4pve-tools.com
GNU General Public License v3.0
83 stars 22 forks source link

Different schedules for the same vm? #28

Open gardar opened 6 years ago

gardar commented 6 years ago

It would be neat if we could do different schedules on the same, for example to keep 5 daily backup, 3 weekly and 1 monthly, etc. backups.

Currently we can do this by setting up a seperate backup job, but that would mean the other backup jobs are taken at the same time, so for example when the monthly backup is taken we would take a daily, weekly and a monthly backup all at the same time.

A better way would be if the daily backup would be taken and copied as a weekly and a monthly backup rather than having to run three backup procedures.

franklupo commented 6 years ago

Hi, nice idea. This is true if we maintain the same times of execution, very difficult. I think the real problem is the first complete image, which is heavy.

Best regards

gardar commented 6 years ago

How about using one initial complete image, and then keep daily/weekly/monthly diffs for that same inital image?

flames commented 5 years ago

though, this is a highly needed feature, but i see a problem there maintaining one initial image and do separate diffs for daily/weekly/monthly. please correct me, if i am wrong (new to this stuff)...: the diffs are not "differential" as the name suggests, but incremental.

  1. differential is, where every diff depends on the initial image
  2. incremental is, where diffs depend on previous diffs, and only the first diff depends on initial image if we want to maintain one initial image and different diffs for d/w/m, they need to be dependent on initial image.

differential backup is the imho the best of both worlds, it takes a little more space than incremental, but still less than full backups (this is why we are here and not using the default proxmox backup feature). But still safe enough to restore a "selected date" even if previous (those between initial image and the selected diff) deltas are not available or broken.

the --label parameter allows to make different schedules, but with one full initial image per schedule. i don't see a better way with ceph export :(

franklupo commented 5 years ago

Hello, except for the initial image, the diffs depend on the previous diff. So the first diff depends on the initial image, the second diff depends on the first diff and so on. An option to make the first smaller image is to export it as 'diff' with 'rbd export-diff' instead of 'rbd export'. One of the problems with this solution is that it can only be restored in CEPH. The current backup exports a RAW image, which can be restored to any system not only CEPH.

I am developing a new plug-in version with a client running outside of Proxmox VE, using the Web API. I'm developing in C # dotnet core.

I'll release a beta version in a few weeks.

Thank you all