CubeCoders / AMP

Issue tracking and documentation for AMP
https://cubecoders.com/AMP
MIT License
206 stars 38 forks source link

Feature Request: Incremental Backups/floating granularity backups #511

Open Pingger opened 3 years ago

Pingger commented 3 years ago

Feature Request

Feature Information:

I'd like the option for both incremental backups and 'floating granularity' backups (keep 1 backup per hour for the last 6 hours, then keep 1 backup per day for 7 days, then keep 1 backup per week for 4 weeks, then 1 backup per month for x month ...).

I confirm:

PhonicUK commented 2 years ago

Backup period tiering is a planned feature as part of the S3 implementation. 👍

imaron85 commented 1 year ago

I really don't wanna be that guy, but I looked through the projects and stati updates and can't really find any references to this or the state of the S3 implementation. Is there any update on this? I would love to see more granularity in backups. (Sorry for bothering if just overlooked something)

Pingger commented 1 year ago

S3 itself has made its way into AMP, but no backup tiering. Additionally, I have no use for S3, as I can't selfhost it. And I do not want to depend on amazon trashservers for way too much money for what they are actually offering. (selfhosting is cheaper, more reliable, faster to set up, and easier to set up)

I'm at the point, that I got rid of AMP backups entirely and am now using BTRFS snapshots, rsync and sometimes LXC snapshots, since I run most AMP instances inside LXC Containers.

mmarquezs commented 1 year ago

S3 itself has made its way into AMP, but no backup tiering. Additionally, I have no use for S3, as I can't selfhost it. And I do not want to depend on amazon trashservers for way too much money for what they are actually offering. (selfhosting is cheaper, more reliable, faster to set up, and easier to set up)

I haven't checked AMP implementation exactly how it works, but in principle any S3 API compatible service should work. There is self hosted solutions for it. MinIO, Ceph, Garage, Seaweedfs, etc. Or not selfhosting there are also other paid services outside Amazon offering support for S3. Backblaze, Wasabi, Digital Ocean, etc.

p0t4t0sandwich commented 1 year ago

Self hosted options should work as long as they are not self-signed. Either HTTP or a proper SSL certificate should work. (I know some have had success with MinIO, not sure about the rest)

PhonicUK commented 1 year ago

Aye there's no shortage of options to self-host S3 compatible storage.

firespawn commented 9 months ago

Is work happening on the introduction of tiered backups?