lucascbeyeler / zmbackup

A reliable software written in Shell Script to help you in your daily task to backup and restore mails and accounts from Zimbra Open Source Email Platform. Project in deprecation process. Please help me with Waddles.
GNU General Public License v3.0
145 stars 74 forks source link

S3 storage backup destination #175

Open ananiasfilho opened 2 years ago

ananiasfilho commented 2 years ago

Send backups to a S3 Storage bucket like AWS S3, MinIO, Wasabi

ISSUE TYPE
SUMMARY

As many zimbra users need send backup files to a external storage, S3 solutions are good and cheap options. The idea is: Make backup of each account and send each file to a S3 bucket - Important running in parallel. We can discuss it better if you accept this feature request.

protontrigg3r commented 2 years ago

A better idea might be a generic Remote Storage Backup Bestination by taking the code from rclone to connect remote storage ...

ananiasfilho commented 2 years ago

IMHO we need a integrated solution. rclone is good but not integrated with ZmBackup procedures and will be more one service/software on Zimbra. When i proposed this, i was thinking on: if i have 2TB backup, i dont need have 2TB FREE on my server to store backup and dont run backup store remote (slow procedure - NFS, SMBFS/CIFS, etc). The idea is: run 10-20GB backup of account/email and when finish this account, send to a S3 bucket, then start new one and delete this old. Today we need on our environmento, more than 6TB free space to make backups and its not good since, after make backup, i need send 6TB to a remote storage, then delete it on local storage. Make it directly sync to S3 bucket, i can create a list and restore it from S3 bucket. Lets discuss!

protontrigg3r commented 2 years ago

we need a integrated solution

I agree with you, in fact I didn't write "using rclone" but "taking the code from rclone"

backup of account/email and when finish this account, send to a S3 bucket, then start new one and delete this old

very interesting ...