toniblyx / alfresco-backup-and-recovery-tool

Alfresco BART is a tool written in shell script on top of Duplicity to do Alfresco backups and restore from a local file system, FTP, SCP or Amazon S3.
Apache License 2.0
96 stars 48 forks source link

Backup of large repository #4

Closed jpbuttet closed 10 years ago

jpbuttet commented 10 years ago

Hello Toni,

Thanks a lot for your work !

Afresco bart works very well with small and medium repositories, no problem so far.

I've tested alfresco bart with a 1300GB repository and it takes more than 12 hours to complete. Do you know how I could decrease the time needed for the backup ? 4-5 hours would be acceptable.

(disabling encryption ? or compression ? any other seting ?)

My setup:

Intel i7 4770 8GB RAM 2 * 4TB HDD Ubuntu 12.04 LTS Alfresco-4.2.d Community edition

My repository: mix of few thousands office documents (.doc, .xls, .pdf ...) and about 60'000 pics and videos.

Thanks in advance for your reply.

Jean-Pierre

toniblyx commented 10 years ago

Hi Jean-Pierre,

My apologizes for late response, I missed your message. Removing compression and encryption may help to reduce the backup time. Your backup destination also may impact on the backup speed.

Anyway, for large contentstores like yours (1,3TB) I recommend to use tools like file system snapshots, you will sabe a lot of time and resources with snapshots, you can use Alfresco BART doing snapshots instead of using duplicity for the contentstore but the script has to be adapted.

Let me know if you need help here and I can try to work with you on that.

jpbuttet commented 10 years ago

Hi Toni,

Thank you very much for your reply. !

I will study your hints, give a try and let you know the results if any.

Best regards.

Jean-Pierre Buttet