jywarren / plots

This is the old website for Public Lab; visit http://publiclab.org and https://github.com/publiclab/plots2 for the new website.
http://old.publiclab.org
12 stars 0 forks source link

revise backup script to save in <5gb chunks for backup in Amazon s3 #89

Open jywarren opened 12 years ago

jywarren commented 12 years ago

http://unix.stackexchange.com/questions/21373/can-i-automate-tars-multi-volume-feature

jywarren commented 12 years ago

The issue seems to be that our version of s3sync.rb (1.2.6) does not do multipart uploads, which is required for >5gb under Amazon's newish >5gb upload system.

We should switch to the (python) s3cmd utility: https://github.com/s3tools/s3cmd