Using s3 sync --delete ${JENKINS_HOME} s3://<BUCKET>/<PATH> is sufficiently fast for small-sized ${JENKINS_HOME}s and when only doing delta'd up-syncs but is paaaaainfully slow on restores beyond 1GiB or so
Expected Behavior:
Restores (full) operate quickly
Actual Behavior:
Restores (full) are painfully slow
Steps to reproduce:
Attempt to build new instance from "quick-recovery" backup
Fix recommendation:
Need to replace s3 sync with more performant method (probably tar cf - ${JENKINS_HOME} | s3 cp - s3://<BUCKET>/<PATH>/<BACKUP_NAME>.tar
ferricoxide
commented
6 years ago
Problem Description:
Using
s3 sync --delete ${JENKINS_HOME} s3://<BUCKET>/<PATH>is sufficiently fast for small-sized${JENKINS_HOME}s and when only doing delta'd up-syncs but is paaaaainfully slow on restores beyond 1GiB or soExpected Behavior:
Restores (full) operate quickly
Actual Behavior:
Restores (full) are painfully slow
Steps to reproduce:
Attempt to build new instance from "quick-recovery" backup
Fix recommendation:
Need to replace
s3 syncwith more performant method (probablytar cf - ${JENKINS_HOME} | s3 cp - s3://<BUCKET>/<PATH>/<BACKUP_NAME>.tar