search

rtweeks / s3-sysbackup

An AWS S3-backed, Unix-philosophy backup system
Other
1 stars 0 forks source link

"Over-retain" quilting content objects to avoid `PutObjectRetention` calls to S3 #3

Closed rtweeks closed 3 years ago

rtweeks commented 3 years ago

If the backup actually specifies retention for longer than needed for "quilting" content objects, then on one or more subsequent runs it can avoid sending a PutObjectRetention command to S3. PutObject and PutObjectRetention are two of the major cost drivers for this system, so avoiding unnecessary instances -- even at the cost of lengthier storage -- can produce a significant savings.

rtweeks commented 3 years ago

While this issue is addressed in 0631b9a15737f3c639bfa835ca435e61eba6524e, it won't really be complete until #10 since existing users can't update the CloudFormation stack to grant the new IAM permissions.

rtweeks commented 3 years ago

Now the 0631b9a is merged and #10 is closed, this issue is complete.