RootPrivileges / terragrunt-aws-modules

MIT License
0 stars 0 forks source link

Don't use S3 Glacier for logging and cloudtrail buckets #19

Closed RootPrivileges closed 4 years ago

RootPrivileges commented 4 years ago

The high cost of transitioning numerous small objects to Glacier far outweighs the benefit of the cheaper storage, especially with the additional 40KB added to each object (when the average object pre-transition appears to be ~6.5KB). Instead, move to Standard-IA after a short time period, and leave files indefinitely.

Eventually, it would probably be much better to have a Lambda function aggregate a large number of historical files into a single archive, and put those objects into Glacier instead.

RootPrivileges commented 4 years ago

http://pragmaticnotes.com/2020/04/22/s3-to-glacier-lifecycle-transition-see-if-its-worth-it/