logstash-plugins / logstash-integration-aws

Apache License 2.0
7 stars 17 forks source link

S3 output - Support for Glacier storage classes #38

Open StefanTheWiz opened 1 year ago

StefanTheWiz commented 1 year ago

Is there a reason for excluding GLACIER (S3 Glacier Flexible Retrieval), GLACIER_IR (S3 Glacier Instant Retrieval), and DEEP_ARCHIVE (S3 Glacier Deep Archive) from the list of supported storage classes?

https://github.com/logstash-plugins/logstash-integration-aws/blob/fcd1f2a371fd31ce97d059413f3a4d788ea74c41/lib/logstash/outputs/s3.rb#L145

Based on the AWS docs it seems that these classes do support multipart upload API.

Yes, I could use S3 lifecycle rules to transition the files to a different storage class. However, even if I set the rule to run on day 0 it takes 3 days to take effect (this is particularly not helpful when implementing/testing pipelines)