brexhq / substation

Substation is a toolkit for routing, normalizing, and enriching security event and audit logs.
https://substation.readme.io
MIT License
330 stars 21 forks source link

feat(transform): Add Storage Class Support to AWS S3 #189

Closed jshlbrd closed 4 months ago

jshlbrd commented 4 months ago

Description

Motivation and Context

This makes it possible to upload objects with unique storage class settings directly to an S3 bucket, which is useful if the transform is being used for the purpose of archiving data.

Another way to do this is with a lifecycle rule, but there are caveats to using that method, such as the object needing to stay in Standard storage for a minimum number of days and the additional cost of transitioning objects between storage classes.

The list of valid storage class strings is here.

How Has This Been Tested?

This has been E2E tested in a production environment for multiple days.

Types of changes

Checklist: