argoproj / argo-workflows

Workflow Engine for Kubernetes
https://argo-workflows.readthedocs.io/
Apache License 2.0
14.61k stars 3.13k forks source link

S3 - allow choosing the storage type for upload #13053

Open templarfelix opened 2 months ago

templarfelix commented 2 months ago

Summary

Allow s3 integration to choice of the bucket storage settings

s3.StorageClassStandard (STANDARD)
s3.StorageClassIntelligentTiering (INTELLIGENT_TIERING)
s3.StorageClassStandardIa (STANDARD_IA)
s3.StorageClassOnezoneIa (ONEZONE_IA)
s3.StorageClassGlacier (GLACIER)
s3.StorageClassGlacierIr (GLACIER_IR)
s3.StorageClassDeepArchive (DEEP_ARCHIVE)
s3.StorageClassReducedRedundancy (REDUCED_REDUNDANCY)

Use Cases

Upload s3 artifacts using INTELLIGENT_TIERING as default storage class.


Message from the maintainers:

Love this feature request? Give it a 👍. We prioritise the proposals with the most 👍.

templarfelix commented 2 months ago

sources to change: https://github.com/argoproj/pkg/blob/c1082084a390704e94b92cd9d91792ffd7226307/s3/s3.go#L1 https://github.com/argoproj/argo-workflows/blob/main/workflow/artifacts/s3/s3.go https://github.com/argoproj/argo-workflows/blob/main/examples/output-artifact-s3.yaml