NASA-IMPACT / veda-pforge-job-runner

Apache Beam + EMR Serverless Job Runner for Pangeo Forge Recipes
2 stars 2 forks source link

Need TF to Support Different AWS Accounts and S3 Buckets #22

Open ranchodeluxe opened 7 months ago

ranchodeluxe commented 7 months ago

Problem

Not everyone wants to run recipes and have caches/outputs in the same bucket for a given AWS account

Solution

To accommodate this we'll have to have some TF in this repository (or another one) where folks can create IAM Assume Roles and S3 buckets that the cross AWS account GH Actions user can assume and create temp credentials for while jobs run on the same cluster

AC: