awslabs / amazon-emr-cli

A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs
Apache License 2.0
35 stars 12 forks source link

Feature/runtime roles #21

Closed chrisabbott closed 1 year ago

chrisabbott commented 1 year ago

Issue #, if available:

10

Description of changes:

This PR enables the passing of execution roles at runtime for EMR EC2 steps via the --job-role parameter in emr run. This allows a tighter scoping of permissions for individual steps, which helps avoid blanket permissions being assigned at a cluster-level.

Changes were validated on an EMR EC2 cluster under release label emr-6.7.0 with support for Spark applications for the following cases:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

dacort commented 1 year ago

This looks great, thank you!

I was going to have you add a note to the README, but realized I need to overhaul it anyway now that EMR on EC2 is supported so I wouldn't worry about that for now unless you're feeling ambitious. ;)