awslabs / amazon-emr-cli

A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs
Apache License 2.0
35 stars 12 forks source link

Add support for spark-submit params and job args in EMR on EC2 #35

Closed dacort closed 9 months ago

dacort commented 9 months ago

Issue #, if available: Unfiled

Description of changes: emr run did not propertly support --spark-submit-opts or --job-args when submitting to EMR on EC2. This PR adds functionality for both of those, including shell-escaping the job args.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.