awslabs / amazon-emr-cli

A command-line interface for packaging, deploying, and running your EMR Serverless Spark jobs
Apache License 2.0
35 stars 12 forks source link

Sample job got failed : Python no such file or directory #32

Closed mayurchoubey closed 9 months ago

mayurchoubey commented 10 months ago

[emr-cli]: Waiting for job to complete... [emr-cli]: Job state is now: PENDING [emr-cli]: Job state is now: SCHEDULED [emr-cli]: Job state is now: RUNNING [emr-cli]: Job state is now: FAILED [emr-cli]: EMR Serverless job failed: Job failed, please check complete logs in configured logging destination. ExitCode: 1. Last few exceptions: Caused by: java.io.IOException: error=2, No such file or directory Exception in thread "main" java.io.IOException: Cannot run program "./environment/bin/python": error=2, No such file or directory...

dacort commented 10 months ago

Hi there, thanks for trying the EMR CLI.

It looks like your job required a virtual environment, but it didn't get packaged or uploaded properly.

Please try the following.

Can you provide some more details on your environment and command? Did you use the emr init command or do you have a pre-existing project?

Thanks!

dacort commented 10 months ago

Just wanted to check back in here? Will close this if I don't hear back. :)