After moving to the Python 3.9 version of the Lambda code EMR cluster setup is failing. It's missing dependencies that were available in the previous version #81
But, the EMR cluster creation is stuck at this step "emrWaitCondition" and in the backend when i checked the CW logs I can see that it is not showing any error also
=====
START RequestId: b2b212a3-3893-4098-a3db-7a9d7e97f834 Version: $LATEST
--
[4705de4a-bd74-4df1-a410-34576b562323][2022-11-16 19:18:22,727][INFO] Lambda RequestId: b2b212a3-3893-4098-a3db-7a9d7e97f834 CloudFormation RequestId: 4705de4a-bd74-4df1-a410-34576b562323
[4705de4a-bd74-4df1-a410-34576b562323][2022-11-16 19:18:22,744][INFO] Received a Create Request
[4705de4a-bd74-4df1-a410-34576b562323][2022-11-16 19:18:24,623][INFO] Completed successfully, sending response to cfn
[4705de4a-bd74-4df1-a410-34576b562323][2022-11-16 19:18:24,861][INFO] CloudFormation returned status code: OK
END RequestId: b2b212a3-3893-4098-a3db-7a9d7e97f834
REPORT RequestId: b2b212a3-3893-4098-a3db-7a9d7e97f834 Duration: 2137.84 ms Billed Duration: 2138 ms Memory Size: 128 MB Max Memory Used: 69 MB Init Duration: 421.75 ms
I am trying to spin up the EMR cluster using the below template as per the blog - https://github.com/aws-samples/aws-emr-apache-ranger/tree/main/aws_emr_blog_v3
Template - https://s3.amazonaws.com/aws-bigdata-blog/artifacts/aws-blog-emr-ranger/3.0/cloudformation/emr-template.template
But, the EMR cluster creation is stuck at this step "emrWaitCondition" and in the backend when i checked the CW logs I can see that it is not showing any error also
=====
START RequestId: b2b212a3-3893-4098-a3db-7a9d7e97f834 Version: $LATEST -- [4705de4a-bd74-4df1-a410-34576b562323][2022-11-16 19:18:22,727][INFO] Lambda RequestId: b2b212a3-3893-4098-a3db-7a9d7e97f834 CloudFormation RequestId: 4705de4a-bd74-4df1-a410-34576b562323 [4705de4a-bd74-4df1-a410-34576b562323][2022-11-16 19:18:22,744][INFO] Received a Create Request [4705de4a-bd74-4df1-a410-34576b562323][2022-11-16 19:18:24,623][INFO] Completed successfully, sending response to cfn [4705de4a-bd74-4df1-a410-34576b562323][2022-11-16 19:18:24,861][INFO] CloudFormation returned status code: OK END RequestId: b2b212a3-3893-4098-a3db-7a9d7e97f834 REPORT RequestId: b2b212a3-3893-4098-a3db-7a9d7e97f834 Duration: 2137.84 ms Billed Duration: 2138 ms Memory Size: 128 MB Max Memory Used: 69 MB Init Duration: 421.75 ms=====
Could you please advise