aws glue image 3.0 docker image exits with error code 0 - Githubissues

awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.

Other

635 stars 299 forks source link

aws glue image 3.0 docker image exits with error code 0 #196

Open samirakarki opened 12 months ago

samirakarki commented 12 months ago

I'm using aws glue image 3.0 in Dockerfile and utilizing this image to run pyspark test case as Codebuild process which is run via buildspec.yml file. Recently out codebuild is failing to run below line:

docker exec -e AWS_DEFAULT_REGION=$AWS_DEFAULT_REGION -e PYTHONPATH=/home/glue_user/aws-glue-libs/PyGlue.zip:/home/glue_user/spark/python/lib/py4j-0.10.9-src.zip:/home/glue_user/spark/python/:/opt/project/glue/python/ glue3 python3 -m unittest discover -s /opt/project/glue/python/tests/

It hits "Reason: exit status 137" upon investaging:

I have checked the log, I see no java related error, if that was cause relating to OOM.
One thing I've identified, container exits right away after the image is tagged.
I've attached the logs below. test.txt