awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Other
635 stars 299 forks source link

Official latest aws-glue-libs docker image with arm64 does not seem to work on Macbook Pro M2 specs #205

Open awongCM opened 5 months ago

awongCM commented 5 months ago

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-libraries.html#develop-local-docker-image

I followed the instructions above to setup its docker image container from DockerHub link I did docker pull amazon/aws-glue-libs:glue_libs_4.0.0_image_01 and tried to start up in docker desktop. It abruptly exited.

At this point, I thought this image does not have arm64 based image layer running on it that may not be compatible for my Macbook Pro M2 machine.

So I tried docker pull amazon/aws-glue-libs:glue_libs_4.0.0_image_01-arm64. Tried starting up in docker desktop. It also abruptly exited too.

Now I'm confused.

Do any of these docker images ever work on Apple M Core Series machines at all since their inception less than 4 years ago?

Can anyone help to shed light on this?

FYI - I followed the exisiting request here - https://github.com/awslabs/aws-glue-libs/issues/83#issue-837963715 which allow me to raise this issue request.