awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Other
636 stars 300 forks source link

Expanding installation process #86

Closed marcin2x4 closed 2 years ago

marcin2x4 commented 3 years ago

Couple users are experiencing various issue (glue, spark context, py4j not working etc) Could someone provide a more step-by-step manual on how to get this lib up and running on both linux/windows environments?

moomindani commented 2 years ago

We apologize for delay.

Docker image for Glue 3.0 is available officially, and it will be easier for those users to set up the local library. Here's the blog post for that. https://aws.amazon.com/blogs/big-data/develop-and-test-aws-glue-version-3-0-jobs-locally-using-a-docker-container/