search

awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Other
641 stars 303 forks source link

Posibility run Glue in cluster mode with master 7077 port available? #110

Open archenroot opened 2 years ago

archenroot commented 2 years ago

Hello,

thx again for releasing v3 of image, its great!

I have a stack of multiple images for local AWS product development:

Now I need to submit spark jobs from either airflow container or from my local computer from shell to the docker image which I am not able to do at moment.

Any hints how to achieve it? Thx a lot!

Eg. Can I start achieve it by starting all /sbin/start-all.sh which starts master and workers? so I get spark://localhost:7077 port available to submit glue jobs?