'local/local_gpu' mode causing errors

aws / sagemaker-spark-container

The SageMaker Spark Container is a Docker image used to run data processing workloads with the Spark framework on Amazon SageMaker.

Apache License 2.0

36 stars 74 forks source link

'local/local_gpu' mode causing errors #65

Open agarwala95 opened 3 years ago

agarwala95 commented 3 years ago

https://github.com/aws/sagemaker-spark-container/blob/0e407d1d06eead24bb919dda1e432fe41725fc84/src/smspark/bootstrapper.py#L341

When using the container for PySpark/Spark Processing Job in 'local' mode, the container starts but exits with a docker-compose error. ['docker-compose', '-f', '/tmp/tmpivizopyn/docker-compose.yaml', 'up', '--build', '--abort-on-container-exit']