search

aws / sagemaker-spark-container

The SageMaker Spark Container is a Docker image used to run data processing workloads with the Spark framework on Amazon SageMaker.
Apache License 2.0
36 stars 74 forks source link

Add libblas and other shared object libraries for pyspark mllib #23

Closed andremoeller closed 4 years ago

andremoeller commented 4 years ago

Issue #, if available:

Pyspark MLLIb requires shared object libraries. These are taken from some DLC containers

These finish with the test-sagemaker target. But I've had trouble running history server tests.

make clean && make test-unit && make build && docker tag sagemaker-spark-processing:2.4-cpu-py37-v0.1 [my account id].dkr.ecr.us-west-2.amazonaws.com/sagemaker-spark-processing:latest && docker push [my account id].dkr.ecr.us-west-2.amazonaws.com/sagemaker-spark-processing:latest && make test-sagemaker

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.