aws / sagemaker-spark-container

The SageMaker Spark Container is a Docker image used to run data processing workloads with the Spark framework on Amazon SageMaker.
Apache License 2.0
36 stars 74 forks source link

Add support for scipy #152

Open KarthikKothareddy opened 7 months ago

KarthikKothareddy commented 7 months ago

I'm trying to use PySparkProcessor along with some scientific packages such as scipy. Is there an easier way to install such dependencies by passing a requirements.txt or should this be installed as a part of this code base?