search

aws / sagemaker-spark-container

The SageMaker Spark Container is a Docker image used to run data processing workloads with the Spark framework on Amazon SageMaker.
Apache License 2.0
36 stars 74 forks source link

Spark3.4.1 #140

Closed mahendruajay closed 8 months ago

mahendruajay commented 8 months ago

Issue #, if available:

Description of changes: Build Spark 3.4.1. Changes:

  1. Consume EMR 6.15.0
  2. Minor updates to Makefile
  3. Update kernel and other libs to address CVEs
  4. Add aws-java-sdk-v2 jars on spark class path

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.