Fixing testcase failure due to Spark version upgrade

aws / sagemaker-spark-container

The SageMaker Spark Container is a Docker image used to run data processing workloads with the Spark framework on Amazon SageMaker.

Apache License 2.0

36 stars 74 forks source link

Fixing testcase failure due to Spark version upgrade #114

Closed aapidinomm closed 1 year ago

aapidinomm commented 1 year ago

Description of changes: Fixing test_scala_spark_multinode testcase failure with Spark-3.3

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Testing Details: Ran make test-local and make test-sagemaker locally to ensure that integration testcases don't fail due to spark version upgrade.