aws / sagemaker-spark-container

The SageMaker Spark Container is a Docker image used to run data processing workloads with the Spark framework on Amazon SageMaker.
Apache License 2.0
36 stars 74 forks source link

Updating hadoop version to 3.2.2 or 3.3.0 #103

Open moitrasayan007 opened 1 year ago

moitrasayan007 commented 1 year ago

Looks like there is a bug with hadoop version 3.2.1, they released the patch in https://issues.apache.org/jira/browse/HDFS-15191. Can you please upgrade the hadoop version to 3.22. or 3.3.0. One of the customer is facing issue because of this.