aws / sagemaker-spark-container

The SageMaker Spark Container is a Docker image used to run data processing workloads with the Spark framework on Amazon SageMaker.
Apache License 2.0
36 stars 74 forks source link

Capture all exceptions when checking availability of FS #119

Closed can-sun closed 1 year ago

can-sun commented 1 year ago

Issue #, if available:

Looks like EndpointConnectionError is not a concrete indicator for whether a service is available or not in a region. Client error can be thrown as well.

Capture all exceptions and rely on the retry to decide if FS is available. The retry attempts should be sufficient which gives us confident that FS service is no available in this region.

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.