For the S3 endpoint from the VPC interface using the PrivateLink, we get the following Authorization Header is Malformed error:
com.amazonaws.services.s3.model.AmazonS3Exception: The authorization header is malformed; the region 'vpce' is wrong; expecting 'ca-central-1'
(Service: Amazon S3; Status Code: 400; Error Code: AuthorizationHeaderMalformed; Request ID: req-id; S3 Extended Request ID: req-id-2), S3 Extended Request ID: req-id-2:AuthorizationHeaderMalformed: The authorization
header is malformed; the region 'vpce' is wrong; expecting 'ca-central-1' (Service: Amazon S3; Status Code: 400; Error Code: AuthorizationHeaderMalformed; Request ID: req-id;
As listed on the hadoop-aws library, we should explicitly set the endpoint region.
Situation
For the S3 endpoint from the VPC interface using the PrivateLink, we get the following
Authorization Header is Malformed
error:As listed on the
hadoop-aws
library, we should explicitly set the endpoint region.For example:
Usage will be as following:
Acceptance Criteria