search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.72k stars 3.78k forks source link

[destination-s3]: invalid s3 bucket path gives cryptic/misleading error message #38338

Open jettdc opened 1 month ago

jettdc commented 1 month ago

Connector Name

destination-s3

Connector Version

0.6.2

What step the error happened?

Configuring a new connector

Relevant information

Trying to create an s3 destination with an invalid bucket path ("/") gives a cryptic warning about request signature.

Screenshot 2024-05-18 at 12 27 23 PM

Screenshot 2024-05-18 at 12 28 32 PM

Fixed by just changing the bucket path.

Screenshot 2024-05-18 at 12 26 50 PM

Screenshot 2024-05-18 at 12 29 21 PM

Maybe this is expected behavior but this took me hours to resolve the issue. Some field validation would be nice.

Also note this is an a s3-api compatible destination, not AWS s3, if that's relevant.

Relevant log output

Configuration check failed
Could not connect to the S3 bucket with the provided configuration. The request signature we calculated does not match the signature you provided. Check your key and signing method. (9a91d2a8-5c0c-4f12-8145-be77efc62e83) (Service: Amazon S3; Status Code: 403; Error Code: SignatureDoesNotMatch; Request ID: 4291e87b1dcbb544; S3 Extended Request ID: 470d27307f4777c3; Proxy: null)

Contribute

marcosmarxm commented 2 weeks ago

@jettdc moved the issue to the connector team backlog. Let's see if other users also have the same problem.