cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.22k stars 3.82k forks source link

AWS_ENDPOINT is not working properly in v24.3.0 #136678

Open def- opened 9 hours ago

def- commented 9 hours ago

Describe the problem

AWS_ENDPOINT is not working properly in v24.3.0, works fine in v24.2.

To Reproduce

We are running

CREATE EXTERNAL CONNECTION backup_bucket
AS 's3://persist/crdb-backup?AWS_ENDPOINT=http://minio:9000/&AWS_REGION=minio&AWS_ACCESS_KEY_ID=minioadmin&AWS_SECRET_ACCESS_KEY=minioadmin';
BACKUP INTO 'external://backup_bucket';
DROP EXTERNAL CONNECTION backup_bucket;

In old versions this connects to the host minio. In new CRDB version it connects to the host persist.minio, which does not exist.

Expected behavior Keep connecting to the right hostname, persist/crdb-backup is the bucket name. I could not find anything about this in the release notes: https://www.cockroachlabs.com/docs/releases/v24.3

Additional data / screenshots

ERROR: failed to construct External Connection details: failed to create s3 external connection: failed to write a sentinel ExternalStorage file: closing object: upload failed: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://persist.minio:9000/crdb-backup/crdb_external_storage_location?x-id=PutObject": dial tcp: lookup persist.minio on 127.0.0.11:53: no such host

Environment:

Additional context Failed tests in our CI

Jira issue: CRDB-45195

blathers-crl[bot] commented 9 hours ago

Hi @def-, please add branch-* labels to identify which branch(es) this C-bug affects.

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

blathers-crl[bot] commented 9 hours ago

Hello, I am Blathers. I am here to help you get the issue triaged.

Hoot - a bug! Though bugs are the bane of my existence, rest assured the wretched thing will get the best of care here.

I have CC'd a few people who may be able to assist you:

If we have not gotten back to your issue within a few business days, you can try the following:

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

blathers-crl[bot] commented 9 hours ago

cc @cockroachdb/disaster-recovery