search

estuary / flow

🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, with Estuary Flow. 🌊
https://estuary.dev
Other
595 stars 47 forks source link

models/journals: region configuration for S3 storage mappings #1410

Closed williamhbaker closed 6 months ago

williamhbaker commented 6 months ago

Description:

Allows setting the region for S3 storage mappings, for buckets that are not in the us-east-1 region.

See also: https://github.com/gazette/core/pull/365. We will need to be running on this version of Gazette prior to deploying the changes here.

Closes https://github.com/estuary/flow/issues/1409

Workflow steps:

Create a storage mapping like this, and it will now work:

{
  "stores": [
    {
      "provider": "S3",
      "bucket": "my-bucket-in-us-west-2",
      "region": "us-west-2",
      "prefix": "collection-data/"
    }
  ]
}

Documentation links affected:

(list any documentation links that you created, or existing ones that you've identified as needing updates, along with a brief description)

Notes for reviewers:

(anything that might help someone review this PR)

This change is Reviewable