Redshift Loader: add support for buckets in different regions

snowplow / snowplow-rdb-loader

Stores Snowplow enriched events in Redshift, Snowflake and Databricks

Other

31 stars 17 forks source link

Redshift Loader: add support for buckets in different regions #705

Closed chuwy closed 1 year ago

chuwy commented 2 years ago

Currently, if Redshift cluster and S3 bucket are placed in different regions - COPY statements do not work (at least in monitoring). If we specify the region explicitly it could solve the problem.

Technically, not a bug, but high priority.

Andy-Hay commented 1 year ago

See https://docs.aws.amazon.com/redshift/latest/dg/copy-parameters-data-source-s3.html for further information on how COPY statements need to include a REGION value for cross region loading.