search

estuary / connectors

Connectors for capturing data from external data sources
Other
50 stars 17 forks source link

source-postgres: Verify that captures from Amazon RDS work #103

Closed willdonnelly closed 2 years ago

willdonnelly commented 2 years ago

We haven't actually tested this yet, and anecdotally from a potential user it sounds like at least our setup instructions may need some tweaking.

willdonnelly commented 2 years ago

I verified that we were able to capture changes from an Amazon RDS PostgreSQL v13 instance, and wrote up the necessary tweaks to the setup process.

TL;DR: Set the parameter rds.logical_replication = 1 instead of using the standard wal_level = logical setting, and there were a couple changes to the capture account creation, like using GRANT rds_replication TO flow_capture; instead of creating the user with REPLICATION, and not needing to grant information_schema / pg_catalog access in the first place.

Olivia is working on adding an RDS-specific section to the connector documentation.