For some specific tables in RDS Aurora postgresql 16.2 - ERROR: invalid snapshot identifier

PeerDB-io / peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

https://peerdb.io

Other

1.91k stars 61 forks source link

For some specific tables in RDS Aurora postgresql 16.2 - ERROR: invalid snapshot identifier #1750

Open debugger22 opened 1 month ago

debugger22 commented 1 month ago

[pg_query_executor] failed to set snapshot: ERROR: invalid snapshot identifier: "0000002F-00040D68-1" (SQLSTATE 22023)

debugger22 commented 1 month ago

It's happening with large tables

debugger22 commented 1 month ago

Sometimes it also throws - failed to set transaction snapshot: failed to set transaction snapshot: ERROR: invalid snapshot identifier: "0000000E-0002EEB6-1" (SQLSTATE 22023)

serprex commented 3 weeks ago

I've seen this happen when the initial copy gets interrupted. In that scenario we should get a new snapshot

Is peerdb running out of memory on your setup?

Amogh-Bharadwaj commented 3 weeks ago

Hi @debugger22 ! Could happen if peerdb - specifically the flow-snapshot-worker container - restarts. That container needs to always be up during initial load. Is it possible to check if that container ever went down?