search

dimitri / pgcopydb

Copy a Postgres database to a target Postgres server (pg_dump | pg_restore on steroids)
Other
1.14k stars 75 forks source link

Can't run the migration when filtering and using a dedicated process to hold the snapshot. #868

Open dcupif opened 1 month ago

dcupif commented 1 month ago

I'm trying to migrate a subset of tables using the filtering capabilities. This migration needs to be performed with logical replication so that we can minimize the downtime window. Also, since the amount of data to move is quite big (~1TB), we wanted to use a dedicated process to hold the snapshot so we could resume the migration in case anything goes wrong.

Here's what I've tried:

# Screen Session `snapshot`
pgcopydb snapshot --follow --slot-name migration

# Screen Session `migration`
pgcopydb clone --follow --slot-name migration --filters filter.ini ...

Trying to do so results in the clone command to fail complaining that the current filtering differs from the filtering used to initialize the catalog. However, there is no option on pgcopydb snapshot to provide the same filtering config file. Is this something known?

pgcopydb version: v0.17

rimbi commented 2 weeks ago

Hi @dcupif , I could not reproduce the case. I can check it if you can provide a script to reproduce it.