search

long2ice / meilisync

Realtime sync data from MySQL/PostgreSQL/MongoDB to Meilisearch
https://github.com/long2ice/meilisync
Apache License 2.0
285 stars 43 forks source link

Delete Operation in PostgreSQL is not Synced #22

Closed zebra-f closed 11 months ago

zebra-f commented 1 year ago

(Apologies for the second issue in such a short time).

The delete operation doesn't work as expected; it doesn't sync with MeiliSearch. I'm using the debezium/postgres Docker image, which comes with the wal_level configured and wal2json installed.
I'm not seeing any logs or errors when performing delete operations.

On the wal2json GitHub page, it mentions:

wal2json is an output plugin for logical decoding. It means that the plugin has access to tuples produced by INSERT and UPDATE. Also, UPDATE/DELETE old row versions can be accessed depending on the configured replica identity.

I'm unsure about what they mean by "old row versions" and how to configure it to work with meilisync, if it's even possible.

By the way debzeium/postgres versions 12 and 14 have no other problems, but with version 15, meilisync throws an error mentioning something like "can't locate pg_wal," if I remember correctly.

Pontus-Green commented 1 year ago

I have the same problem

christianbradley commented 1 year ago

I also have this issue.

xlanex6 commented 1 year ago

So I am

zebra-f commented 1 year ago

Going back to:

On the wal2json GitHub page, it mentions:

wal2json is an output plugin for logical decoding. It means that the plugin has access to tuples produced by INSERT and UPDATE. Also, UPDATE/DELETE old row versions can be accessed depending on the configured replica identity.

Configuring replica identity to FULL for a table doesn't fix this issue.