search

long2ice / meilisync

Realtime sync data from MySQL/PostgreSQL/MongoDB to Meilisearch
https://github.com/long2ice/meilisync
Apache License 2.0
287 stars 43 forks source link

MySQL support for bulk inserts, deletes by reading multiple event rows #103

Closed KDMW-IO closed 3 months ago

KDMW-IO commented 6 months ago

MySQL support for bulk inserts, deletes by reading multiple event

Description

Refactor binlog event processing to support bulk operations.

Instead of assuming the ifrst index of event.rows contains the full pyload of the binlog event, we iterate through the full event, picking up additional inserts, deletes.

Testing

Tested against an a hosted MySQL instance. Flows from our backend that were leading to meilisearch being out of sync are now working as expected.

Related Issue

https://github.com/long2ice/meilisync/issues/93

KDMW-IO commented 3 months ago

Any updates / feedback?

Is this project abandoned?

long2ice commented 3 months ago

Thanks!