search

long2ice / meilisync

Realtime sync data from MySQL/PostgreSQL/MongoDB to Meilisearch
https://github.com/long2ice/meilisync
Apache License 2.0
260 stars 40 forks source link

MySQL support for bulk inserts, deletes by reading multiple event rows #103

Closed KDMW-IO closed 1 month ago

KDMW-IO commented 4 months ago

MySQL support for bulk inserts, deletes by reading multiple event

Description

Refactor binlog event processing to support bulk operations.

Instead of assuming the ifrst index of event.rows contains the full pyload of the binlog event, we iterate through the full event, picking up additional inserts, deletes.

Testing

Tested against an a hosted MySQL instance. Flows from our backend that were leading to meilisearch being out of sync are now working as expected.

Related Issue

https://github.com/long2ice/meilisync/issues/93

KDMW-IO commented 1 month ago

Any updates / feedback?

Is this project abandoned?

long2ice commented 1 month ago

Thanks!