long2ice / meilisync

Realtime sync data from MySQL/PostgreSQL/MongoDB to Meilisearch
https://github.com/long2ice/meilisync
Apache License 2.0
247 stars 37 forks source link

Need some clarification #14

Open KrunchMuffin opened 1 year ago

KrunchMuffin commented 1 year ago

Trying to understand this and if it is what I need.

Does it just sync whole tables flat? Can I use a view? Can it take a query?

This is a partial piece of the documents I need to sync. image

brunoocasali commented 1 year ago

I will want to have the @long2ice inputs here.

But yes @KrunchMuffin, so far, the meilisync only supports flat tables because we are watching the raw binlog of the MySQL instance (in the MySQL case). By doing this you can safely use it without worrying about overloading your production database with unwanted SELECT * requests.

That could be a good improvement idea for this repository, although I don't think of how it could work with the current implementation. Plus, I do not like triggering select requests to ingest data into other sources, I think this could have unwanted side effects on your production db.