search

mosuka / blast

Blast is a full text search and indexing server, written in Go, built on top of Bleve.
Apache License 2.0
1.07k stars 76 forks source link

Syncing or integrating with existing PostgreSQL database #122

Open rrjanbiah opened 4 years ago

rrjanbiah commented 4 years ago

Are there any recommended approach to sync with PostgreSQL? IOW, how do people using Blast integrate it with their existing PostgreSQL systems?

mosuka commented 4 years ago

Basically, send PostgreSQL data to Blast and index it. I haven't heard of Blast use cases yet.

rrjanbiah commented 4 years ago

@mosuka Thank you so much for your reply. Hopefully debezium along with Kafka will help for real time sync.

joeblew99 commented 4 years ago

The other more scalable way is to use CDC on the SQL database

The change feed can then be used to update blast.

This is the pattern typically used because you can then update a myriad of systems when the data in the dB mutates It also means that you respect the transactions in the DB being committed or rollbacked

rrjanbiah commented 4 years ago

@joeblew99 Thanks for sharing your ideas. For Postgres, do you know any solution other than debezium ?