search

pgflo / pg_flo

Stream, transform, and route PostgreSQL data in real-time.
https://pgflo.io
Apache License 2.0
664 stars 13 forks source link

Decouple WAL reading from sink writing & transformations using NATS Jet Stream #9

Closed shayonj closed 1 month ago

shayonj commented 2 months ago

Ensures the source DB isn't at a risk of slow consumers. NATS consumers can be scaled out horizontally for high write workload DBs. Today we cannot.

Helps with https://github.com/shayonj/pg_flo/issues/4 https://github.com/shayonj/pg_flo/issues/3

Also NATS vs...? 🤔