search

maxpert / marmot

A distributed SQLite replicator built on top of NATS
https://maxpert.github.io/marmot/
MIT License
1.81k stars 41 forks source link

benthos and marmot seems like a bit of a good marriage #42

Open gedw99 opened 1 year ago

gedw99 commented 1 year ago

because marmot is a CDC based pattern, it would probably be a pretty good match with benthos.

https://github.com/benthosdev/benthos

benthos already is used in CDC patterns with cockroach for example.

so the idea is that a change to the DB gets sent to benthos, and then benthos can react.

Benthos has a NATS source / sink btw. https://www.benthos.dev/docs/components/inputs/nats_jetstream/

Here is a simple example: https://github.com/davidandradeduarte/benthos-nats-jetstream-output-loop-bug

Another cool example: https://github.com/amirhnajafiz/jetstream-mirroring/

The use cases people would use this for a huge IMHO. Maybe you want to initiate certain logic or secondary data transform to update your business analytics db or whatever you want.

maxpert commented 1 year ago

Very well aware of Benthos and I love Benthos! I will be more than happy accepting contributions on any demo videos, blog posts, or contributions.

gedw99 commented 1 year ago

Great - it will be a while before I get to this.

glad you see the synergy