When I create 3 bridge containers via docker, the messages coming into jetstream are tripled in kafka.
I tried with 2 different jetstream streams as below:
I want to keep messages in jetstream in case all consumers fail. After coming back, they should be able to continue where they left. (hoping to provide this by durable consumers)
I want also fault tolerance and want to run 3 bridge containers on 3 different machines making 9 client consumers. Messages in jetstream should be pushed to only one of them in a circular manner which nats will adjust.
Could please help with the configuration? or does this project not support this kind of configuration?
As far as I investigate the code, there is only one option to subscribe to jetstream:
I am using this config.
When I create 3 bridge containers via docker, the messages coming into jetstream are tripled in kafka. I tried with 2 different jetstream streams as below:
Result did not change.
However, in another context where I dont use jetstream and just using pub-sub, NatsToKafka works fine with below config:
I want to keep messages in jetstream in case all consumers fail. After coming back, they should be able to continue where they left. (hoping to provide this by durable consumers) I want also fault tolerance and want to run 3 bridge containers on 3 different machines making 9 client consumers. Messages in jetstream should be pushed to only one of them in a circular manner which nats will adjust.
Could please help with the configuration? or does this project not support this kind of configuration?
As far as I investigate the code, there is only one option to subscribe to jetstream:
so it does not seem possible. Right?