search

Azure / azure-documentdb-changefeedprocessor-dotnet

This library provides a host for distributing change feed events in partitioned collection across multiple observers. Instances of the host can scale up (by adding) or down (by removing) dynamically, and the load will be automatically distributed among active instances in about-equal way.
Other
50 stars 20 forks source link

Consumer Groups #136

Open yahorsi opened 5 years ago

yahorsi commented 5 years ago

Does change feed API support grouping consumers? E.g. like Kafka does. E.g. I have a feed that should be processed by 2 different groups of processors where

  1. Every single group shoud receive all the messages
  2. Every single group should be load balanced separatly of other groups

E.g. 1 group of consumers is responsible for reading data and updating e.g. Elastic while another one is updating warehouse

From the readme this seems to be not supported

bartelink commented 5 years ago

The LeaseId parameter is the equivalent (if you don't supply one, the consumer group is effectively "")

I'd personally love to see you do a PR to edit in some mention of this into the readme; I'm in the middle of a sortie but am planning to come back and add lots of hard won info which currently only lives in the open issues list (even though it would be nice if MS had someone that has proper time allocated for maintaining this, which doesn't seem to be the case)