apache / openwhisk-package-kafka

Apache OpenWhisk package for communicating with Kafka or Message Hub
https://openwhisk.apache.org/
Apache License 2.0
32 stars 43 forks source link

Gradually start consumers when provider starts #240

Open dubee opened 6 years ago

dubee commented 6 years ago

Consumers should not all be started at the same time when the provider starts as this may result in throttling.

abaruni commented 6 years ago

@dubeejw perhaps we should use a backoff strategy. i.e. start n comsumers on startup, wait the interval, start n comsumers, wait the interval, etc... where the interval is global

dubee commented 6 years ago

Sounds good, as long as the provider doesn't take an exorbitant amount of time to start all of the consumers.