search

amazon-archives / kinesis-storm-spout

Kinesis spout for Storm
Other
106 stars 64 forks source link

Number of spouts and shards #47

Open srivikarthik opened 7 years ago

srivikarthik commented 7 years ago

Hi I've used the following configuration. However the throughput is not as expected.

Using code sample from another open issue

Kinesis side: Number of shards: 5 builder.setSpout("kinesis_spout", spout, 10); conf.setNumWorkers(5);

  1. Can more than one spout used against a shard (Number of workers) ? YES or NO ?
  2. Having more number of threads (10 threads for 5 workers) speeds up the process ?
  3. How to enforce a kinesis starting offset even if zookeeper state exists ?

Karthik