search

colinsurprenant / redstorm

JRuby on Storm
Other
298 stars 56 forks source link

offsets missing from zookeeper in kafka-topology #131

Open sokratisg opened 9 years ago

sokratisg commented 9 years ago

Hi,

I tried running your kafka-topology example but unfortunately I cannot make the offsets appear under "/kafkaspout" path in zookeeper.

I created the zk node prior running my tests using zkCmd "create /kafkaspout null" and I can see the node created with null data. Unfortunately no node offsets are added after the spout runs for a while and starts committing offsets.

Is there any possibility spouts in local topology not be able to commit on external zk hosts? I am asking because there seems to be some relevance to this: http://stackoverflow.com/questions/24408063/failing-to-write-offset-data-to-zookeeper-in-kafka-storm

Thanks.