amazon-archives / kinesis-storm-spout

Kinesis spout for Storm
Other
106 stars 64 forks source link

Exception in zookeepershardstate.java getLastCommittedSeqNum(shardId) function #24

Open nehavishnoi11 opened 8 years ago

nehavishnoi11 commented 8 years ago

I am getting the following Exception when running my topology

10442 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperStateManager - ZookeeperStateManager[taskIndex=0]Activating with shardList [shardId-000000000000, shardId-000000000001, shardId-000000000002, shardId-000000000003, shardId-000000000004, shardId-000000000005, shardId-000000000006, shardId-000000000007, shardId-000000000008, shardId-000000000009, shardId-000000000010, shardId-000000000011, shardId-000000000012, shardId-000000000013, shardId-000000000014, shardId-000000000015, shardId-000000000016, shardId-000000000017, shardId-000000000018, shardId-000000000019] 10443 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperStateManager - ZookeeperStateManager[taskIndex=0]Activating with shardList [shardId-000000000000, shardId-000000000001, shardId-000000000002, shardId-000000000003, shardId-000000000004, shardId-000000000005, shardId-000000000006, shardId-000000000007, shardId-000000000008, shardId-000000000009, shardId-000000000010, shardId-000000000011, shardId-000000000012, shardId-000000000013, shardId-000000000014, shardId-000000000015, shardId-000000000016, shardId-000000000017, shardId-000000000018, shardId-000000000019] 10456 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - ShardList already initialized in Zookeeper. Assuming it is valid. 10456 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - ShardList already initialized in Zookeeper. Assuming it is valid. 10594 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperStateManager - ZookeeperStateManager[taskIndex=1] Got shardList: [shardId-000000000000, shardId-000000000001, shardId-000000000002, shardId-000000000003, shardId-000000000004, shardId-000000000005, shardId-000000000006, shardId-000000000007, shardId-000000000008, shardId-000000000009, shardId-000000000010, shardId-000000000011, shardId-000000000012, shardId-000000000013, shardId-000000000014, shardId-000000000015, shardId-000000000016, shardId-000000000017, shardId-000000000018, shardId-000000000019] 10604 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperStateManager - ZookeeperStateManager[taskIndex=0] Got shardList: [shardId-000000000000, shardId-000000000001, shardId-000000000002, shardId-000000000003, shardId-000000000004, shardId-000000000005, shardId-000000000006, shardId-000000000007, shardId-000000000008, shardId-000000000009, shardId-000000000010, shardId-000000000011, shardId-000000000012, shardId-000000000013, shardId-000000000014, shardId-000000000015, shardId-000000000016, shardId-000000000017, shardId-000000000018, shardId-000000000019] 10606 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000001 10606 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000000 10609 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000003 10609 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000002 10610 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000004 10610 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000005 10611 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000007 10611 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000006 10611 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000008 10611 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000009 10612 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000011 10612 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000010 10613 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000012 10613 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000013 10614 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000015 10614 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000014 10614 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000017 10614 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000016 10615 [Thread-14-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000018 10615 [Thread-16-spout] INFO com.amazonaws.services.kinesis.stormspout.state.zookeeper.ZookeeperShardState - No shard state for shardId-000000000019

nehavishnoi11 commented 8 years ago

any update on this... actually as far as i researched my storm topology is not able to access the zookeeper znodes which are created in zookeeper.