Open lokeshhctm opened 8 years ago
I downloaded the latest build and compiled and ran application with command:
bin/capillary -Dcapillary.zookeepers=zookeeper-1:2181,zookeeper-2:2181,zookeeper-3:2181 -Dcapillary.kafka.zkroot=/rtb0900 -Dcapillary.storm.zkroot=/rtb0900/data/storm -Dlogger.root=DEBUG -Dlogger.play=DEBUG -Dlogger.application=DEBUG -Dcapillary.use.trident=false
_I see out on console like below & then nothing is being displayed in UI. Am i doing something wrong here. Logs show that it is able to fetch offsets for storm consumers but i am not seeing anywhere is trying to fetch offset from Kafka. _
_[debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 1,12 replyHeader:: 1,4298358617,0 request:: '/rtb0900/data/storm,F response:: v{'rtb_bidders,'rtb_avail,'rtb_bidders_request},s{4294970770,4294970770,1455067524057,1455067524057,0,3,0,0,0,3,4294971417} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 2,12 replyHeader:: 2,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders,F response:: v{'partition_5,'partition_6,'partition_7,'partition_8,'partition_9,'partition_0,'partition_1,'partition_2,'partition_3,'partition_4},s{4294970771,4294970771,1455067524062,1455067524062,0,10,0,0,0,10,4294970795} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 3,12 replyHeader:: 3,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_5,F response:: v{},s{4294970788,4298358589,1455067526635,1455158172473,38467,0,0,0,172,0,4294970788} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 4,12 replyHeader:: 4,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_6,F response:: v{},s{4294970773,4298358603,1455067524542,1455158172835,38642,0,0,0,172,0,4294970773} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 5,12 replyHeader:: 5,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_7,F response:: v{},s{4294970780,4298358604,1455067526036,1455158172848,38633,0,0,0,173,0,4294970780} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 6,12 replyHeader:: 6,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_8,F response:: v{},s{4294970789,4298358595,1455067526635,1455158172786,38331,0,0,0,172,0,4294970789} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 7,12 replyHeader:: 7,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_9,F response:: v{},s{4294970791,4298358566,1455067526695,1455158171605,38404,0,0,0,173,0,4294970791} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 8,12 replyHeader:: 8,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_0,F response:: v{},s{4294970795,4298358584,1455067526701,1455158172193,38468,0,0,0,172,0,4294970795} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 9,12 replyHeader:: 9,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_1,F response:: v{},s{4294970782,4298358600,1455067526041,1455158172834,38633,0,0,0,172,0,4294970782} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 10,12 replyHeader:: 10,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_2,F response:: v{},s{4294970790,4298358598,1455067526635,1455158172794,38639,0,0,0,173,0,4294970790} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 11,12 replyHeader:: 11,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_3,F response:: v{},s{4294970792,4298358596,1455067526695,1455158172787,38310,0,0,0,172,0,4294970792} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 12,12 replyHeader:: 12,4298358618,0 request:: '/rtb0900/data/storm/rtb_bidders/partition4,F response:: v{},s{4294970772,4298358569,1455067524065,1455158171678,38429,0,0,0,173,0,4294970772}
I downloaded the latest build and compiled and ran application with command:
bin/capillary -Dcapillary.zookeepers=zookeeper-1:2181,zookeeper-2:2181,zookeeper-3:2181 -Dcapillary.kafka.zkroot=/rtb0900 -Dcapillary.storm.zkroot=/rtb0900/data/storm -Dlogger.root=DEBUG -Dlogger.play=DEBUG -Dlogger.application=DEBUG -Dcapillary.use.trident=false
_I see out on console like below & then nothing is being displayed in UI. Am i doing something wrong here. Logs show that it is able to fetch offsets for storm consumers but i am not seeing anywhere is trying to fetch offset from Kafka. _
_[debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 1,12 replyHeader:: 1,4298358617,0 request:: '/rtb0900/data/storm,F response:: v{'rtb_bidders,'rtb_avail,'rtb_bidders_request},s{4294970770,4294970770,1455067524057,1455067524057,0,3,0,0,0,3,4294971417} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 2,12 replyHeader:: 2,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders,F response:: v{'partition_5,'partition_6,'partition_7,'partition_8,'partition_9,'partition_0,'partition_1,'partition_2,'partition_3,'partition_4},s{4294970771,4294970771,1455067524062,1455067524062,0,10,0,0,0,10,4294970795} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 3,12 replyHeader:: 3,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_5,F response:: v{},s{4294970788,4298358589,1455067526635,1455158172473,38467,0,0,0,172,0,4294970788} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 4,12 replyHeader:: 4,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_6,F response:: v{},s{4294970773,4298358603,1455067524542,1455158172835,38642,0,0,0,172,0,4294970773} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 5,12 replyHeader:: 5,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_7,F response:: v{},s{4294970780,4298358604,1455067526036,1455158172848,38633,0,0,0,173,0,4294970780} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 6,12 replyHeader:: 6,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_8,F response:: v{},s{4294970789,4298358595,1455067526635,1455158172786,38331,0,0,0,172,0,4294970789} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 7,12 replyHeader:: 7,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_9,F response:: v{},s{4294970791,4298358566,1455067526695,1455158171605,38404,0,0,0,173,0,4294970791} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 8,12 replyHeader:: 8,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_0,F response:: v{},s{4294970795,4298358584,1455067526701,1455158172193,38468,0,0,0,172,0,4294970795} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 9,12 replyHeader:: 9,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_1,F response:: v{},s{4294970782,4298358600,1455067526041,1455158172834,38633,0,0,0,172,0,4294970782} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 10,12 replyHeader:: 10,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_2,F response:: v{},s{4294970790,4298358598,1455067526635,1455158172794,38639,0,0,0,173,0,4294970790} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 11,12 replyHeader:: 11,4298358617,0 request:: '/rtb0900/data/storm/rtb_bidders/partition_3,F response:: v{},s{4294970792,4298358596,1455067526695,1455158172787,38310,0,0,0,172,0,4294970792} [debug] o.a.z.ClientCnxn - Reading reply sessionid:0x252c8b9a3a00d26, packet:: clientPath:null serverPath:null finished:false header:: 12,12 replyHeader:: 12,4298358618,0 request:: '/rtb0900/data/storm/rtb_bidders/partition4,F response:: v{},s{4294970772,4298358569,1455067524065,1455158171678,38429,0,0,0,173,0,4294970772}