Kafka Burrow run time exception - dies after running few hours.

[singh05]

I tried deploying it several times, and every time it runs for a while for few hours and keeps then stops with errors. It prints following error:

Started Burrow at December 24, 2016 at 11:52pm (ICT) 2016/12/24 23:52:42 Connected to 10.117.170.5:2181 2016/12/24 23:52:42 Connected to 10.117.170.5:2181 2016/12/24 23:52:42 Authenticated: id=241180442484362689, timeout=40000 2016/12/24 23:52:42 Re-submitting 0 credentials after reconnect 2016/12/24 23:52:42 Authenticated: id=241180442484362690, timeout=40000 2016/12/24 23:52:42 Re-submitting 0 credentials after reconnect 2016/12/25 00:07:26 http: multiple response.WriteHeader calls fatal error: concurrent map writes

goroutine 961935 [running]: runtime.throw(0xad2a00, 0x15) /usr/lib/golang/src/runtime/panic.go:547 +0x90 fp=0xc8211dec10 sp=0xc8211debf8 runtime.mapassign1(0x8a5400, 0xc82025ff50, 0xc8211ded48, 0xc8211dee08) /usr/lib/golang/src/runtime/hashmap.go:445 +0xb1 fp=0xc8211decb8 sp=0xc8211dec10 github.com/linkedin/Burrow/notifier.(SlackNotifier).Notify(0xc820b4a090, 0xc82014b520, 0x7, 0xc82016a4b0, 0x2c, 0x1, 0x1, 0xd7cc40, 0x0, 0x0, ...) /opt/goprojects/src/src/github.com/linkedin/Burrow/notifier/slack_notifier.go:76 +0x383 fp=0xc8211dee70 sp=0xc8211decb8 main.(NotifyCenter).handleEvaluationResponse(0xc820b50420, 0xc82041e660) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:117 +0xe4 fp=0xc8211defa0 sp=0xc8211dee70 runtime.goexit() /usr/lib/golang/src/runtime/asm_amd64.s:1998 +0x1 fp=0xc8211defa8 sp=0xc8211defa0 created by main.StartNotifiers /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:95 +0x398

goroutine 1 [chan receive, 228 minutes]: main.burrowMain(0x0) /opt/goprojects/src/src/github.com/linkedin/Burrow/main.go:154 +0x2155 main.main() /opt/goprojects/src/src/github.com/linkedin/Burrow/main.go:162 +0x57

goroutine 17 [syscall, 228 minutes, locked to thread]: runtime.goexit() /usr/lib/golang/src/runtime/asm_amd64.s:1998 +0x1

goroutine 5 [semacquire, 228 minutes]: sync.runtime_Syncsemacquire(0xc820053b10) /usr/lib/golang/src/runtime/sema.go:241 +0x201 sync.(Cond).Wait(0xc820053b00) /usr/lib/golang/src/sync/cond.go:63 +0x9b github.com/cihub/seelog.(asyncLoopLogger).processItem(0xc8200886c0, 0x0) /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xee github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc8200886c0) /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x40 created by github.com/cihub/seelog.NewAsyncLoopLogger /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91

goroutine 6 [semacquire, 228 minutes]: sync.runtime_Syncsemacquire(0xc820053c90) /usr/lib/golang/src/runtime/sema.go:241 +0x201 sync.(Cond).Wait(0xc820053c80) /usr/lib/golang/src/sync/cond.go:63 +0x9b github.com/cihub/seelog.(asyncLoopLogger).processItem(0xc8200887e0, 0x0) /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xee github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc8200887e0) /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x40 created by github.com/cihub/seelog.NewAsyncLoopLogger /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91

goroutine 8 [syscall, 228 minutes]: os/signal.signal_recv(0x0) /usr/lib/golang/src/runtime/sigqueue.go:116 +0x132 os/signal.loop() /usr/lib/golang/src/os/signal/signal_unix.go:22 +0x18 created by os/signal.init.1 /usr/lib/golang/src/os/signal/signal_unix.go:28 +0x37

goroutine 18 [semacquire, 224 minutes]: sync.runtime_Syncsemacquire(0xc820160450) /usr/lib/golang/src/runtime/sema.go:241 +0x201 sync.(Cond).Wait(0xc820160440) /usr/lib/golang/src/sync/cond.go:63 +0x9b github.com/cihub/seelog.(asyncLoopLogger).processItem(0xc8201383f0, 0x0) /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xee github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc8201383f0) /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x40 created by github.com/cihub/seelog.NewAsyncLoopLogger /opt/goprojects/src/src/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91

goroutine 19 [semacquire, 228 minutes]: sync.runtime_Semacquire(0xc82000e3dc) /usr/lib/golang/src/runtime/sema.go:47 +0x26 sync.(WaitGroup).Wait(0xc82000e3d0) /usr/lib/golang/src/sync/waitgroup.go:127 +0xb4 github.com/samuel/go-zookeeper/zk.(Conn).loop(0xc82014d180) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:436 +0x8c1 github.com/samuel/go-zookeeper/zk.Connect.func1(0xc82014d180) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:218 +0x21 created by github.com/samuel/go-zookeeper/zk.Connect /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:222 +0x80e

goroutine 20 [select]: main.NewOffsetStorage.func1(0xc820160580) /opt/goprojects/src/src/github.com/linkedin/Burrow/offsets_store.go:120 +0x4b8 created by main.NewOffsetStorage /opt/goprojects/src/src/github.com/linkedin/Burrow/offsets_store.go:151 +0x571

goroutine 21 [IO wait, 209 minutes]: net.runtime_pollWait(0x7fa622973648, 0x72, 0x0) /usr/lib/golang/src/runtime/netpoll.go:160 +0x60 net.(pollDesc).Wait(0xc820112990, 0x72, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x3a net.(pollDesc).WaitRead(0xc820112990, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x36 net.(netFD).accept(0xc820112930, 0x0, 0x7fa622920800, 0xc821065b40) /usr/lib/golang/src/net/fd_unix.go:426 +0x27c net.(TCPListener).AcceptTCP(0xc8200264b8, 0x47bf80, 0x0, 0x0) /usr/lib/golang/src/net/tcpsock_posix.go:254 +0x4d main.tcpKeepAliveListener.Accept(0xc8200264b8, 0x0, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/linkedin/Burrow/http_server.go:45 +0x41 net/http.(*Server).Serve(0xc8204b2780, 0x7fa622973708, 0xc8200264b8, 0x0, 0x0) /usr/lib/golang/src/net/http/server.go:2117 +0x129 created by main.NewHttpServer /opt/goprojects/src/src/github.com/linkedin/Burrow/http_server.go:90 +0x904

goroutine 22 [semacquire, 228 minutes]: sync.runtime_Semacquire(0xc8204920dc) /usr/lib/golang/src/runtime/sema.go:47 +0x26 sync.(WaitGroup).Wait(0xc8204920d0) /usr/lib/golang/src/sync/waitgroup.go:127 +0xb4 github.com/samuel/go-zookeeper/zk.(Conn).loop(0xc82014d400) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:436 +0x8c1 github.com/samuel/go-zookeeper/zk.Connect.func1(0xc82014d400) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:218 +0x21 created by github.com/samuel/go-zookeeper/zk.Connect /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:222 +0x80e

goroutine 34 [select]: github.com/samuel/go-zookeeper/zk.(Conn).sendLoop(0xc82014d180, 0x0, 0x0) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:652 +0x690 github.com/samuel/go-zookeeper/zk.(Conn).loop.func1(0xc82006a240, 0xc82014d180, 0xc82000e3d0) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:416 +0x56 created by github.com/samuel/go-zookeeper/zk.(*Conn).loop /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:420 +0x841

goroutine 35 [IO wait]: net.runtime_pollWait(0x7fa622973588, 0x72, 0xc8207ce000) /usr/lib/golang/src/runtime/netpoll.go:160 +0x60 net.(pollDesc).Wait(0xc82016c060, 0x72, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x3a net.(pollDesc).WaitRead(0xc82016c060, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x36 net.(netFD).Read(0xc82016c000, 0xc8207ce000, 0x4, 0x180000, 0x0, 0x7fa62295e050, 0xc82000e160) /usr/lib/golang/src/net/fd_unix.go:250 +0x23a net.(conn).Read(0xc82046a008, 0xc8207ce000, 0x4, 0x180000, 0x0, 0x0, 0x0) /usr/lib/golang/src/net/net.go:172 +0xe4 io.ReadAtLeast(0x7fa622920850, 0xc82046a008, 0xc8207ce000, 0x4, 0x180000, 0x4, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:297 +0xe6 io.ReadFull(0x7fa622920850, 0xc82046a008, 0xc8207ce000, 0x4, 0x180000, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:315 +0x62 github.com/samuel/go-zookeeper/zk.(Conn).recvLoop(0xc82014d180, 0x7fa620284030, 0xc82046a008, 0x0, 0x0) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:683 +0x20f github.com/samuel/go-zookeeper/zk.(Conn).loop.func2(0xc82014d180, 0xc82000e3d0) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:424 +0x51 created by github.com/samuel/go-zookeeper/zk.(*Conn).loop /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:431 +0x887

goroutine 23 [select]: github.com/samuel/go-zookeeper/zk.(Conn).sendLoop(0xc82014d400, 0x0, 0x0) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:652 +0x690 github.com/samuel/go-zookeeper/zk.(Conn).loop.func1(0xc82013c1e0, 0xc82014d400, 0xc8204920d0) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:416 +0x56 created by github.com/samuel/go-zookeeper/zk.(*Conn).loop /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:420 +0x841

goroutine 24 [IO wait]: net.runtime_pollWait(0x7fa6229734c8, 0x72, 0xc82094e000) /usr/lib/golang/src/runtime/netpoll.go:160 +0x60 net.(pollDesc).Wait(0xc820054140, 0x72, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x3a net.(pollDesc).WaitRead(0xc820054140, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x36 net.(netFD).Read(0xc8200540e0, 0xc82094e000, 0x4, 0x180000, 0x0, 0x7fa62295e050, 0xc82000e160) /usr/lib/golang/src/net/fd_unix.go:250 +0x23a net.(conn).Read(0xc8203b4008, 0xc82094e000, 0x4, 0x180000, 0x0, 0x0, 0x0) /usr/lib/golang/src/net/net.go:172 +0xe4 io.ReadAtLeast(0x7fa622920850, 0xc8203b4008, 0xc82094e000, 0x4, 0x180000, 0x4, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:297 +0xe6 io.ReadFull(0x7fa622920850, 0xc8203b4008, 0xc82094e000, 0x4, 0x180000, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:315 +0x62 github.com/samuel/go-zookeeper/zk.(Conn).recvLoop(0xc82014d400, 0x7fa620284030, 0xc8203b4008, 0x0, 0x0) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:683 +0x20f github.com/samuel/go-zookeeper/zk.(Conn).loop.func2(0xc82014d400, 0xc8204920d0) /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:424 +0x51 created by github.com/samuel/go-zookeeper/zk.(*Conn).loop /opt/goprojects/src/src/github.com/samuel/go-zookeeper/zk/conn.go:431 +0x887

goroutine 25 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b1880, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 26 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b00c0, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 27 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b00e0, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 28 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0100, 0x11) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 29 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e050, 0xf) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 30 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0120, 0x1d) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 31 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0140, 0x18) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 32 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a090, 0x22) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 33 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a0c0, 0x22) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 50 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a120, 0x22) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 51 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a180, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 52 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a150, 0x21) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 53 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a1b0, 0x27) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 54 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a200, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 55 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a1e0, 0x2c) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 56 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a240, 0x21) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 57 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0160, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 58 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e220, 0x8) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 59 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e228, 0x8) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 60 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e380, 0xd) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 61 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e390, 0xe) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 62 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0180, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 63 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a270, 0x22) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 64 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b01a0, 0x1a) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 65 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a240, 0x3a) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 66 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b01c0, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 67 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b01e0, 0x15) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 68 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0200, 0x18) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 69 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a2d0, 0x24) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 70 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a300, 0x24) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 71 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0220, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 72 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0240, 0x11) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 73 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a280, 0x37) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 74 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a2c0, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 75 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a4c0, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 76 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0260, 0x18) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 77 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a500, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 78 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0280, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 79 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b02a0, 0x1d) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 80 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b02c0, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 81 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e3c0, 0xa) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 82 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b02e0, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 83 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a360, 0x2c) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 84 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0300, 0x18) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 85 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0320, 0x1f) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 86 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e3ca, 0x5) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 87 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a390, 0x2c) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 88 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a540, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 89 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0340, 0x15) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 90 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a580, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 91 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0360, 0x18) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 92 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0380, 0x18) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 93 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a5c0, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 94 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b03a0, 0x14) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 95 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b03c0, 0x1a) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 96 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b03e0, 0x14) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 97 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0400, 0x1d) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 98 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0420, 0x1d) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 99 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0440, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 100 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a3f0, 0x22) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 101 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a420, 0x22) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 102 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a600, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 103 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a450, 0x22) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 104 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0460, 0x15) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 105 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0480, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 106 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a4b0, 0x2c) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 107 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b04a0, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 108 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b04c0, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 109 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a640, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 110 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b04e0, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 111 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0500, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 112 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a4e0, 0x23) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 113 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a510, 0x23) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 114 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0520, 0x15) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 115 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a540, 0x23) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 116 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0540, 0x18) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 117 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0560, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 118 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a680, 0x38) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 119 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0580, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 120 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a570, 0x24) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 121 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a5a0, 0x24) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 122 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a5d0, 0x21) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 123 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b05a0, 0x1a) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 124 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b05c0, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 125 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b05e0, 0x15) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 126 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0600, 0x17) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 127 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0620, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 128 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a600, 0x2c) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 129 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a6c0, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 130 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0640, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 131 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0660, 0x1a) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 132 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a700, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 133 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a740, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 134 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e3e0, 0x10) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 135 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a630, 0x21) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 136 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e460, 0xb) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 137 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e470, 0xb) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 138 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a780, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 139 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a660, 0x23) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 140 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a690, 0x28) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 141 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82016a6c0, 0x23) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 142 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0680, 0x1a) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 143 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b06a0, 0x1f) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 144 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b06c0, 0x1f) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 145 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b06e0, 0x1c) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 146 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a7c0, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 147 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0700, 0x1f) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 148 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a800, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 149 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0720, 0x12) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 150 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e480, 0xb) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 151 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a840, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 152 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e490, 0xd) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 153 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0740, 0x16) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 154 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e4a0, 0x10) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 155 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82000e4b0, 0x10) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 156 [sleep]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0760, 0x1a) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 157 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b0780, 0x17) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 158 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b07a0, 0x17) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 159 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc82010a880, 0x32) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 160 [sleep, 1 minutes]: time.Sleep(0xdf8475800) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(ZookeeperClient).startConsumerGroupChecker(0xc8201760a0, 0xc8203b07c0, 0x19) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:133 +0x432 created by main.(ZookeeperClient).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:100 +0x9cd

goroutine 161 [chan receive, 3 minutes]: main.NewZookeeperClient.func1(0xc8201760a0) /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:54 +0x58 created by main.NewZookeeperClient /opt/goprojects/src/src/github.com/linkedin/Burrow/zookeeper.go:57 +0x2ed

goroutine 15289 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0640, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 178 [chan receive]: github.com/rcrowley/go-metrics.(*meterArbiter).tick(0xd5f460) /opt/goprojects/src/src/github.com/rcrowley/go-metrics/meter.go:221 +0x4b created by github.com/rcrowley/go-metrics.NewMeter /opt/goprojects/src/src/github.com/rcrowley/go-metrics/meter.go:40 +0x154

goroutine 179 [chan receive, 8 minutes]: github.com/Shopify/sarama.(Broker).responseReceiver(0xc820090000) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:473 +0xf2 github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x20 github.com/Shopify/sarama.withRecover(0xc8204a41d0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*Broker).Open.func1 /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x131c

goroutine 36 [select, 8 minutes]: github.com/Shopify/sarama.(client).backgroundMetadataUpdater(0xc82000c280) /opt/goprojects/src/src/github.com/Shopify/sarama/client.go:563 +0x323 github.com/Shopify/sarama.(client).(github.com/Shopify/sarama.backgroundMetadataUpdater)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/client.go:149 +0x20 github.com/Shopify/sarama.withRecover(0xc8204bbd20) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.NewClient /opt/goprojects/src/src/github.com/Shopify/sarama/client.go:149 +0x756

goroutine 37 [chan receive, 228 minutes]: main.NewKafkaClient.func1(0xc82008e000) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:85 +0x8f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:88 +0x578

goroutine 38 [chan receive, 228 minutes]: main.NewKafkaClient.func2(0xc82008e000) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:91 +0x95 created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:94 +0x59d

goroutine 39 [chan receive, 228 minutes]: main.NewKafkaClient.func3(0xc82008e000) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:99 +0x4e created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:102 +0x5d3

goroutine 198 [IO wait]: net.runtime_pollWait(0x7fa622973108, 0x72, 0xc8203c6000) /usr/lib/golang/src/runtime/netpoll.go:160 +0x60 net.(pollDesc).Wait(0xc82041c0d0, 0x72, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x3a net.(pollDesc).WaitRead(0xc82041c0d0, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x36 net.(netFD).Read(0xc82041c070, 0xc8203c6000, 0x1000, 0x1000, 0x0, 0x7fa62295e050, 0xc82000e160) /usr/lib/golang/src/net/fd_unix.go:250 +0x23a net.(conn).Read(0xc8203c0000, 0xc8203c6000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/lib/golang/src/net/net.go:172 +0xe4 bufio.(Reader).fill(0xc8203c4000) /usr/lib/golang/src/bufio/bufio.go:97 +0x1e9 bufio.(Reader).Read(0xc8203c4000, 0xc820414390, 0x8, 0x8, 0x72, 0x0, 0x0) /usr/lib/golang/src/bufio/bufio.go:207 +0x260 github.com/Shopify/sarama.(bufConn).Read(0xc820142080, 0xc820414390, 0x8, 0x8, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:110 +0x51 io.ReadAtLeast(0x7fa6228def18, 0xc820142080, 0xc820414390, 0x8, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:297 +0xe6 io.ReadFull(0x7fa6228def18, 0xc820142080, 0xc820414390, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:315 +0x62 github.com/Shopify/sarama.(Broker).responseReceiver(0xc8203b2420) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:486 +0x397 github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x20 github.com/Shopify/sarama.withRecover(0xc820414380) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(Broker).Open.func1 /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x131c

goroutine 197 [chan receive]: github.com/Shopify/sarama.(Broker).responseReceiver(0xc8203b2000) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:473 +0xf2 github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x20 github.com/Shopify/sarama.withRecover(0xc8204142a0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*Broker).Open.func1 /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x131c

goroutine 199 [IO wait]: net.runtime_pollWait(0x7fa622973288, 0x72, 0xc8203c7000) /usr/lib/golang/src/runtime/netpoll.go:160 +0x60 net.(pollDesc).Wait(0xc820054370, 0x72, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x3a net.(pollDesc).WaitRead(0xc820054370, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x36 net.(netFD).Read(0xc820054310, 0xc8203c7000, 0x1000, 0x1000, 0x0, 0x7fa62295e050, 0xc82000e160) /usr/lib/golang/src/net/fd_unix.go:250 +0x23a net.(conn).Read(0xc8203c0008, 0xc8203c7000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/lib/golang/src/net/net.go:172 +0xe4 bufio.(Reader).fill(0xc8203c4060) /usr/lib/golang/src/bufio/bufio.go:97 +0x1e9 bufio.(Reader).Read(0xc8203c4060, 0xc820414438, 0x8, 0x8, 0x72, 0x0, 0x0) /usr/lib/golang/src/bufio/bufio.go:207 +0x260 github.com/Shopify/sarama.(bufConn).Read(0xc820142120, 0xc820414438, 0x8, 0x8, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:110 +0x51 io.ReadAtLeast(0x7fa6228def18, 0xc820142120, 0xc820414438, 0x8, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:297 +0xe6 io.ReadFull(0x7fa6228def18, 0xc820142120, 0xc820414438, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:315 +0x62 github.com/Shopify/sarama.(Broker).responseReceiver(0xc8203b22c0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:486 +0x397 github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x20 github.com/Shopify/sarama.withRecover(0xc820414470) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(Broker).Open.func1 /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x131c

goroutine 196 [IO wait]: net.runtime_pollWait(0x7fa6229731c8, 0x72, 0xc8203c2000) /usr/lib/golang/src/runtime/netpoll.go:160 +0x60 net.(pollDesc).Wait(0xc8200543e0, 0x72, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x3a net.(pollDesc).WaitRead(0xc8200543e0, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x36 net.(netFD).Read(0xc820054380, 0xc8203c2000, 0x1000, 0x1000, 0x0, 0x7fa62295e050, 0xc82000e160) /usr/lib/golang/src/net/fd_unix.go:250 +0x23a net.(conn).Read(0xc820026000, 0xc8203c2000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/lib/golang/src/net/net.go:172 +0xe4 bufio.(Reader).fill(0xc820146240) /usr/lib/golang/src/bufio/bufio.go:97 +0x1e9 bufio.(Reader).Read(0xc820146240, 0xc8204141c0, 0x8, 0x8, 0x72, 0x0, 0x0) /usr/lib/golang/src/bufio/bufio.go:207 +0x260 github.com/Shopify/sarama.(bufConn).Read(0xc820128200, 0xc8204141c0, 0x8, 0x8, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:110 +0x51 io.ReadAtLeast(0x7fa6228def18, 0xc820128200, 0xc8204141c0, 0x8, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:297 +0xe6 io.ReadFull(0x7fa6228def18, 0xc820128200, 0xc8204141c0, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:315 +0x62 github.com/Shopify/sarama.(Broker).responseReceiver(0xc8203b2160) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:486 +0x397 github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x20 github.com/Shopify/sarama.withRecover(0xc8204141b0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(Broker).Open.func1 /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x131c

goroutine 210 [IO wait]: net.runtime_pollWait(0x7fa622973048, 0x72, 0xc8201b8000) /usr/lib/golang/src/runtime/netpoll.go:160 +0x60 net.(pollDesc).Wait(0xc820054450, 0x72, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:73 +0x3a net.(pollDesc).WaitRead(0xc820054450, 0x0, 0x0) /usr/lib/golang/src/net/fd_poll_runtime.go:78 +0x36 net.(netFD).Read(0xc8200543f0, 0xc8201b8000, 0x1000, 0x1000, 0x0, 0x7fa62295e050, 0xc82000e160) /usr/lib/golang/src/net/fd_unix.go:250 +0x23a net.(conn).Read(0xc8203c0010, 0xc8201b8000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/lib/golang/src/net/net.go:172 +0xe4 bufio.(Reader).fill(0xc8203c40c0) /usr/lib/golang/src/bufio/bufio.go:97 +0x1e9 bufio.(Reader).Read(0xc8203c40c0, 0xc8203cc0d8, 0x8, 0x8, 0x72, 0x0, 0x0) /usr/lib/golang/src/bufio/bufio.go:207 +0x260 github.com/Shopify/sarama.(bufConn).Read(0xc820142180, 0xc8203cc0d8, 0x8, 0x8, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:110 +0x51 io.ReadAtLeast(0x7fa6228def18, 0xc820142180, 0xc8203cc0d8, 0x8, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:297 +0xe6 io.ReadFull(0x7fa6228def18, 0xc820142180, 0xc8203cc0d8, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/lib/golang/src/io/io.go:315 +0x62 github.com/Shopify/sarama.(Broker).responseReceiver(0xc8203b2580) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:486 +0x397 github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x20 github.com/Shopify/sarama.withRecover(0xc8203cc0e0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(Broker).Open.func1 /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:148 +0x131c

goroutine 15278 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e480, 0xb, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 1186 [chan receive]: main.NewKafkaClient.func4(0xc82008e000) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:108 +0x5b created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:111 +0x65b

goroutine 1419 [select]: github.com/Shopify/sarama.(brokerConsumer).subscriptionManager(0xc820b44550) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:595 +0x3e9 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionManager)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48d70) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x201

goroutine 15323 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e3ca, 0x5, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15232 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0400, 0x1d, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15321 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0200, 0x18, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15333 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a2d0, 0x24, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 698 [chan receive, 228 minutes]: main.NewKafkaClient.func6(0xc82008e000, 0x7fa622973940, 0xc820b42000) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:137 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:140 +0xc59

goroutine 214 [chan receive, 228 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc8201d4080) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:327 +0x57 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x20 github.com/Shopify/sarama.withRecover(0xc8203cd1d0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x451

goroutine 1408 [runnable]: github.com/Shopify/sarama.(Broker).sendAndReceive(0xc8203b2000, 0x7fa620284bf0, 0xc820b206e0, 0x7fa620284c38, 0xc820b20700, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:415 +0x281 github.com/Shopify/sarama.(Broker).Fetch(0xc8203b2000, 0xc820b206e0, 0xc82040fd94, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:259 +0xc1 github.com/Shopify/sarama.(brokerConsumer).fetchNewMessages(0xc820b44050, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:734 +0x3f4 github.com/Shopify/sarama.(brokerConsumer).subscriptionConsumer(0xc820b44050) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:628 +0x144 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionConsumer)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48b40) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x254

goroutine 15263 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a120, 0x22, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 213 [chan receive, 228 minutes]: main.NewKafkaClient.func6(0xc82008e000, 0x7fa622973940, 0xc82000c400) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:137 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:140 +0xc59

goroutine 15322 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a280, 0x37, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15225 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0340, 0x15, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15262 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a540, 0x23, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 217 [select]: github.com/Shopify/sarama.(Broker).sendAndReceive(0xc8203b22c0, 0x7fa620284bf0, 0xc820b20740, 0x7fa620284c38, 0xc820b20760, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:415 +0x281 github.com/Shopify/sarama.(Broker).Fetch(0xc8203b22c0, 0xc820b20740, 0xc820311d94, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:259 +0xc1 github.com/Shopify/sarama.(brokerConsumer).fetchNewMessages(0xc82026ee60, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:734 +0x3f4 github.com/Shopify/sarama.(brokerConsumer).subscriptionConsumer(0xc82026ee60) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:628 +0x144 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionConsumer)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x20 github.com/Shopify/sarama.withRecover(0xc8203cd200) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x254

goroutine 15233 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0780, 0x17, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15312 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0500, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15313 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0460, 0x15, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 701 [select]: github.com/Shopify/sarama.(brokerConsumer).subscriptionManager(0xc820359090) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:595 +0x3e9 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionManager)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x20 github.com/Shopify/sarama.withRecover(0xc8203fd2d0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x201

goroutine 700 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc82000c400) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:440 +0xab github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x20 github.com/Shopify/sarama.withRecover(0xc8203fd2c0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x4a8

goroutine 15251 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a740, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 697 [chan receive, 228 minutes]: main.NewKafkaClient.func5(0xc82008e000, 0x7fa622973940, 0xc820b42000) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:131 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:134 +0xc1a

goroutine 699 [chan receive, 228 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc82000c400) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:327 +0x57 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x20 github.com/Shopify/sarama.withRecover(0xc8203fd2b0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x451

goroutine 15335 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0160, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 216 [select]: github.com/Shopify/sarama.(brokerConsumer).subscriptionManager(0xc82026ee60) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:595 +0x3e9 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionManager)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x20 github.com/Shopify/sarama.withRecover(0xc8203cd1f0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x201

goroutine 15282 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0600, 0x17, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15287 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a360, 0x2c, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15293 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b03c0, 0x1a, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15329 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b04e0, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15271 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e470, 0xb, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15256 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0260, 0x18, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15314 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e4b0, 0x10, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15337 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0120, 0x1d, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 218 [chan receive, 228 minutes]: main.NewKafkaClient.func5(0xc82008e000, 0x7fa622973940, 0xc8201d4080) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:131 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:134 +0xc1a

goroutine 219 [chan receive, 228 minutes]: main.NewKafkaClient.func6(0xc82008e000, 0x7fa622973940, 0xc8201d4080) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:137 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:140 +0xc59

goroutine 15283 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b06c0, 0x1f, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15284 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b05c0, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 1418 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc8201d4100) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:440 +0xab github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48d60) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x4a8

goroutine 1417 [chan receive, 228 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc8201d4100) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:327 +0x57 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48d50) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x451

goroutine 15274 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b01e0, 0x15, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15330 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0680, 0x1a, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15285 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e228, 0x8, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15324 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e4a0, 0x10, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15228 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e220, 0x8, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 215 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc8201d4080) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:440 +0xab github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x20 github.com/Shopify/sarama.withRecover(0xc8203cd1e0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x4a8

goroutine 702 [select]: github.com/Shopify/sarama.(Broker).sendAndReceive(0xc8203b2160, 0x7fa620284bf0, 0xc82025a320, 0x7fa620284c38, 0xc82025a340, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:415 +0x281 github.com/Shopify/sarama.(Broker).Fetch(0xc8203b2160, 0xc82025a320, 0xc820167d94, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:259 +0xc1 github.com/Shopify/sarama.(brokerConsumer).fetchNewMessages(0xc820359090, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:734 +0x3f4 github.com/Shopify/sarama.(brokerConsumer).subscriptionConsumer(0xc820359090) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:628 +0x144 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionConsumer)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x20 github.com/Shopify/sarama.withRecover(0xc8203fd2e0) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x254

goroutine 15298 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0700, 0x1f, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15230 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a6c0, 0x23, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15270 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0320, 0x1f, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 1406 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc820b42000) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:440 +0xab github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48b20) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x4a8

goroutine 15280 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0180, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15336 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b05a0, 0x1a, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15268 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b07a0, 0x17, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15258 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a500, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15297 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a800, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 1432 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b04a0, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 1430 [select, 228 minutes, locked to thread]: runtime.gopark(0xb82d00, 0xc82023c728, 0xa6e810, 0x6, 0x18, 0x2) /usr/lib/golang/src/runtime/proc.go:262 +0x163 runtime.selectgoImpl(0xc82023c728, 0x0, 0x18) /usr/lib/golang/src/runtime/select.go:392 +0xa67 runtime.selectgo(0xc82023c728) /usr/lib/golang/src/runtime/select.go:215 +0x12 runtime.ensureSigM.func1() /usr/lib/golang/src/runtime/signal1_unix.go:279 +0x358 runtime.goexit() /usr/lib/golang/src/runtime/asm_amd64.s:1998 +0x1

goroutine 1405 [chan receive, 228 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc820b42000) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:327 +0x57 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48b10) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x451

goroutine 1407 [select]: github.com/Shopify/sarama.(brokerConsumer).subscriptionManager(0xc820b44050) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:595 +0x3e9 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionManager)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48b30) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x201

goroutine 15309 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a3f0, 0x22, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15291 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a690, 0x28, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15288 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a240, 0x21, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 212 [chan receive, 228 minutes]: main.NewKafkaClient.func5(0xc82008e000, 0x7fa622973940, 0xc82000c400) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:131 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:134 +0xc1a

goroutine 15325 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a660, 0x23, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15279 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0140, 0x18, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15273 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b02e0, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15281 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b01c0, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15277 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e490, 0xd, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15265 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0740, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15334 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0440, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15264 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b01a0, 0x1a, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15252 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0660, 0x1a, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15343 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a180, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15340 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b02c0, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15261 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0540, 0x18, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15296 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b00e0, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15341 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b06e0, 0x1c, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15316 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b07c0, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15272 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a700, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15260 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b03e0, 0x14, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15294 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a200, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15342 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b06a0, 0x1f, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15290 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a510, 0x23, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15310 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a0c0, 0x22, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15254 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e380, 0xd, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15308 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a5c0, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15227 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0560, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15266 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0100, 0x11, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15338 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a570, 0x24, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15226 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a150, 0x21, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15326 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b03a0, 0x14, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15318 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a6c0, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15250 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0520, 0x15, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15255 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a420, 0x22, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15311 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a450, 0x22, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15339 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a640, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15315 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a300, 0x24, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 1420 [select]: github.com/Shopify/sarama.(Broker).sendAndReceive(0xc8203b2420, 0x7fa620284bf0, 0xc820b20f40, 0x7fa620284c38, 0xc820b20f60, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:415 +0x281 github.com/Shopify/sarama.(Broker).Fetch(0xc8203b2420, 0xc820b20f40, 0xc820411d94, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:259 +0xc1 github.com/Shopify/sarama.(brokerConsumer).fetchNewMessages(0xc820b44550, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:734 +0x3f4 github.com/Shopify/sarama.(brokerConsumer).subscriptionConsumer(0xc820b44550) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:628 +0x144 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionConsumer)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48d80) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x254

goroutine 1421 [chan receive, 228 minutes]: main.NewKafkaClient.func5(0xc82008e000, 0x7fa622973940, 0xc8201d4100) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:131 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:134 +0xc1a

goroutine 1422 [chan receive, 228 minutes]: main.NewKafkaClient.func6(0xc82008e000, 0x7fa622973940, 0xc8201d4100) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:137 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:140 +0xc59

goroutine 1423 [chan receive, 228 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc820b42080) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:327 +0x57 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48e50) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:161 +0x451

goroutine 1424 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc820b42080) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:440 +0xab github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48e60) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).ConsumePartition /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:162 +0x4a8

goroutine 1425 [select]: github.com/Shopify/sarama.(brokerConsumer).subscriptionManager(0xc820b446e0) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:595 +0x3e9 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionManager)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48e70) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(*consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:568 +0x201

goroutine 1426 [select]: github.com/Shopify/sarama.(Broker).sendAndReceive(0xc8203b2580, 0x7fa620284bf0, 0xc82025a2c0, 0x7fa620284c38, 0xc82025a2e0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:415 +0x281 github.com/Shopify/sarama.(Broker).Fetch(0xc8203b2580, 0xc82025a2c0, 0xc82030ed94, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/broker.go:259 +0xc1 github.com/Shopify/sarama.(brokerConsumer).fetchNewMessages(0xc820b446e0, 0x0, 0x0, 0x0) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:734 +0x3f4 github.com/Shopify/sarama.(brokerConsumer).subscriptionConsumer(0xc820b446e0) /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:628 +0x144 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionConsumer)-fm() /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x20 github.com/Shopify/sarama.withRecover(0xc820b48e80) /opt/goprojects/src/src/github.com/Shopify/sarama/utils.go:46 +0x3a created by github.com/Shopify/sarama.(consumer).newBrokerConsumer /opt/goprojects/src/src/github.com/Shopify/sarama/consumer.go:569 +0x254

goroutine 1427 [chan receive, 228 minutes]: main.NewKafkaClient.func5(0xc82008e000, 0x7fa622973940, 0xc820b42080) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:131 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:134 +0xc1a

goroutine 1428 [chan receive, 228 minutes]: main.NewKafkaClient.func6(0xc82008e000, 0x7fa622973940, 0xc820b42080) /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:137 +0x9f created by main.NewKafkaClient /opt/goprojects/src/src/github.com/linkedin/Burrow/kafka_client.go:140 +0xc59

goroutine 1429 [select]: main.StartNotifiers(0xc820171c80) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:89 +0x3b3 created by main.burrowMain /opt/goprojects/src/src/github.com/linkedin/Burrow/main.go:146 +0x1dfb

goroutine 15327 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a600, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15319 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0760, 0x1a, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15253 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b04c0, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15344 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a1e0, 0x2c, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15267 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b1880, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15295 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a4b0, 0x2c, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15259 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a600, 0x2c, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15331 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b00c0, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15229 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e050, 0xf, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15292 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e390, 0xe, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15231 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a680, 0x38, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15276 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0420, 0x1d, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15328 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0580, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15269 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0720, 0x12, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15317 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0240, 0x11, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15306 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a390, 0x2c, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15332 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a270, 0x22, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15275 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0300, 0x18, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15307 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b02a0, 0x1d, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15257 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0380, 0x18, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15320 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a880, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15286 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0360, 0x18, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15301 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82016a5a0, 0x24, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15305 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0480, 0x19, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15304 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a580, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15303 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a7c0, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15302 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82000e460, 0xb, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15300 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc82010a840, 0x32, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

goroutine 15299 [sleep]: time.Sleep(0x2540be400) /usr/lib/golang/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc820b50420, 0xc8203b0620, 0x16, 0xc82014b520, 0x7) /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:181 +0x3df created by main.(NotifyCenter).refreshConsumerGroups /opt/goprojects/src/src/github.com/linkedin/Burrow/notify_center.go:147 +0x981

[toddpalino]

I took a quick look at this, and it does look like a bug. In the Slack notifier Notify method, it attempts to initialize groupMsgs: if slack.groupMsgs == nil { slack.groupMsgs = make(map[string]Message) }

However, if multiple calls are being made to Notify, there's a race condition here and below where groups and messages are updated. I don't have enough time right now to go through the logic, but it seems like this either needs to eliminate the module-wide groupMsgs variable, or put a lock around it to assure synchronous access.

@jsvisa, do you have a good idea of how to resolve this here? If not, I'll take another look when I have a chance.

[jsvisa]

@toddpalino I'm fixing it by move groupMsgs to a local variable, see from #179

[volvicoasis]

Hello,

After few hours of deployment, same behaviour. Not only in slack_notifier, I think there is same issue in email_notifier.go :

fatal error: concurrent map writes

goroutine 28407 [running]: runtime.throw(0x8aba55, 0x15) /usr/local/go/src/runtime/panic.go:596 +0x95 fp=0xc420686c18 sp=0xc420686bf8 runtime.mapassign(0x81ef40, 0xc420efc000, 0xc420686da8, 0x4a) /usr/local/go/src/runtime/hashmap.go:499 +0x667 fp=0xc420686cb8 sp=0xc420686c18 github.com/linkedin/Burrow/notifier.(EmailNotifier).Notify(0xc420262000, 0xc4200fd590, 0x5, 0xc420fe0280, 0x44, 0x1, 0x1, 0xacb160, 0x0, 0x0, ...) /go/src/github.com/linkedin/Burrow/notifier/email_notifier.go:72 +0x32d fp=0xc420686ec8 sp=0xc420686cb8 main.(NotifyCenter).handleEvaluationResponse(0xc42020b7a0, 0xc420017bc0) /go/src/github.com/linkedin/Burrow/notify_center.go:117 +0xb9 fp=0xc420686fd0 sp=0xc420686ec8 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:2197 +0x1 fp=0xc420686fd8 sp=0xc420686fd0 created by main.StartNotifiers /go/src/github.com/linkedin/Burrow/notify_center.go:95 +0x31d

goroutine 1 [chan receive, 125 minutes]: main.burrowMain(0x0) /go/src/github.com/linkedin/Burrow/main.go:156 +0x1455 main.main() /go/src/github.com/linkedin/Burrow/main.go:164 +0x44

goroutine 17 [syscall, 125 minutes, locked to thread]: runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:2197 +0x1

goroutine 5 [semacquire, 125 minutes]: sync.runtime_notifyListWait(0xc420019590, 0xc400000000) /usr/local/go/src/runtime/sema.go:297 +0x10b sync.(Cond).Wait(0xc420019580) /usr/local/go/src/sync/cond.go:57 +0x89 github.com/cihub/seelog.(asyncLoopLogger).processItem(0xc420016780, 0x0) /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0x97 github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc420016780) /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x33 created by github.com/cihub/seelog.newAsyncLoopLogger /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x96

goroutine 6 [semacquire, 125 minutes]: sync.runtime_notifyListWait(0xc420019710, 0xc400000000) /usr/local/go/src/runtime/sema.go:297 +0x10b sync.(Cond).Wait(0xc420019700) /usr/local/go/src/sync/cond.go:57 +0x89 github.com/cihub/seelog.(asyncLoopLogger).processItem(0xc4200168a0, 0x0) /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0x97 github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc4200168a0) /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x33 created by github.com/cihub/seelog.newAsyncLoopLogger /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x96

goroutine 7 [syscall, 125 minutes]: os/signal.signal_recv(0x0) /usr/local/go/src/runtime/sigqueue.go:116 +0x104 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:22 +0x22 created by os/signal.init.1 /usr/local/go/src/os/signal/signal_unix.go:28 +0x41

goroutine 8 [semacquire, 1 minutes]: sync.runtime_notifyListWait(0xc42029f750, 0xc400000023) /usr/local/go/src/runtime/sema.go:297 +0x10b sync.(Cond).Wait(0xc42029f740) /usr/local/go/src/sync/cond.go:57 +0x89 github.com/cihub/seelog.(asyncLoopLogger).processItem(0xc42029d680, 0x0) /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0x97 github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc42029d680) /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x33 created by github.com/cihub/seelog.newAsyncLoopLogger /go/src/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x96

goroutine 9 [semacquire, 125 minutes]: sync.runtime_Semacquire(0xc42001a04c) /usr/local/go/src/runtime/sema.go:47 +0x34 sync.(WaitGroup).Wait(0xc42001a040) /usr/local/go/src/sync/waitgroup.go:131 +0x7a github.com/samuel/go-zookeeper/zk.(Conn).loop(0xc420075a00) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:227 +0x54d github.com/samuel/go-zookeeper/zk.ConnectWithDialer.func1(0xc420075a00) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:145 +0x2f created by github.com/samuel/go-zookeeper/zk.ConnectWithDialer /go/src/github.com/samuel/go-zookeeper/zk/conn.go:149 +0x402

goroutine 10 [select]: main.NewOffsetStorage.func1(0xc42029f7c0) /go/src/github.com/linkedin/Burrow/offsets_store.go:120 +0x403 created by main.NewOffsetStorage /go/src/github.com/linkedin/Burrow/offsets_store.go:151 +0x3a7

goroutine 18 [IO wait, 125 minutes]: net.runtime_pollWait(0x7f23b1be8f00, 0x72, 0x0) /usr/local/go/src/runtime/netpoll.go:164 +0x59 net.(pollDesc).wait(0xc4202dc0d8, 0x72, 0x0, 0xc4202d6140) /usr/local/go/src/net/fd_poll_runtime.go:75 +0x38 net.(pollDesc).waitRead(0xc4202dc0d8, 0xffffffffffffffff, 0x0) /usr/local/go/src/net/fd_poll_runtime.go:80 +0x34 net.(netFD).accept(0xc4202dc070, 0x0, 0xa79780, 0xc4202d6140) /usr/local/go/src/net/fd_unix.go:430 +0x1e5 net.(TCPListener).accept(0xc4202f6000, 0xc4202cc3c0, 0xc42002f700, 0x504b2d) /usr/local/go/src/net/tcpsock_posix.go:136 +0x2e net.(TCPListener).AcceptTCP(0xc4202f6000, 0x6a90d3, 0xc42002f718, 0xc42002f710) /usr/local/go/src/net/tcpsock.go:215 +0x49 main.tcpKeepAliveListener.Accept(0xc4202f6000, 0xc4202cc390, 0x817ec0, 0xaa3a80, 0x85cb20) /go/src/github.com/linkedin/Burrow/http_server.go:45 +0x2f net/http.(Server).Serve(0xc4202f8000, 0xa7e140, 0xc4202f6000, 0x0, 0x0) /usr/local/go/src/net/http/server.go:2643 +0x228 created by main.NewHttpServer /go/src/github.com/linkedin/Burrow/http_server.go:90 +0x6d6

goroutine 19 [semacquire, 125 minutes]: sync.runtime_Semacquire(0xc42033c02c) /usr/local/go/src/runtime/sema.go:47 +0x34 sync.(WaitGroup).Wait(0xc42033c020) /usr/local/go/src/sync/waitgroup.go:131 +0x7a github.com/samuel/go-zookeeper/zk.(Conn).loop(0xc420320000) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:227 +0x54d github.com/samuel/go-zookeeper/zk.ConnectWithDialer.func1(0xc420320000) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:145 +0x2f created by github.com/samuel/go-zookeeper/zk.ConnectWithDialer /go/src/github.com/samuel/go-zookeeper/zk/conn.go:149 +0x402

goroutine 50 [select]: github.com/samuel/go-zookeeper/zk.(Conn).sendLoop(0xc420320000, 0xa81120, 0xc4202f6008, 0xc42033e000, 0x0, 0x0) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:412 +0xad5 github.com/samuel/go-zookeeper/zk.(Conn).loop.func1(0xc420320000, 0xc42033e000, 0xc42033c020) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:212 +0x47 created by github.com/samuel/go-zookeeper/zk.(*Conn).loop /go/src/github.com/samuel/go-zookeeper/zk/conn.go:215 +0x4e5

goroutine 51 [IO wait]: net.runtime_pollWait(0x7f23b1be8e40, 0x72, 0x4) /usr/local/go/src/runtime/netpoll.go:164 +0x59 net.(pollDesc).wait(0xc420310228, 0x72, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_poll_runtime.go:75 +0x38 net.(pollDesc).waitRead(0xc420310228, 0xc42034a000, 0x4) /usr/local/go/src/net/fd_poll_runtime.go:80 +0x34 net.(netFD).Read(0xc4203101c0, 0xc42034a000, 0x4, 0x180000, 0x0, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_unix.go:250 +0x1b7 net.(conn).Read(0xc4202f6008, 0xc42034a000, 0x4, 0x180000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:181 +0x70 io.ReadAtLeast(0x7f23b1be9010, 0xc4202f6008, 0xc42034a000, 0x4, 0x180000, 0x4, 0x892540, 0x0, 0x7f23b1be9010) /usr/local/go/src/io/io.go:307 +0xa9 io.ReadFull(0x7f23b1be9010, 0xc4202f6008, 0xc42034a000, 0x4, 0x180000, 0x0, 0x0, 0x0) /usr/local/go/src/io/io.go:325 +0x58 github.com/samuel/go-zookeeper/zk.(Conn).recvLoop(0xc420320000, 0xa81120, 0xc4202f6008, 0x0, 0x0) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:476 +0x16e github.com/samuel/go-zookeeper/zk.(Conn).loop.func2(0xc4202d8310, 0xc420320000, 0xc42033e000, 0xc42033c020) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:219 +0x41 created by github.com/samuel/go-zookeeper/zk.(*Conn).loop /go/src/github.com/samuel/go-zookeeper/zk/conn.go:225 +0x53f

goroutine 23 [select]: github.com/samuel/go-zookeeper/zk.(Conn).sendLoop(0xc420075a00, 0xa81120, 0xc420338000, 0xc420016360, 0x0, 0x0) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:412 +0xad5 github.com/samuel/go-zookeeper/zk.(Conn).loop.func1(0xc420075a00, 0xc420016360, 0xc42001a040) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:212 +0x47 created by github.com/samuel/go-zookeeper/zk.(*Conn).loop /go/src/github.com/samuel/go-zookeeper/zk/conn.go:215 +0x4e5

goroutine 24 [IO wait]: net.runtime_pollWait(0x7f23b1be8d80, 0x72, 0x6) /usr/local/go/src/runtime/netpoll.go:164 +0x59 net.(pollDesc).wait(0xc420310298, 0x72, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_poll_runtime.go:75 +0x38 net.(pollDesc).waitRead(0xc420310298, 0xc420696000, 0x4) /usr/local/go/src/net/fd_poll_runtime.go:80 +0x34 net.(netFD).Read(0xc420310230, 0xc420696000, 0x4, 0x180000, 0x0, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_unix.go:250 +0x1b7 net.(conn).Read(0xc420338000, 0xc420696000, 0x4, 0x180000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:181 +0x70 io.ReadAtLeast(0x7f23b1be9010, 0xc420338000, 0xc420696000, 0x4, 0x180000, 0x4, 0x892540, 0x0, 0x7f23b1be9010) /usr/local/go/src/io/io.go:307 +0xa9 io.ReadFull(0x7f23b1be9010, 0xc420338000, 0xc420696000, 0x4, 0x180000, 0x0, 0x0, 0x0) /usr/local/go/src/io/io.go:325 +0x58 github.com/samuel/go-zookeeper/zk.(Conn).recvLoop(0xc420075a00, 0xa81120, 0xc420338000, 0x0, 0x0) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:476 +0x16e github.com/samuel/go-zookeeper/zk.(Conn).loop.func2(0xc42033c000, 0xc420075a00, 0xc420016360, 0xc42001a040) /go/src/github.com/samuel/go-zookeeper/zk/conn.go:219 +0x41 created by github.com/samuel/go-zookeeper/zk.(*Conn).loop /go/src/github.com/samuel/go-zookeeper/zk/conn.go:225 +0x53f

goroutine 54 [chan receive, 1 minutes]: main.NewZookeeperClient.func1(0xc4201120f0) /go/src/github.com/linkedin/Burrow/zookeeper.go:54 +0x6b created by main.NewZookeeperClient /go/src/github.com/linkedin/Burrow/zookeeper.go:57 +0x24b

goroutine 63 [IO wait]: net.runtime_pollWait(0x7f23b1be8900, 0x72, 0x9) /usr/local/go/src/runtime/netpoll.go:164 +0x59 net.(pollDesc).wait(0xc42068c228, 0x72, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_poll_runtime.go:75 +0x38 net.(pollDesc).waitRead(0xc42068c228, 0xc4200ff000, 0x1000) /usr/local/go/src/net/fd_poll_runtime.go:80 +0x34 net.(netFD).Read(0xc42068c1c0, 0xc4200ff000, 0x1000, 0x1000, 0x0, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_unix.go:250 +0x1b7 net.(conn).Read(0xc42000e048, 0xc4200ff000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:181 +0x70 bufio.(Reader).Read(0xc42010e960, 0xc4200fc820, 0x8, 0x8, 0xed05c4222, 0xc40f42f471, 0xaaea80) /usr/local/go/src/bufio/bufio.go:213 +0x312 github.com/Shopify/sarama.(bufConn).Read(0xc4202a0680, 0xc4200fc820, 0x8, 0x8, 0x0, 0xc40f42f471, 0xaaea80) /go/src/github.com/Shopify/sarama/utils.go:110 +0x4d io.ReadAtLeast(0x7f23b1c4c1c0, 0xc4202a0680, 0xc4200fc820, 0x8, 0x8, 0x8, 0x862e40, 0x0, 0x7f23b1c4c1c0) /usr/local/go/src/io/io.go:307 +0xa9 io.ReadFull(0x7f23b1c4c1c0, 0xc4202a0680, 0xc4200fc820, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/local/go/src/io/io.go:325 +0x58 github.com/Shopify/sarama.(Broker).responseReceiver(0xc42005a4d0) /go/src/github.com/Shopify/sarama/broker.go:429 +0x31e github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /go/src/github.com/Shopify/sarama/broker.go:99 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fc7f0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*Broker).Open.func1 /go/src/github.com/Shopify/sarama/broker.go:99 +0x604

goroutine 85 [chan receive, 6 minutes]: github.com/Shopify/sarama.(Broker).responseReceiver(0xc42005a150) /go/src/github.com/Shopify/sarama/broker.go:416 +0xf0 github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /go/src/github.com/Shopify/sarama/broker.go:99 +0x2a github.com/Shopify/sarama.withRecover(0xc420120070) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*Broker).Open.func1 /go/src/github.com/Shopify/sarama/broker.go:99 +0x604

goroutine 26 [select, 6 minutes]: github.com/Shopify/sarama.(client).backgroundMetadataUpdater(0xc42007e180) /go/src/github.com/Shopify/sarama/client.go:559 +0x2c7 github.com/Shopify/sarama.(client).(github.com/Shopify/sarama.backgroundMetadataUpdater)-fm() /go/src/github.com/Shopify/sarama/client.go:148 +0x2a github.com/Shopify/sarama.withRecover(0xc42010dc50) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.NewClient /go/src/github.com/Shopify/sarama/client.go:148 +0x694

goroutine 93 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124200) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420120680) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 27 [chan receive, 5 minutes]: main.NewKafkaClient.func1(0xc4202f80b0) /go/src/github.com/linkedin/Burrow/kafka_client.go:105 +0x87 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:108 +0x476

goroutine 28 [chan receive, 125 minutes]: main.NewKafkaClient.func2(0xc4202f80b0) /go/src/github.com/linkedin/Burrow/kafka_client.go:111 +0x87 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:114 +0x49b

goroutine 29 [chan receive, 125 minutes]: main.NewKafkaClient.func3(0xc4202f80b0) /go/src/github.com/linkedin/Burrow/kafka_client.go:119 +0x57 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:122 +0x4d1

goroutine 306 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322500) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fc9e0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 363 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc4202a6a80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 65 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322500) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fc9d0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 101 [IO wait]: net.runtime_pollWait(0x7f23b1be8cc0, 0x72, 0x8) /usr/local/go/src/runtime/netpoll.go:164 +0x59 net.(pollDesc).wait(0xc42030e378, 0x72, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_poll_runtime.go:75 +0x38 net.(pollDesc).waitRead(0xc42030e378, 0xc420318000, 0x1000) /usr/local/go/src/net/fd_poll_runtime.go:80 +0x34 net.(netFD).Read(0xc42030e310, 0xc420318000, 0x1000, 0x1000, 0x0, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_unix.go:250 +0x1b7 net.(conn).Read(0xc420338458, 0xc420318000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:181 +0x70 bufio.(Reader).Read(0xc42031c4e0, 0xc4201090a0, 0x8, 0x8, 0xed05c4222, 0xc40d721f96, 0xaaea80) /usr/local/go/src/bufio/bufio.go:213 +0x312 github.com/Shopify/sarama.(bufConn).Read(0xc4200d8d00, 0xc4201090a0, 0x8, 0x8, 0x0, 0xc40d721f96, 0xaaea80) /go/src/github.com/Shopify/sarama/utils.go:110 +0x4d io.ReadAtLeast(0x7f23b1c4c1c0, 0xc4200d8d00, 0xc4201090a0, 0x8, 0x8, 0x8, 0x862e40, 0x0, 0x7f23b1c4c1c0) /usr/local/go/src/io/io.go:307 +0xa9 io.ReadFull(0x7f23b1c4c1c0, 0xc4200d8d00, 0xc4201090a0, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/local/go/src/io/io.go:325 +0x58 github.com/Shopify/sarama.(Broker).responseReceiver(0xc42005a5b0) /go/src/github.com/Shopify/sarama/broker.go:429 +0x31e github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /go/src/github.com/Shopify/sarama/broker.go:99 +0x2a github.com/Shopify/sarama.withRecover(0xc420109070) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*Broker).Open.func1 /go/src/github.com/Shopify/sarama/broker.go:99 +0x604

goroutine 361 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc4202a6a80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf0e0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 362 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc4202a6a80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 160 [chan receive, 1 minutes]: main.NewKafkaClient.func4(0xc4202f80b0) /go/src/github.com/linkedin/Burrow/kafka_client.go:128 +0x6e created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:131 +0x54d

goroutine 364 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124800) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf380) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 92 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc42007ed80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 64 [IO wait]: net.runtime_pollWait(0x7f23b1be8a80, 0x72, 0xa) /usr/local/go/src/runtime/netpoll.go:164 +0x59 net.(pollDesc).wait(0xc42068c298, 0x72, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_poll_runtime.go:75 +0x38 net.(pollDesc).waitRead(0xc42068c298, 0xc420316000, 0x1000) /usr/local/go/src/net/fd_poll_runtime.go:80 +0x34 net.(netFD).Read(0xc42068c230, 0xc420316000, 0x1000, 0x1000, 0x0, 0xa7ac40, 0xa765c8) /usr/local/go/src/net/fd_unix.go:250 +0x1b7 net.(conn).Read(0xc42000e050, 0xc420316000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:181 +0x70 bufio.(Reader).Read(0xc42010eba0, 0xc4200fc868, 0x8, 0x8, 0xed05c4222, 0xc417e688bc, 0xaaea80) /usr/local/go/src/bufio/bufio.go:213 +0x312 github.com/Shopify/sarama.(bufConn).Read(0xc4202a0720, 0xc4200fc868, 0x8, 0x8, 0x0, 0xc417e688bc, 0xaaea80) /go/src/github.com/Shopify/sarama/utils.go:110 +0x4d io.ReadAtLeast(0x7f23b1c4c1c0, 0xc4202a0720, 0xc4200fc868, 0x8, 0x8, 0x8, 0x862e40, 0x0, 0x7f23b1c4c1c0) /usr/local/go/src/io/io.go:307 +0xa9 io.ReadFull(0x7f23b1c4c1c0, 0xc4202a0720, 0xc4200fc868, 0x8, 0x8, 0x0, 0x0, 0x0) /usr/local/go/src/io/io.go:325 +0x58 github.com/Shopify/sarama.(Broker).responseReceiver(0xc42005a3f0) /go/src/github.com/Shopify/sarama/broker.go:429 +0x31e github.com/Shopify/sarama.(Broker).(github.com/Shopify/sarama.responseReceiver)-fm() /go/src/github.com/Shopify/sarama/broker.go:99 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fc840) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*Broker).Open.func1 /go/src/github.com/Shopify/sarama/broker.go:99 +0x604

goroutine 308 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322500) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 307 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322500) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 310 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc4202a6b80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fd230) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 309 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc4202a6b80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fd220) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 94 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124200) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420120690) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 95 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124200) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 96 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124200) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 97 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322880) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420120aa0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 338 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322880) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420120ab0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 339 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322880) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 340 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322880) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 341 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322a80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420120b60) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 342 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322a80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420120b70) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 343 [chan receive, 5 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322a80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 344 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322a80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 345 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124600) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420120d20) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 346 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124600) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420120d30) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 347 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124600) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 348 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124600) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 349 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322b80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420120e40) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 350 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322b80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420120e50) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 351 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322b80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 352 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322b80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 353 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322c00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420121040) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 386 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322c00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420121050) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 387 [chan receive, 76 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322c00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 388 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322c00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 389 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322d00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420121260) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 390 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322d00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420121270) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 391 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322d00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 392 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322d00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 277 [select]: github.com/Shopify/sarama.(brokerConsumer).subscriptionManager(0xc4202b2af0) /go/src/github.com/Shopify/sarama/consumer.go:557 +0x525 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionManager)-fm() /go/src/github.com/Shopify/sarama/consumer.go:530 +0x2a github.com/Shopify/sarama.withRecover(0xc420126da0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).newBrokerConsumer /go/src/github.com/Shopify/sarama/consumer.go:530 +0x1de

goroutine 278 [select]: github.com/Shopify/sarama.(Broker).sendAndReceive(0xc42005a5b0, 0xa7ea80, 0xc420df3b80, 0xa784c0, 0xc42000e0f8, 0xc420098370, 0xaaaa50) /go/src/github.com/Shopify/sarama/broker.go:358 +0x194 github.com/Shopify/sarama.(Broker).Fetch(0xc42005a5b0, 0xc420df3b80, 0xc42030ade4, 0xc42020c218, 0xc420e4df68) /go/src/github.com/Shopify/sarama/broker.go:210 +0x70 github.com/Shopify/sarama.(brokerConsumer).fetchNewMessages(0xc4202b2af0, 0x0, 0x0, 0x0) /go/src/github.com/Shopify/sarama/consumer.go:689 +0x263 github.com/Shopify/sarama.(brokerConsumer).subscriptionConsumer(0xc4202b2af0) /go/src/github.com/Shopify/sarama/consumer.go:590 +0x167 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionConsumer)-fm() /go/src/github.com/Shopify/sarama/consumer.go:531 +0x2a github.com/Shopify/sarama.withRecover(0xc420126db0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(consumer).newBrokerConsumer /go/src/github.com/Shopify/sarama/consumer.go:531 +0x238

goroutine 279 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124280) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420126ee0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 280 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124280) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420126ef0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 281 [chan receive, 13 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124280) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 282 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124280) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 283 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124580) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420127350) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 284 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124580) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420127360) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 285 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124580) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 286 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124580) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 287 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124780) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420127c10) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 288 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124780) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420127c20) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 289 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124780) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 370 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124780) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 371 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420323080) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4202d95f0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 372 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420323080) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4202d9600) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 373 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420323080) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 374 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420323080) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 375 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420323180) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4202d97b0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 376 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420323180) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4202d97c0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 377 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420323180) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 378 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420323180) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 379 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc42007f000) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4202d9d10) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 380 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc42007f000) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4202d9d20) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 381 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc42007f000) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 382 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc42007f000) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 91 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc42007ed80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 360 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc4202a6a80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf0d0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 359 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124700) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 358 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124700) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 357 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124700) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bead0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 356 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124700) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201beac0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 355 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322980) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 354 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322980) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 337 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322980) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201be7e0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 336 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322980) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201be7d0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 335 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc4202a6400) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 334 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc4202a6400) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 333 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc4202a6400) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201be600) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 332 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc4202a6400) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201be5f0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 331 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322800) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 330 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322800) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 329 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322800) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201be110) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 328 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322800) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201be100) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 327 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322780) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 326 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322780) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 325 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322780) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201be060) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 324 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322780) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201be050) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 323 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322580) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 322 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322580) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 305 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322580) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420109f50) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 304 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322580) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420109f40) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 303 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc4202a6200) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 302 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc4202a6200) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 301 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc4202a6200) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420109cf0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 300 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc4202a6200) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420109ce0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 299 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322480) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 298 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322480) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 297 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322480) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201099a0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 296 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322480) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420109990) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 295 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322400) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 294 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322400) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 293 [select]: github.com/Shopify/sarama.(Broker).sendAndReceive(0xc42005a3f0, 0xa7ea80, 0xc42010d4a0, 0xa784c0, 0xc420338080, 0xc420098a00, 0xaaaa50) /go/src/github.com/Shopify/sarama/broker.go:358 +0x194 github.com/Shopify/sarama.(Broker).Fetch(0xc42005a3f0, 0xc42010d4a0, 0xc420308de4, 0xc421050e38, 0xc4203219b8) /go/src/github.com/Shopify/sarama/broker.go:210 +0x70 github.com/Shopify/sarama.(brokerConsumer).fetchNewMessages(0xc42005dae0, 0x0, 0x0, 0x0) /go/src/github.com/Shopify/sarama/consumer.go:689 +0x263 github.com/Shopify/sarama.(brokerConsumer).subscriptionConsumer(0xc42005dae0) /go/src/github.com/Shopify/sarama/consumer.go:590 +0x167 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionConsumer)-fm() /go/src/github.com/Shopify/sarama/consumer.go:531 +0x2a github.com/Shopify/sarama.withRecover(0xc4201097e0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(consumer).newBrokerConsumer /go/src/github.com/Shopify/sarama/consumer.go:531 +0x238

goroutine 292 [select]: github.com/Shopify/sarama.(brokerConsumer).subscriptionManager(0xc42005dae0) /go/src/github.com/Shopify/sarama/consumer.go:557 +0x525 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionManager)-fm() /go/src/github.com/Shopify/sarama/consumer.go:530 +0x2a github.com/Shopify/sarama.withRecover(0xc4201097d0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).newBrokerConsumer /go/src/github.com/Shopify/sarama/consumer.go:530 +0x1de

goroutine 291 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322400) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201097c0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 290 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322400) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201097b0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 209 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322380) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 208 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322380) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 207 [select]: github.com/Shopify/sarama.(Broker).sendAndReceive(0xc42005a4d0, 0xa7ea80, 0xc4200fc280, 0xa784c0, 0xc4202f60a8, 0xc4200985f0, 0xaaaa50) /go/src/github.com/Shopify/sarama/broker.go:358 +0x194 github.com/Shopify/sarama.(Broker).Fetch(0xc42005a4d0, 0xc4200fc280, 0xc420306de4, 0xc420174210, 0xc420261268) /go/src/github.com/Shopify/sarama/broker.go:210 +0x70 github.com/Shopify/sarama.(brokerConsumer).fetchNewMessages(0xc42005d860, 0x0, 0x0, 0x0) /go/src/github.com/Shopify/sarama/consumer.go:689 +0x263 github.com/Shopify/sarama.(brokerConsumer).subscriptionConsumer(0xc42005d860) /go/src/github.com/Shopify/sarama/consumer.go:590 +0x167 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionConsumer)-fm() /go/src/github.com/Shopify/sarama/consumer.go:531 +0x2a github.com/Shopify/sarama.withRecover(0xc4201096b0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(consumer).newBrokerConsumer /go/src/github.com/Shopify/sarama/consumer.go:531 +0x238

goroutine 206 [select]: github.com/Shopify/sarama.(brokerConsumer).subscriptionManager(0xc42005d860) /go/src/github.com/Shopify/sarama/consumer.go:557 +0x525 github.com/Shopify/sarama.(brokerConsumer).(github.com/Shopify/sarama.subscriptionManager)-fm() /go/src/github.com/Shopify/sarama/consumer.go:530 +0x2a github.com/Shopify/sarama.withRecover(0xc4201096a0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).newBrokerConsumer /go/src/github.com/Shopify/sarama/consumer.go:530 +0x1de

goroutine 205 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322380) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420109690) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 204 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322380) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420109680) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 203 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc4202a6100) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 202 [chan receive, 31 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc4202a6100) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 365 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124800) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf390) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 90 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc42007ed80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420120450) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 89 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc42007ed80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420120440) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 366 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124800) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 276 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc4202a6100) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420126d90) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 275 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc4202a6100) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420126d80) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 367 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124800) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 368 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322c80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf620) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 369 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322c80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf630) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 402 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322c80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 403 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322c80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 393 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124880) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420121570) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 394 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124880) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420121580) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 395 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124880) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 396 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124880) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 404 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124900) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf830) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 405 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124900) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf840) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 406 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124900) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 407 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124900) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 408 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322d80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf8e0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 409 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322d80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bf8f0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 410 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322d80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 411 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322d80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 412 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322e00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bfca0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 413 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322e00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bfcb0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 414 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322e00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 415 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322e00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 416 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322e80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bff30) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 417 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322e80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4201bff40) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 418 [chan receive, 31 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322e80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 419 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322e80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 397 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322f00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420121c30) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 398 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322f00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420121c40) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 399 [chan receive, 76 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322f00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 400 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322f00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 420 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124980) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42033c600) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 421 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124980) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42033c610) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 422 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124980) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 423 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124980) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 401 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420322f80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc420121ce0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 434 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420322f80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc420121cf0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 435 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420322f80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 436 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420322f80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 424 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420124a00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42033c6b0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 425 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420124a00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42033c6c0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 426 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420124a00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 427 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420124a00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 428 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420323000) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42033c9e0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 429 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420323000) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42033c9f0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 430 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420323000) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 431 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420323000) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 432 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc4202a6b00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42033d090) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 433 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc4202a6b00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42033d0a0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 450 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc4202a6b00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 451 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc4202a6b00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 452 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420323100) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42033d260) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 453 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420323100) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42033d270) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 454 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420323100) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 455 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420323100) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 311 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc4202a6b80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 312 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc4202a6b80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 456 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc42007ee00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42033d9d0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 457 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc42007ee00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42033d9e0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 458 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc42007ee00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 459 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc42007ee00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 313 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420323200) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fd6a0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 314 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420323200) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fd6b0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 315 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420323200) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 316 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420323200) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 460 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc42007ee80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42022c0d0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 461 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc42007ee80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42022c0e0) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 462 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc42007ee80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 463 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc42007ee80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 317 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420323280) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fdb20) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 318 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420323280) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fdb30) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 319 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420323280) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 320 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420323280) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 464 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc42007ef00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42022c830) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 465 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc42007ef00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42022c840) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 466 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc42007ef00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 467 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc42007ef00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 321 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc420323300) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fdf70) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 482 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc420323300) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc4200fdf80) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 483 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc420323300) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 484 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc420323300) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 485 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc42007ef80) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42024c340) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 486 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc42007ef80) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42024c350) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 487 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc42007ef80) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 488 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc42007ef80) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 489 [chan receive, 125 minutes]: github.com/Shopify/sarama.(partitionConsumer).dispatcher(0xc4202a6c00) /go/src/github.com/Shopify/sarama/consumer.go:305 +0x5f github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.dispatcher)-fm() /go/src/github.com/Shopify/sarama/consumer.go:155 +0x2a github.com/Shopify/sarama.withRecover(0xc42024c970) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:155 +0x31c

goroutine 490 [chan receive]: github.com/Shopify/sarama.(partitionConsumer).responseFeeder(0xc4202a6c00) /go/src/github.com/Shopify/sarama/consumer.go:416 +0x74 github.com/Shopify/sarama.(partitionConsumer).(github.com/Shopify/sarama.responseFeeder)-fm() /go/src/github.com/Shopify/sarama/consumer.go:156 +0x2a github.com/Shopify/sarama.withRecover(0xc42024c980) /go/src/github.com/Shopify/sarama/utils.go:46 +0x43 created by github.com/Shopify/sarama.(*consumer).ConsumePartition /go/src/github.com/Shopify/sarama/consumer.go:156 +0x37a

goroutine 491 [chan receive, 125 minutes]: main.NewKafkaClient.func5(0xc4202f80b0, 0xa7f8c0, 0xc4202a6c00) /go/src/github.com/linkedin/Burrow/kafka_client.go:151 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:154 +0x962

goroutine 492 [chan receive, 125 minutes]: main.NewKafkaClient.func6(0xc4202f80b0, 0xa7f8c0, 0xc4202a6c00) /go/src/github.com/linkedin/Burrow/kafka_client.go:157 +0x97 created by main.NewKafkaClient /go/src/github.com/linkedin/Burrow/kafka_client.go:160 +0x9a1

goroutine 493 [select]: main.StartNotifiers(0xc42010bd80) /go/src/github.com/linkedin/Burrow/notify_center.go:89 +0x330 created by main.burrowMain /go/src/github.com/linkedin/Burrow/main.go:148 +0x1317

goroutine 494 [select, 125 minutes, locked to thread]: runtime.gopark(0x8bfc80, 0x0, 0x8a5afe, 0x6, 0x18, 0x2) /usr/local/go/src/runtime/proc.go:271 +0x13a runtime.selectgoImpl(0xc420243f50, 0x0, 0x18) /usr/local/go/src/runtime/select.go:423 +0x1364 runtime.selectgo(0xc420243f50) /usr/local/go/src/runtime/select.go:238 +0x1c runtime.ensureSigM.func1() /usr/local/go/src/runtime/signal_unix.go:434 +0x2dd runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:2197 +0x1

goroutine 28565 [runnable]: github.com/linkedin/Burrow/notifier.(EmailNotifier).Notify(0xc420262000, 0xc4200fd590, 0x5, 0xc420b5d8c0, 0x3f, 0x1, 0x1, 0xacb160, 0x0, 0x0, ...) /go/src/github.com/linkedin/Burrow/notifier/email_notifier.go:72 +0x32d main.(NotifyCenter).handleEvaluationResponse(0xc42020b7a0, 0xc420c46de0) /go/src/github.com/linkedin/Burrow/notify_center.go:117 +0xb9 created by main.StartNotifiers /go/src/github.com/linkedin/Burrow/notify_center.go:95 +0x31d

goroutine 9873 [sleep]: time.Sleep(0x2540be400) /usr/local/go/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc42020b7a0, 0xc42005b810, 0x63, 0xc4200fd590, 0x5) /go/src/github.com/linkedin/Burrow/notify_center.go:181 +0x1da created by main.(NotifyCenter).refreshConsumerGroups /go/src/github.com/linkedin/Burrow/notify_center.go:147 +0x75e

goroutine 9872 [sleep]: time.Sleep(0x2540be400) /usr/local/go/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc42020b7a0, 0xc420322180, 0x75, 0xc4200fd590, 0x5) /go/src/github.com/linkedin/Burrow/notify_center.go:181 +0x1da created by main.(NotifyCenter).refreshConsumerGroups /go/src/github.com/linkedin/Burrow/notify_center.go:147 +0x75e

goroutine 4006 [sleep]: time.Sleep(0x2540be400) /usr/local/go/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc42020b7a0, 0xc420b5d8c0, 0x3f, 0xc4200fd590, 0x5) /go/src/github.com/linkedin/Burrow/notify_center.go:181 +0x1da created by main.(NotifyCenter).refreshConsumerGroups /go/src/github.com/linkedin/Burrow/notify_center.go:147 +0x75e

goroutine 20764 [sleep, 1 minutes]: time.Sleep(0x2540be400) /usr/local/go/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc42020b7a0, 0xc420d4dc70, 0x63, 0xc4200fd590, 0x5) /go/src/github.com/linkedin/Burrow/notify_center.go:181 +0x1da created by main.(NotifyCenter).refreshConsumerGroups /go/src/github.com/linkedin/Burrow/notify_center.go:147 +0x75e

goroutine 10066 [sleep]: time.Sleep(0x2540be400) /usr/local/go/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc42020b7a0, 0xc420fe0280, 0x44, 0xc4200fd590, 0x5) /go/src/github.com/linkedin/Burrow/notify_center.go:181 +0x1da created by main.(NotifyCenter).refreshConsumerGroups /go/src/github.com/linkedin/Burrow/notify_center.go:147 +0x75e

goroutine 9871 [sleep, 1 minutes]: time.Sleep(0x2540be400) /usr/local/go/src/runtime/time.go:59 +0xf9 main.(NotifyCenter).startConsumerGroupEvaluator(0xc42020b7a0, 0xc4202a6080, 0x75, 0xc4200fd590, 0x5) /go/src/github.com/linkedin/Burrow/notify_center.go:181 +0x1da created by main.(NotifyCenter).refreshConsumerGroups /go/src/github.com/linkedin/Burrow/notify_center.go:147 +0x75e

[toddpalino]

It looks like this is related to #218

[daodennis-zz]

I'm having the same issue. I can give you the whole goroutine dump but this is the [running] goroutine it printed right below the fatal line. Is LinkedIn just auto-restarting this constantly with RunIt and removing the pid file at the moment or is there something else we can do here?

fatal error: concurrent map read and map write

goroutine 9167923 [running]:
runtime.throw(0x92fe63, 0x21)
        /usr/local/go/src/runtime/panic.go:605 +0x95 fp=0xc4219479b8 sp=0xc421947998 pc=0x42b615
runtime.mapaccess1_faststr(0x8890e0, 0xc4203fa3f0, 0xc421595120, 0x9, 0xc4200bc920)
        /usr/local/go/src/runtime/hashmap_fast.go:217 +0x43a fp=0xc421947a10 sp=0xc4219479b8 pc=0x40baea
main.(*OffsetStorage).evaluateGroup(0xc420116200, 0xc420135530, 0xa, 0xc4200105e0, 0xc, 0xc4203fe7e0, 0x0)
        [redacted by me path]offsets_store.go:398 +0x455 fp=0xc421947fa8 sp=0xc421947a10 pc=0x8002b5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:2337 +0x1 fp=0xc421947fb0 sp=0xc421947fa8 pc=0x459c51
created by main.NewOffsetStorage.func1
       [redacted by me path]offsets_store.go:140 +0x34d

Which doesn't look like it's in the notifier to me.

[toddpalino]

Thanks @daodennis. I'm not too worried about it right now, since everything in 1.0 is different about these maps.

[toddpalino]

Resolved by 1.0 rewrite