search

driskell / log-courier

The Log Courier Suite is a set of lightweight tools created to ship and process log files speedily and securely, with low resource usage, to Elasticsearch or Logstash instances.
Other
419 stars 107 forks source link

log-courier 2.x: panic: Endpoint is not ready (3) #294

Closed jfrome closed 8 years ago

jfrome commented 8 years ago

Logstash: 1.5.6 log-courier plugin: 1.6.11

Seems to panic randomly after a few minutes of running:

2016/03/22 18:20:41.557273 [<LOGSTASH_SERVER>:9223] Attempting to connect to 172.16.188.231:9223 (<LOGSTASH_SERVER>)
2016/03/22 18:20:41.637355 [<LOGSTASH_SERVER>:9223] Connected to 172.16.188.231:9223 (<LOGSTASH_SERVER>)
2016/03/22 18:20:41.637355 [<LOGSTASH_SERVER>:9223] Endpoint recovered
panic: Endpoint is not ready (3)

goroutine 19 [running]:
panic(0x7aa540, 0xc097cf5580)
        C:/Go/src/runtime/panic.go:464 +0x3f4
github.com/driskell/log-courier/lc-lib/endpoint.(*Endpoint).SendPayload(0xc0820be1a0, 0xc08e6664e0, 0x0, 0x0)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/endpoint/endpoint.go:120 +0x689
github.com/driskell/log-courier/lc-lib/publisher.(*Publisher).sendPayload(0xc08204f1e0, 0xc0820be1a0, 0xc08e6664e0, 0x0, 0x0)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/publisher/publisher.go:251 +0x42
github.com/driskell/log-courier/lc-lib/publisher.(*Publisher).sendEvents(0xc08204f1e0, 0xc0820be1a0, 0xc0db2b4000, 0x16f5, 0x2800, 0x0, 0x0)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/publisher/publisher.go:246 +0x1f6
github.com/driskell/log-courier/lc-lib/publisher.(*Publisher).sendIfAvailable(0xc08204f1e0, 0xc0820be1a0, 0x0)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/publisher/publisher.go:471 +0x774
github.com/driskell/log-courier/lc-lib/publisher.(*Publisher).OnReady(0xc08204f1e0, 0xc0820be1a0)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/publisher/publisher.go:272 +0x44
github.com/driskell/log-courier/lc-lib/endpoint.(*Sink).processStatusChange(0xc0820528c0, 0xc08caf01a0, 0xc0820be1a0, 0xfaa278, 0xc08204f1e0)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/endpoint/process.go:115 +0x1f0
github.com/driskell/log-courier/lc-lib/endpoint.(*Sink).ProcessEvent(0xc0820528c0, 0x2815bd8, 0xc08caf01a0, 0xfaa278, 0xc08204f1e0)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/endpoint/process.go:52 +0x10d
github.com/driskell/log-courier/lc-lib/publisher.(*Publisher).runOnce(0xc08204f1e0, 0xc0822fe000)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/publisher/publisher.go:166 +0x1c5
github.com/driskell/log-courier/lc-lib/publisher.(*Publisher).Run(0xc08204f1e0)
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/publisher/publisher.go:146 +0xa2
created by github.com/driskell/log-courier/lc-lib/core.(*Pipeline).Start
        C:/GOWORKSPACE/src/github.com/driskell/log-courier/lc-lib/core/pipeline.go:67 +0xa6

Config located here: https://gist.github.com/jfrome/1a38c2b88ce069026c27