raintank / worldping-api

Worldping Backend Service
Other
25 stars 18 forks source link

rabbitmq dies -> grafana reconnects but doesn't start consumption #34

Closed woodsaj closed 8 years ago

woodsaj commented 8 years ago

Issue by Dieterbe Tuesday Mar 15, 2016 at 02:39 GMT Originally opened as https://github.com/raintank/grafana/issues/573


@ctdk said "everything happily recovers when one of the servers drops out ​except​ the alerting process when a rabbitmq server goes away 9:21 grafana ​ does​ reconnect to rabbitmq, but it never starts doing its thing again"

i'm not very familiar with this code but could it be that at https://github.com/raintank/grafana/blob/master/pkg/services/rabbitmq/consumer.go#L120 when it calls Connect, the latter invokes consume(), but we don't check the err return value from consume. We should probably not ignore this error?