marathon-lb stopped updating haproxy config when one of three marathon(first) services stop

[stevenlee87]

my marathon version is:Version 1.4.5 and Version 0.13.0 marathon-lb version is ：v1.11.2(latest) that's my marathon(Version 0.13.0) json { "id": "marathon-lb", "cpus": 8, "mem": 4096, "disk": 1000, "instances": 1, "container": { "type": "DOCKER", "docker": { "image": "container/marathon-lb:v1.11.2", "privileged": true, "network": "HOST" } }, "healthChecks":[ { "protocol": "COMMAND", "portIndex": 0, "command": { "value": "/bin/bash -c \\"</dev/tcp/localhost/9090\\"" }, "gracePeriodSeconds": 60, "intervalSeconds": 10, "timeoutSeconds": 10, "maxConsecutiveFailures": 3, "ignoreHttp1xx": false } ], "args": ["sse", "-m", "http://10.10.10.1:8080", "http://10.10.10.2:8080", "--group", "external", "--health-check", "--lru-cache-capacity", "2000", "--skip-validation", "--dont-bind-http-https"] }

when one of three marathon(first): "http://10.10.10.1:8080" stop , marathon-lb stopped updating haproxy config.

marathon-lb report this ： 2017-12-27 06:38:13,249 marathon_lb: (140318559692544): condition wait expired 2017-12-27 06:38:13,249 marathon_lb: fetching apps 2017-12-27 06:38:13,254 marathon_lb: (140318559692544): Connection error(None): None 2017-12-27 06:38:34,587 marathon_lb: SSE Active, trying fetch events from http://10.10.10.2:8080/v2/events 2017-12-27 06:38:34,588 marathon_lb: fetching apps 2017-12-27 06:38:34,593 marathon_lb: (140318559692544): Connection error(None): None 2017-12-27 06:38:34,595 marathon_lb: received event of type event_stream_attached

[stevenlee87]

that's my marathon(Version 1.4.5) json { "id": "/marathon-lb", "cmd": null, "cpus": 8, "mem": 4096, "disk": 1000, "instances": 1, "acceptedResourceRoles": [], "container": { "type": "DOCKER", "volumes": [], "docker": { "image": "container/marathon-lb:v1.11.2", "network": "HOST", "portMappings": [], "privileged": true, "parameters": [], "forcePullImage": false } }, "healthChecks": [ { "gracePeriodSeconds": 60, "intervalSeconds": 5, "timeoutSeconds": 5, "maxConsecutiveFailures": 3, "port": 9090, "protocol": "TCP" } ], "portDefinitions": [ { "port": 10000, "protocol": "tcp", "name": "default", "labels": {} } ], "args": [ "sse", "-m", "http://10.10.10.3:8080", "http://10.10.10.4:8080", "--group", "external", "--health-check", "--lru-cache-capacity", "2000", "--skip-validation", "--dont-bind-http-https" ] }

when one of three marathon(first): "http://10.10.10.3:8080" stop , marathon-lb stopped updating haproxy config.

marathon-lb report this ： 2017-12-27 06:50:43,474 marathon_lb: SSE Active, trying fetch events from http://10.10.10.4:8080/v2/events 2017-12-27 06:50:43,475 marathon_lb: fetching apps 2017-12-27 06:50:43,479 marathon_lb: (139708856383232): Connection error(None): None 2017-12-27 06:50:43,483 marathon_lb: received event of type event_stream_attached 2017-12-27 06:50:50,766 marathon_lb: received event of type event_stream_detached