deis / builder

Git server and application builder for Deis Workflow
https://deis.com
MIT License
40 stars 41 forks source link

healthsrv failing healthchecks on AWS #203

Closed bacongobbler closed 8 years ago

bacongobbler commented 8 years ago

After a short while, the builder will start to fail:

><> kd logs -f deis-builder-lgsfs
2016/02/26 07:53:57 Running in debug mode
2016/02/26 07:53:57 Starting health check server on port 8092
2016/02/26 07:53:57 Starting deleted app cleaner
2016/02/26 07:53:57 Starting SSH server on 0.0.0.0:2223
[debug] Generating ssh keys for sshd
[debug] Parsing ssh host keys
[info] Parsed host key /etc/ssh/ssh_host_rsa_key.
[info] Parsed host key /etc/ssh/ssh_host_dsa_key.
[info] Parsed host key /etc/ssh/ssh_host_ecdsa_key.
[debug] Name: EXTERNAL_PORT, Val: 2223
[info] Added hostkey.
[info] Added hostkey.
[info] Added hostkey.
[info] Listening on 0.0.0.0:2223
[info] Accepting new connections.
[info] Checking closer.
[info] Builder is running.
[debug] Generating ssh keys for sshd
[debug] Parsing ssh host keys
[info] Parsed host key /etc/ssh/ssh_host_rsa_key.
[info] Parsed host key /etc/ssh/ssh_host_dsa_key.
[info] Parsed host key /etc/ssh/ssh_host_ecdsa_key.
[debug] Name: EXTERNAL_PORT, Val: 2223
[info] Added hostkey.
[info] Added hostkey.
[info] Added hostkey.
[info] Listening on 0.0.0.0:2223
[info] Accepting new connections.
[info] Checking closer.
[info] Builder is running.
Healthcheck endpoint timed out after 2s
Healthcheck endpoint timed out after 2s
Healthcheck endpoint timed out after 2s
Healthcheck endpoint timed out after 2s
Healthcheck endpoint timed out after 2s

Tested on AWS, all default kubernetes config settings for v1.1.7.

bacongobbler commented 8 years ago

Turns out it was because my cluster nodes were flapping. Closing as intentional!