search

buildkite / feedback

Got feedback? Please let us know!
https://buildkite.com
25 stars 24 forks source link

Docker Dying #327

Closed chandanadesilva closed 6 years ago

chandanadesilva commented 6 years ago

I am getting these intermittent errors from my build agents. I have had to kill the agent and wait for the AS group to bring up a new one

docker: Checking docker
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
:alert: Docker isn't running!
pgrep -lf docker    0s
tail -n 50 /var/log/docker  0s
\nFri Mar 16 04:29:27 UTC 2018\n
time="2018-03-16T04:30:38.005411291Z" level=debug msg="Listener created for HTTP on unix (/var/run/docker.sock)"
time="2018-03-16T04:30:38.006568601Z" level=info msg="libcontainerd: started new docker-containerd process" pid=2778
time="2018-03-16T04:30:59.950802102Z" level=error msg="containerd did not exit successfully" error="signal: terminated" module=libcontainerd
Failed to connect to containerd: failed to dial "/var/run/docker/containerd/docker-containerd.sock": dial unix:///var/run/docker/containerd/docker-containerd.sock: timeout
exit 1  0s
🚨 Error: The global environment hook exited with an error: Error running `/bin/bash -c /tmp/buildkite-agent-bootstrap-hook-runner-193392174`: exit status 1
🚨 Error: Error setting up bootstrap: Error running `/bin/bash -c /tmp/buildkite-agent-bootstrap-hook-runner-193392174`: exit status 1
lox commented 6 years ago

Follow https://github.com/buildkite/elastic-ci-stack-for-aws/issues/381 for more details!