coreos / bugs

Issue tracker for CoreOS Container Linux
https://coreos.com/os/eol/
147 stars 30 forks source link

docker ps hangs on 1353.1.0 / docker 1.13.1 #1880

Open mikebryant opened 7 years ago

mikebryant commented 7 years ago

Issue Report

Bug

Container Linux Version

$ cat /etc/os-release
NAME="Container Linux by CoreOS"
ID=coreos
VERSION=1353.1.0
VERSION_ID=1353.1.0
BUILD_ID=2017-03-17-0813
PRETTY_NAME="Container Linux by CoreOS 1353.1.0 (Ladybug)"
ANSI_COLOR="38;5;75"
HOME_URL="https://coreos.com/"
BUG_REPORT_URL="https://github.com/coreos/bugs/issues"

Environment

What hardware/cloud provider/hypervisor is being used to run Container Linux? Openstack

Expected Behavior

docker ps should work

Actual Behavior

docker ps hangs

Reproduction Steps

Try and run Kubernetes Run docker ps

Other Information

Reported to docker (https://github.com/docker/docker/issues/32007), but they want CoreOS to look at it first.

containerd.txt goroutine-stacks-2017-03-22T162146Z.txt daemon-data-2017-03-22T162146Z.txt

mikebryant commented 7 years ago

The current stable/beta/alpha versions of coreos are almost unusable for us due to how frequently docker is hanging. Can this issue be triaged?

And please let me know if there's anything else I need to provide for you to investigate this issue.

nbutton23 commented 7 years ago

We are seeing this exact same issue on coreOS VERSION=1353.7.0

We need to get this fixed asap it's eating alot of our Operations time constantly fixing it.

lucab commented 7 years ago

It looks like a likely root cause of this has identified by the original reporter and the upstream issue is being tracked here: https://github.com/moby/moby/issues/32892. It seems to be a locking bug resulting in starvation on the daemon, docker fix still pending.