docker / for-linux

Docker Engine for Linux
https://docs.docker.com/engine/installation/
749 stars 85 forks source link

Docker rm hangs: grouting stuck in runtime_SemacquireMutex (possible deadlock) #1319

Open pranavadn opened 2 years ago

pranavadn commented 2 years ago

Expected behavior

docker rm should delete the container

Actual behavior

docker rm hangs, gets stuck and does not complete

Steps to reproduce the behavior

It was found that docker rm of a container was not completing. sudo docker rm -f afbbb2668c2d ^C

"docker inspect" and "docker exec" were also found to be not completing for the same container.

"curl --unix-socket /var/run/docker.sock http://./debug/pprof/goroutine?debug=2" output shows that for each "docker rm" or "docker exec" or "docker inspect", a go routine is created that gets stuck in acquiring a semaphore in runtime_SemacquireMutex.

goroutine 673677 [semacquire, 1130 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc001857600, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).GetPID(0xc0009a1400, 0xc000a7d2a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:248 +0x7b github.com/docker/docker/daemon.killProcessDirectly(0xc000113440, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/container_operations_unix.go:346 +0x14e github.com/docker/docker/daemon.(Daemon).Kill(0xc00000c3c0, 0xc000113440, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/kill.go:152 +0x19b github.com/docker/docker/daemon.(Daemon).cleanupContainer(0xc00000c3c0, 0xc000113440, 0x1, 0xc000113440, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:90 +0x387 github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc000f400d9, 0xc, 0xc000bc81c6, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:45 +0x181 github.com/docker/docker/api/server/router/container.(containerRouter).*deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc0011ecae0, 0x55df6c273400, 0xc0004008c0, 0xc001794800, 0xc0011eca20, 0xc0001b8001, 0xc000b8e840)

Looks like the whole behaviour gets triggered with "docker rm". Before that, docker inspect would be working. A docker rm on the working container gets it into this state. Post that docker inspect and docker exec also hang in acquiring the lock.

Output of docker version:

Docker version 19.03.12, build 48a66213fe

Output of docker info:

Client:
 Debug Mode: false

Server:
 Containers: 12
  Running: 7
  Paused: 0
  Stopped: 5
 Images: 13
 Server Version: 19.03.12
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: true
 Logging Driver: json-file
 Cgroup Driver: systemd
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 7ad184331fa3e55e52b890ea95e65ba581ae3429
 runc version: dc9208a3303feef5b3839f4323d9beb36df0a9dd
 init version: fec3683
 Security Options:
  seccomp
   Profile: default
 Kernel Version: 3.10.0-1160.42.2.el7.x86_64
 Operating System: CentOS Linux 7 (Core)
 OSType: linux
 Architecture: x86_64
 CPUs: 32
 Total Memory: 62.66GiB
 Name: watchmenmagpch-local-bqkp74907548-node-3
 ID: VNHM:52GA:UMCL:CDRZ:ITFH:NUA7:HZSF:EZKD:KRZW:DMQH:J6KC:HK6H
 Docker Root Dir: /home_cohesity_data/disks/sdd2_b109fd0e-6a80-4114-a2c9-ca4ab8207c5c/athena/docker
 Debug Mode: false
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: false
 Insecure Registries:
  localhost:25684
  localhost:25699
  127.0.0.0/8
 Live Restore Enabled: false

Additional environment details (AWS, VirtualBox, physical, etc.)

akerouanton commented 2 years ago

Hello @pranavadn, could you provide the whole output of curl --unix-socket /var/run/docker.sock http://./debug/pprof/goroutine?debug=2 please? Maintainers/contributors would need it to know what is preventing the mutex on State to be locked.

pranavadn commented 2 years ago

Hi @akerouanton, Please find it below -

goroutine 705714 [running]: runtime/pprof.writeGoroutineStacks(0x55df6c226d20, 0xc0007b4620, 0x0, 0x0) /usr/local/go/src/runtime/pprof/pprof.go:679 +0x9f runtime/pprof.writeGoroutine(0x55df6c226d20, 0xc0007b4620, 0x2, 0x7, 0x10) /usr/local/go/src/runtime/pprof/pprof.go:668 +0x46 runtime/pprof.(Profile).WriteTo(0x55df6d370980, 0x55df6c226d20, 0xc0007b4620, 0x2, 0xc0007b4620, 0x10) /usr/local/go/src/runtime/pprof/pprof.go:329 +0x3dc net/http/pprof.handler.ServeHTTP(0xc000056731, 0x9, 0x55df6c273400, 0xc0007b4620, 0xc0019a4600) /usr/local/go/src/net/http/pprof/pprof.go:245 +0x33c github.com/docker/docker/api/server/router/debug.handlePprof(0x55df6c2823c0, 0xc0016f6300, 0x55df6c273400, 0xc0007b4620, 0xc0019a4600, 0xc0016f6210, 0x55df6c01ab80, 0x1) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/debug/debug_routes.go:10 +0xa5 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0016f6300, 0x55df6c273400, 0xc0007b4620, 0xc0019a4600, 0xc0016f6210, 0x55df6c2823c0, 0xc0016f6300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0016f62a0, 0x55df6c273400, 0xc0007b4620, 0xc0019a4600, 0xc0016f6210, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc0016f62a0, 0x55df6c273400, 0xc0007b4620, 0xc0019a4600, 0xc0016f6210, 0x55df6c2823c0, 0xc0016f62a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0007b4620, 0xc0019a4300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000daf020, 0x55df6c273400, 0xc0007b4620, 0xc0019a4300) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0007b4620, 0xc0019a4000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0007b4620, 0xc0019a4000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0007b4620, 0xc0019a4000) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000125860, 0x55df6c282300, 0xc000f5c280) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 1 [chan receive, 4137 minutes]: main.(DaemonCli).start(0xc000773530, 0xc000349b00, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/daemon.go:253 +0xc03 main.runDaemon(...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/docker_unix.go:13 main.newDaemonCommand.func1(0xc000846000, 0xc0007734d0, 0x0, 0x3, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/docker.go:34 +0x7c github.com/docker/docker/vendor/github.com/spf13/cobra.(Command).execute(0xc000846000, 0xc00004e0d0, 0x3, 0x3, 0xc000846000, 0xc00004e0d0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/spf13/cobra/command.go:762 +0x462 github.com/docker/docker/vendor/github.com/spf13/cobra.(Command).ExecuteC(0xc000846000, 0x0, 0x0, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/spf13/cobra/command.go:852 +0x2ec github.com/docker/docker/vendor/github.com/spf13/cobra.(Command).Execute(...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/spf13/cobra/command.go:800 main.main() /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/docker.go:97 +0x191

goroutine 6 [syscall, 1256 minutes]: os/signal.signal_recv(0x55df6c25cbc0) /usr/local/go/src/runtime/sigqueue.go:147 +0x9e os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x24 created by os/signal.init.0 /usr/local/go/src/os/signal/signal_unix.go:29 +0x43

goroutine 30 [select]: github.com/docker/docker/vendor/go.opencensus.io/stats/view.(*worker).start(0xc00004f780) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/go.opencensus.io/stats/view/worker.go:144 +0xdf created by github.com/docker/docker/vendor/go.opencensus.io/stats/view.init.0 /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/go.opencensus.io/stats/view/worker.go:29 +0x59

goroutine 79 [chan receive, 4137 minutes]: github.com/docker/docker/daemon.(Daemon).setupDumpStackTrap.func1(0xc0000dfc20, 0x55df6b1a8007, 0xf) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/debugtrap_unix.go:18 +0x43 created by github.com/docker/docker/daemon.(Daemon).setupDumpStackTrap /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/debugtrap_unix.go:17 +0xc1

goroutine 98 [chan receive, 1256 minutes]: github.com/docker/docker/pkg/signal.Trap.func1(0xc000884240, 0x55df6c225b00, 0xc00012c9a0, 0xc000881140) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/signal/trap.go:38 +0x5d created by github.com/docker/docker/pkg/signal.Trap /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/signal/trap.go:36 +0x11d

goroutine 116 [IO wait, 4137 minutes]: internal/poll.runtime_pollWait(0x7efd3c364d68, 0x72, 0x0) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc000776398, 0x72, 0x0, 0x0, 0x55df6b199543) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Accept(0xc000776380, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:384 +0x1fa net.(netFD).accept(0xc000776380, 0xc000550000, 0x7efd3c3c0d98, 0x0) /usr/local/go/src/net/fd_unix.go:238 +0x44 net.(UnixListener).accept(0xc00088a360, 0xc0000c4dd8, 0x55df698cc40a, 0x30) /usr/local/go/src/net/unixsock_posix.go:162 +0x34 net.(UnixListener).Accept(0xc00088a360, 0x55df6c01ab80, 0xc00081cae0, 0x55df6be12e40, 0x55df6d36a070) /usr/local/go/src/net/unixsock.go:260 +0x49 net/http.(Server).Serve(0xc0007b40e0, 0x55df6c273180, 0xc00088a360, 0x0, 0x0) /usr/local/go/src/net/http/server.go:2896 +0x282 net/http.Serve(...) /usr/local/go/src/net/http/server.go:2468 github.com/docker/docker/daemon.(Daemon).listenMetricsSock.func1(0x55df6c273180, 0xc00088a360, 0xc0003f8780) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/metrics_unix.go:31 +0x6e created by github.com/docker/docker/daemon.(*Daemon).listenMetricsSock /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/metrics_unix.go:30 +0x1af

goroutine 117 [select, 4137 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0003f8a40) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x12e created by github.com/docker/docker/vendor/google.golang.org/grpc.newCCBalancerWrapper /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x16b

goroutine 118 [chan receive, 4137 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc.(addrConn).resetTransport(0xc000846280) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/clientconn.go:1077 +0x6ae created by github.com/docker/docker/vendor/google.golang.org/grpc.(addrConn).connect /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/clientconn.go:743 +0x122

goroutine 147 [IO wait, 27 minutes]: internal/poll.runtime_pollWait(0x7efd3c364c98, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc0009a0098, 0x72, 0x8000, 0x8000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc0009a0080, 0xc0009ae000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc0009a0080, 0xc0009ae000, 0x8000, 0x8000, 0x0, 0x800000601, 0x0) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc00099c008, 0xc0009ae000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a bufio.(Reader).Read(0xc000994060, 0xc0009c6038, 0x9, 0x9, 0x20, 0x18, 0x55df6bf1e040) /usr/local/go/src/bufio/bufio.go:226 +0x26c io.ReadAtLeast(0x55df6c222ec0, 0xc000994060, 0xc0009c6038, 0x9, 0x9, 0x9, 0x10055df69f04377, 0x0, 0x9) /usr/local/go/src/io/io.go:310 +0x89 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/docker/docker/vendor/golang.org/x/net/http2.readFrameHeader(0xc0009c6038, 0x9, 0x9, 0x55df6c222ec0, 0xc000994060, 0x0, 0xc000000000, 0x55df698cc40a, 0xc00099a0b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/net/http2/frame.go:237 +0x89 github.com/docker/docker/vendor/golang.org/x/net/http2.(Framer).ReadFrame(0xc0009c6000, 0xc000c6b5e0, 0xc000c6b5e0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/net/http2/frame.go:492 +0xa3 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(http2Client).reader(0xc00018c700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1249 +0x198 created by github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/http2_client.go:289 +0xd77

goroutine 148 [select, 27 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(controlBuffer).get(0xc00099a0a0, 0x1, 0x0, 0x0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x124 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(loopyWriter).run(0xc000994180, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1e5 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00018c700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/http2_client.go:333 +0x7d created by github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/http2_client.go:331 +0xf14

goroutine 47 [select, 4137 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000a18200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:115 +0x12e created by github.com/docker/docker/vendor/google.golang.org/grpc.newCCBalancerWrapper /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:106 +0x16b

goroutine 48 [chan receive, 4137 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc.(addrConn).resetTransport(0xc000122280) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/clientconn.go:1077 +0x6ae created by github.com/docker/docker/vendor/google.golang.org/grpc.(addrConn).connect /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/clientconn.go:743 +0x122

goroutine 100 [IO wait, 48 minutes]: internal/poll.runtime_pollWait(0x7efd3c364bc8, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc0009a0418, 0x72, 0x8000, 0x8000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc0009a0400, 0xc00047a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc0009a0400, 0xc00047a000, 0x8000, 0x8000, 0x0, 0x800000601, 0x7efd00000000) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc000010058, 0xc00047a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a bufio.(Reader).Read(0xc0009945a0, 0xc0009c6118, 0x9, 0x9, 0xc0008f2df8, 0x55df698c47de, 0xc000946600) /usr/local/go/src/bufio/bufio.go:226 +0x26c io.ReadAtLeast(0x55df6c222ec0, 0xc0009945a0, 0xc0009c6118, 0x9, 0x9, 0x9, 0x55df69919810, 0xc000946600, 0xc0008f2e30) /usr/local/go/src/io/io.go:310 +0x89 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/docker/docker/vendor/golang.org/x/net/http2.readFrameHeader(0xc0009c6118, 0x9, 0x9, 0x55df6c222ec0, 0xc0009945a0, 0x0, 0xc000000000, 0x10055df698cc40a, 0xc0003d6420) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/net/http2/frame.go:237 +0x89 github.com/docker/docker/vendor/golang.org/x/net/http2.(Framer).ReadFrame(0xc0009c60e0, 0xc001ae4000, 0xc001ae4000, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/net/http2/frame.go:492 +0xa3 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(http2Client).reader(0xc00018c8c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1249 +0x198 created by github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/http2_client.go:289 +0xd77

goroutine 101 [select, 48 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(controlBuffer).get(0xc0003d6410, 0x1, 0x0, 0x0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x124 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(loopyWriter).run(0xc0009946c0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1e5 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00018c8c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/http2_client.go:333 +0x7d created by github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/http2_client.go:331 +0xf14

goroutine 83 [select, 4137 minutes]: github.com/docker/docker/libcontainerd/remote.(*client).processEventStream(0xc0009ea0c0, 0x55df6c282300, 0xc0003f8740, 0x55df6b1a38c4, 0xc) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:700 +0x2ab created by github.com/docker/docker/libcontainerd/remote.NewClient /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:67 +0x268

goroutine 49 [select, 4137 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc.newClientStream.func5(0xc0001b8700, 0xc0001105a0, 0x55df6c2823c0, 0xc000770cc0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:319 +0xd9 created by github.com/docker/docker/vendor/google.golang.org/grpc.newClientStream /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:318 +0x9a7

goroutine 162 [select, 4137 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).waitOnHeader(0xc000778100, 0xc0009a0080, 0xc0009a0098) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:312 +0xce github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).RecvCompress(...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:331 github.com/docker/docker/vendor/google.golang.org/grpc.(csAttempt).recvMsg(0xc000776000, 0x55df6c0c05a0, 0xc000348900, 0x0, 0x0, 0x8) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:871 +0x755 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg.func1(0xc000776000, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:736 +0x48 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).withRetry(0xc0001105a0, 0xc0000c9e48, 0xc0000c9e18, 0x9, 0x48) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:594 +0x9e github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg(0xc0001105a0, 0x55df6c0c05a0, 0xc000348900, 0x55df698edf3c, 0x1) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:735 +0x105 github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/events/v1.(eventsSubscribeClient).Recv(0xc0004743f0, 0xc00018c700, 0xc0009c6028, 0xc00094c7c8) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/events/v1/events.pb.go:351 +0x64 github.com/docker/docker/vendor/github.com/containerd/containerd.(eventRemote).Subscribe.func1(0xc0003484e0, 0x55df6c2a0880, 0xc0004743f0, 0xc0009aaba0, 0x55df6c282300, 0xc0003f8740) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/events.go:99 +0x8f created by github.com/docker/docker/vendor/github.com/containerd/containerd.(*eventRemote).Subscribe /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/events.go:95 +0x1c6

goroutine 84 [sync.Cond.Wait, 4137 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc00095c890, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc00095c880) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/daemon/stats.(Collector).Run(0xc00095c840) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/stats/collector.go:101 +0x4a created by github.com/docker/docker/daemon.(*Daemon).newStatsCollector /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/stats_collector.go:24 +0x7f

goroutine 85 [chan receive, 3 minutes]: github.com/docker/docker/daemon.(*Daemon).execCommandGC(0xc00000c3c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/exec.go:305 +0x14b created by github.com/docker/docker/daemon.NewDaemon /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/daemon.go:1060 +0x288f

goroutine 86 [select, 27 minutes]: github.com/docker/docker/libcontainerd/remote.(*client).processEventStream(0xc0009eac00, 0x55df6c282300, 0xc0003f8740, 0x55df6b194fe4, 0x4) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:700 +0x2ab created by github.com/docker/docker/libcontainerd/remote.NewClient /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:67 +0x268

goroutine 87 [select, 3961 minutes]: github.com/docker/docker/vendor/github.com/docker/libnetwork.(controller).watchLoop(0xc0007b6000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/store.go:451 +0xc8 created by github.com/docker/docker/vendor/github.com/docker/libnetwork.(controller).startWatch /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/store.go:468 +0xcf

goroutine 163 [select, 4137 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc.newClientStream.func5(0xc000878380, 0xc000110900, 0x55df6c2823c0, 0xc000770f60) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:319 +0xd9 created by github.com/docker/docker/vendor/google.golang.org/grpc.newClientStream /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:318 +0x9a7

goroutine 164 [select, 27 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(recvBufferReader).readClient(0xc00094a460, 0xc00045ced0, 0x5, 0x5, 0xa0, 0xc00014a106, 0x55df6c1e24b8) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:185 +0xd5 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(recvBufferReader).Read(0xc00094a460, 0xc00045ced0, 0x5, 0x5, 0xc0000c3ef0, 0xc0002b0800, 0xc0000c39a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:165 +0x197 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(transportReader).Read(0xc0007713b0, 0xc00045ced0, 0x5, 0x5, 0xc0000c39c8, 0xc0000c39c8, 0x55df69f4819e) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:488 +0x57 io.ReadAtLeast(0x55df6c226760, 0xc0007713b0, 0xc00045ced0, 0x5, 0x5, 0x5, 0x55df69a0196e, 0xc000770f60, 0xc0009aaf60) /usr/local/go/src/io/io.go:310 +0x89 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).Read(0xc000778400, 0xc00045ced0, 0x5, 0x5, 0x55df6c0c05a0, 0x7efd3c376eb8, 0xc0009aaf60) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:472 +0xc9 github.com/docker/docker/vendor/google.golang.org/grpc.(parser).recvMsg(0xc00045cec0, 0x1000000, 0xdb, 0xdb, 0x0, 0x0, 0x7efd3c376e88, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/rpc_util.go:508 +0x65 github.com/docker/docker/vendor/google.golang.org/grpc.recvAndDecompress(0xc00045cec0, 0xc000778400, 0x0, 0x0, 0x1000000, 0x0, 0x0, 0x0, 0xc00014a0e0, 0xdb, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4f github.com/docker/docker/vendor/google.golang.org/grpc.recv(0xc00045cec0, 0x7efd2c5aa008, 0x55df6d4266b0, 0xc000778400, 0x0, 0x0, 0x55df6c0c05a0, 0xc001529740, 0x1000000, 0x0, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/rpc_util.go:684 +0x9d github.com/docker/docker/vendor/google.golang.org/grpc.(csAttempt).recvMsg(0xc000776080, 0x55df6c0c05a0, 0xc001529740, 0x0, 0xc0000c3d38, 0x55df6991c630) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:885 +0xef github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg.func1(0xc000776080, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:736 +0x48 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).withRetry(0xc000110900, 0xc0000c3e48, 0xc0000c3e18, 0x0, 0x48) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:590 +0x362 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg(0xc000110900, 0x55df6c0c05a0, 0xc001529740, 0xc0000c3eec, 0x2) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:735 +0x105 github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/events/v1.(eventsSubscribeClient).Recv(0xc0004744c0, 0xc0000c3ee8, 0x2, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/events/v1/events.pb.go:351 +0x64 github.com/docker/docker/vendor/github.com/containerd/containerd.(eventRemote).Subscribe.func1(0xc000348ba0, 0x55df6c2a0880, 0xc0004744c0, 0xc0009aade0, 0x55df6c282300, 0xc0003f8740) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/events.go:99 +0x8f created by github.com/docker/docker/vendor/github.com/containerd/containerd.(eventRemote).Subscribe /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/events.go:95 +0x1c6

goroutine 88 [select, 4137 minutes]: github.com/docker/docker/vendor/github.com/docker/libnetwork/drivers/overlay.(*driver).peerOpRoutine(0xc0007b6200, 0x55df6c282300, 0xc00095ccc0, 0xc0003ef5c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/drivers/overlay/peerdb.go:279 +0x10c created by github.com/docker/docker/vendor/github.com/docker/libnetwork/drivers/overlay.Init /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/drivers/overlay/overlay.go:77 +0x17f

goroutine 89 [IO wait, 3961 minutes]: internal/poll.runtime_pollWait(0x7efd3c364af8, 0x72, 0x0) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc00077ce98, 0x72, 0x0, 0x0, 0x55df6b199543) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Accept(0xc00077ce80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:384 +0x1fa net.(netFD).accept(0xc00077ce80, 0xc0004624f0, 0x0, 0x0) /usr/local/go/src/net/fd_unix.go:238 +0x44 net.(UnixListener).accept(0xc0009c8960, 0xc001201f48, 0xc001201f50, 0x18) /usr/local/go/src/net/unixsock_posix.go:162 +0x34 net.(UnixListener).Accept(0xc0009c8960, 0x55df6c1dd170, 0x55df6c2aa180, 0xc0004624f0, 0xc0007b6000) /usr/local/go/src/net/unixsock.go:260 +0x49 github.com/docker/docker/vendor/github.com/docker/libnetwork.(controller).acceptClientConnections(0xc0007b6000, 0xc00082e480, 0x2c, 0x55df6c273180, 0xc0009c8960) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/sandbox_externalkey_unix.go:144 +0x3d created by github.com/docker/docker/vendor/github.com/docker/libnetwork.(controller).startExternalKeyListener /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/sandbox_externalkey_unix.go:138 +0x339

goroutine 119 [IO wait]: internal/poll.runtime_pollWait(0x7efd3c364e38, 0x72, 0x0) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc000776318, 0x72, 0x0, 0x0, 0x55df6b199543) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Accept(0xc000776300, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:384 +0x1fa net.(netFD).accept(0xc000776300, 0x55df698ee7a3, 0x55df6c1e24b8, 0xc0011fed40) /usr/local/go/src/net/fd_unix.go:238 +0x44 net.(UnixListener).accept(0xc00088a150, 0xc0011fed40, 0xc0011feda0, 0x55df69c3a9b6) /usr/local/go/src/net/unixsock_posix.go:162 +0x34 net.(UnixListener).Accept(0xc00088a150, 0xf169608011fed40, 0x617005df, 0xc0011feda0, 0x55df69988b98) /usr/local/go/src/net/unixsock.go:260 +0x49 github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverride).Accept(0xc00045e2d0, 0xc0011fedf0, 0x18, 0xc00098ad80, 0x55df69c39ed6) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:116 +0x39 net/http.(Server).Serve(0xc00083c0e0, 0x55df6c264740, 0xc00045e2d0, 0x0, 0x0) /usr/local/go/src/net/http/server.go:2896 +0x282 github.com/docker/docker/api/server.(HTTPServer).Serve(...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:113 github.com/docker/docker/api/server.(Server).serveAPI.func1(0xc0000de300, 0xc000881120) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:87 +0xd1 created by github.com/docker/docker/api/server.(*Server).serveAPI /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:84 +0x88

goroutine 91 [IO wait, 4137 minutes]: internal/poll.runtime_pollWait(0x7efd3c364a28, 0x72, 0x1000) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc00077d398, 0x72, 0x0, 0x10, 0xc000a2a020) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).ReadMsg(0xc00077d380, 0xc0007ca7c0, 0x10, 0x10, 0xc000a2a020, 0x1000, 0x1000, 0x0, 0x0, 0x0, ...) /usr/local/go/src/internal/poll/fd_unix.go:243 +0x230 net.(netFD).readMsg(0xc00077d380, 0xc0007ca7c0, 0x10, 0x10, 0xc000a2a020, 0x1000, 0x1000, 0x7efd36b66fff, 0xc00, 0x7efd369b8800, ...) /usr/local/go/src/net/fd_unix.go:214 +0x92 net.(UnixConn).readMsg(0xc0004624f8, 0xc0007ca7c0, 0x10, 0x10, 0xc000a2a020, 0x1000, 0x1000, 0xc0007ca654, 0xc0007ca650, 0xc000a29500, ...) /usr/local/go/src/net/unixsock_posix.go:115 +0x93 net.(UnixConn).ReadMsgUnix(0xc0004624f8, 0xc0007ca7c0, 0x10, 0x10, 0xc000a2a020, 0x1000, 0x1000, 0xc000a2a000, 0x1300, 0x1020, ...) /usr/local/go/src/net/unixsock.go:143 +0x9a github.com/docker/docker/vendor/github.com/godbus/dbus.(oobReader).Read(0xc000a2a000, 0xc0007ca7c0, 0x10, 0x10, 0xc000499c68, 0x55df698cc40a, 0x1300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/godbus/dbus/transport_unix.go:21 +0x8f io.ReadAtLeast(0x55df6c224d80, 0xc000a2a000, 0xc0007ca7c0, 0x10, 0x10, 0x10, 0x5, 0xc000499ce8, 0x55df698c4a97) /usr/local/go/src/io/io.go:310 +0x89 io.ReadFull(...) /usr/local/go/src/io/io.go:329 github.com/docker/docker/vendor/github.com/godbus/dbus.(unixTransport).ReadMessage(0xc000495500, 0xc0009c95c0, 0x55df0000000e, 0xc0001cf528) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/godbus/dbus/transport_unix.go:85 +0x11d github.com/docker/docker/vendor/github.com/godbus/dbus.(Conn).inWorker(0xc0008045a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/godbus/dbus/conn.go:251 +0x59 created by github.com/docker/docker/vendor/github.com/godbus/dbus.(Conn).Auth /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/godbus/dbus/auth.go:118 +0x623

goroutine 92 [chan receive, 4137 minutes]: github.com/docker/docker/vendor/github.com/godbus/dbus.(Conn).outWorker(0xc0008045a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/godbus/dbus/conn.go:388 +0x57 created by github.com/docker/docker/vendor/github.com/godbus/dbus.(Conn).Auth /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/godbus/dbus/auth.go:119 +0x648

goroutine 93 [chan receive, 4137 minutes]: github.com/docker/docker/vendor/github.com/docker/libnetwork/iptables.signalHandler() /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/iptables/firewalld.go:96 +0x56 created by github.com/docker/docker/vendor/github.com/docker/libnetwork/iptables.FirewalldInit /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/iptables/firewalld.go:53 +0x106

goroutine 102 [chan receive]: github.com/docker/docker/builder/builder-next/adapters/containerimage.newResolverCache.func1(0xc000478740, 0xc0003d6c80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/builder/builder-next/adapters/containerimage/pull.go:896 +0x4b created by github.com/docker/docker/builder/builder-next/adapters/containerimage.newResolverCache /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/builder/builder-next/adapters/containerimage/pull.go:894 +0x97

goroutine 178 [chan receive, 4137 minutes]: github.com/docker/docker/vendor/github.com/moby/buildkit/solver.(scheduler).loop.func2(0xc000180620) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/moby/buildkit/solver/scheduler.go:76 +0x3e created by github.com/docker/docker/vendor/github.com/moby/buildkit/solver.(scheduler).loop /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/moby/buildkit/solver/scheduler.go:75 +0x79

goroutine 103 [sync.Cond.Wait, 4137 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc0009d0dd0, 0x55df00000000) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc0009d0dc0) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/vendor/github.com/moby/buildkit/util/cond.(StatefulCond).Wait(0xc000a5ff80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/moby/buildkit/util/cond/cond.go:28 +0xb1 github.com/docker/docker/vendor/github.com/moby/buildkit/solver.(*scheduler).loop(0xc000180620) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/moby/buildkit/solver/scheduler.go:101 +0x18c created by github.com/docker/docker/vendor/github.com/moby/buildkit/solver.newScheduler /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/moby/buildkit/solver/scheduler.go:35 +0x1ad

goroutine 165 [select, 4137 minutes]: github.com/docker/docker/daemon.(Daemon).ProcessClusterNotifications(0xc00000c3c0, 0x55df6c282300, 0xc0003f8740, 0xc000995140) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/events.go:126 +0xe7 created by main.(DaemonCli).start /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/daemon.go:238 +0xb70

goroutine 166 [chan receive, 4135 minutes]: main.(DaemonCli).setupConfigReloadTrap.func1(0xc0001d11a0, 0xc000773530) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/daemon_unix.go:84 +0x57 created by main.(DaemonCli).setupConfigReloadTrap /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/daemon_unix.go:83 +0xb7

goroutine 167 [chan receive, 4137 minutes]: github.com/docker/docker/api/server.(Server).serveAPI(0xc000884180, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:95 +0x130 github.com/docker/docker/api/server.(Server).Wait(0xc000884180, 0xc0008f6c00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:205 +0x31 created by main.(*DaemonCli).start /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/daemon.go:246 +0xbd5

goroutine 369 [select]: github.com/docker/docker/vendor/github.com/docker/libnetwork/osl.removeUnusedPaths() /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/osl/namespace_linux.go:99 +0x2dd created by github.com/docker/docker/vendor/github.com/docker/libnetwork/osl.createBasePath /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/docker/libnetwork/osl/namespace_linux.go:84 +0xbd

goroutine 704810 [semacquire, 352 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc0005db000, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbc046, 0xc, 0x0, 0x1, 0xc001830138, 0xc00117c060) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbc046, 0xc, 0x0, 0xc000dbc036, 0x4, 0xc000878700, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc000bbc300, 0x55df6c273400, 0xc000ada000, 0xc000058500, 0xc000bbc1b0, 0xc000878701, 0xc0016e0160) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000bbc300, 0x55df6c273400, 0xc000ada000, 0xc000058500, 0xc000bbc1b0, 0x55df6c2823c0, 0xc000bbc300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000bbc2d0, 0x55df6c273400, 0xc000ada000, 0xc000058500, 0xc000bbc1b0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000bbc2d0, 0x55df6c273400, 0xc000ada000, 0xc000058500, 0xc000bbc1b0, 0x55df6c2823c0, 0xc000bbc2d0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000ada000, 0xc000058400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000ada000, 0xc000058400) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000ada000, 0xc0013e2000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000ada000, 0xc0013e2000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000ada000, 0xc0013e2000) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc0001ef540, 0x55df6c282300, 0xc001330280) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 234 [IO wait, 3962 minutes]: internal/poll.runtime_pollWait(0x7efd3c364478, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc000f34c98, 0x72, 0x1000, 0x1000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc000f34c80, 0xc001b02000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc000f34c80, 0xc001b02000, 0x1000, 0x1000, 0x0, 0x0, 0x55df6c098f20) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc001049858, 0xc001b02000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc001e0d100, 0xc001b02000, 0x1000, 0x1000, 0xc001b030c8, 0x55df6d38f054, 0x2) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).Read(0xc000a120c0, 0xc001b02000, 0x1000, 0x1000, 0xc001cd9c00, 0x55df6d38f054, 0x2) /usr/local/go/src/net/http/server.go:785 +0xf6 bufio.(Reader).fill(0xc0015d00c0) /usr/local/go/src/bufio/bufio.go:100 +0x105 bufio.(Reader).ReadSlice(0xc0015d00c0, 0x55df698f770a, 0xc000d49380, 0xc0014899a8, 0x55df698cbb82, 0xc0019a5600, 0x100) /usr/local/go/src/bufio/bufio.go:359 +0x3f bufio.(Reader).ReadLine(0xc0015d00c0, 0xc0014899b0, 0xc0009ce380, 0x7efd3c3d57f0, 0x0, 0xd, 0xc000f34c80) /usr/local/go/src/bufio/bufio.go:388 +0x36 net/textproto.(Reader).readLineSlice(0xc000a5eae0, 0xc0019a5600, 0x0, 0x0, 0xc001489d70, 0xc000f34c80) /usr/local/go/src/net/textproto/reader.go:57 +0x6e net/textproto.(Reader).ReadLine(...) /usr/local/go/src/net/textproto/reader.go:38 net/http.readRequest(0xc0015d00c0, 0x0, 0xc0019a5600, 0x0, 0x0) /usr/local/go/src/net/http/request.go:1012 +0x94 net/http.(conn).readRequest(0xc000c068c0, 0x55df6c282300, 0xc001cd9bc0, 0x0, 0x0, 0x0) /usr/local/go/src/net/http/server.go:965 +0x161 net/http.(conn).serve(0xc000c068c0, 0x55df6c282300, 0xc001cd9bc0) /usr/local/go/src/net/http/server.go:1817 +0x6d6 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705063 [semacquire, 331 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xf80000c001e0d700, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).Wait(0xc0009a1400, 0x55df6c2823c0, 0xc001a598f0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:182 +0x2cd github.com/docker/docker/daemon.(Daemon).ContainerWait(0xc00000c3c0, 0x55df6c2823c0, 0xc001a598f0, 0xc000daa9d7, 0xc, 0x0, 0xc0001021a0, 0x55df6b196281, 0xc000e315c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/wait.go:22 +0xa4 github.com/docker/docker/api/server/router/container.(containerRouter).postContainersWait(0xc0009d0ec0, 0x55df6c2823c0, 0xc001a598f0, 0x55df6c273400, 0xc000adb260, 0xc001449700, 0xc001a59830, 0xc0001b8001, 0xc000fc6580) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:341 +0x150 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001a598f0, 0x55df6c273400, 0xc000adb260, 0xc001449700, 0xc001a59830, 0x55df6c2823c0, 0xc001a598f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001a598c0, 0x55df6c273400, 0xc000adb260, 0xc001449700, 0xc001a59830, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001a598c0, 0x55df6c273400, 0xc000adb260, 0xc001449700, 0xc001a59830, 0x55df6c2823c0, 0xc001a598c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000adb260, 0xc001449600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bb6580, 0x55df6c273400, 0xc000adb260, 0xc001449600) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000adb260, 0xc001449400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000adb260, 0xc001449400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000adb260, 0xc001449400) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000ca7c20, 0x55df6c282300, 0xc0003f9dc0) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 605 [select, 4136 minutes]: io.(pipe).Read(0xc000db27d0, 0xc000e3e000, 0x8000, 0x8000, 0x55df6be8da00, 0xc0000b8a01, 0x0) /usr/local/go/src/io/pipe.go:50 +0xe9 io.(PipeReader).Read(0xc0015d2618, 0xc000e3e000, 0x8000, 0x8000, 0x0, 0x0, 0x55df6bdb9fe0) /usr/local/go/src/io/pipe.go:127 +0x4e io.copyBuffer(0x7efd3c2e1b98, 0xc0008f9f80, 0x55df6c226880, 0xc0015d2618, 0xc000e3e000, 0x8000, 0x8000, 0x0, 0x5, 0x0) /usr/local/go/src/io/io.go:402 +0x124 io.CopyBuffer(0x7efd3c2e1b98, 0xc0008f9f80, 0x55df6c226880, 0xc0015d2618, 0xc000e3e000, 0x8000, 0x8000, 0x4, 0xc000f66f40, 0x55df69902e71) /usr/local/go/src/io/io.go:375 +0x84 github.com/docker/docker/pkg/pools.Copy(0x7efd3c2e1b98, 0xc0008f9f80, 0x55df6c226880, 0xc0015d2618, 0xc0015d2618, 0xc000051400, 0xc000f66fc0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/pools/pools.go:81 +0xbe github.com/docker/docker/container/stream.(Config).CopyToPipe.func2(0xc00044dc20, 0x55df6c25a900, 0xc0015d2618) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:142 +0xad created by github.com/docker/docker/container/stream.(Config).CopyToPipe /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:141 +0xbb

goroutine 674706 [select, 1384 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).waitOnHeader(0xc0019a4700, 0xc00162a560, 0x1) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:312 +0xce github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).RecvCompress(...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:331 github.com/docker/docker/vendor/google.golang.org/grpc.(csAttempt).recvMsg(0xc000e4e600, 0x55df6c08cfe0, 0xc00094afa0, 0x0, 0xc0009ca320, 0x42) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:871 +0x755 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg.func1(0xc000e4e600, 0x42, 0x42) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:736 +0x48 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).withRetry(0xc001074900, 0xc000d6aaa8, 0xc000d6aa78, 0xc0009ca320, 0xc000cd43e0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:594 +0x9e github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg(0xc001074900, 0x55df6c08cfe0, 0xc00094afa0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:735 +0x105 github.com/docker/docker/vendor/google.golang.org/grpc.invoke(0x55df6c2823c0, 0xc00195f260, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc00195f1d0, 0x55df6c08cfe0, 0xc00094afa0, 0xc000878380, 0xc000881960, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/call.go:73 +0x13d github.com/docker/docker/vendor/github.com/containerd/containerd.namespaceInterceptor.unary(0x55df6b194fe4, 0x4, 0x55df6c282340, 0xc000052038, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc00195f1d0, 0x55df6c08cfe0, 0xc00094afa0, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/grpc.go:35 +0xf4 github.com/docker/docker/vendor/google.golang.org/grpc.(ClientConn).Invoke(0xc000878380, 0x55df6c282340, 0xc000052038, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc00195f1d0, 0x55df6c08cfe0, 0xc00094afa0, 0x0, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/call.go:35 +0x10b github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/tasks/v1.(tasksClient).Delete(0xc0001f20e0, 0x55df6c282340, 0xc000052038, 0xc00195f1d0, 0x0, 0x0, 0x0, 0xed900b868, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/tasks/v1/tasks.pb.go:1315 +0xd1 github.com/docker/docker/vendor/github.com/containerd/containerd.(task).Delete(0xc00195ef90, 0x55df6c282340, 0xc000052038, 0x0, 0x0, 0x0, 0x4, 0x55df6c2b3b80, 0xc00195ef90) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/task.go:312 +0x221 github.com/docker/docker/libcontainerd/remote.(client).DeleteTask(0xc0009eac00, 0x55df6c282340, 0xc000052038, 0xc0009f2f40, 0x40, 0x0, 0x55df6b200771, 0x2f, 0x55df6c138560, 0xc0008f8ba0, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:438 +0xd6 github.com/docker/docker/daemon.(Daemon).ProcessEvent(0xc00000c3c0, 0xc001046140, 0x40, 0x55df6b194db4, 0x4, 0xc001046140, 0x40, 0xc001046180, 0x40, 0x8900000eb8, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/monitor.go:53 +0x2bc github.com/docker/docker/libcontainerd/remote.(client).processEvent.func1() /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:634 +0x109 github.com/docker/docker/libcontainerd/queue.(Queue).Append.func1(0xc001046100, 0x0, 0xc001ef8120, 0xc0009aa3c0, 0xc0009eac40, 0xc001046140, 0x40) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/queue/queue.go:28 +0x3a created by github.com/docker/docker/libcontainerd/queue.(Queue).Append /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/queue/queue.go:24 +0x1cf

goroutine 603 [sync.Cond.Wait, 4136 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc000825b90, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc000825b80) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc000825b40, 0xc000e26000, 0x800, 0x4000, 0x0, 0x55df698f7700, 0xc000ab4d80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc000825bc0, 0x55df6b19857a, 0x6, 0x7efd3c34e6f8, 0xc000825b40) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 602 [sync.Cond.Wait, 4136 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc000825b10, 0x16) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc000825b00) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc000825ac0, 0xc000e22030, 0x800, 0x3fd0, 0xffffffffffffffff, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc000825bc0, 0x55df6b198580, 0x6, 0x7efd3c34e6f8, 0xc000825ac0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 755 [IO wait, 3961 minutes]: internal/poll.runtime_pollWait(0x7efd3c3642d8, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc000776f98, 0x72, 0x1000, 0x1000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc000776f80, 0xc0008ae000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc000776f80, 0xc0008ae000, 0x1000, 0x1000, 0x0, 0x0, 0x55df6c098f20) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc0001f20d8, 0xc0008ae000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc000bfcf20, 0xc0008ae000, 0x1000, 0x1000, 0xc0008af0c8, 0x55df6d38f054, 0x2) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).Read(0xc0007703f0, 0xc0008ae000, 0x1000, 0x1000, 0xc0009d0bc0, 0x55df6d38f054, 0x2) /usr/local/go/src/net/http/server.go:785 +0xf6 bufio.(Reader).fill(0xc0009ea420) /usr/local/go/src/bufio/bufio.go:100 +0x105 bufio.(Reader).ReadSlice(0xc0009ea420, 0x55df698f770a, 0xc000d2db00, 0xc000ae39a8, 0x55df698cbb82, 0xc0007b7b00, 0x100) /usr/local/go/src/bufio/bufio.go:359 +0x3f bufio.(Reader).ReadLine(0xc0009ea420, 0xc000ae39b0, 0xc0001b8000, 0x7efd3c3c0008, 0x0, 0x0, 0xc000776f80) /usr/local/go/src/bufio/bufio.go:388 +0x36 net/textproto.(Reader).readLineSlice(0xc000d3a690, 0xc0007b7b00, 0x0, 0x0, 0xc000ae3d70, 0xc000776f80) /usr/local/go/src/net/textproto/reader.go:57 +0x6e net/textproto.(Reader).ReadLine(...) /usr/local/go/src/net/textproto/reader.go:38 net/http.readRequest(0xc0009ea420, 0x0, 0xc0007b7b00, 0x0, 0x0) /usr/local/go/src/net/http/request.go:1012 +0x94 net/http.(conn).readRequest(0xc000c063c0, 0x55df6c282300, 0xc00095ce80, 0x0, 0x0, 0x0) /usr/local/go/src/net/http/server.go:965 +0x161 net/http.(conn).serve(0xc000c063c0, 0x55df6c282300, 0xc00095ce80) /usr/local/go/src/net/http/server.go:1817 +0x6d6 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704857 [semacquire, 333 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x7efd2c518800, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0001da136, 0xc, 0x0, 0x1, 0xc001ce6018, 0xc000478850) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0001da136, 0xc, 0x0, 0xc0001da126, 0x4, 0x10, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001b4eb70, 0x55df6c273400, 0xc000401960, 0xc000059000, 0xc001b4ea50, 0xc00091e301, 0xc000a5d1e0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4eb70, 0x55df6c273400, 0xc000401960, 0xc000059000, 0xc001b4ea50, 0x55df6c2823c0, 0xc001b4eb70) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4eb10, 0x55df6c273400, 0xc000401960, 0xc000059000, 0xc001b4ea50, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001b4eb10, 0x55df6c273400, 0xc000401960, 0xc000059000, 0xc001b4ea50, 0x55df6c2823c0, 0xc001b4eb10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000401960, 0xc000058f00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000401960, 0xc000058f00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000401960, 0xc000058c00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000401960, 0xc000058c00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000401960, 0xc000058c00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000cf4000, 0x55df6c282300, 0xc001574000) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 673677 [semacquire, 1384 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc001857600, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).GetPID(0xc0009a1400, 0xc000a7d2a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:248 +0x7b github.com/docker/docker/daemon.killProcessDirectly(0xc000113440, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/container_operations_unix.go:346 +0x14e github.com/docker/docker/daemon.(Daemon).Kill(0xc00000c3c0, 0xc000113440, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/kill.go:152 +0x19b github.com/docker/docker/daemon.(Daemon).cleanupContainer(0xc00000c3c0, 0xc000113440, 0x1, 0xc000113440, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:90 +0x387 github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc000f400d9, 0xc, 0xc000bc81c6, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:45 +0x181 github.com/docker/docker/api/server/router/container.(containerRouter).deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc0011ecae0, 0x55df6c273400, 0xc0004008c0, 0xc001794800, 0xc0011eca20, 0xc0001b8001, 0xc000b8e840) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:528 +0x17a github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0011ecae0, 0x55df6c273400, 0xc0004008c0, 0xc001794800, 0xc0011eca20, 0x55df6c2823c0, 0xc0011ecae0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0011ecab0, 0x55df6c273400, 0xc0004008c0, 0xc001794800, 0xc0011eca20, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc0011ecab0, 0x55df6c273400, 0xc0004008c0, 0xc001794800, 0xc0011eca20, 0x55df6c2823c0, 0xc0011ecab0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0004008c0, 0xc001794700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bfc1c0, 0x55df6c273400, 0xc0004008c0, 0xc001794700) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0004008c0, 0xc001794500) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0004008c0, 0xc001794500) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0004008c0, 0xc001794500) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000cf4640, 0x55df6c282300, 0xc0001d4280) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 99907 [IO wait, 3961 minutes]: internal/poll.runtime_pollWait(0x7efd2c496350, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc000f35d98, 0x72, 0x1000, 0x1000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc000f35d80, 0xc00138f000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc000f35d80, 0xc00138f000, 0x1000, 0x1000, 0x0, 0x1, 0x1) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc001b0abe0, 0xc00138f000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc00076de20, 0xc00138f000, 0x1000, 0x1000, 0xc0012c5998, 0x55df69c25742, 0x55df6d3701c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).Read(0xc0017db710, 0xc00138f000, 0x1000, 0x1000, 0x4, 0x0, 0x0) /usr/local/go/src/net/http/server.go:785 +0xf6 bufio.(Reader).fill(0xc0000def60) /usr/local/go/src/bufio/bufio.go:100 +0x105 bufio.(Reader).ReadSlice(0xc0000def60, 0x55df698f770a, 0xc000c92d80, 0xc0012c59a8, 0x55df698cbb82, 0xc001448400, 0x100) /usr/local/go/src/bufio/bufio.go:359 +0x3f bufio.(Reader).ReadLine(0xc0000def60, 0xc0012c59b0, 0xc00053b880, 0x7efd3c3c06d0, 0x0, 0x1, 0xc000f35d80) /usr/local/go/src/bufio/bufio.go:388 +0x36 net/textproto.(Reader).readLineSlice(0xc000a5e030, 0xc001448400, 0x0, 0x0, 0xc0012c5d70, 0xc000f35d80) /usr/local/go/src/net/textproto/reader.go:57 +0x6e net/textproto.(Reader).ReadLine(...) /usr/local/go/src/net/textproto/reader.go:38 net/http.readRequest(0xc0000def60, 0x0, 0xc001448400, 0x0, 0x0) /usr/local/go/src/net/http/request.go:1012 +0x94 net/http.(conn).readRequest(0xc000d56780, 0x55df6c282300, 0xc00095ca80, 0x0, 0x0, 0x0) /usr/local/go/src/net/http/server.go:965 +0x161 net/http.(conn).serve(0xc000d56780, 0x55df6c282300, 0xc00095ca80) /usr/local/go/src/net/http/server.go:1817 +0x6d6 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 100072 [sync.Cond.Wait, 3947 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc00124db50, 0x1b) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc00124db40) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc00124db00, 0xc000a9a000, 0x800, 0x4000, 0xffffffffffffffff, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc00124db80, 0x55df6b19857a, 0x6, 0x7efd3c34e6f8, 0xc00124db00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 703418 [semacquire, 1217 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x55df6ad04500, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).SetRemovalInProgress(0xc0009a1400, 0xc000830c00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:344 +0xbc github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc000830cd9, 0xc, 0xc001e12abc, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:30 +0xb9 github.com/docker/docker/api/server/router/container.(containerRouter).deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc001b4f320, 0x55df6c273400, 0xc0007b42a0, 0xc0007b6900, 0xc001b4f260, 0xc00091e301, 0xc001826f20) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:528 +0x17a github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4f320, 0x55df6c273400, 0xc0007b42a0, 0xc0007b6900, 0xc001b4f260, 0x55df6c2823c0, 0xc001b4f320) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4f2f0, 0x55df6c273400, 0xc0007b42a0, 0xc0007b6900, 0xc001b4f260, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001b4f2f0, 0x55df6c273400, 0xc0007b42a0, 0xc0007b6900, 0xc001b4f260, 0x55df6c2823c0, 0xc001b4f2f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0007b42a0, 0xc0007b6800) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bfc1c0, 0x55df6c273400, 0xc0007b42a0, 0xc0007b6800) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0007b42a0, 0xc0007b6600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0007b42a0, 0xc0007b6600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0007b42a0, 0xc0007b6600) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c06280, 0x55df6c282300, 0xc00124d000) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 100472 [sync.Cond.Wait, 3961 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc000f5c010, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc000f5c000) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc00124dfc0, 0xc001682000, 0x800, 0x4000, 0x0, 0x600, 0x600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc000f5c0c0, 0x55df6b198580, 0x6, 0x7efd3c34e6f8, 0xc00124dfc0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 704144 [semacquire, 1093 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x55df6ad04500, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).SetRemovalInProgress(0xc0009a1400, 0xc000f7a000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:344 +0xbc github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc000f7a059, 0xc, 0xc0006e0726, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:30 +0xb9 github.com/docker/docker/api/server/router/container.(containerRouter).deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc0018605a0, 0x55df6c273400, 0xc0013481c0, 0xc001794d00, 0xc0018604e0, 0xc000a02e01, 0xc000a5c840) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:528 +0x17a github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0018605a0, 0x55df6c273400, 0xc0013481c0, 0xc001794d00, 0xc0018604e0, 0x55df6c2823c0, 0xc0018605a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001860570, 0x55df6c273400, 0xc0013481c0, 0xc001794d00, 0xc0018604e0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001860570, 0x55df6c273400, 0xc0013481c0, 0xc001794d00, 0xc0018604e0, 0x55df6c2823c0, 0xc001860570) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0013481c0, 0xc001794b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bfc1c0, 0x55df6c273400, 0xc0013481c0, 0xc001794b00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0013481c0, 0xc001794900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0013481c0, 0xc001794900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0013481c0, 0xc001794900) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000422e60, 0x55df6c282300, 0xc0019b2080) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704436 [semacquire, 274 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x0, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc001540046, 0xc, 0x0, 0x1, 0xc000eb9e78, 0xc00122c070) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc001540046, 0xc, 0x0, 0xc001540036, 0x4, 0x55df698e11e5, 0xc001bd0150, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001bd0150, 0x55df6c273400, 0xc001468000, 0xc000778b00, 0xc001bd0090, 0x8, 0x9) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001bd0150, 0x55df6c273400, 0xc001468000, 0xc000778b00, 0xc001bd0090, 0x55df6c2823c0, 0xc001bd0150) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001bd0120, 0x55df6c273400, 0xc001468000, 0xc000778b00, 0xc001bd0090, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001bd0120, 0x55df6c273400, 0xc001468000, 0xc000778b00, 0xc001bd0090, 0x55df6c2823c0, 0xc001bd0120) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc001468000, 0xc000778a00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc001468000, 0xc000778a00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc001468000, 0xc0009f0000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc001468000, 0xc0009f0000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc001468000, 0xc0009f0000) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000b7e8c0, 0x55df6c282300, 0xc001cd8000) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 99407 [IO wait, 3961 minutes]: internal/poll.runtime_pollWait(0x7efd3c3643a8, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc001989b18, 0x72, 0x1000, 0x1000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc001989b00, 0xc001452000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc001989b00, 0xc001452000, 0x1000, 0x1000, 0x0, 0x17, 0x4) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc000010ad8, 0xc001452000, 0x1000, 0x1000, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc001afd180, 0xc001452000, 0x1000, 0x1000, 0xc001794b00, 0xc001738180, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).Read(0xc000b71320, 0xc001452000, 0x1000, 0x1000, 0x55df6b527bf8, 0x55df6b527c08, 0x55df6bf56301) /usr/local/go/src/net/http/server.go:785 +0xf6 bufio.(Reader).fill(0xc00139ae40) /usr/local/go/src/bufio/bufio.go:100 +0x105 bufio.(Reader).ReadSlice(0xc00139ae40, 0x55df698f770a, 0xc0019eef00, 0xc00125f9a8, 0x55df698cbb82, 0xc001794c00, 0x100) /usr/local/go/src/bufio/bufio.go:359 +0x3f bufio.(Reader).ReadLine(0xc00139ae40, 0xc00125f9b0, 0xc00053b880, 0x7efd3c3c1460, 0x0, 0x3, 0xc001989b00) /usr/local/go/src/bufio/bufio.go:388 +0x36 net/textproto.(Reader).readLineSlice(0xc001276390, 0xc001794c00, 0x0, 0x0, 0xc00125fd70, 0xc001989b00) /usr/local/go/src/net/textproto/reader.go:57 +0x6e net/textproto.(Reader).ReadLine(...) /usr/local/go/src/net/textproto/reader.go:38 net/http.readRequest(0xc00139ae40, 0x0, 0xc001794c00, 0x0, 0x0) /usr/local/go/src/net/http/request.go:1012 +0x94 net/http.(conn).readRequest(0xc000d565a0, 0x55df6c282300, 0xc001272f80, 0x0, 0x0, 0x0) /usr/local/go/src/net/http/server.go:965 +0x161 net/http.(conn).serve(0xc000d565a0, 0x55df6c282300, 0xc001272f80) /usr/local/go/src/net/http/server.go:1817 +0x6d6 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704926 [select, 337 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).waitOnHeader(0xc000059e00, 0xc00117c830, 0x1) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:312 +0xce github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).RecvCompress(...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:331 github.com/docker/docker/vendor/google.golang.org/grpc.(csAttempt).recvMsg(0xc000f35680, 0x55df6c08cfe0, 0xc0001e0b90, 0x0, 0xc0013ec1e0, 0x42) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:871 +0x755 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg.func1(0xc000f35680, 0x42, 0x42) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:736 +0x48 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).withRetry(0xc000449560, 0xc000ae2aa8, 0xc000ae2a78, 0xc0013ec1e0, 0xc000be2380) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:594 +0x9e github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg(0xc000449560, 0x55df6c08cfe0, 0xc0001e0b90, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:735 +0x105 github.com/docker/docker/vendor/google.golang.org/grpc.invoke(0x55df6c2823c0, 0xc001b4f800, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc001b4f770, 0x55df6c08cfe0, 0xc0001e0b90, 0xc000878380, 0xc000881960, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/call.go:73 +0x13d github.com/docker/docker/vendor/github.com/containerd/containerd.namespaceInterceptor.unary(0x55df6b194fe4, 0x4, 0x55df6c282340, 0xc000052038, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc001b4f770, 0x55df6c08cfe0, 0xc0001e0b90, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/grpc.go:35 +0xf4 github.com/docker/docker/vendor/google.golang.org/grpc.(ClientConn).Invoke(0xc000878380, 0x55df6c282340, 0xc000052038, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc001b4f770, 0x55df6c08cfe0, 0xc0001e0b90, 0x0, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/call.go:35 +0x10b github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/tasks/v1.(tasksClient).Delete(0xc00063c4b8, 0x55df6c282340, 0xc000052038, 0xc001b4f770, 0x0, 0x0, 0x0, 0xed901ae18, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/tasks/v1/tasks.pb.go:1315 +0xd1 github.com/docker/docker/vendor/github.com/containerd/containerd.(task).Delete(0xc0018a8720, 0x55df6c282340, 0xc000052038, 0x0, 0x0, 0x0, 0x4, 0x55df6c2b3b80, 0xc0018a8720) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/task.go:312 +0x221 github.com/docker/docker/libcontainerd/remote.(client).DeleteTask(0xc0009eac00, 0x55df6c282340, 0xc000052038, 0xc001b651c0, 0x40, 0x0, 0xc00077d900, 0xc000a62f27, 0x24f3, 0x272e, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:438 +0xd6 github.com/docker/docker/daemon.(Daemon).ProcessEvent(0xc00000c3c0, 0xc000a36740, 0x40, 0x55df6b194db4, 0x4, 0xc000a36740, 0x40, 0xc000a36780, 0x40, 0xf58, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/monitor.go:53 +0x2bc github.com/docker/docker/libcontainerd/remote.(client).processEvent.func1() /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:634 +0x109 github.com/docker/docker/libcontainerd/queue.(Queue).Append.func1(0xc000a36700, 0x0, 0xc001688120, 0xc0003ef740, 0xc0009eac40, 0xc000a36740, 0x40) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/queue/queue.go:28 +0x3a created by github.com/docker/docker/libcontainerd/queue.(Queue).Append /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/queue/queue.go:24 +0x1cf

goroutine 705623 [semacquire, 31 minutes]: sync.runtime_SemacquireMutex(0xc000776804, 0xc0016f8200, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000776800) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).GetPID(0xc000776800, 0xc000adf2a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:248 +0x7b github.com/docker/docker/daemon.killProcessDirectly(0xc000afa240, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/container_operations_unix.go:346 +0x14e github.com/docker/docker/daemon.(Daemon).Kill(0xc00000c3c0, 0xc000afa240, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/kill.go:152 +0x19b github.com/docker/docker/daemon.(Daemon).cleanupContainer(0xc00000c3c0, 0xc000afa240, 0x1, 0xc000afa240, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:90 +0x387 github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc0001d8119, 0xc, 0xc0006e07d6, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:45 +0x181 github.com/docker/docker/api/server/router/container.(containerRouter).deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc001dfad80, 0x55df6c273400, 0xc00083c1c0, 0xc000f42200, 0xc001dfac60, 0xc00053b801, 0xc0003daf20) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:528 +0x17a github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfad80, 0x55df6c273400, 0xc00083c1c0, 0xc000f42200, 0xc001dfac60, 0x55df6c2823c0, 0xc001dfad80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfad50, 0x55df6c273400, 0xc00083c1c0, 0xc000f42200, 0xc001dfac60, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001dfad50, 0x55df6c273400, 0xc00083c1c0, 0xc000f42200, 0xc001dfac60, 0x55df6c2823c0, 0xc001dfad50) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc00083c1c0, 0xc000f42100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bfc1c0, 0x55df6c273400, 0xc00083c1c0, 0xc000f42100) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc00083c1c0, 0xc0009f1300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc00083c1c0, 0xc0009f1300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc00083c1c0, 0xc0009f1300) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c1e1e0, 0x55df6c282300, 0xc00124cb80) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704807 [semacquire, 352 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x55df699bda00, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024ee196, 0xc, 0x0, 0x1, 0xc000eb85b8, 0xc0004782a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024ee196, 0xc, 0x0, 0xc0024ee186, 0x4, 0xc000878700, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001dfa6c0, 0x55df6c273400, 0xc000400620, 0xc0012f0700, 0xc001dfa600, 0xc000878701, 0xc00149a580) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfa6c0, 0x55df6c273400, 0xc000400620, 0xc0012f0700, 0xc001dfa600, 0x55df6c2823c0, 0xc001dfa6c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfa690, 0x55df6c273400, 0xc000400620, 0xc0012f0700, 0xc001dfa600, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001dfa690, 0x55df6c273400, 0xc000400620, 0xc0012f0700, 0xc001dfa600, 0x55df6c2823c0, 0xc001dfa690) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000400620, 0xc0012f0600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000400620, 0xc0012f0600) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000400620, 0xc0012f0400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000400620, 0xc0012f0400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000400620, 0xc0012f0400) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc0001ef0e0, 0x55df6c282300, 0xc001330000) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705715 [IO wait]: internal/poll.runtime_pollWait(0x7efd3c3546e0, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc001a68418, 0x72, 0x0, 0x1, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc001a68400, 0xc0016f60a1, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc001a68400, 0xc0016f60a1, 0x1, 0x1, 0x3, 0x8, 0x2) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc001b0e008, 0xc0016f60a1, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc000d24080, 0xc0016f60a1, 0x1, 0x1, 0x1, 0x55df698f73a8, 0x55df6c1e2200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).backgroundRead(0xc0016f6090) /usr/local/go/src/net/http/server.go:677 +0x5a created by net/http.(connReader).startBackgroundRead /usr/local/go/src/net/http/server.go:673 +0xd6

goroutine 100071 [sync.Cond.Wait, 3962 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc00124dad0, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc00124dac0) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc00124da80, 0xc000aa2000, 0x800, 0x4000, 0x0, 0x55df698f7700, 0xc0019ef800) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc00124db80, 0x55df6b198580, 0x6, 0x7efd3c34e6f8, 0xc00124da80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 704401 [semacquire, 329 minutes]: sync.runtime_SemacquireMutex(0xc000e4ea84, 0x260000c00000e500, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000e4ea80) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).Wait(0xc000e4ea80, 0x55df6c2823c0, 0xc000fc8630, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:182 +0x2cd github.com/docker/docker/daemon.(Daemon).ContainerWait(0xc00000c3c0, 0x55df6c2823c0, 0xc000fc8630, 0xc000a36017, 0xc, 0x0, 0xc001718002, 0x29, 0xc0016105c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/wait.go:22 +0xa4 github.com/docker/docker/api/server/router/container.(containerRouter).postContainersWait(0xc0009d0ec0, 0x55df6c2823c0, 0xc000fc8630, 0x55df6c273400, 0xc0014680e0, 0xc001062700, 0xc000fc8510, 0x26, 0x27) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:341 +0x150 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000fc8630, 0x55df6c273400, 0xc0014680e0, 0xc001062700, 0xc000fc8510, 0x55df6c2823c0, 0xc000fc8630) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000fc8600, 0x55df6c273400, 0xc0014680e0, 0xc001062700, 0xc000fc8510, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000fc8600, 0x55df6c273400, 0xc0014680e0, 0xc001062700, 0xc000fc8510, 0x55df6c2823c0, 0xc000fc8600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0014680e0, 0xc001062600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bb6580, 0x55df6c273400, 0xc0014680e0, 0xc001062600) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0014680e0, 0xc001062400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0014680e0, 0xc001062400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0014680e0, 0xc001062400) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000bf4320, 0x55df6c282300, 0xc000fcc000) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 95961 [sync.Cond.Wait, 3962 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc00124c810, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc00124c800) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc00124c7c0, 0xc0012a0000, 0x800, 0x4000, 0x0, 0x55df698f7700, 0xc000d2c600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc00124c840, 0x55df6b19857a, 0x6, 0x7efd3c34e6f8, 0xc00124c7c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 704948 [semacquire, 337 minutes]: sync.runtime_Semacquire(0xc0016f75a0) /usr/local/go/src/runtime/sema.go:56 +0x44 sync.(WaitGroup).Wait(0xc0016f7598) /usr/local/go/src/sync/waitgroup.go:130 +0x66 github.com/docker/docker/vendor/golang.org/x/sync/errgroup.(Group).Wait(0xc0016f7590, 0x55df6c1e2200, 0xc000db2320) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/sync/errgroup/errgroup.go:40 +0x33 github.com/docker/docker/container/stream.(Config).CopyStreams.func5.1(0xc000bd46c0, 0xc0016f7590) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/attach.go:138 +0x2d created by github.com/docker/docker/container/stream.(Config).CopyStreams.func5 /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/attach.go:137 +0xee

goroutine 704604 [IO wait, 337 minutes]: internal/poll.runtime_pollWait(0x7efd3c3646e8, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc000f34b98, 0x72, 0x0, 0x1, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc000f34b80, 0xc001b4e311, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc000f34b80, 0xc001b4e311, 0x1, 0x1, 0xc000953eb0, 0xc000949320, 0x18) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc00063c038, 0xc001b4e311, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc0007f09e0, 0xc001b4e311, 0x1, 0x1, 0xc0009e5328, 0x55df6c1e2200, 0xc000ecab90) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).backgroundRead(0xc001b4e300) /usr/local/go/src/net/http/server.go:677 +0x5a created by net/http.(connReader).startBackgroundRead /usr/local/go/src/net/http/server.go:673 +0xd6

goroutine 99687 [IO wait, 3962 minutes]: internal/poll.runtime_pollWait(0x7efd2c496900, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc001467b78, 0x72, 0x8001, 0x8000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc001467b60, 0xc000a38000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 os.(File).read(...) /usr/local/go/src/os/file_unix.go:259 os.(File).Read(0xc00063da50, 0xc000a38000, 0x8000, 0x8000, 0x55df698c8800, 0xc00003c000, 0x55df6be67a00) /usr/local/go/src/os/file.go:116 +0x73 github.com/docker/docker/vendor/github.com/containerd/fifo.(fifo).Read(0xc000ac4f60, 0xc000a38000, 0x8000, 0x8000, 0x0, 0xc0016ffe00, 0x55df6993ce79) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/fifo/fifo.go:159 +0x276 io.copyBuffer(0x55df6c223b20, 0xc001564f40, 0x7efd3c294100, 0xc000ac4f60, 0xc000a38000, 0x8000, 0x8000, 0x55df6bcf9940, 0x4, 0xc001ed8580) /usr/local/go/src/io/io.go:402 +0x124 io.CopyBuffer(0x55df6c223b20, 0xc001564f40, 0x7efd3c294100, 0xc000ac4f60, 0xc000a38000, 0x8000, 0x8000, 0x4, 0xc0019fdf40, 0x55df69902e71) /usr/local/go/src/io/io.go:375 +0x84 github.com/docker/docker/pkg/pools.Copy(0x55df6c223b20, 0xc001564f40, 0x7efd3c294100, 0xc000ac4f60, 0xc000ac4f60, 0xc000050500, 0x7efd3c36f090) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/pools/pools.go:81 +0xbe github.com/docker/docker/container/stream.(Config).CopyToPipe.func1.1(0x55df6c223b20, 0xc001564f40, 0x7efd3c34e690, 0xc000ac4f60, 0xc001edcaa0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:124 +0x73 created by github.com/docker/docker/container/stream.(Config).CopyToPipe.func1 /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:123 +0x86

goroutine 705227 [semacquire, 312 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc000bc4600, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbc0a6, 0xc, 0x0, 0x1, 0xc001830498, 0xc000479390) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbc0a6, 0xc, 0x0, 0xc000dbc096, 0x4, 0xc000a02e00, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc000bbcf90, 0x55df6c273400, 0xc000401ce0, 0xc0009f0e00, 0xc000bbce40, 0xc000a02e01, 0xc0003dadc0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000bbcf90, 0x55df6c273400, 0xc000401ce0, 0xc0009f0e00, 0xc000bbce40, 0x55df6c2823c0, 0xc000bbcf90) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000bbcf00, 0x55df6c273400, 0xc000401ce0, 0xc0009f0e00, 0xc000bbce40, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000bbcf00, 0x55df6c273400, 0xc000401ce0, 0xc0009f0e00, 0xc000bbce40, 0x55df6c2823c0, 0xc000bbcf00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000401ce0, 0xc0009f0d00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000401ce0, 0xc0009f0d00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000401ce0, 0xc0009f0b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000401ce0, 0xc0009f0b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000401ce0, 0xc0009f0b00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000b74aa0, 0x55df6c282300, 0xc00095c580) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705203 [semacquire, 318 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc000b7e900, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000057936, 0xc, 0x0, 0x1, 0xc0013c4138, 0xc00122d380) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000057936, 0xc, 0x0, 0xc000057926, 0x4, 0xc0001b8000, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001cf2930, 0x55df6c273400, 0xc001ee90a0, 0xc001794b00, 0xc001cf2870, 0xc0001b8001, 0xc00173fce0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001cf2930, 0x55df6c273400, 0xc001ee90a0, 0xc001794b00, 0xc001cf2870, 0x55df6c2823c0, 0xc001cf2930) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001cf2900, 0x55df6c273400, 0xc001ee90a0, 0xc001794b00, 0xc001cf2870, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001cf2900, 0x55df6c273400, 0xc001ee90a0, 0xc001794b00, 0xc001cf2870, 0x55df6c2823c0, 0xc001cf2900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc001ee90a0, 0xc001794a00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc001ee90a0, 0xc001794a00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc001ee90a0, 0xc0013e2800) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc001ee90a0, 0xc0013e2800) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc001ee90a0, 0xc0013e2800) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000d40dc0, 0x55df6c282300, 0xc0019b38c0) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705185 [semacquire, 306 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc000bc5c00, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbc106, 0xc, 0x0, 0x1, 0xc001831578, 0xc000fbe2d0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbc106, 0xc, 0x0, 0xc000dbc0f6, 0x4, 0xc000a02e00, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001dfaff0, 0x55df6c273400, 0xc00083c2a0, 0xc001448a00, 0xc001dfaf30, 0xc000a02e01, 0xc0003db4a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfaff0, 0x55df6c273400, 0xc00083c2a0, 0xc001448a00, 0xc001dfaf30, 0x55df6c2823c0, 0xc001dfaff0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfafc0, 0x55df6c273400, 0xc00083c2a0, 0xc001448a00, 0xc001dfaf30, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001dfafc0, 0x55df6c273400, 0xc00083c2a0, 0xc001448a00, 0xc001dfaf30, 0x55df6c2823c0, 0xc001dfafc0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc00083c2a0, 0xc001448900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc00083c2a0, 0xc001448900) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc00083c2a0, 0xc001448700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc00083c2a0, 0xc001448700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc00083c2a0, 0xc001448700) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000b74fa0, 0x55df6c282300, 0xc000f5c180) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 676581 [semacquire, 1378 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x0, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0010d27f6, 0xc, 0x0, 0x1, 0xc001833d58, 0xc001ed6790) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0010d27f6, 0xc, 0x0, 0xc0010d27e6, 0x4, 0xc00091f500, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc0011aacc0, 0x55df6c273400, 0xc0014689a0, 0xc0013e3000, 0xc0011aac00, 0xc00091f501, 0xc00132c000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0011aacc0, 0x55df6c273400, 0xc0014689a0, 0xc0013e3000, 0xc0011aac00, 0x55df6c2823c0, 0xc0011aacc0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0011aac90, 0x55df6c273400, 0xc0014689a0, 0xc0013e3000, 0xc0011aac00, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc0011aac90, 0x55df6c273400, 0xc0014689a0, 0xc0013e3000, 0xc0011aac00, 0x55df6c2823c0, 0xc0011aac90) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0014689a0, 0xc0013e2f00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc0014689a0, 0xc0013e2f00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0014689a0, 0xc0012f1b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0014689a0, 0xc0012f1b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0014689a0, 0xc0012f1b00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000423ea0, 0x55df6c282300, 0xc0019b2b40) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 676626 [semacquire, 1378 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x0, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc00107c136, 0xc, 0x0, 0x1, 0xc001831458, 0xc00162ad00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc00107c136, 0xc, 0x0, 0xc00107c126, 0x4, 0xc00091f500, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc00176e0f0, 0x55df6c273400, 0xc0013488c0, 0xc0012a9d00, 0xc00176e000, 0xc00091f501, 0xc00149a9a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc00176e0f0, 0x55df6c273400, 0xc0013488c0, 0xc0012a9d00, 0xc00176e000, 0x55df6c2823c0, 0xc00176e0f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc00176e0c0, 0x55df6c273400, 0xc0013488c0, 0xc0012a9d00, 0xc00176e000, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc00176e0c0, 0x55df6c273400, 0xc0013488c0, 0xc0012a9d00, 0xc00176e000, 0x55df6c2823c0, 0xc00176e0c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0013488c0, 0xc0012a9c00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc0013488c0, 0xc0012a9c00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0013488c0, 0xc0012a9a00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0013488c0, 0xc0012a9a00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0013488c0, 0xc0012a9a00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c5b680, 0x55df6c282300, 0xc000d50400) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705632 [semacquire, 29 minutes]: sync.runtime_SemacquireMutex(0xc000776804, 0xc000a75300, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000776800) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0000567c6, 0xc, 0x0, 0x1, 0xc0004487f8, 0xc001b3a450) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0000567c6, 0xc, 0x0, 0xc0000567b6, 0x4, 0xc000989880, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001dfb5f0, 0x55df6c273400, 0xc0007b4460, 0xc000f42900, 0xc001dfb530, 0xc000989801, 0xc001826420) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfb5f0, 0x55df6c273400, 0xc0007b4460, 0xc000f42900, 0xc001dfb530, 0x55df6c2823c0, 0xc001dfb5f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfb5c0, 0x55df6c273400, 0xc0007b4460, 0xc000f42900, 0xc001dfb530, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001dfb5c0, 0x55df6c273400, 0xc0007b4460, 0xc000f42900, 0xc001dfb530, 0x55df6c2823c0, 0xc001dfb5c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0007b4460, 0xc000f42800) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc0007b4460, 0xc000f42800) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0007b4460, 0xc0019a4200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0007b4460, 0xc0019a4200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0007b4460, 0xc0019a4200) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000bf4640, 0x55df6c282300, 0xc00124cc40) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704946 [sync.Cond.Wait, 337 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc001c37390, 0x55df00000001) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc001c37380) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc001c37340, 0xc000a6a000, 0x8000, 0x8000, 0x25, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b io.copyBuffer(0x55df6c223c40, 0xc000d25b40, 0x7efd3c34e6f8, 0xc001c37340, 0xc000a6a000, 0x8000, 0x8000, 0x0, 0x2, 0x0) /usr/local/go/src/io/io.go:402 +0x124 io.CopyBuffer(0x55df6c223c40, 0xc000d25b40, 0x7efd3c34e6f8, 0xc001c37340, 0xc000a6a000, 0x8000, 0x8000, 0xc0004beda0, 0x55df6997bed0, 0x55df6997970c) /usr/local/go/src/io/io.go:375 +0x84 github.com/docker/docker/pkg/pools.Copy(0x55df6c223c40, 0xc000d25b40, 0x7efd3c34e6f8, 0xc001c37340, 0xc001c37340, 0x1, 0x1) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/pools/pools.go:81 +0xbe github.com/docker/docker/container/stream.(Config).CopyStreams.func2(0x55df6b19857a, 0x6, 0x55df6c223c40, 0xc000d25b40, 0x55df6c2568c0, 0xc001c37340, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/attach.go:111 +0x24d github.com/docker/docker/container/stream.(Config).CopyStreams.func4(0xc0004bef68, 0x55df698c42b5) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/attach.go:129 +0x67 github.com/docker/docker/vendor/golang.org/x/sync/errgroup.(Group).Go.func1(0xc0016f7590, 0xc000d25bc0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x66 created by github.com/docker/docker/vendor/golang.org/x/sync/errgroup.(Group).Go /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x68

goroutine 704947 [select, 337 minutes]: github.com/docker/docker/container/stream.(Config).CopyStreams.func5(0xc0016f7590, 0x55df6c282300, 0xc001c37400, 0xc001ef83f0, 0xc000bd4660) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/attach.go:140 +0x19d created by github.com/docker/docker/container/stream.(Config).CopyStreams /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/attach.go:134 +0x101

goroutine 705615 [select, 27 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).waitOnHeader(0xc000f43200, 0xc00117caa0, 0x1) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:312 +0xce github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).RecvCompress(...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:331 github.com/docker/docker/vendor/google.golang.org/grpc.(csAttempt).recvMsg(0xc0009a1300, 0x55df6c08cfe0, 0xc001edcb40, 0x0, 0xc0013ec7d0, 0x42) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:871 +0x755 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg.func1(0xc0009a1300, 0x42, 0x42) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:736 +0x48 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).withRetry(0xc001c52b40, 0xc000aceaa8, 0xc000acea78, 0xc0013ec7d0, 0xc000c6c7d0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:594 +0x9e github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg(0xc001c52b40, 0x55df6c08cfe0, 0xc001edcb40, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:735 +0x105 github.com/docker/docker/vendor/google.golang.org/grpc.invoke(0x55df6c2823c0, 0xc001a58810, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc001a58780, 0x55df6c08cfe0, 0xc001edcb40, 0xc000878380, 0xc000881960, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/call.go:73 +0x13d github.com/docker/docker/vendor/github.com/containerd/containerd.namespaceInterceptor.unary(0x55df6b194fe4, 0x4, 0x55df6c282340, 0xc000052038, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc001a58780, 0x55df6c08cfe0, 0xc001edcb40, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/grpc.go:35 +0xf4 github.com/docker/docker/vendor/google.golang.org/grpc.(ClientConn).Invoke(0xc000878380, 0x55df6c282340, 0xc000052038, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc001a58780, 0x55df6c08cfe0, 0xc001edcb40, 0x0, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/call.go:35 +0x10b github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/tasks/v1.(tasksClient).Delete(0xc001b0a0a8, 0x55df6c282340, 0xc000052038, 0xc001a58780, 0x0, 0x0, 0x0, 0xed901f6b0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/tasks/v1/tasks.pb.go:1315 +0xd1 github.com/docker/docker/vendor/github.com/containerd/containerd.(task).Delete(0xc001a584b0, 0x55df6c282340, 0xc000052038, 0x0, 0x0, 0x0, 0x4, 0x55df6c2b3b80, 0xc001a584b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/task.go:312 +0x221 github.com/docker/docker/libcontainerd/remote.(client).DeleteTask(0xc0009eac00, 0x55df6c282340, 0xc000052038, 0xc0001d8180, 0x40, 0x0, 0x0, 0x0, 0x0, 0x0, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:438 +0xd6 github.com/docker/docker/daemon.(Daemon).ProcessEvent(0xc00000c3c0, 0xc000830b40, 0x40, 0x55df6b194db4, 0x4, 0xc000830b40, 0x40, 0xc000830b80, 0x40, 0x8900000f81, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/monitor.go:53 +0x2bc github.com/docker/docker/libcontainerd/remote.(client).processEvent.func1() /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:634 +0x109 github.com/docker/docker/libcontainerd/queue.(Queue).Append.func1(0xc000830b00, 0x0, 0xc0009486c0, 0xc001076660, 0xc0009eac40, 0xc000830b40, 0x40) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/queue/queue.go:28 +0x3a created by github.com/docker/docker/libcontainerd/queue.(Queue).Append /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/queue/queue.go:24 +0x1cf

goroutine 99686 [sync.Cond.Wait, 3962 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc001af7990, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc001af7980) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc001af7940, 0xc001070000, 0x800, 0x4000, 0x0, 0xc001a1bb00, 0x72) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc001af79c0, 0x55df6b19857a, 0x6, 0x7efd3c34e6f8, 0xc001af7940) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 99441 [IO wait, 3962 minutes]: internal/poll.runtime_pollWait(0x7efd3c354af0, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc0015d0258, 0x72, 0x8001, 0x8000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc0015d0240, 0xc001ddc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 os.(File).read(...) /usr/local/go/src/os/file_unix.go:259 os.(File).Read(0xc0001f2040, 0xc001ddc000, 0x8000, 0x8000, 0x55df698c8800, 0xc00003c000, 0x55df6be67a00) /usr/local/go/src/os/file.go:116 +0x73 github.com/docker/docker/vendor/github.com/containerd/fifo.(fifo).Read(0xc00139bc20, 0xc001ddc000, 0x8000, 0x8000, 0x0, 0xc001755e00, 0x55df6993cf6d) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/fifo/fifo.go:159 +0x276 io.copyBuffer(0x55df6c223b20, 0xc000881f00, 0x7efd3c294100, 0xc00139bc20, 0xc001ddc000, 0x8000, 0x8000, 0x55df6bcf9940, 0x1, 0xc0008811e0) /usr/local/go/src/io/io.go:402 +0x124 io.CopyBuffer(0x55df6c223b20, 0xc000881f00, 0x7efd3c294100, 0xc00139bc20, 0xc001ddc000, 0x8000, 0x8000, 0x4, 0xc001755f40, 0x55df69902e71) /usr/local/go/src/io/io.go:375 +0x84 github.com/docker/docker/pkg/pools.Copy(0x55df6c223b20, 0xc000881f00, 0x7efd3c294100, 0xc00139bc20, 0xc00139bc20, 0xc001edd4a0, 0x7efd3c36f090) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/pools/pools.go:81 +0xbe github.com/docker/docker/container/stream.(Config).CopyToPipe.func1.1(0x55df6c223b20, 0xc000881f00, 0x7efd3c34e690, 0xc00139bc20, 0xc000e5ee10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:124 +0x73 created by github.com/docker/docker/container/stream.(Config).CopyToPipe.func1 /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:123 +0x86

goroutine 705217 [semacquire, 306 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc0017e7e00, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc001540016, 0xc, 0x0, 0x1, 0xc0009ec258, 0xc000479320) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc001540016, 0xc, 0x0, 0xc001540006, 0x4, 0x7efd3c334f08, 0x3f, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc000bbcbd0, 0x55df6c273400, 0xc000401b20, 0xc000059600, 0xc000bbca80, 0xc000a02e01, 0xc00173e9a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000bbcbd0, 0x55df6c273400, 0xc000401b20, 0xc000059600, 0xc000bbca80, 0x55df6c2823c0, 0xc000bbcbd0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000bbcb40, 0x55df6c273400, 0xc000401b20, 0xc000059600, 0xc000bbca80, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000bbcb40, 0x55df6c273400, 0xc000401b20, 0xc000059600, 0xc000bbca80, 0x55df6c2823c0, 0xc000bbcb40) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000401b20, 0xc000059100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000401b20, 0xc000059100) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000401b20, 0xc001448b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000401b20, 0xc001448b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000401b20, 0xc001448b00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000b7e460, 0x55df6c282300, 0xc00095c200) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704924 [semacquire, 337 minutes]: sync.runtime_SemacquireMutex(0xc000e4ea84, 0xc000a81100, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000e4ea80) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).killWithSignal(0xc00000c3c0, 0xc000fac6c0, 0x2, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/kill.go:64 +0xa2a github.com/docker/docker/daemon.(Daemon).ContainerKill(0xc00000c3c0, 0xc000f7a157, 0xc, 0x2, 0x0, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/kill.go:54 +0xd1 github.com/docker/docker/api/server/router/container.(containerRouter).postContainersKill(0xc0009d0ec0, 0x55df6c2823c0, 0xc000b8b650, 0x55df6c273400, 0xc0007b4000, 0xc0012a8400, 0xc000b8b3e0, 0xc00091e301, 0xc000851080) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:249 +0xec github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000b8b650, 0x55df6c273400, 0xc0007b4000, 0xc0012a8400, 0xc000b8b3e0, 0x55df6c2823c0, 0xc000b8b650) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000b8b5f0, 0x55df6c273400, 0xc0007b4000, 0xc0012a8400, 0xc000b8b3e0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000b8b5f0, 0x55df6c273400, 0xc0007b4000, 0xc0012a8400, 0xc000b8b3e0, 0x55df6c2823c0, 0xc000b8b5f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0007b4000, 0xc0012a8300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b79680, 0x55df6c273400, 0xc0007b4000, 0xc0012a8300) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0007b4000, 0xc0012a8100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0007b4000, 0xc0012a8100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0007b4000, 0xc0012a8100) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c3bf40, 0x55df6c282300, 0xc001c36f00) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 99439 [sync.Cond.Wait, 3962 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc001331510, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc001331500) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc0013314c0, 0xc001106000, 0x800, 0x4000, 0x0, 0x600, 0x600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc001331540, 0x55df6b19857a, 0x6, 0x7efd3c34e6f8, 0xc0013314c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 705635 [select, 31 minutes]: github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).waitOnHeader(0xc0009f1600, 0xc001cfe6f0, 0x1) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:312 +0xce github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport.(Stream).RecvCompress(...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/internal/transport/transport.go:331 github.com/docker/docker/vendor/google.golang.org/grpc.(csAttempt).recvMsg(0xc00170b080, 0x55df6c08cfe0, 0xc001b3e730, 0x0, 0xc001876140, 0x42) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:871 +0x755 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg.func1(0xc00170b080, 0x42, 0x42) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:736 +0x48 github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).withRetry(0xc000449200, 0xc000b2caa8, 0xc000b2ca78, 0xc001876140, 0xc000c6c240) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:594 +0x9e github.com/docker/docker/vendor/google.golang.org/grpc.(clientStream).RecvMsg(0xc000449200, 0x55df6c08cfe0, 0xc001b3e730, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/stream.go:735 +0x105 github.com/docker/docker/vendor/google.golang.org/grpc.invoke(0x55df6c2823c0, 0xc000f85320, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc000f85290, 0x55df6c08cfe0, 0xc001b3e730, 0xc000878380, 0xc000881960, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/call.go:73 +0x13d github.com/docker/docker/vendor/github.com/containerd/containerd.namespaceInterceptor.unary(0x55df6b194fe4, 0x4, 0x55df6c282340, 0xc000052038, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc000f85290, 0x55df6c08cfe0, 0xc001b3e730, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/grpc.go:35 +0xf4 github.com/docker/docker/vendor/google.golang.org/grpc.(ClientConn).Invoke(0xc000878380, 0x55df6c282340, 0xc000052038, 0x55df6b1efa2e, 0x2a, 0x55df6c089b00, 0xc000f85290, 0x55df6c08cfe0, 0xc001b3e730, 0x0, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/google.golang.org/grpc/call.go:35 +0x10b github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/tasks/v1.(tasksClient).Delete(0xc001b0e070, 0x55df6c282340, 0xc000052038, 0xc000f85290, 0x0, 0x0, 0x0, 0xed901f5dd, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/api/services/tasks/v1/tasks.pb.go:1315 +0xd1 github.com/docker/docker/vendor/github.com/containerd/containerd.(task).Delete(0xc000bbc810, 0x55df6c282340, 0xc000052038, 0x0, 0x0, 0x0, 0x4, 0x55df6c2b3b80, 0xc000bbc810) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/containerd/task.go:312 +0x221 github.com/docker/docker/libcontainerd/remote.(client).DeleteTask(0xc0009eac00, 0x55df6c282340, 0xc000052038, 0xc000831e40, 0x40, 0x0, 0x0, 0x0, 0x55df698cb6d6, 0xc000a41020, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:438 +0xd6 github.com/docker/docker/daemon.(Daemon).ProcessEvent(0xc00000c3c0, 0xc000830640, 0x40, 0x55df6b194db4, 0x4, 0xc000830640, 0x40, 0xc000830680, 0x40, 0x8900005fd2, ...) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/monitor.go:53 +0x2bc github.com/docker/docker/libcontainerd/remote.(client).processEvent.func1() /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/remote/client.go:634 +0x109 github.com/docker/docker/libcontainerd/queue.(Queue).Append.func1(0xc000830600, 0x0, 0xc00044c630, 0xc0003eeb40, 0xc0009eac40, 0xc000830640, 0x40) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/queue/queue.go:28 +0x3a created by github.com/docker/docker/libcontainerd/queue.(Queue).Append /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/libcontainerd/queue/queue.go:24 +0x1cf

goroutine 99438 [sync.Cond.Wait, 3962 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc001331490, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc001331480) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc001331440, 0xc00114a000, 0x800, 0x4000, 0x0, 0x55df698f7700, 0xc0010c1c80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc001331540, 0x55df6b198580, 0x6, 0x7efd3c34e6f8, 0xc001331440) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 704922 [chan receive, 337 minutes]: github.com/docker/docker/api/server/router/container.(containerRouter).postContainersWait(0xc0009d0ec0, 0x55df6c2823c0, 0xc0016f6a50, 0x55df6c273400, 0xc000401dc0, 0xc0013e2a00, 0xc0016f6990, 0xc000988e01, 0xc0018271e0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:357 +0x29c github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0016f6a50, 0x55df6c273400, 0xc000401dc0, 0xc0013e2a00, 0xc0016f6990, 0x55df6c2823c0, 0xc0016f6a50) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0016f6a20, 0x55df6c273400, 0xc000401dc0, 0xc0013e2a00, 0xc0016f6990, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc0016f6a20, 0x55df6c273400, 0xc000401dc0, 0xc0013e2a00, 0xc0016f6990, 0x55df6c2823c0, 0xc0016f6a20) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000401dc0, 0xc0013e2800) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bb6580, 0x55df6c273400, 0xc000401dc0, 0xc0013e2800) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000401dc0, 0xc000059300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000401dc0, 0xc000059300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000401dc0, 0xc000059300) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c3bd60, 0x55df6c282300, 0xc001574200) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 95960 [sync.Cond.Wait, 3962 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc00124c790, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc00124c780) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc00124c740, 0xc0012de000, 0x800, 0x4000, 0x0, 0x55df698f7700, 0xc0014ccd80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc00124c840, 0x55df6b198580, 0x6, 0x7efd3c34e6f8, 0xc00124c740) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 704762 [semacquire, 348 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xf80000c001564800, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).Wait(0xc0009a1400, 0x55df6c2823c0, 0xc001b4e7e0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:182 +0x2cd github.com/docker/docker/daemon.(Daemon).ContainerWait(0xc00000c3c0, 0x55df6c2823c0, 0xc001b4e7e0, 0xc000f7a117, 0xc, 0x0, 0xc0001020d0, 0x55df6b196281, 0xc0008ef5c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/wait.go:22 +0xa4 github.com/docker/docker/api/server/router/container.(containerRouter).postContainersWait(0xc0009d0ec0, 0x55df6c2823c0, 0xc001b4e7e0, 0x55df6c273400, 0xc001ee88c0, 0xc0013e3700, 0xc001b4e720, 0xc0009cea01, 0xc001827600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:341 +0x150 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4e7e0, 0x55df6c273400, 0xc001ee88c0, 0xc0013e3700, 0xc001b4e720, 0x55df6c2823c0, 0xc001b4e7e0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4e7b0, 0x55df6c273400, 0xc001ee88c0, 0xc0013e3700, 0xc001b4e720, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001b4e7b0, 0x55df6c273400, 0xc001ee88c0, 0xc0013e3700, 0xc001b4e720, 0x55df6c2823c0, 0xc001b4e7b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc001ee88c0, 0xc0013e3600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bb6580, 0x55df6c273400, 0xc001ee88c0, 0xc0013e3600) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc001ee88c0, 0xc0013e3400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc001ee88c0, 0xc0013e3400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc001ee88c0, 0xc0013e3400) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000423b80, 0x55df6c282300, 0xc001c366c0) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705447 [semacquire, 147 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc000269300, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024ee316, 0xc, 0x0, 0x1, 0xc0017e6258, 0xc00122c1b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024ee316, 0xc, 0x0, 0xc0024ee306, 0x4, 0xc0009ce000, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001bd0360, 0x55df6c273400, 0xc0009c61c0, 0xc000778e00, 0xc001bd02a0, 0xc0009ce001, 0xc0016e0c60) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001bd0360, 0x55df6c273400, 0xc0009c61c0, 0xc000778e00, 0xc001bd02a0, 0x55df6c2823c0, 0xc001bd0360) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001bd0330, 0x55df6c273400, 0xc0009c61c0, 0xc000778e00, 0xc001bd02a0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001bd0330, 0x55df6c273400, 0xc0009c61c0, 0xc000778e00, 0xc001bd02a0, 0x55df6c2823c0, 0xc001bd0330) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0009c61c0, 0xc000778d00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc0009c61c0, 0xc000778d00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0009c61c0, 0xc000778900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0009c61c0, 0xc000778900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0009c61c0, 0xc000778900) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000124aa0, 0x55df6c282300, 0xc000f5c640) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 100473 [sync.Cond.Wait, 3961 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc000f5c090, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc000f5c080) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc000f5c040, 0xc0015da000, 0x800, 0x4000, 0x0, 0xc00141f600, 0x55df69900575) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc000f5c0c0, 0x55df6b19857a, 0x6, 0x7efd3c34e6f8, 0xc000f5c040) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 704609 [sync.Cond.Wait, 337 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc001c372d0, 0x55df00000000) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc001c372c0) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc001c37280, 0xc000a62000, 0x8000, 0x8000, 0x0, 0x0, 0x55df6bdb9fe0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b io.copyBuffer(0x55df6c223c40, 0xc000d25b60, 0x7efd3c34e6f8, 0xc001c37280, 0xc000a62000, 0x8000, 0x8000, 0x0, 0x2, 0x0) /usr/local/go/src/io/io.go:402 +0x124 io.CopyBuffer(0x55df6c223c40, 0xc000d25b60, 0x7efd3c34e6f8, 0xc001c37280, 0xc000a62000, 0x8000, 0x8000, 0x55df698ee7a3, 0x203000, 0xc001724d90) /usr/local/go/src/io/io.go:375 +0x84 github.com/docker/docker/pkg/pools.Copy(0x55df6c223c40, 0xc000d25b60, 0x7efd3c34e6f8, 0xc001c37280, 0xc001c37280, 0x1, 0x1) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/pools/pools.go:81 +0xbe github.com/docker/docker/container/stream.(Config).CopyStreams.func2(0x55df6b198580, 0x6, 0x55df6c223c40, 0xc000d25b60, 0x55df6c2568c0, 0xc001c37280, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/attach.go:111 +0x24d github.com/docker/docker/container/stream.(Config).CopyStreams.func3(0xc001724f68, 0x7efd3c36f001) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/attach.go:124 +0x64 github.com/docker/docker/vendor/golang.org/x/sync/errgroup.(Group).Go.func1(0xc0016f7590, 0xc000d25ba0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/sync/errgroup/errgroup.go:57 +0x66 created by github.com/docker/docker/vendor/golang.org/x/sync/errgroup.(Group).Go /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/golang.org/x/sync/errgroup/errgroup.go:54 +0x68

goroutine 705083 [semacquire, 331 minutes]: sync.runtime_SemacquireMutex(0xc000e4ea84, 0x260000c000835300, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000e4ea80) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).Wait(0xc000e4ea80, 0x55df6c2823c0, 0xc000eccd20, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:182 +0x2cd github.com/docker/docker/daemon.(Daemon).ContainerWait(0xc00000c3c0, 0x55df6c2823c0, 0xc000eccd20, 0xc000f7a1d7, 0xc, 0x0, 0xc000806750, 0x55df6b196281, 0xc000e305c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/wait.go:22 +0xa4 github.com/docker/docker/api/server/router/container.(containerRouter).postContainersWait(0xc0009d0ec0, 0x55df6c2823c0, 0xc000eccd20, 0x55df6c273400, 0xc001349b20, 0xc000f42a00, 0xc000eccc60, 0xc0000b9101, 0xc000f2af20) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:341 +0x150 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000eccd20, 0x55df6c273400, 0xc001349b20, 0xc000f42a00, 0xc000eccc60, 0x55df6c2823c0, 0xc000eccd20) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000ecccf0, 0x55df6c273400, 0xc001349b20, 0xc000f42a00, 0xc000eccc60, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000ecccf0, 0x55df6c273400, 0xc001349b20, 0xc000f42a00, 0xc000eccc60, 0x55df6c2823c0, 0xc000ecccf0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc001349b20, 0xc000f42900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bb6580, 0x55df6c273400, 0xc001349b20, 0xc000f42900) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc001349b20, 0xc000f42700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc001349b20, 0xc000f42700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc001349b20, 0xc000f42700) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000d06e60, 0x55df6c282300, 0xc000f11600) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705230 [semacquire, 308 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x55df6ad04500, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).SetRemovalInProgress(0xc0009a1400, 0xc000ff6000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:344 +0xbc github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc000ff6019, 0xc, 0xc000c8c046, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:30 +0xb9 github.com/docker/docker/api/server/router/container.(containerRouter).deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc000ca3380, 0x55df6c273400, 0xc00083c000, 0xc001448300, 0xc000ca2cc0, 0xc000a02a01, 0xc0003da580) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:528 +0x17a github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000ca3380, 0x55df6c273400, 0xc00083c000, 0xc001448300, 0xc000ca2cc0, 0x55df6c2823c0, 0xc000ca3380) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000ca3170, 0x55df6c273400, 0xc00083c000, 0xc001448300, 0xc000ca2cc0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000ca3170, 0x55df6c273400, 0xc00083c000, 0xc001448300, 0xc000ca2cc0, 0x55df6c2823c0, 0xc000ca3170) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc00083c000, 0xc001448100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bfc1c0, 0x55df6c273400, 0xc00083c000, 0xc001448100) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc00083c000, 0xc000058d00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc00083c000, 0xc000058d00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc00083c000, 0xc000058d00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000b74000, 0x55df6c282300, 0xc00095c180) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 99440 [IO wait, 3962 minutes]: internal/poll.runtime_pollWait(0x7efd2c496d10, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc0000dec18, 0x72, 0x8001, 0x8000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc0000dec00, 0xc001298000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 os.(File).read(...) /usr/local/go/src/os/file_unix.go:259 os.(File).Read(0xc001b0e068, 0xc001298000, 0x8000, 0x8000, 0x55df698c8800, 0xc00003c000, 0x55df6be67a00) /usr/local/go/src/os/file.go:116 +0x73 github.com/docker/docker/vendor/github.com/containerd/fifo.(fifo).Read(0xc00139b8c0, 0xc001298000, 0x8000, 0x8000, 0x0, 0xc001758e00, 0x55df6993ce79) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/fifo/fifo.go:159 +0x276 io.copyBuffer(0x55df6c223b20, 0xc000881f20, 0x7efd3c294100, 0xc00139b8c0, 0xc001298000, 0x8000, 0x8000, 0x55df6bcf9940, 0x4, 0xc0007b37c0) /usr/local/go/src/io/io.go:402 +0x124 io.CopyBuffer(0x55df6c223b20, 0xc000881f20, 0x7efd3c294100, 0xc00139b8c0, 0xc001298000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/io/io.go:375 +0x84 github.com/docker/docker/pkg/pools.Copy(0x55df6c223b20, 0xc000881f20, 0x7efd3c294100, 0xc00139b8c0, 0xc00139b8c0, 0x1, 0x55df698f73a8) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/pools/pools.go:81 +0xbe github.com/docker/docker/container/stream.(Config).CopyToPipe.func1.1(0x55df6c223b20, 0xc000881f20, 0x7efd3c34e690, 0xc00139b8c0, 0xc000e5ee10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:124 +0x73 created by github.com/docker/docker/container/stream.(Config).CopyToPipe.func1 /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:123 +0x86

goroutine 703420 [IO wait, 1217 minutes]: internal/poll.runtime_pollWait(0x7efd3c354880, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc00077d718, 0x72, 0x0, 0x1, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc00077d700, 0xc001b4eee1, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc00077d700, 0xc001b4eee1, 0x1, 0x1, 0x0, 0x55df6c226840, 0x55df698c88dd) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc001b0e2f0, 0xc001b4eee1, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc000e4db00, 0xc001b4eee1, 0x1, 0x1, 0x55df698f73a8, 0x55df6c1e2200, 0xc001b3e3c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).backgroundRead(0xc001b4eed0) /usr/local/go/src/net/http/server.go:677 +0x5a created by net/http.(connReader).startBackgroundRead /usr/local/go/src/net/http/server.go:673 +0xd6

goroutine 704856 [IO wait, 337 minutes]: internal/poll.runtime_pollWait(0x7efd3c354f00, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc000f35098, 0x72, 0x0, 0x1, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc000f35080, 0xc0016f6c11, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc000f35080, 0xc0016f6c11, 0x1, 0x1, 0x55df69d9674e, 0xc00128d738, 0x1) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc00063c040, 0xc0016f6c11, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc0007f0b20, 0xc0016f6c11, 0x1, 0x1, 0x0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).backgroundRead(0xc0016f6c00) /usr/local/go/src/net/http/server.go:677 +0x5a created by net/http.(connReader).startBackgroundRead /usr/local/go/src/net/http/server.go:673 +0xd6

goroutine 704755 [semacquire, 352 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x7efd3c234300, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024ee2b6, 0xc, 0x0, 0x1, 0xc000eb86d8, 0xc000478810) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024ee2b6, 0xc, 0x0, 0xc0024ee2a6, 0x4, 0x10, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001dfaba0, 0x55df6c273400, 0xc0004010a0, 0xc0012f0e00, 0xc001dfaae0, 0xc0009cea01, 0xc00149af20) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfaba0, 0x55df6c273400, 0xc0004010a0, 0xc0012f0e00, 0xc001dfaae0, 0x55df6c2823c0, 0xc001dfaba0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfab70, 0x55df6c273400, 0xc0004010a0, 0xc0012f0e00, 0xc001dfaae0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001dfab70, 0x55df6c273400, 0xc0004010a0, 0xc0012f0e00, 0xc001dfaae0, 0x55df6c2823c0, 0xc001dfab70) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0004010a0, 0xc0012f0d00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc0004010a0, 0xc0012f0d00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0004010a0, 0xc0013e2500) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0004010a0, 0xc0013e2500) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0004010a0, 0xc0013e2500) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000cf4140, 0x55df6c282300, 0xc001c36000) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 99688 [IO wait, 3962 minutes]: internal/poll.runtime_pollWait(0x7efd2c4969d0, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc00139fbd8, 0x72, 0x8001, 0x8000, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc00139fbc0, 0xc000f1c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 os.(File).read(...) /usr/local/go/src/os/file_unix.go:259 os.(File).Read(0xc001b0a838, 0xc000f1c000, 0x8000, 0x8000, 0x55df698c8800, 0xc00003c000, 0x55df6be67a00) /usr/local/go/src/os/file.go:116 +0x73 github.com/docker/docker/vendor/github.com/containerd/fifo.(fifo).Read(0xc000ac50e0, 0xc000f1c000, 0x8000, 0x8000, 0x0, 0xc001289e00, 0x55df6993cf6d) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/containerd/fifo/fifo.go:159 +0x276 io.copyBuffer(0x55df6c223b20, 0xc001564f20, 0x7efd3c294100, 0xc000ac50e0, 0xc000f1c000, 0x8000, 0x8000, 0x55df6bcf9940, 0x4, 0xc0008f8a40) /usr/local/go/src/io/io.go:402 +0x124 io.CopyBuffer(0x55df6c223b20, 0xc001564f20, 0x7efd3c294100, 0xc000ac50e0, 0xc000f1c000, 0x8000, 0x8000, 0x4, 0xc001289f40, 0x55df69902e71) /usr/local/go/src/io/io.go:375 +0x84 github.com/docker/docker/pkg/pools.Copy(0x55df6c223b20, 0xc001564f20, 0x7efd3c294100, 0xc000ac50e0, 0xc000ac50e0, 0xc000050410, 0x7efd3c36f090) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/pools/pools.go:81 +0xbe github.com/docker/docker/container/stream.(Config).CopyToPipe.func1.1(0x55df6c223b20, 0xc001564f20, 0x7efd3c34e690, 0xc000ac50e0, 0xc001edcaa0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:124 +0x73 created by github.com/docker/docker/container/stream.(Config).CopyToPipe.func1 /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/stream/streams.go:123 +0x86

goroutine 705255 [semacquire, 310 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc001800300, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbc0d6, 0xc, 0x0, 0x1, 0xc0018306d8, 0xc0004782a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbc0d6, 0xc, 0x0, 0xc000dbc0c6, 0x4, 0xc0009ce380, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001dfa8a0, 0x55df6c273400, 0xc000400700, 0xc001448200, 0xc001dfa780, 0xc0009ce301, 0xc0003da2c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfa8a0, 0x55df6c273400, 0xc000400700, 0xc001448200, 0xc001dfa780, 0x55df6c2823c0, 0xc001dfa8a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfa870, 0x55df6c273400, 0xc000400700, 0xc001448200, 0xc001dfa780, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001dfa870, 0x55df6c273400, 0xc000400700, 0xc001448200, 0xc001dfa780, 0x55df6c2823c0, 0xc001dfa870) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000400700, 0xc001448100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000400700, 0xc001448100) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000400700, 0xc0009f0400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000400700, 0xc0009f0400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000400700, 0xc0009f0400) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000b75720, 0x55df6c282300, 0xc000f5cac0) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705268 [semacquire, 308 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x0, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbc586, 0xc, 0x0, 0x1, 0xc0018319f8, 0xc000fbfc40) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbc586, 0xc, 0x0, 0xc000dbc576, 0x4, 0xc000972000, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001b4f590, 0x55df6c273400, 0xc00083cb60, 0xc001449600, 0xc001b4f4d0, 0xc000972001, 0xc00173e000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4f590, 0x55df6c273400, 0xc00083cb60, 0xc001449600, 0xc001b4f4d0, 0x55df6c2823c0, 0xc001b4f590) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4f560, 0x55df6c273400, 0xc00083cb60, 0xc001449600, 0xc001b4f4d0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001b4f560, 0x55df6c273400, 0xc00083cb60, 0xc001449600, 0xc001b4f4d0, 0x55df6c2823c0, 0xc001b4f560) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc00083cb60, 0xc001449500) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc00083cb60, 0xc001449500) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc00083cb60, 0xc001449200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc00083cb60, 0xc001449200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc00083cb60, 0xc001449200) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000b759a0, 0x55df6c282300, 0xc000f5cb80) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704824 [semacquire, 341 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x900, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024ee6d6, 0xc, 0x0, 0x1, 0xc001d3a138, 0xc00117c360) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024ee6d6, 0xc, 0x0, 0xc0024ee6c6, 0x4, 0xc0009cea80, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001b4e960, 0x55df6c273400, 0xc000ada460, 0xc000059800, 0xc001b4e8a0, 0xc0009cea01, 0xc0016e14a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4e960, 0x55df6c273400, 0xc000ada460, 0xc000059800, 0xc001b4e8a0, 0x55df6c2823c0, 0xc001b4e960) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4e930, 0x55df6c273400, 0xc000ada460, 0xc000059800, 0xc001b4e8a0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001b4e930, 0x55df6c273400, 0xc000ada460, 0xc000059800, 0xc001b4e8a0, 0x55df6c2823c0, 0xc001b4e930) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000ada460, 0xc000059700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000ada460, 0xc000059700) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000ada460, 0xc000059400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000ada460, 0xc000059400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000ada460, 0xc000059400) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000423d60, 0x55df6c282300, 0xc00124c8c0) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 99417 [sync.Cond.Wait, 337 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc001a0c610, 0x1) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc001a0c600) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc001a0c5c0, 0xc000ec6000, 0x800, 0x4000, 0xffffffffffffffff, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc001a0c680, 0x55df6b19857a, 0x6, 0x7efd3c34e6f8, 0xc001a0c5c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 704605 [select, 337 minutes]: github.com/docker/docker/container.(State).Wait.func1(0x55df6c2823c0, 0xc0016f6a50, 0xc0007c4f00, 0xc0009ab6e0, 0xc0009ab740, 0xc000e4ea80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:213 +0xf1 created by github.com/docker/docker/container.(State).Wait /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:212 +0x156

goroutine 99685 [sync.Cond.Wait, 3962 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc001af7910, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc001af7900) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc001af78c0, 0xc001152000, 0x800, 0x4000, 0x0, 0xc000157b00, 0x72) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc001af79c0, 0x55df6b198580, 0x6, 0x7efd3c34e6f8, 0xc001af78c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 99416 [sync.Cond.Wait, 3962 minutes]: runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:310 sync.runtime_notifyListWait(0xc001a0c590, 0x0) /usr/local/go/src/runtime/sema.go:510 +0xfc sync.(Cond).Wait(0xc001a0c580) /usr/local/go/src/sync/cond.go:56 +0x9f github.com/docker/docker/pkg/ioutils.(BytesPipe).Read(0xc001a0c540, 0xc000f14000, 0x800, 0x4000, 0x0, 0xc000e4e900, 0x72) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/ioutils/bytespipe.go:134 +0x29b github.com/docker/docker/daemon/logger.(Copier).copySrc(0xc001a0c680, 0x55df6b198580, 0x6, 0x7efd3c34e6f8, 0xc001a0c540) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:81 +0x91e created by github.com/docker/docker/daemon/logger.(Copier).Run /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/logger/copier.go:48 +0x111

goroutine 704227 [select, 1089 minutes]: github.com/docker/docker/container.(State).Wait.func1(0x55df6c282340, 0xc000052038, 0xc0003efaa0, 0xc0008f69c0, 0xc0008f6a20, 0xc001d0ec00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:213 +0xf1 created by github.com/docker/docker/container.(State).Wait /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:212 +0x156

goroutine 704813 [semacquire, 348 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x0, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbc076, 0xc, 0x0, 0x1, 0xc001830258, 0xc000478110) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbc076, 0xc, 0x0, 0xc000dbc066, 0x4, 0xc0000b9180, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001dfa4b0, 0x55df6c273400, 0xc000400460, 0xc0012f0200, 0xc001dfa3f0, 0xc0000b9101, 0xc00149a160) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfa4b0, 0x55df6c273400, 0xc000400460, 0xc0012f0200, 0xc001dfa3f0, 0x55df6c2823c0, 0xc001dfa4b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfa480, 0x55df6c273400, 0xc000400460, 0xc0012f0200, 0xc001dfa3f0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001dfa480, 0x55df6c273400, 0xc000400460, 0xc0012f0200, 0xc001dfa3f0, 0x55df6c2823c0, 0xc001dfa480) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000400460, 0xc0012f0100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000400460, 0xc0012f0100) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000400460, 0xc000058900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000400460, 0xc000058900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000400460, 0xc000058900) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc0001efe00, 0x55df6c282300, 0xc00124c1c0) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705439 [semacquire, 255 minutes]: sync.runtime_SemacquireMutex(0xc000e4ea84, 0x55df699bda00, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000e4ea80) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024ee2e6, 0xc, 0x0, 0x1, 0xc0017e6138, 0xc001b3a2f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024ee2e6, 0xc, 0x0, 0xc0024ee2d6, 0x4, 0xc0009ce000, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc000b8af60, 0x55df6c273400, 0xc000401c00, 0xc0019a4900, 0xc000b8ade0, 0xc0009ce001, 0xc0003db760) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000b8af60, 0x55df6c273400, 0xc000401c00, 0xc0019a4900, 0xc000b8ade0, 0x55df6c2823c0, 0xc000b8af60) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000b8af00, 0x55df6c273400, 0xc000401c00, 0xc0019a4900, 0xc000b8ade0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000b8af00, 0x55df6c273400, 0xc000401c00, 0xc0019a4900, 0xc000b8ade0, 0x55df6c2823c0, 0xc000b8af00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000401c00, 0xc0019a4800) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000401c00, 0xc0019a4800) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000401c00, 0xc0019a4500) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000401c00, 0xc0019a4500) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000401c00, 0xc0019a4500) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000bda0a0, 0x55df6c282300, 0xc001cd8100) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705271 [semacquire, 308 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x0, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbc616, 0xc, 0x0, 0x1, 0xc001831b18, 0xc000fbfde0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbc616, 0xc, 0x0, 0xc000dbc606, 0x4, 0xc000972000, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001b4fcb0, 0x55df6c273400, 0xc00083cd20, 0xc001449f00, 0xc001b4fb60, 0xc000972001, 0xc00173e6e0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4fcb0, 0x55df6c273400, 0xc00083cd20, 0xc001449f00, 0xc001b4fb60, 0x55df6c2823c0, 0xc001b4fcb0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4fc20, 0x55df6c273400, 0xc00083cd20, 0xc001449f00, 0xc001b4fb60, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001b4fc20, 0x55df6c273400, 0xc00083cd20, 0xc001449f00, 0xc001b4fb60, 0x55df6c2823c0, 0xc001b4fc20) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc00083cd20, 0xc001449e00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc00083cd20, 0xc001449e00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc00083cd20, 0xc001449c00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc00083cd20, 0xc001449c00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc00083cd20, 0xc001449c00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000b7e140, 0x55df6c282300, 0xc000f5cf40) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704236 [semacquire, 1084 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x55df6ad04500, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).SetRemovalInProgress(0xc0009a1400, 0xc000830400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:344 +0xbc github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc000830419, 0xc, 0xc001b1e53c, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:30 +0xb9 github.com/docker/docker/api/server/router/container.(containerRouter).deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc000ecd8c0, 0x55df6c273400, 0xc000ada540, 0xc000059500, 0xc000ecd800, 0xc000a02e01, 0xc0016e11e0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:528 +0x17a github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000ecd8c0, 0x55df6c273400, 0xc000ada540, 0xc000059500, 0xc000ecd800, 0x55df6c2823c0, 0xc000ecd8c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000ecd890, 0x55df6c273400, 0xc000ada540, 0xc000059500, 0xc000ecd800, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000ecd890, 0x55df6c273400, 0xc000ada540, 0xc000059500, 0xc000ecd800, 0x55df6c2823c0, 0xc000ecd890) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000ada540, 0xc000059400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bfc1c0, 0x55df6c273400, 0xc000ada540, 0xc000059400) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000ada540, 0xc000059200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000ada540, 0xc000059200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000ada540, 0xc000059200) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c07180, 0x55df6c282300, 0xc0003f9040) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705555 [semacquire, 124 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc0013c4a00, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024eea66, 0xc, 0x0, 0x1, 0xc001800b58, 0xc001cfe4b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024eea66, 0xc, 0x0, 0xc0024eea56, 0x4, 0xc000a02e00, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001bd1200, 0x55df6c273400, 0xc000ada1c0, 0xc000779200, 0xc001bd1110, 0xc000a02e01, 0xc00149bb80) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001bd1200, 0x55df6c273400, 0xc000ada1c0, 0xc000779200, 0xc001bd1110, 0x55df6c2823c0, 0xc001bd1200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001bd11a0, 0x55df6c273400, 0xc000ada1c0, 0xc000779200, 0xc001bd1110, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001bd11a0, 0x55df6c273400, 0xc000ada1c0, 0xc000779200, 0xc001bd1110, 0x55df6c2823c0, 0xc001bd11a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000ada1c0, 0xc000779100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000ada1c0, 0xc000779100) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000ada1c0, 0xc001448000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000ada1c0, 0xc001448000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000ada1c0, 0xc001448000) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000bc45a0, 0x55df6c282300, 0xc001aeac40) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704821 [semacquire, 341 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc000276900, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024ee1f6, 0xc, 0x0, 0x1, 0xc001d3a018, 0xc00117c1b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024ee1f6, 0xc, 0x0, 0xc0024ee1e6, 0x4, 0xc0009cea80, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001b4e270, 0x55df6c273400, 0xc000ada2a0, 0xc000058e00, 0xc001b4e1b0, 0xc0009cea01, 0xc0016e0840) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4e270, 0x55df6c273400, 0xc000ada2a0, 0xc000058e00, 0xc001b4e1b0, 0x55df6c2823c0, 0xc001b4e270) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4e240, 0x55df6c273400, 0xc000ada2a0, 0xc000058e00, 0xc001b4e1b0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001b4e240, 0x55df6c273400, 0xc000ada2a0, 0xc000058e00, 0xc001b4e1b0, 0x55df6c2823c0, 0xc001b4e240) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000ada2a0, 0xc000058d00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000ada2a0, 0xc000058d00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000ada2a0, 0xc000058b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000ada2a0, 0xc000058b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000ada2a0, 0xc000058b00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000423220, 0x55df6c282300, 0xc00124c2c0) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 673679 [IO wait, 1384 minutes]: internal/poll.runtime_pollWait(0x7efd3c354e30, 0x72, 0xffffffffffffffff) /usr/local/go/src/runtime/netpoll.go:184 +0x57 internal/poll.(pollDesc).wait(0xc000f34518, 0x72, 0x0, 0x1, 0xffffffffffffffff) /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47 internal/poll.(pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 internal/poll.(FD).Read(0xc000f34500, 0xc0011ec731, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/internal/poll/fd_unix.go:169 +0x1d1 net.(netFD).Read(0xc000f34500, 0xc0011ec731, 0x1, 0x1, 0x0, 0x55df6c226840, 0x55df698c88dd) /usr/local/go/src/net/fd_unix.go:202 +0x51 net.(conn).Read(0xc00099c078, 0xc0011ec731, 0x1, 0x1, 0x0, 0x0, 0x0) /usr/local/go/src/net/net.go:184 +0x6a github.com/docker/docker/cmd/dockerd/hack.(MalformedHostHeaderOverrideConn).Read(0xc000bb6760, 0xc0011ec731, 0x1, 0x1, 0x55df698f73a8, 0x55df6c1e2200, 0xc000e64140) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/cmd/dockerd/hack/malformed_host_override.go:110 +0x84 net/http.(connReader).backgroundRead(0xc0011ec720) /usr/local/go/src/net/http/server.go:677 +0x5a created by net/http.(connReader).startBackgroundRead /usr/local/go/src/net/http/server.go:673 +0xd6

goroutine 704757 [semacquire, 348 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0x0, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024ee1c6, 0xc, 0x0, 0x1, 0xc000eb9b18, 0xc001b3a1a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024ee1c6, 0xc, 0x0, 0xc0024ee1b6, 0x4, 0xc0000b9180, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc001b4e060, 0x55df6c273400, 0xc001ee81c0, 0xc0013e2900, 0xc000ca3f20, 0xc0000b9101, 0xc0018266e0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4e060, 0x55df6c273400, 0xc001ee81c0, 0xc0013e2900, 0xc000ca3f20, 0x55df6c2823c0, 0xc001b4e060) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001b4e030, 0x55df6c273400, 0xc001ee81c0, 0xc0013e2900, 0xc000ca3f20, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001b4e030, 0x55df6c273400, 0xc001ee81c0, 0xc0013e2900, 0xc000ca3f20, 0x55df6c2823c0, 0xc001b4e030) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc001ee81c0, 0xc0013e2800) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc001ee81c0, 0xc0013e2800) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc001ee81c0, 0xc0013e2600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc001ee81c0, 0xc0013e2600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc001ee81c0, 0xc0013e2600) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000cf5040, 0x55df6c282300, 0xc001c36080) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704108 [chan receive, 1089 minutes]: github.com/docker/docker/daemon.(Daemon).Kill(0xc00000c3c0, 0xc001aabb00, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/kill.go:161 +0x24a github.com/docker/docker/daemon.(Daemon).cleanupContainer(0xc00000c3c0, 0xc001aabb00, 0x1, 0xc001aabb00, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:90 +0x387 github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc000ccc019, 0xc, 0xc000b9a7c6, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:45 +0x181 github.com/docker/docker/api/server/router/container.(containerRouter).deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc000ca3b00, 0x55df6c273400, 0xc000ada0e0, 0xc000058a00, 0xc000ca3590, 0xc00053bc01, 0xc000a5c580) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:528 +0x17a github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000ca3b00, 0x55df6c273400, 0xc000ada0e0, 0xc000058a00, 0xc000ca3590, 0x55df6c2823c0, 0xc000ca3b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000ca3950, 0x55df6c273400, 0xc000ada0e0, 0xc000058a00, 0xc000ca3590, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000ca3950, 0x55df6c273400, 0xc000ada0e0, 0xc000058a00, 0xc000ca3590, 0x55df6c2823c0, 0xc000ca3950) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000ada0e0, 0xc000058900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bfc1c0, 0x55df6c273400, 0xc000ada0e0, 0xc000058900) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000ada0e0, 0xc000058700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000ada0e0, 0xc000058700) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000ada0e0, 0xc000058700) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c1f360, 0x55df6c282300, 0xc0003f8040) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704607 [chan receive, 337 minutes]: github.com/docker/docker/daemon.(Daemon).containerAttach(0xc00000c3c0, 0xc000fac6c0, 0xc001ef83f0, 0xc000d20100, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/attach.go:177 +0x134 github.com/docker/docker/daemon.(Daemon).ContainerAttach(0xc00000c3c0, 0xc0017fd197, 0xc, 0xc0016f7440, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/attach.go:74 +0x38e github.com/docker/docker/api/server/router/container.(containerRouter).postContainersAttach(0xc0009d0ec0, 0x55df6c2823c0, 0xc0016f7380, 0x55df6c273400, 0xc001348000, 0xc0013e3600, 0xc0016f72c0, 0xc00091e301, 0xc000a5c160) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:602 +0x357 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0016f7380, 0x55df6c273400, 0xc001348000, 0xc0013e3600, 0xc0016f72c0, 0x55df6c2823c0, 0xc0016f7380) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0016f7350, 0x55df6c273400, 0xc001348000, 0xc0013e3600, 0xc0016f72c0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc0016f7350, 0x55df6c273400, 0xc001348000, 0xc0013e3600, 0xc0016f72c0, 0x55df6c2823c0, 0xc0016f7350) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc001348000, 0xc0013e3500) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bb6a80, 0x55df6c273400, 0xc001348000, 0xc0013e3500) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc001348000, 0xc0013e3200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc001348000, 0xc0013e3200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc001348000, 0xc0013e3200) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000bda1e0, 0x55df6c282300, 0xc001c37080) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705149 [semacquire, 318 minutes]: sync.runtime_SemacquireMutex(0xc000e4ea84, 0xc001ce6400, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000e4ea80) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbc256, 0xc, 0x0, 0x1, 0xc00127d218, 0xc001cfe260) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbc256, 0xc, 0x0, 0xc000dbc246, 0x4, 0xc0009ce700, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc00179e300, 0x55df6c273400, 0xc001348620, 0xc0012f0500, 0xc00179e240, 0xc0009ce701, 0xc00127a840) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc00179e300, 0x55df6c273400, 0xc001348620, 0xc0012f0500, 0xc00179e240, 0x55df6c2823c0, 0xc00179e300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc00179e2d0, 0x55df6c273400, 0xc001348620, 0xc0012f0500, 0xc00179e240, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc00179e2d0, 0x55df6c273400, 0xc001348620, 0xc0012f0500, 0xc00179e240, 0x55df6c2823c0, 0xc00179e2d0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc001348620, 0xc0012f0300) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc001348620, 0xc0012f0300) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc001348620, 0xc0012f0000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc001348620, 0xc0012f0000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc001348620, 0xc0012f0000) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc0001937c0, 0x55df6c282300, 0xc001a0d640) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705435 [semacquire, 263 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xc00106b300, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc001540076, 0xc, 0x0, 0x1, 0xc000448258, 0xc00122c100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc001540076, 0xc, 0x0, 0xc001540066, 0x4, 0xc00053a380, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc000b8a600, 0x55df6c273400, 0xc0014681c0, 0xc000778c00, 0xc000b8a4b0, 0xc00053a301, 0xc0016e09a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000b8a600, 0x55df6c273400, 0xc0014681c0, 0xc000778c00, 0xc000b8a4b0, 0x55df6c2823c0, 0xc000b8a600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000b8a570, 0x55df6c273400, 0xc0014681c0, 0xc000778c00, 0xc000b8a4b0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000b8a570, 0x55df6c273400, 0xc0014681c0, 0xc000778c00, 0xc000b8a4b0, 0x55df6c2823c0, 0xc000b8a570) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc0014681c0, 0xc000778a00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc0014681c0, 0xc000778a00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc0014681c0, 0xc0019a4400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc0014681c0, 0xc0019a4400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc0014681c0, 0xc0019a4400) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c3bb80, 0x55df6c282300, 0xc001cd8080) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705291 [semacquire, 306 minutes]: sync.runtime_SemacquireMutex(0xc000e4ea84, 0xc00093e000, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000e4ea80) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc000dbca06, 0xc, 0x0, 0x1, 0xc00180ceb8, 0xc001b3bd60) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc000dbca06, 0xc, 0x0, 0xc000dbc9f6, 0x4, 0xc0001b8380, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc0013aa720, 0x55df6c273400, 0xc00083d880, 0xc0019a5300, 0xc0013aa630, 0xc0001b8301, 0xc000851760) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0013aa720, 0x55df6c273400, 0xc00083d880, 0xc0019a5300, 0xc0013aa630, 0x55df6c2823c0, 0xc0013aa720) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0013aa6f0, 0x55df6c273400, 0xc00083d880, 0xc0019a5300, 0xc0013aa630, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc0013aa6f0, 0x55df6c273400, 0xc00083d880, 0xc0019a5300, 0xc0013aa630, 0x55df6c2823c0, 0xc0013aa6f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc00083d880, 0xc0019a5200) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc00083d880, 0xc0019a5200) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc00083d880, 0xc0019a5000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc00083d880, 0xc0019a5000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc00083d880, 0xc0019a5000) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000bf4960, 0x55df6c282300, 0xc000f5dbc0) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704864 [semacquire, 333 minutes]: sync.runtime_SemacquireMutex(0xc000e4ea84, 0x0, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc000e4ea80) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc00105c526, 0xc, 0x0, 0x1, 0xc001ce65b8, 0xc00117c2f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc00105c526, 0xc, 0x0, 0xc00105c516, 0x4, 0xc000972000, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc000b8a240, 0x55df6c273400, 0xc000401ea0, 0xc0012a8e00, 0xc000b8a000, 0xc000972001, 0xc0001171e0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000b8a240, 0x55df6c273400, 0xc000401ea0, 0xc0012a8e00, 0xc000b8a000, 0x55df6c2823c0, 0xc000b8a240) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc000b8a1b0, 0x55df6c273400, 0xc000401ea0, 0xc0012a8e00, 0xc000b8a000, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc000b8a1b0, 0x55df6c273400, 0xc000401ea0, 0xc0012a8e00, 0xc000b8a000, 0x55df6c2823c0, 0xc000b8a1b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000401ea0, 0xc0012a8d00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc000401ea0, 0xc0012a8d00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000401ea0, 0xc0012a8b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000401ea0, 0xc0012a8b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000401ea0, 0xc0012a8b00) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000bdbb80, 0x55df6c282300, 0xc001574800) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 704748 [semacquire, 346 minutes]: sync.runtime_SemacquireMutex(0xc0009a1404, 0xf80000c000880300, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc0009a1400) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).Wait(0xc0009a1400, 0x55df6c2823c0, 0xc001dfac30, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:182 +0x2cd github.com/docker/docker/daemon.(Daemon).ContainerWait(0xc00000c3c0, 0x55df6c2823c0, 0xc001dfac30, 0xc0001d8157, 0xc, 0x0, 0xc00080e5b0, 0x55df6b196281, 0xc0016fa5c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/wait.go:22 +0xa4 github.com/docker/docker/api/server/router/container.(containerRouter).postContainersWait(0xc0009d0ec0, 0x55df6c2823c0, 0xc001dfac30, 0x55df6c273400, 0xc000401340, 0xc0012f0a00, 0xc001dfa9f0, 0xc0001b9501, 0xc00149b080) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:341 +0x150 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfac30, 0x55df6c273400, 0xc000401340, 0xc0012f0a00, 0xc001dfa9f0, 0x55df6c2823c0, 0xc001dfac30) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc001dfaba0, 0x55df6c273400, 0xc000401340, 0xc0012f0a00, 0xc001dfa9f0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc001dfaba0, 0x55df6c273400, 0xc000401340, 0xc0012f0a00, 0xc001dfa9f0, 0x55df6c2823c0, 0xc001dfaba0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc000401340, 0xc0012f0900) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bb6580, 0x55df6c273400, 0xc000401340, 0xc0012f0900) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc000401340, 0xc0012f0600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc000401340, 0xc0012f0600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc000401340, 0xc0012f0600) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000c065a0, 0x55df6c282300, 0xc001330140) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705654 [semacquire, 27 minutes]: sync.runtime_SemacquireMutex(0xc00077db04, 0xc001ff3200, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc00077db00) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/container.(State).GetPID(0xc00077db00, 0xc000b292a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/container/state.go:248 +0x7b github.com/docker/docker/daemon.killProcessDirectly(0xc0017a4fc0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/container_operations_unix.go:346 +0x14e github.com/docker/docker/daemon.(Daemon).Kill(0xc00000c3c0, 0xc0017a4fc0, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/kill.go:152 +0x19b github.com/docker/docker/daemon.(Daemon).cleanupContainer(0xc00000c3c0, 0xc0017a4fc0, 0x1, 0xc0017a4fc0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:90 +0x387 github.com/docker/docker/daemon.(Daemon).ContainerRm(0xc00000c3c0, 0xc000830519, 0xc, 0xc000b9a7fc, 0x0, 0x0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/delete.go:45 +0x181 github.com/docker/docker/api/server/router/container.(containerRouter).deleteContainers(0xc0009d0ec0, 0x55df6c2823c0, 0xc0016f66f0, 0x55df6c273400, 0xc00083c460, 0xc000f42c00, 0xc0016f6630, 0xc000a02a01, 0xc0018269a0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/container_routes.go:528 +0x17a github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0016f66f0, 0x55df6c273400, 0xc00083c460, 0xc000f42c00, 0xc0016f6630, 0x55df6c2823c0, 0xc0016f66f0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0016f66c0, 0x55df6c273400, 0xc00083c460, 0xc000f42c00, 0xc0016f6630, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc0016f66c0, 0x55df6c273400, 0xc00083c460, 0xc000f42c00, 0xc0016f6630, 0x55df6c2823c0, 0xc0016f66c0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc00083c460, 0xc000f42b00) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000bfc1c0, 0x55df6c273400, 0xc00083c460, 0xc000f42b00) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc00083c460, 0xc000f42600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc00083c460, 0xc000f42600) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc00083c460, 0xc000f42600) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000bf4460, 0x55df6c282300, 0xc0019b2280) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

goroutine 705518 [semacquire, 27 minutes]: sync.runtime_SemacquireMutex(0xc00077db04, 0x7efd3c36c900, 0x1) /usr/local/go/src/runtime/sema.go:71 +0x49 sync.(Mutex).lockSlow(0xc00077db00) /usr/local/go/src/sync/mutex.go:138 +0xfe sync.(Mutex).Lock(...) /usr/local/go/src/sync/mutex.go:81 github.com/docker/docker/daemon.(Daemon).ContainerInspectCurrent(0xc00000c3c0, 0xc0024ee676, 0xc, 0x0, 0x1, 0xc001ce6138, 0xc000fbe370) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:40 +0xa41 github.com/docker/docker/daemon.(Daemon).ContainerInspect(0xc00000c3c0, 0xc0024ee676, 0xc, 0x0, 0xc0024ee666, 0x4, 0xc0001b8380, 0x55df699c48d4, 0x8, 0x10) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/daemon/inspect.go:29 +0x11b github.com/docker/docker/api/server/router/container.(containerRouter).getContainersByName(0xc0009d0ec0, 0x55df6c2823c0, 0xc0009e56b0, 0x55df6c273400, 0xc001468380, 0xc000779500, 0xc0009e55f0, 0xc0001b8301, 0xc000b8ec60) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router/container/inspect.go:15 +0x116 github.com/docker/docker/api/server/middleware.ExperimentalMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0009e56b0, 0x55df6c273400, 0xc001468380, 0xc000779500, 0xc0009e55f0, 0x55df6c2823c0, 0xc0009e56b0) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/experimental.go:26 +0x177 github.com/docker/docker/api/server/middleware.VersionMiddleware.WrapHandler.func1(0x55df6c2823c0, 0xc0009e5680, 0x55df6c273400, 0xc001468380, 0xc000779500, 0xc0009e55f0, 0x203000, 0x203000) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/middleware/version.go:62 +0x5fb github.com/docker/docker/pkg/authorization.(Middleware).WrapHandler.func1(0x55df6c2823c0, 0xc0009e5680, 0x55df6c273400, 0xc001468380, 0xc000779500, 0xc0009e55f0, 0x55df6c2823c0, 0xc0009e5680) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/pkg/authorization/middleware.go:59 +0x826 github.com/docker/docker/api/server.(Server).makeHTTPHandler.func1(0x55df6c273400, 0xc001468380, 0xc000779400) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/server.go:142 +0x241 net/http.HandlerFunc.ServeHTTP(0xc000b78360, 0x55df6c273400, 0xc001468380, 0xc000779400) /usr/local/go/src/net/http/server.go:2007 +0x46 github.com/docker/docker/vendor/github.com/gorilla/mux.(Router).ServeHTTP(0xc000b68180, 0x55df6c273400, 0xc001468380, 0xc000779100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/vendor/github.com/gorilla/mux/mux.go:212 +0xe4 github.com/docker/docker/api/server.(routerSwapper).ServeHTTP(0xc000dacf90, 0x55df6c273400, 0xc001468380, 0xc000779100) /root/rpmbuild/BUILD/src/engine/.gopath/src/github.com/docker/docker/api/server/router_swapper.go:29 +0x75 net/http.serverHandler.ServeHTTP(0xc00083c0e0, 0x55df6c273400, 0xc001468380, 0xc000779100) /usr/local/go/src/net/http/server.go:2802 +0xa6 net/http.(conn).serve(0xc000d060a0, 0x55df6c282300, 0xc000f5c400) /usr/local/go/src/net/http/server.go:1890 +0x877 created by net/http.(*Server).Serve /usr/local/go/src/net/http/server.go:2928 +0x386

akerouanton commented 2 years ago

@pranavadn Thanks for the stack trace. Could you put it in a gist to make this issue more readable please?

I looked a bit at the stack trace and it seems docker is stuck on a request to containerd. I see you're using containerd v1.2.13 and Docker 19.03.12. Both received security and bug fixes. Could you try to update them and see if the issue is still there? If that's the case, could you provide a stack trace of containerd using following commands please? sudo kill -SIGUSR1 $(pidof containerd); sudo journalctl -u containerd -n 10 (it should be written to a file in /tmp)