google / cadvisor

Analyzes resource usage and performance characteristics of running containers.
Other
16.96k stars 2.31k forks source link

dockerd mount error on cadvisor image #2333

Open ggpaue opened 4 years ago

ggpaue commented 4 years ago

Hi, we are currently using cadvisro v0.31.0 and facing the current issue when installing cadvisor on worker node.

OCI runtime create failed: container_linux.go:348: starting container process caused "process_linux.go:402: container init caused \"rootfs_linux.go:58: mounting \\"/var/vcap/sys/run/docker/docker.sock\\" to rootfs \\"/var/vcap/store/docker/docker/overlay2/xxxxxx/merged\\" at \\"/var/vcap/store/docker/docker/overlay2/xxxxxx/merged/run/docker.sock\\" caused \\"not a directory\\"\"": unknown: Are you trying to mount a directory onto a file (or vice-versa)? Check if the specified host path exists and is the expected type

This is only happens on part of the worker nodes and we are not sure if this is a problem from cadvisor image or dockerd, please advise if you have any idea Thank you very much!

dashpole commented 4 years ago

That error looks like it is coming from docker. It looks like your mount has a typo?

ggpaue commented 4 years ago

That error looks like it is coming from docker. It looks like your mount has a typo?

Thanks for the reply, can you point out where the typo? This is wired because we apply the same install logic to all workers but only part of the workers have this error, and only the pod install cadvisor has this error. We have checked dockerd is running properly, is there any other way to dive deeper? Also, would upgrade cadvisor from v0.31.0 to a newer version will help? Thank you David!

dashpole commented 4 years ago

Actually, I think i misread the initial error. Can you paste the command you are using to run this?

jmichelgarcia commented 3 years ago

@ggpaue did you ended up finding the solution? Having the same problem here.