selloween / podman-gitlab-runner-docker-executor

Run GitLab Runner Podman Containers supporting Runners using Docker Executor
7 stars 4 forks source link

Docker host not parsed #1

Open maxclac opened 2 years ago

maxclac commented 2 years ago

Hi! Thank you for this repo!

I am running into a problem while following your instructions. For the docker host, whenever I put localhost, 127.0.0.1, or the IP of the machine, the docker host cannot be parsed while running a job.

Running with gitlab-runner 14.10.0 (c6bb62f6)
  on podman H6a2jZwA
Preparing the "docker" executor
ERROR: Failed to remove network for build
ERROR: Preparation failed: unable to parse docker host `1.111.1.111`
Will be retried in 3s ...
ERROR: Failed to remove network for build
ERROR: Preparation failed: unable to parse docker host `1.111.1.111`
Will be retried in 3s ...

What's wrong?

selloween commented 2 years ago

Hi,

Try setting:

DOCKER_HOST="tcp://127.0.0.1:2375"
maxclac commented 2 years ago

Thank you for the answer!

Now I run into another problem:

Running with gitlab-runner 14.10.0 (c6bb62f6)
  on Podman PT69p653
Preparing the "docker" executor
ERROR: Failed to remove network for build
ERROR: Preparation failed: Cannot connect to the Docker daemon at tcp://127.0.0.1:2375. Is the docker daemon running? (docker.go:857:0s)
Will be retried in 3s ...
ERROR: Failed to remove network for build
ERROR: Preparation failed: Cannot connect to the Docker daemon at tcp://127.0.0.1:2375. Is the docker daemon running? (docker.go:857:0s)
Will be retried in 3s ...
ERROR: Failed to remove network for build
ERROR: Preparation failed: Cannot connect to the Docker daemon at tcp://127.0.0.1:2375. Is the docker daemon running? (docker.go:857:0s)
Will be retried in 3s ...
selloween commented 2 years ago

The dind container is running? If yes, stop and remove the containers. Then add this option "--net host" to both podman.sh scripts. This lets the containers use the host network. Then run the podman.sh scripts again.

selloween commented 2 years ago

Also you might want to remove this line from the config.toml (assuming you're not using a HTTP proxy). environment = ["NO_PROXY=docker:2375,docker:2376", "no_proxy=docker:2375,docker:2376"]

maxclac commented 2 years ago

It's still not working with the same error message.

maxclac commented 2 years ago

I forgot to mention that I skipped the TLS part of the tutorial because the GitLab instance I am using is insecure. Does it have any consequences on the setup of the Podman containers?

selloween commented 2 years ago

Can you post the logs of the dind container (Docker in Docker): podman logs dind ?

maxclac commented 2 years ago
# podman logs dind
Could not mount /sys/kernel/security.
AppArmor detection and --privileged mode might break.
mount: mounting none on /tmp failed: Permission denied
satonreb commented 2 years ago

Managed resolve this:

ERROR: Preparation failed: Cannot connect to the Docker daemon at tcp://127.0.0.1:2375. Is the docker daemon running? (docker.go:857:0s)

by removing --net host from both containers, and instead using --privileged for dind container. In addition, added host = "unix:///var/run/docker.sock" to the config.yaml. However, this lead me to a new issue:

Requeued the runner                                 builds=1 runner=hZeY5Uek
Running with gitlab-runner 14.10.1 (f761588f)       job=14775 project=213 runner=hZeY5Uek
  on docker hZeY5Uek                                job=14775 project=213 runner=hZeY5Uek
Preparing the "docker" executor         job=14775 project=213 runner=hZeY5Uek
Connected to docker daemon (api version: 1.41, server version: 20.10.15, kernel: 5.10.102.1-microsoft-standard-WSL2, os: linux/x86_64)  job=14775 project=213 runner=hZeY5Uek
Shell configuration: command: bash
arguments: []
cmdline: bash
dockercommand:
- sh
- -c
- "if [ -x /usr/local/bin/bash ]; then\n\texec /usr/local/bin/bash \nelif [ -x /usr/bin/bash
  ]; then\n\texec /usr/bin/bash \nelif [ -x /bin/bash ]; then\n\texec /bin/bash \nelif
  [ -x /usr/local/bin/sh ]; then\n\texec /usr/local/bin/sh \nelif [ -x /usr/bin/sh
  ]; then\n\texec /usr/bin/sh \nelif [ -x /bin/sh ]; then\n\texec /bin/sh \nelif [
  -x /busybox/sh ]; then\n\texec /busybox/sh \nelse\n\techo shell not found\n\texit
  1\nfi\n\n"
passfile: false
extension: ""
  job=14775 project=213 runner=hZeY5Uek
Using Docker executor with image python:3.8 ...     job=14775 project=213 runner=hZeY5Uek
Looking for prebuilt image registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f761588f...  job=14775 project=213 runner=hZeY5Uek
Creating user-defined volumes...                    job=14775 project=213 runner=hZeY5Uek
Using host-based "/var/run/docker.sock" for "/var/run/docker.sock"...  job=14775 project=213 runner=hZeY5Uek
Checking for jobs... nothing                        runner=hZeY5Uek
Created container to set volume permissions         container_id=47be89a7ca97f073f3488bb090bc389be816b09b66b732d9843a1b563bfaab33 context=set_volume_permission job=14775 project=213 runner=hZeY5Uek volume_name=runner-hzey5uek-project-213-concurrent-0-cache-3c3f060a0374fc8bc39395164f415a70
WARNING: Preparation failed: adding cache volume: set volume permissions: running permission container "47be89a7ca97f073f3488bb090bc389be816b09b66b732d9843a1b563bfaab33" for volume "runner-hzey5uek-project-213-concurrent-0-cache-3c3f060a0374fc8bc39395164f415a70": starting permission container: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: unable to apply cgroup configuration: mkdir /sys/fs/cgroup/cpuset/docker: permission denied: unknown (linux_set.go:105:0s)  job=14775 project=213 runner=hZeY5Uek
Will be retried in 3s ...                           job=14775 project=213 runner=hZeY5Uek
Feeding runners to channel                          builds=1
Checking for jobs... nothing                        runner=hZeY5Uek
Appending trace to coordinator... ok                code=202 job=14775 job-log=0-845 job-status=running runner=hZeY5Uek sent-log=0-844 status=202 Accepted update-interval=3s
Connected to docker daemon (api version: 1.41, server version: 20.10.15, kernel: 5.10.102.1-microsoft-standard-WSL2, os: linux/x86_64)  job=14775 project=213 runner=hZeY5Uek
Shell configuration: command: bash
arguments: []
cmdline: bash
dockercommand:
- sh
- -c
- "if [ -x /usr/local/bin/bash ]; then\n\texec /usr/local/bin/bash \nelif [ -x /usr/bin/bash
  ]; then\n\texec /usr/bin/bash \nelif [ -x /bin/bash ]; then\n\texec /bin/bash \nelif
  [ -x /usr/local/bin/sh ]; then\n\texec /usr/local/bin/sh \nelif [ -x /usr/bin/sh
  ]; then\n\texec /usr/bin/sh \nelif [ -x /bin/sh ]; then\n\texec /bin/sh \nelif [
  -x /busybox/sh ]; then\n\texec /busybox/sh \nelse\n\techo shell not found\n\texit
  1\nfi\n\n"
passfile: false
extension: ""
  job=14775 project=213 runner=hZeY5Uek
Using Docker executor with image python:3.8 ...     job=14775 project=213 runner=hZeY5Uek
Looking for prebuilt image registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f761588f...  job=14775 project=213 runner=hZeY5Uek
Creating user-defined volumes...                    job=14775 project=213 runner=hZeY5Uek
Using host-based "/var/run/docker.sock" for "/var/run/docker.sock"...  job=14775 project=213 runner=hZeY5Uek
Created container to set volume permissions         container_id=cc2dd3963ec36af4841ff1e39681f8770e73d610f33fa8b155ff0f4fe3371fcc context=set_volume_permission job=14775 project=213 runner=hZeY5Uek volume_name=runner-hzey5uek-project-213-concurrent-0-cache-3c3f060a0374fc8bc39395164f415a70
WARNING: Preparation failed: adding cache volume: set volume permissions: running permission container "cc2dd3963ec36af4841ff1e39681f8770e73d610f33fa8b155ff0f4fe3371fcc" for volume "runner-hzey5uek-project-213-concurrent-0-cache-3c3f060a0374fc8bc39395164f415a70": starting permission container: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: unable to apply cgroup configuration: mkdir /sys/fs/cgroup/cpuset/docker: permission denied: unknown (linux_set.go:105:0s)  job=14775 project=213 runner=hZeY5Uek
Will be retried in 3s ...                           job=14775 project=213 runner=hZeY5Uek
Feeding runners to channel                          builds=1
Checking for jobs... nothing                        runner=hZeY5Uek
Appending trace to coordinator... ok                code=202 job=14775 job-log=0-1506 job-status=running runner=hZeY5Uek sent-log=845-1505 status=202 Accepted update-interval=3s
Connected to docker daemon (api version: 1.41, server version: 20.10.15, kernel: 5.10.102.1-microsoft-standard-WSL2, os: linux/x86_64)  job=14775 project=213 runner=hZeY5Uek
Shell configuration: command: bash
arguments: []
cmdline: bash
dockercommand:
- sh
- -c
- "if [ -x /usr/local/bin/bash ]; then\n\texec /usr/local/bin/bash \nelif [ -x /usr/bin/bash
  ]; then\n\texec /usr/bin/bash \nelif [ -x /bin/bash ]; then\n\texec /bin/bash \nelif
  [ -x /usr/local/bin/sh ]; then\n\texec /usr/local/bin/sh \nelif [ -x /usr/bin/sh
  ]; then\n\texec /usr/bin/sh \nelif [ -x /bin/sh ]; then\n\texec /bin/sh \nelif [
  -x /busybox/sh ]; then\n\texec /busybox/sh \nelse\n\techo shell not found\n\texit
  1\nfi\n\n"
passfile: false
extension: ""
  job=14775 project=213 runner=hZeY5Uek
Using Docker executor with image python:3.8 ...     job=14775 project=213 runner=hZeY5Uek
Looking for prebuilt image registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f761588f...  job=14775 project=213 runner=hZeY5Uek
Creating user-defined volumes...                    job=14775 project=213 runner=hZeY5Uek
Using host-based "/var/run/docker.sock" for "/var/run/docker.sock"...  job=14775 project=213 runner=hZeY5Uek
Created container to set volume permissions         container_id=4bf3a5171b628d84048534899a653d92ee342a0aa7b6163578375d08b463db26 context=set_volume_permission job=14775 project=213 runner=hZeY5Uek volume_name=runner-hzey5uek-project-213-concurrent-0-cache-3c3f060a0374fc8bc39395164f415a70
WARNING: Preparation failed: adding cache volume: set volume permissions: running permission container "4bf3a5171b628d84048534899a653d92ee342a0aa7b6163578375d08b463db26" for volume "runner-hzey5uek-project-213-concurrent-0-cache-3c3f060a0374fc8bc39395164f415a70": starting permission container: Error response from daemon: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: unable to apply cgroup configuration: mkdir /sys/fs/cgroup/cpuset/docker: permission denied: unknown (linux_set.go:105:0s)  job=14775 project=213 runner=hZeY5Uek
Will be retried in 3s ...                           job=14775 project=213 runner=hZeY5Ue
satonreb commented 2 years ago

Log from dind container is

Generating RSA private key, 4096 bit long modulus (2 primes)
.....................................................................................++++
.++++
e is 65537 (0x010001)
Generating RSA private key, 4096 bit long modulus (2 primes)
...............................................................................++++
..++++
e is 65537 (0x010001)
Signature ok
subject=CN = docker:dind server
Getting CA Private Key
/certs/server/cert.pem: OK
Generating RSA private key, 4096 bit long modulus (2 primes)
..............................++++
.........................................................................................................++++
e is 65537 (0x010001)
Signature ok
subject=CN = docker:dind client
Getting CA Private Key
/certs/client/cert.pem: OK
time="2022-05-11T19:58:27.433800000Z" level=info msg="Starting up"
time="2022-05-11T19:58:27.436774700Z" level=warning msg="could not change group /var/run/docker.sock to docker: group docker not found"
time="2022-05-11T19:58:27.439136000Z" level=info msg="libcontainerd: started new containerd process" pid=72
time="2022-05-11T19:58:27.439184300Z" level=info msg="parsed scheme: \"unix\"" module=grpc
time="2022-05-11T19:58:27.439208500Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
time="2022-05-11T19:58:27.439303500Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
time="2022-05-11T19:58:27.439332600Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
time="2022-05-11T19:58:27Z" level=warning msg="deprecated version : `1`, please switch to version `2`"
time="2022-05-11T19:58:27.482476500Z" level=info msg="starting containerd" revision=212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 version=v1.6.4
time="2022-05-11T19:58:27.493567900Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1
time="2022-05-11T19:58:27.493762100Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.498339800Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"ip: can't find device 'aufs'\\nmodprobe: can't change directory to '/lib/modules': No such file or directory\\n\"): skip plugin" type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.498381100Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.498622100Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.498653000Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.498667500Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"
time="2022-05-11T19:58:27.498676400Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.498791600Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.499643900Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.499810800Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1
time="2022-05-11T19:58:27.499843500Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1
time="2022-05-11T19:58:27.499912600Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"
time="2022-05-11T19:58:27.499939800Z" level=info msg="metadata content store policy set" policy=shared
time="2022-05-11T19:58:27.514273900Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1
time="2022-05-11T19:58:27.514322300Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1
time="2022-05-11T19:58:27.514335400Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1
time="2022-05-11T19:58:27.514384100Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.514419700Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.514432100Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.514461000Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.514473800Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.514633200Z" level=info msg="loading plugin \"io.containerd.service.v1.leases-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.514880600Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.514929300Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.515047700Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
time="2022-05-11T19:58:27.515530600Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
time="2022-05-11T19:58:27.515972000Z" level=error msg="cleanup working directory in namespace" error="open /var/lib/docker/containerd/daemon/io.containerd.runtime.v2.task/moby: no such file or directory" namespace=moby
time="2022-05-11T19:58:27.516017100Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
time="2022-05-11T19:58:27.516266700Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
time="2022-05-11T19:58:27.516307800Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516320200Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
time="2022-05-11T19:58:27.516370500Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516400300Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516422000Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516447600Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516459100Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516487100Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516497900Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516525500Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.516539500Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
time="2022-05-11T19:58:27.517753300Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.517794100Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.517825100Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
time="2022-05-11T19:58:27.517836100Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1
time="2022-05-11T19:58:27.517848800Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="no OpenTelemetry endpoint: skip plugin" type=io.containerd.tracing.processor.v1
time="2022-05-11T19:58:27.517875300Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1
time="2022-05-11T19:58:27.517900800Z" level=error msg="failed to initialize a tracing processor \"otlp\"" error="no OpenTelemetry endpoint: skip plugin"
time="2022-05-11T19:58:27.518558000Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock
time="2022-05-11T19:58:27.519028500Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc
time="2022-05-11T19:58:27.519398100Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock
time="2022-05-11T19:58:27.519446100Z" level=info msg="containerd successfully booted in 0.038391s"
time="2022-05-11T19:58:27.527521500Z" level=info msg="parsed scheme: \"unix\"" module=grpc
time="2022-05-11T19:58:27.527552000Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
time="2022-05-11T19:58:27.527566500Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
time="2022-05-11T19:58:27.527574400Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
time="2022-05-11T19:58:27.529283300Z" level=info msg="parsed scheme: \"unix\"" module=grpc
time="2022-05-11T19:58:27.529309200Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
time="2022-05-11T19:58:27.529321600Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock  <nil> 0 <nil>}] <nil> <nil>}" module=grpc
time="2022-05-11T19:58:27.529328000Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
time="2022-05-11T19:58:27.531069800Z" level=error msg="failed to mount overlay: operation not permitted" storage-driver=overlay2
time="2022-05-11T19:58:27.531487000Z" level=error msg="exec: \"fuse-overlayfs\": executable file not found in $PATH" storage-driver=fuse-overlayfs
time="2022-05-11T19:58:27.534725500Z" level=error msg="AUFS cannot be used in non-init user namespace" storage-driver=aufs
time="2022-05-11T19:58:27.535174300Z" level=error msg="failed to mount overlay: operation not permitted" storage-driver=overlay
time="2022-05-11T19:58:27.535198700Z" level=error msg="Failed to built-in GetDriver graph devicemapper /var/lib/docker"
time="2022-05-11T19:58:27.552216000Z" level=warning msg="Your kernel does not support cgroup blkio weight"
time="2022-05-11T19:58:27.552256200Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
time="2022-05-11T19:58:27.552265100Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_bps_device"
time="2022-05-11T19:58:27.552269400Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_bps_device"
time="2022-05-11T19:58:27.552273500Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_iops_device"
time="2022-05-11T19:58:27.552279600Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_iops_device"
time="2022-05-11T19:58:27.552533800Z" level=info msg="Loading containers: start."
time="2022-05-11T19:58:27.644136700Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
time="2022-05-11T19:58:27.694723700Z" level=info msg="Loading containers: done."
time="2022-05-11T19:58:27.706245500Z" level=info msg="Docker daemon" commit=4433bf6 graphdriver(s)=vfs version=20.10.15
time="2022-05-11T19:58:27.706448300Z" level=info msg="Daemon has completed initialization"
time="2022-05-11T19:58:27.741813500Z" level=info msg="API listen on /var/run/docker.sock"
time="2022-05-11T19:58:27.744652900Z" level=info msg="API listen on [::]:2376"
time="2022-05-11T19:59:29.289387800Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
time="2022-05-11T19:59:29.289434300Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
time="2022-05-11T19:59:29.289444300Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
time="2022-05-11T19:59:29.289674500Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/4ff3deae3e1f08d9b7ea7dadf6b1f45b073c25c95d679170bf640c746e30ea5d pid=218 runtime=io.containerd.runc.v2
time="2022-05-11T19:59:29.311248000Z" level=info msg="shim disconnected" id=4ff3deae3e1f08d9b7ea7dadf6b1f45b073c25c95d679170bf640c746e30ea5d
time="2022-05-11T19:59:29.311311200Z" level=warning msg="cleaning up after shim disconnected" id=4ff3deae3e1f08d9b7ea7dadf6b1f45b073c25c95d679170bf640c746e30ea5d namespace=moby
time="2022-05-11T19:59:29.311323200Z" level=info msg="cleaning up dead shim"
time="2022-05-11T19:59:29.317627700Z" level=warning msg="cleanup warnings time=\"2022-05-11T19:59:29Z\" level=info msg=\"starting signal loop\" namespace=moby pid=238 runtime=io.containerd.runc.v2\ntime=\"2022-05-11T19:59:29Z\" level=warning msg=\"failed to read init pid file\" error=\"open /run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/4ff3deae3e1f08d9b7ea7dadf6b1f45b073c25c95d679170bf640c746e30ea5d/init.pid: no such file or directory\" runtime=io.containerd.runc.v2\n"
time="2022-05-11T19:59:29.318769000Z" level=error msg="copy shim log" error="read /proc/self/fd/14: file already closed"
time="2022-05-11T19:59:29.319696900Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T19:59:29.319776200Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T19:59:29.531675400Z" level=error msg="4ff3deae3e1f08d9b7ea7dadf6b1f45b073c25c95d679170bf640c746e30ea5d cleanup: failed to delete container from containerd: no such container"
time="2022-05-11T19:59:32.815822000Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
time="2022-05-11T19:59:32.815899200Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
time="2022-05-11T19:59:32.815911300Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
time="2022-05-11T19:59:32.816186300Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/970badae48615e5e2cd7ec642f7138240c6f10fd964f72dff091fef12d87bc07 pid=264 runtime=io.containerd.runc.v2
time="2022-05-11T19:59:32.835546600Z" level=info msg="shim disconnected" id=970badae48615e5e2cd7ec642f7138240c6f10fd964f72dff091fef12d87bc07
time="2022-05-11T19:59:32.835639200Z" level=warning msg="cleaning up after shim disconnected" id=970badae48615e5e2cd7ec642f7138240c6f10fd964f72dff091fef12d87bc07 namespace=moby
time="2022-05-11T19:59:32.835690700Z" level=info msg="cleaning up dead shim"
time="2022-05-11T19:59:32.843452700Z" level=warning msg="cleanup warnings time=\"2022-05-11T19:59:32Z\" level=info msg=\"starting signal loop\" namespace=moby pid=283 runtime=io.containerd.runc.v2\ntime=\"2022-05-11T19:59:32Z\" level=warning msg=\"failed to read init pid file\" error=\"open /run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/970badae48615e5e2cd7ec642f7138240c6f10fd964f72dff091fef12d87bc07/init.pid: no such file or directory\" runtime=io.containerd.runc.v2\n"
time="2022-05-11T19:59:32.844946500Z" level=error msg="copy shim log" error="read /proc/self/fd/14: file already closed"
time="2022-05-11T19:59:32.845785700Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T19:59:32.845922700Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T19:59:33.060271700Z" level=error msg="970badae48615e5e2cd7ec642f7138240c6f10fd964f72dff091fef12d87bc07 cleanup: failed to delete container from containerd: no such container"
time="2022-05-11T19:59:36.332568800Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
time="2022-05-11T19:59:36.332632700Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
time="2022-05-11T19:59:36.332643100Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
time="2022-05-11T19:59:36.332963300Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/20ddb0c1a6739b33ae9504a920455046abdbec2534ced88782636af43aedd85d pid=309 runtime=io.containerd.runc.v2
time="2022-05-11T19:59:36.349694400Z" level=info msg="shim disconnected" id=20ddb0c1a6739b33ae9504a920455046abdbec2534ced88782636af43aedd85d
time="2022-05-11T19:59:36.349771300Z" level=warning msg="cleaning up after shim disconnected" id=20ddb0c1a6739b33ae9504a920455046abdbec2534ced88782636af43aedd85d namespace=moby
time="2022-05-11T19:59:36.349782600Z" level=info msg="cleaning up dead shim"
time="2022-05-11T19:59:36.356904200Z" level=warning msg="cleanup warnings time=\"2022-05-11T19:59:36Z\" level=info msg=\"starting signal loop\" namespace=moby pid=329 runtime=io.containerd.runc.v2\ntime=\"2022-05-11T19:59:36Z\" level=warning msg=\"failed to read init pid file\" error=\"open /run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/20ddb0c1a6739b33ae9504a920455046abdbec2534ced88782636af43aedd85d/init.pid: no such file or directory\" runtime=io.containerd.runc.v2\n"
time="2022-05-11T19:59:36.358300500Z" level=error msg="copy shim log" error="read /proc/self/fd/14: file already closed"
time="2022-05-11T19:59:36.359122800Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T19:59:36.359137500Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T19:59:36.519360200Z" level=error msg="20ddb0c1a6739b33ae9504a920455046abdbec2534ced88782636af43aedd85d cleanup: failed to delete container from containerd: no such container"
time="2022-05-11T20:06:32.011356100Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
time="2022-05-11T20:06:32.011428500Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
time="2022-05-11T20:06:32.011441200Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
time="2022-05-11T20:06:32.011761600Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/47be89a7ca97f073f3488bb090bc389be816b09b66b732d9843a1b563bfaab33 pid=355 runtime=io.containerd.runc.v2
time="2022-05-11T20:06:32.032665700Z" level=info msg="shim disconnected" id=47be89a7ca97f073f3488bb090bc389be816b09b66b732d9843a1b563bfaab33
time="2022-05-11T20:06:32.032736100Z" level=warning msg="cleaning up after shim disconnected" id=47be89a7ca97f073f3488bb090bc389be816b09b66b732d9843a1b563bfaab33 namespace=moby
time="2022-05-11T20:06:32.032757800Z" level=info msg="cleaning up dead shim"
time="2022-05-11T20:06:32.041487600Z" level=warning msg="cleanup warnings time=\"2022-05-11T20:06:32Z\" level=info msg=\"starting signal loop\" namespace=moby pid=374 runtime=io.containerd.runc.v2\ntime=\"2022-05-11T20:06:32Z\" level=warning msg=\"failed to read init pid file\" error=\"open /run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/47be89a7ca97f073f3488bb090bc389be816b09b66b732d9843a1b563bfaab33/init.pid: no such file or directory\" runtime=io.containerd.runc.v2\n"
time="2022-05-11T20:06:32.043673300Z" level=error msg="copy shim log" error="read /proc/self/fd/14: file already closed"
time="2022-05-11T20:06:32.044860300Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T20:06:32.044898800Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T20:06:32.218791700Z" level=error msg="47be89a7ca97f073f3488bb090bc389be816b09b66b732d9843a1b563bfaab33 cleanup: failed to delete container from containerd: no such container"
time="2022-05-11T20:06:35.536491800Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
time="2022-05-11T20:06:35.536603000Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
time="2022-05-11T20:06:35.536613600Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
time="2022-05-11T20:06:35.536990100Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/cc2dd3963ec36af4841ff1e39681f8770e73d610f33fa8b155ff0f4fe3371fcc pid=400 runtime=io.containerd.runc.v2
time="2022-05-11T20:06:35.558506600Z" level=info msg="shim disconnected" id=cc2dd3963ec36af4841ff1e39681f8770e73d610f33fa8b155ff0f4fe3371fcc
time="2022-05-11T20:06:35.558582600Z" level=warning msg="cleaning up after shim disconnected" id=cc2dd3963ec36af4841ff1e39681f8770e73d610f33fa8b155ff0f4fe3371fcc namespace=moby
time="2022-05-11T20:06:35.558594400Z" level=info msg="cleaning up dead shim"
time="2022-05-11T20:06:35.565477800Z" level=warning msg="cleanup warnings time=\"2022-05-11T20:06:35Z\" level=info msg=\"starting signal loop\" namespace=moby pid=419 runtime=io.containerd.runc.v2\ntime=\"2022-05-11T20:06:35Z\" level=warning msg=\"failed to read init pid file\" error=\"open /run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/cc2dd3963ec36af4841ff1e39681f8770e73d610f33fa8b155ff0f4fe3371fcc/init.pid: no such file or directory\" runtime=io.containerd.runc.v2\n"
time="2022-05-11T20:06:35.567530500Z" level=error msg="copy shim log" error="read /proc/self/fd/14: file already closed"
time="2022-05-11T20:06:35.568841200Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T20:06:35.568909900Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T20:06:35.739592700Z" level=error msg="cc2dd3963ec36af4841ff1e39681f8770e73d610f33fa8b155ff0f4fe3371fcc cleanup: failed to delete container from containerd: no such container"
time="2022-05-11T20:06:39.021958500Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
time="2022-05-11T20:06:39.022018000Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
time="2022-05-11T20:06:39.022030400Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
time="2022-05-11T20:06:39.022274800Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/4bf3a5171b628d84048534899a653d92ee342a0aa7b6163578375d08b463db26 pid=445 runtime=io.containerd.runc.v2
time="2022-05-11T20:06:39.041383900Z" level=info msg="shim disconnected" id=4bf3a5171b628d84048534899a653d92ee342a0aa7b6163578375d08b463db26
time="2022-05-11T20:06:39.041484800Z" level=warning msg="cleaning up after shim disconnected" id=4bf3a5171b628d84048534899a653d92ee342a0aa7b6163578375d08b463db26 namespace=moby
time="2022-05-11T20:06:39.041516600Z" level=info msg="cleaning up dead shim"
time="2022-05-11T20:06:39.048320700Z" level=warning msg="cleanup warnings time=\"2022-05-11T20:06:39Z\" level=info msg=\"starting signal loop\" namespace=moby pid=464 runtime=io.containerd.runc.v2\ntime=\"2022-05-11T20:06:39Z\" level=warning msg=\"failed to read init pid file\" error=\"open /run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/4bf3a5171b628d84048534899a653d92ee342a0aa7b6163578375d08b463db26/init.pid: no such file or directory\" runtime=io.containerd.runc.v2\n"
time="2022-05-11T20:06:39.050174000Z" level=error msg="copy shim log" error="read /proc/self/fd/14: file already closed"
time="2022-05-11T20:06:39.051214800Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T20:06:39.051270900Z" level=error msg="stream copy error: reading from a closed fifo"
time="2022-05-11T20:06:39.240481400Z" level=error msg="4bf3a5171b628d84048534899a653d92ee342a0aa7b6163578375d08b463db26 cleanup: failed to delete container from containerd: no such container"