Stuck on “Kubernetes is starting…”

Jastrzebowski commented 3 years ago

[x] I have tried with the latest version of Docker Desktop
[x] I have tried disabling enabled experimental features
[x] I have uploaded Diagnostics
Diagnostics ID: 38B25116-F767-42F3-B5F4-65A1DFBDCE16/20210517095934

Expected behavior

Kubernetes cluster should start

Actual behavior

Kubernetes cluster is stuck in Kubernetes is starting… state

Information

macOS Version: 11.3.1
Intel chip or Apple chip: Intel
Docker Desktop Version: 3.3.3

Steps to reproduce the behavior

After upgrading to MacOS 11.3.1 last week k8s cluster is stuck in Kubernetes is starting…, I've tried the following:

Update to last Docker for Mac version 3.3.3
Reset Kubernetes cluster
Clean purge data
Reset to factory settings
rm -rf ~/Library/Group\ Containers/group.com.docker/pki
rm -rf ~/.kube
Uninstall Docker, remove the app, reboot and install again (actually twice, with different combination of point 5 and 6)
Cleaning up disk space (more than 100GB free)
Turning on and off Use new virtualization framework
Updating local kubectl version to 1.21.0, working as expected with remote clusters

Resources used

Containers

I've turned on Show system containers (advanced) option, when restarting docker the docker/desktop-kubernetes image is not running, when started manually throw ane error:

Error invoking remote method 'docker-run-container': Error: (HTTP code 400) unexpected - OCI runtime create failed: container_linux.go:367: starting container process caused: exec: "/usr/bin/kubelet.sh": stat /usr/bin/kubelet.sh: no such file or directory: unknown

Creating a new container:

Logs

In logs (why logs section despaired from settings?) I see the following when running k8s:

default 12:13:14.105180+0200    com.docker.hyperkit [   34.029894] bpfilter: Loaded bpfilter_umh pid 2925
default 12:13:14.106481+0200    com.docker.hyperkit [   34.031752] bpfilter: write fail -32

Help will be highly appreciated.

djs55 commented 3 years ago

@Jastrzebowski thanks for the detailed report. We fixed a Kubernetes startup issue in version 3.4.0 which could lead to this. Could you update and try again? If it still reproduces, could you upload a fresh set of diagnostics and quote the ID. Thanks in advance!

aaronfern commented 3 years ago

I have a similar issue Upgraded docker-for-desktop to v3.4.0, and kubernetes refuses to startup

These are the logs I get in pod k8s_kube-scheduler_kube-scheduler-docker-desktop_kube-system_0.....

I0623 14:20:51.356913 1 serving.go:347] Generated self-signed cert in-memory

W0623 14:20:51.772381 1 authentication.go:337] Error looking up in-cluster authentication configuration: Get "https://192.168.65.4:6443/api/v1/namespaces/kube-system/configmaps/extension-apiserver-authentication": dial tcp 192.168.65.4:6443: connect: connection refused

W0623 14:20:51.772418 1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous.

W0623 14:20:51.772422 1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

I0623 14:20:51.778031 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file

I0623 14:20:51.778070 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

I0623 14:20:51.778082 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259

I0623 14:20:51.778109 1 tlsconfig.go:240] Starting DynamicServingCertificateController

E0623 14:20:51.778981 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.65.4:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.65.4:6443: connect: connection refused

E0623 14:20:51.779119 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: Get "https://192.168.65.4:6443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.65.4:6443: connect: connection refused

E0623 14:20:51.779251 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.65.4:6443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%3Dextension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.65.4:6443: connect: connection refused

E0623 14:20:51.779344 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.65.4:6443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.65.4:6443: connect: connection refused

E0623 14:20:51.779534 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: Get "https://192.168.65.4:6443/apis/storage.k8s.io/v1beta1/csistoragecapacities?limit=500&resourceVersion=0": dial tcp 192.168.65.4:6443: connect: connection refused

E0623 14:20:51.779558 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.65.4:6443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.65.4:6443: connect: connection refused

Any help to solve this would be highly appreciated

UPDATE: Fixed this. Increasing amount of RAM and CPU helped https://stackoverflow.com/questions/54264421/suddenly-getting-unable-to-connect-to-the-server-net-http-tls-handshake-timeo

alonsoir commented 3 years ago

I have a similar issue. I tried to upgrade vertical in local machine, but it is freezed in "Starting", until Docker Desktop says: Failed to Start. I will gather data using /Applications/Docker.app/Contents/MacOS/com.docker.diagnose gather -upload command.

CPU: 4, RAM: 8, SWAP: 4. Mac OS Big Sur 11.4. Docker Desktop Version 3.5.1 (3.5.1.7) K8s: 1.21.2 It is stuck in Starting...

Please, help.

aaronfern commented 3 years ago

@alonsoir did you enable and check the container logs? That might provide some hint to the cause

alonsoir commented 3 years ago

Hi Aaron, this is the output:

[I] ➜ /Applications/Docker.app/Contents/MacOS/com.docker.diagnose gather -upload Gathering diagnostics for ID 8D3F8A20-BDEE-4415-AEA4-4463AF8A473A/20210630122639 into /tmp/8D3F8A20-BDEE-4415-AEA4-4463AF8A473A/20210630122639.zip. This may take up to 15 minutes. time="2021-06-30T14:26:39+02:00" level=info msg="Triggering Linux sysrq via a unix socket: Library/Containers/com.docker.docker/Data/diagnosticd.sock" type=unixsock time="2021-06-30T14:27:40+02:00" level=warning msg="[/usr/local/bin/kubectl.docker --namespace docker get pods -o go-template={{range .items}}{{.metadata.name}}\n{{end}}]: exit status 1" type=kubernetes time="2021-06-30T14:27:40+02:00" level=warning msg="Error from server (InternalError): an error on the server (\"\") has prevented the request from succeeding\n" type=kubernetes time="2021-06-30T14:28:30+02:00" level=warning msg="[/usr/local/bin/kubectl.docker --namespace kube-system get pods -o go-template={{range .items}}{{.metadata.name}}\n{{end}}]: exit status 1" type=kubernetes time="2021-06-30T14:28:30+02:00" level=warning msg="Error from server (InternalError): an error on the server (\"\") has prevented the request from succeeding\n" type=kubernetes time="2021-06-30T14:28:46+02:00" level=info msg="Start gathering list of 90 elements (timeout=15m0s)" type=list time="2021-06-30T14:28:46+02:00" level=info msg="Gathering DiagKit" type=list time="2021-06-30T14:28:46+02:00" level=info msg="Gathering BackendGatherer" type=list time="2021-06-30T14:28:46+02:00" level=info msg="Gathering system" type=list time="2021-06-30T14:28:46+02:00" level=info msg="Executing: [sw_vers -productVersion]" time="2021-06-30T14:28:46+02:00" level=info msg="Executing: [sw_vers -buildVersion]" time="2021-06-30T14:28:46+02:00" level=info msg="Executing: [uname -r]" time="2021-06-30T14:28:46+02:00" level=info msg="Executing: [sysctl kern.boottime]" time="2021-06-30T14:28:46+02:00" level=info msg="Executing: [sysctl hw.memsize]" time="2021-06-30T14:28:46+02:00" level=info msg="Executing: [vm_stat]" time="2021-06-30T14:28:46+02:00" level=info msg="Executing: [sysctl machdep.cpu]" time="2021-06-30T14:28:46+02:00" level=info msg="Gathering ProcessGatherer" type=list time="2021-06-30T14:28:48+02:00" level=info msg="Gathering uname -a" type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [uname -a]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering ps uax" type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [ps uax]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering dmesg " type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [dmesg]" time="2021-06-30T14:28:48+02:00" level=warning msg="[dmesg] exit status 1" type=cmd time="2021-06-30T14:28:48+02:00" level=info msg="Gathering id " type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [id]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering sysctl -a" type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [sysctl -a]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering mount " type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [mount]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering df -h" type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [df -h]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering launchctl print-disabled (timeout 0s)system" type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [launchctl print-disabled system]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering system_profiler SPHardwareDataType" type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [system_profiler SPHardwareDataType]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering defaults read (timeout 0s)/Library/Preferences/com.apple.alf.plist" type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [defaults read /Library/Preferences/com.apple.alf.plist]" time="2021-06-30T14:28:48+02:00" level=info msg="Gathering kextstat " type=list time="2021-06-30T14:28:48+02:00" level=info msg="Executing: [kextstat]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering ifconfig -a" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [ifconfig -a]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering netstat -ln" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [netstat -ln]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering netstat -mm" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [netstat -mm]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering netstat -nr" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [netstat -nr]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering /etc/resolv.conf" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Gathering: /etc/resolv.conf" type=file time="2021-06-30T14:28:49+02:00" level=info msg="Gathering /etc/hosts" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Gathering: /etc/hosts" type=file time="2021-06-30T14:28:49+02:00" level=info msg="Gathering scutil --dns" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [scutil --dns]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering scutil --nc (timeout 0s)list" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [scutil --nc list]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering scutil --proxy (timeout 0s)list" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [scutil --proxy list]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering system_profiler SPFirewallDataType" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [system_profiler SPFirewallDataType]" time="2021-06-30T14:28:49+02:00" level=info msg="Gathering HTTP GET localhost /v1.24/version" type=list time="2021-06-30T14:28:49+02:00" level=info msg="HTTP GET: localhost /v1.24/version" type=http time="2021-06-30T14:28:49+02:00" level=info msg="Gathering HTTP GET localhost /v1.24/info" type=list time="2021-06-30T14:28:49+02:00" level=info msg="HTTP GET: localhost /v1.24/info" type=http time="2021-06-30T14:28:49+02:00" level=info msg="Gathering HTTP GET localhost /v1.24/containers/json?all=1" type=list time="2021-06-30T14:28:49+02:00" level=info msg="HTTP GET: localhost /v1.24/containers/json?all=1" type=http time="2021-06-30T14:28:49+02:00" level=info msg="Gathering HTTP GET localhost /v1.24/nodes" type=list time="2021-06-30T14:28:49+02:00" level=info msg="HTTP GET: localhost /v1.24/nodes" type=http time="2021-06-30T14:28:49+02:00" level=info msg="Gathering HTTP GET localhost /v1.24/services" type=list time="2021-06-30T14:28:49+02:00" level=info msg="HTTP GET: localhost /v1.24/services" type=http time="2021-06-30T14:28:49+02:00" level=info msg="Gathering HTTP GET localhost /v1.24/networks" type=list time="2021-06-30T14:28:49+02:00" level=info msg="HTTP GET: localhost /v1.24/networks" type=http time="2021-06-30T14:28:49+02:00" level=info msg="Gathering {\n \"id\": \"8D3F8A20-BDEE-4415-AEA4-4463AF8A473A\",\n \"date\": \"2021-06-30 12:26:39.862868 +0000 UTC\"\n}\n" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace docker describe pods" type=list time="2021-06-30T14:28:49+02:00" level=info msg="Executing: [/usr/local/bin/kubectl.docker --context docker-desktop version]" time="2021-06-30T14:28:54+02:00" level=warning msg="[/usr/local/bin/kubectl.docker --context docker-desktop version] signal: killed" type=cmd time="2021-06-30T14:28:54+02:00" level=warning msg="[/usr/local/bin/kubectl.docker --context docker-desktop version] (timeout: 5s) -> context deadline exceeded" time="2021-06-30T14:28:54+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:54+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace docker describe daemonset" type=list time="2021-06-30T14:28:54+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:54+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace docker describe replicaset" type=list time="2021-06-30T14:28:54+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:54+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace docker describe deployments" type=list time="2021-06-30T14:28:54+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:54+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace kube-system describe pods" type=list time="2021-06-30T14:28:54+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:54+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace kube-system describe daemonset" type=list time="2021-06-30T14:28:54+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:54+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace kube-system describe replicaset" type=list time="2021-06-30T14:28:54+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:54+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace kube-system describe deployments" type=list time="2021-06-30T14:28:54+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:54+02:00" level=info msg="Gathering VPNKit" type=list time="2021-06-30T14:28:54+02:00" level=info msg="Gathering Library/Containers/com.docker.docker/Data/log/vm/**" type=list time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm" type=directory time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/acpid.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/binfmt.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/binfmt.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Skipping empty file: Library/Containers/com.docker.docker/Data/log/vm/console.log.10" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.4" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.5" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.6" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.7" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.8" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/console.log.9" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/containerd.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/containerd.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/containerd.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/containerd.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/dhcpcd.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/diagnose.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/dns-forwarder.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.4" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.5" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.6" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.7" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.log.8" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/docker.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/dockerd.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/dockerd.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/dockerd.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/dockerd.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/dockerd.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/host-timesync-daemon.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.4" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.5" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.6" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.7" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.log.8" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/http-proxy.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.4" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.5" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.6" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.7" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kmsg.log.8" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.4" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.5" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.6" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.7" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/kubelet.log.8" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.4" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.5" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.6" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.7" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.log.8" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/lifecycle-server.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/memlogd.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/nfs-common.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.000-dhcpcd.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.003-format.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.004-extend.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.006-metadata.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.007-swap.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.007-swap.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.008-mount-docker.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.009-bridge.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.009-swap.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.009-swap.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.010-mount-docker.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/onboot.011-bridge.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/rpcbind.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/sntpc.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/sntpc.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/sntpc.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/sntpc.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/socks.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/trim-after-delete.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/volume-contents.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/volume-contents.out.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/vpnkit-bridge.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/vpnkit-bridge.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/vpnkit-bridge.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/vpnkit-bridge.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/vpnkit-bridge.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/vpnkit-bridge.log.4" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/vpnkit-bridge.log.5" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/vm/vpnkit-forwarder.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering Library/Containers/com.docker.docker/Data/log/host/**" type=list time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host" type=directory time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/Docker.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/Docker.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/Docker.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/Docker.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/Docker.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.0" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.1" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.2" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.3" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.4" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.5" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.6" type=file time="2021-06-30T14:28:54+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.7" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.backend.log.8" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.diagnose.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.0" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.1" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.2" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.3" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.4" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.5" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.6" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.7" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.log.8" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.stderr.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Skipping empty file: Library/Containers/com.docker.docker/Data/log/host/com.docker.driver.amd64-linux.stdout.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.osxfs.stderr.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Skipping empty file: Library/Containers/com.docker.docker/Data/log/host/com.docker.osxfs.stdout.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.supervisor.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.virtualization.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.vpnkit.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.vpnkit.log.0" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.vpnkit.log.1" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/com.docker.vpnkit.stderr.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Skipping empty file: Library/Containers/com.docker.docker/Data/log/host/com.docker.vpnkit.stdout.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Skipping empty file: Library/Containers/com.docker.docker/Data/log/host/docker-credential-desktop.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/docker.stderr.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Skipping empty file: Library/Containers/com.docker.docker/Data/log/host/docker.stdout.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/electron.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/vpnkit-bridge.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/vpnkit-bridge.stderr.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/log/host/vpnkit-bridge.stdout.log" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering /Users/aironman/Library/Group Containers/group.com.docker/features-overrides.json" type=list time="2021-06-30T14:28:55+02:00" level=warning msg="/Users/aironman/Library/Group Containers/group.com.docker/features-overrides.json not included" type=file time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace version " type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace config get-contexts" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace config current-context" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace get nodes" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace get namespaces" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace describe nodes" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace describe pods" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace cluster-info dump" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace describe services" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering kubectl --context docker-desktop --namespace describe storageclass,pv,pvc" type=list time="2021-06-30T14:28:55+02:00" level=info msg="kubernetes is broken" type=kubectl time="2021-06-30T14:28:55+02:00" level=info msg="Gathering log process matches \".[Dd]ocker.\" || (process in {\"kernel\", \"launchservicesd\", \"taskgated-helper\"} && eventMessage contains[c] \"docker\")" type=list time="2021-06-30T14:28:55+02:00" level=info msg="Executing: [/bin/sh -c /usr/bin/log show --debug --info --style syslog --last 1d --predicate 'process matches \".[Dd]ocker.\" || (process in {\"kernel\", \"launchservicesd\", \"taskgated-helper\"} && eventMessage contains[c] \"docker\")']" time="2021-06-30T14:29:12+02:00" level=info msg="Gathering DarwinSyslog Sender = docker Docker Message = docker Docker" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [syslog -F $((Time)(JZ)) $Host $(Sender)[$(Facility)][$(PID)] <$((Level)(str))>: $Message -o -k Sender Seq docker -o -k Sender Seq Docker -o -k Message Seq docker -o -k Message Seq Docker]" time="2021-06-30T14:29:12+02:00" level=info msg="Gathering Library/Containers/com.docker.docker/Data/vms/0/console-ring" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Gathering: Library/Containers/com.docker.docker/Data/vms/0/console-ring" type=file time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o com.docker.driver.amd64-linux) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.driver.amd64-linux)]" time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o com.docker.hyperkit) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.hyperkit)]" time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o qemu-system-aarch64) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o qemu-system-aarch64)]" time="2021-06-30T14:29:12+02:00" level=warning msg="[/bin/sh -c lsof -n -P -p $(pgrep -o qemu-system-aarch64)] exit status 1" type=cmd time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o com.docker.virtualization) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.virtualization)]" time="2021-06-30T14:29:12+02:00" level=warning msg="[/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.virtualization)] exit status 1" type=cmd time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o com.docker.osxfs) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.osxfs)]" time="2021-06-30T14:29:12+02:00" level=warning msg="[/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.osxfs)] exit status 1" type=cmd time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o com.docker.supervisor) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.supervisor)]" time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o com.docker.backend) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.backend)]" time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o com.docker.dev-envs) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.dev-envs)]" time="2021-06-30T14:29:12+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o com.docker.vpnkit) (timeout 0s)" type=list time="2021-06-30T14:29:12+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o com.docker.vpnkit)]" time="2021-06-30T14:29:13+02:00" level=info msg="Gathering lsof -n -P -p $(pgrep -o vpnkit-bridge) (timeout 0s)" type=list time="2021-06-30T14:29:13+02:00" level=info msg="Executing: [/bin/sh -c lsof -n -P -p $(pgrep -o vpnkit-bridge)]" time="2021-06-30T14:29:13+02:00" level=info msg="Gathering osxfsGatherer" type=list time="2021-06-30T14:29:13+02:00" level=info msg="Connecting to com.docker.osxfs" time="2021-06-30T14:29:13+02:00" level=info msg="Querying com.docker.osxfs ExportState" time="2021-06-30T14:29:13+02:00" level=info msg="Querying com.docker.osxfs MountState" time="2021-06-30T14:29:13+02:00" level=info msg="Gathering ls -l (timeout 0s)/Users/aironman/Library/Containers/com.docker.docker/Data/vms/0/data/Docker.raw" type=list time="2021-06-30T14:29:13+02:00" level=info msg="Executing: [ls -l /Users/aironman/Library/Containers/com.docker.docker/Data/vms/0/data/Docker.raw]" time="2021-06-30T14:29:13+02:00" level=info msg="Gathering /tmp/hyperkit-spindump.txt" type=list time="2021-06-30T14:29:13+02:00" level=info msg="Gathering: /tmp/hyperkit-spindump.txt" type=file time="2021-06-30T14:29:13+02:00" level=info msg="Gathering /Users/aironman/Library/Group Containers/group.com.docker/DockerAppStderr.txt" type=list time="2021-06-30T14:29:13+02:00" level=info msg="Gathering: /Users/aironman/Library/Group Containers/group.com.docker/DockerAppStderr.txt" type=file time="2021-06-30T14:29:13+02:00" level=info msg="Gathering /Users/aironman/Library/Group Containers/group.com.docker/already-enabled-features.json" type=list time="2021-06-30T14:29:13+02:00" level=warning msg="/Users/aironman/Library/Group Containers/group.com.docker/already-enabled-features.json not included" type=file time="2021-06-30T14:29:13+02:00" level=info msg="Gathering /Users/aironman/Library/Group Containers/group.com.docker/dhcp.json" type=list time="2021-06-30T14:29:13+02:00" level=info msg="Gathering: /Users/aironman/Library/Group Containers/group.com.docker/dhcp.json" type=file time="2021-06-30T14:29:13+02:00" level=info msg="Gathering /Users/aironman/Library/Group Containers/group.com.docker/features.json" type=list time="2021-06-30T14:29:13+02:00" level=warning msg="/Users/aironman/Library/Group Containers/group.com.docker/features.json not included" type=file time="2021-06-30T14:29:13+02:00" level=info msg="Gathering /Users/aironman/Library/Group Containers/group.com.docker/http_proxy.json" type=list time="2021-06-30T14:29:13+02:00" level=info msg="Gathering: /Users/aironman/Library/Group Containers/group.com.docker/http_proxy.json" type=file time="2021-06-30T14:29:13+02:00" level=info msg="Gathering /Users/aironman/Library/Group Containers/group.com.docker/settings.json" type=list time="2021-06-30T14:29:13+02:00" level=info msg="Gathering: /Users/aironman/Library/Group Containers/group.com.docker/settings.json" type=file time="2021-06-30T14:29:13+02:00" level=info msg="Gathering /Users/aironman/Library/Preferences/group.com.docker.plist" type=list time="2021-06-30T14:29:13+02:00" level=warning msg="/Users/aironman/Library/Preferences/group.com.docker.plist not included" type=file time="2021-06-30T14:29:13+02:00" level=info msg="Gathering ls /Users/aironman/.docker /usr/local/bin /Library/PrivilegedHelperTools /Library/LaunchDaemons /Users/aironman/Library/LaunchAgents /Library/Application Support/Docker/DockerDesktop /Users/aironman/Library/Group Containers/group.com.docker /Users/aironman/Library/Containers/com.docker.docker /Applications/Docker.app" type=list time="2021-06-30T14:29:13+02:00" level=warning msg="exit status 1" type=directorylist time="2021-06-30T14:29:14+02:00" level=info msg="Gathering Redacted /Users/aironman/.docker/config.json" type=list time="2021-06-30T14:29:14+02:00" level=info msg="Gathering: /Users/aironman/.docker/config.json" type=redacted-json time="2021-06-30T14:29:14+02:00" level=info msg="Gathering Redacted /Users/aironman/.docker/daemon.json" type=list time="2021-06-30T14:29:14+02:00" level=info msg="Gathering: /Users/aironman/.docker/daemon.json" type=redacted-json time="2021-06-30T14:29:14+02:00" level=info msg="Gathering /Users/aironman/.docker/canary.json" type=list time="2021-06-30T14:29:14+02:00" level=warning msg="/Users/aironman/.docker/canary.json not included" type=file time="2021-06-30T14:29:14+02:00" level=info msg="Gathering /Users/aironman/.docker/features.json" type=list time="2021-06-30T14:29:14+02:00" level=warning msg="/Users/aironman/.docker/features.json not included" type=file time="2021-06-30T14:29:14+02:00" level=info msg="Gathering HTTP GET localhost /fuse/time" type=list time="2021-06-30T14:29:14+02:00" level=info msg="HTTP GET: localhost /fuse/time" type=http time="2021-06-30T14:29:14+02:00" level=warning msg="Get \"http://localhost/fuse/time\": EOF" type=http time="2021-06-30T14:29:14+02:00" level=info msg="Gathering HTTP GET localhost /fuse/count" type=list time="2021-06-30T14:29:14+02:00" level=info msg="HTTP GET: localhost /fuse/count" type=http time="2021-06-30T14:29:14+02:00" level=warning msg="Get \"http://localhost/fuse/count\": EOF" type=http time="2021-06-30T14:29:14+02:00" level=info msg="Gathering HTTP GET localhost /fuse/filename" type=list time="2021-06-30T14:29:14+02:00" level=info msg="HTTP GET: localhost /fuse/filename" type=http time="2021-06-30T14:29:14+02:00" level=warning msg="Get \"http://localhost/fuse/filename\": EOF" type=http time="2021-06-30T14:29:14+02:00" level=info msg="Gathering HTTP GET localhost /fuse/calls" type=list time="2021-06-30T14:29:14+02:00" level=info msg="HTTP GET: localhost /fuse/calls" type=http time="2021-06-30T14:29:14+02:00" level=warning msg="Get \"http://localhost/fuse/calls\": EOF" type=http time="2021-06-30T14:29:14+02:00" level=info msg="Gathering fuseVolumeGatherer" type=list time="2021-06-30T14:29:14+02:00" level=info msg="Gathering fuseStacksGatherer" type=list time="2021-06-30T14:29:14+02:00" level=info msg="Gathering mutagenGatherer" type=list time="2021-06-30T14:29:19+02:00" level=info msg="Gathering Library/Containers/com.docker.docker/Data/diagnosticd.sock" type=list time="2021-06-30T14:29:19+02:00" level=info msg="Getting Linux Diagnostics via a unix socket: Library/Containers/com.docker.docker/Data/diagnosticd.sock" type=unixsock time="2021-06-30T14:29:25+02:00" level=info msg="All 90 gatherers finished" type=list INFO[0168] Uploaded diagnostics to: https://docker-pinata-support.s3.amazonaws.com/incoming/3/8D3F8A20-BDEE-4415-AEA4-4463AF8A473A/20210630122639.zip

Diagnostics Bundle: /tmp/8D3F8A20-BDEE-4415-AEA4-4463AF8A473A/20210630122639.zip Diagnostics ID: 8D3F8A20-BDEE-4415-AEA4-4463AF8A473A/20210630122639 (uploaded)

Uploading that zip file, I have renamed it.

~ on 🐳 v20.10.7 (desktop-linux) took 2m 49s [I] ➜ output-k8s-failed-at-start.zip

alonsoir commented 3 years ago

I hope that helps. I have run these commands:

pred='process matches ".(ocker|vpnkit)." || (process in {"taskgated-helper", "launchservicesd", "kernel"} && eventMessage contains[c] "docker")'

/usr/bin/log show --debug --info --style syslog --last 1d --predicate "$pred" >/tmp/logs-1-day.txt

Kubernetes failed to start, the generated file is 1.1 GB since I restart Docker. Definitely there is a problem with Kubernetes 1.21.2 and Docker Desktop Version 3.5.1 (3.5.1.7) in osx Big Sur 11.4 (20F71).

alonsoir commented 3 years ago

Please, I need a solution because I can not continue with my course using my only machine, in osx.

"@lorenrh the issue cannot be closed because it is not solved and it is not delivered any patch. I cannot run k8s in docker Desktop for mac, the message when I run from scratch is Kubernetes is starting... and nothing happens. It does not start. Please, if you can reproduce the problem, ask me something, but but don't leave me hanging because because of this problem, I can't finish my k8s training on the only machine I have available. If you think there is not enough evidence to reproduce the problem, it is because you are not using the same version that I have, so please explain how you are trying to reproduce the problem. Even better, give me a solution to be able to use k8s on my Mac laptop for the latest version of osx, 11.4.

MacOs version: 11.4 (20F71) Kubernetes version 1.21.2 Docker engine: v20.10.7

{ "experimental": false, "builder": { "gc": { "enabled": true, "defaultKeepStorage": "20GB" } }, "features": { "buildkit": true } }"

zsh 3473 % kubectl get pods Error from server (InternalError): an error on the server ("") has prevented the request from succeeding [mié 21/07/14 11:35 CEST][s000][x86_64/darwin20.0/20.5.0][5.8]

Update 14 Julio 2021: I can see that there is a new version.

alonsoir commented 3 years ago

I generate that file running:

zsh 3474 [1] % pred='process matches ".(ocker|vpnkit)." || (process in {"taskgated-helper", "launchservicesd", "kernel"} && eventMessage contains[c] "docker")' [mié 21/07/14 11:50 CEST][s000][x86_64/darwin20.0/20.5.0][5.8] aironman@MacBook-Pro-de-Alonso:~ zsh 3475 % /usr/bin/log show --debug --info --style syslog --last 1d --predicate "$pred" >/tmp/k8s-logs-1-day.txt

k8s-logs-1.day-latest-version.txt

Docker Desktop version:

Version 3.5.2 (3.5.2.18)

Kubernetes version: v1.21.2

Docker engine: v20.10.7

{ "experimental": false, "builder": { "gc": { "enabled": true, "defaultKeepStorage": "20GB" } }, "features": { "buildkit": true } }

alonsoir commented 3 years ago

I can see the pods running for a few seconds, exited, reinstantiated again, so on, so forth. K8s It is not working in the latest version. Please, help.

Jastrzebowski commented 3 years ago

@djs55 I didn't need k8s locally for some time. Tried today after a few version updates and nothing changed, Kubernetes is stuck in starting.

macOS Version: 11.5 Docker Desktop Version: 3.5.2.18 NEW Diagnostics ID: 38B25116-F767-42F3-B5F4-65A1DFBDCE16/20210728093407

I've taken a look in the logs again and found a lot of logs related to DNS:

default 11:30:49.804724+0200  com.docker.backend  UDP DNS <- ;; opcode: QUERY, status: NOERROR, id: 64617
;; flags: rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;docker-desktop.  IN   AAAA
default 11:30:49.804728+0200  com.docker.backend  UDP DNS <- ;; opcode: QUERY, status: NOERROR, id: 47037
;; flags: rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;docker-desktop.  IN   A
default 11:30:49.805465+0200  com.docker.backend  &{PlatformSpecificContent:{BackupData:false DockerAppLaunchPath:/Applications/Docker.app DisplayedDeprecate1012:false DisplayedDeprecate1013:false DiskFlush:os DiskQcowCompactAfter:262144 DiskQcowKeepErased:262144 DiskQcowRuntimeAsserts:false DiskStats: VpnKitMTU:1500 VpnKitAllowedBindAddresses:0.0.0.0 VpnKitMaxPortIdleTime:300 VpnKitMaxConnections:2000 VpnKitTransparentProxy:true} SettingsVersion:13 AutoStart:false ActiveOrganizationName: UseCredentialHelper:true CredentialHelper:docker-credential-osxkeychain DisableTips:true TipLastViewedTime:1627463478701 TipLastID:18 UpdateAvailableTime:0 UpdatePopupAppearanceTime:1626716163976 UpdateSkippedBuild: DisableUpdate:false OpenUIOnStartupDisabled:true AnalyticsEnabled:true DisplayedTutorial:true DisplayRestartDialog:true DisplaySwitchVersionPack:true DisplayedElectronPopup:[] LatestBannerKey: AcceptCanaryUpdates:false DataFolder:/Users/user_name/Library/Containers/com.docker.docker/Data/vms/0/data MemoryMiB:5120 SwapMiB:1024 Cpus:6 <decode: missing data>
default 11:30:49.805464+0200  com.docker.backend  &{PlatformSpecificContent:{BackupData:false DockerAppLaunchPath:/Applications/Docker.app DisplayedDeprecate1012:false DisplayedDeprecate1013:false DiskFlush:os DiskQcowCompactAfter:262144 DiskQcowKeepErased:262144 DiskQcowRuntimeAsserts:false DiskStats: VpnKitMTU:1500 VpnKitAllowedBindAddresses:0.0.0.0 VpnKitMaxPortIdleTime:300 VpnKitMaxConnections:2000 VpnKitTransparentProxy:true} SettingsVersion:13 AutoStart:false ActiveOrganizationName: UseCredentialHelper:true CredentialHelper:docker-credential-osxkeychain DisableTips:true TipLastViewedTime:1627463478701 TipLastID:18 UpdateAvailableTime:0 UpdatePopupAppearanceTime:1626716163976 UpdateSkippedBuild: DisableUpdate:false OpenUIOnStartupDisabled:true AnalyticsEnabled:true DisplayedTutorial:true DisplayRestartDialog:true DisplaySwitchVersionPack:true DisplayedElectronPopup:[] LatestBannerKey: AcceptCanaryUpdates:false DataFolder:/Users/user_name/Library/Containers/com.docker.docker/Data/vms/0/data MemoryMiB:5120 SwapMiB:1024 Cpus:6 <decode: missing data>
default 11:30:49.805512+0200  com.docker.backend  [...] DiskSizeMiB:61035 DiskTRIM:true VpnkitCIDR:192.168.65.0/28 SocksProxyPort:0 ProxyHTTPMode:system OverrideProxyHTTP: OverrideProxyHTTPS: OverrideProxyExclude: FilesharingDirectories:[/Users /Volumes /private /tmp /var/folders] SynchronizedDirectories:[] UseDNSForwarder:true DNS:8.8.8.8 KubernetesEnabled:true ShowKubernetesSystemContainers:false KubernetesInitialInstallPerformed:false VersionPack:default UseVirtualizationFramework:false UseVpnkit:true UseWindowsContainers:false}
default 11:30:49.805519+0200  com.docker.backend  [...] DiskSizeMiB:61035 DiskTRIM:true VpnkitCIDR:192.168.65.0/28 SocksProxyPort:0 ProxyHTTPMode:system OverrideProxyHTTP: OverrideProxyHTTPS: OverrideProxyExclude: FilesharingDirectories:[/Users /Volumes /private /tmp /var/folders] SynchronizedDirectories:[] UseDNSForwarder:true DNS:8.8.8.8 KubernetesEnabled:true ShowKubernetesSystemContainers:false KubernetesInitialInstallPerformed:false VersionPack:default UseVirtualizationFramework:false UseVpnkit:true UseWindowsContainers:false}
default 11:30:49.805715+0200  com.docker.backend  UDP DNS -> ;; opcode: QUERY, status: NOERROR, id: 64617
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;docker-desktop.  IN   AAAA
default 11:30:49.805804+0200  com.docker.backend  UDP DNS -> ;; opcode: QUERY, status: NOERROR, id: 47037
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;docker-desktop.  IN   A

;; ANSWER SECTION:
docker-desktop. 60  IN  A 192.168.65.4
default 11:30:50.438371+0200  mDNSResponder [R8230] DNSServiceQueryRecord(15000, 0, <mask.hash: 'yRIqMWoUp24me4cRNsKcSw=='>, Addr) START PID[35965](com.docker.back)
default 11:30:50.438739+0200  mDNSResponder [R8231] DNSServiceQueryRecord(15000, 0, <mask.hash: 'yRIqMWoUp24me4cRNsKcSw=='>, AAAA) START PID[35965](com.docker.back)
default 11:30:50.439137+0200  mDNSResponder [R8230] DNSServiceQueryRecord(15000, 0, <mask.hash: '7kYhPsTUhPrFyR3f71PvJg=='>, Addr) STOP PID[35965](com.docker.back)
default 11:30:50.439228+0200  mDNSResponder [R8231] DNSServiceQueryRecord(15000, 0, <mask.hash: '7kYhPsTUhPrFyR3f71PvJg=='>, AAAA) STOP PID[35965](com.docker.back)
default 11:30:50.504483+0200  mDNSResponder [R8232] DNSServiceQueryRecord(15000, 0, <mask.hash: 'yRIqMWoUp24me4cRNsKcSw=='>, Addr) START PID[35965](com.docker.back)
default 11:30:50.504868+0200  mDNSResponder [R8233] DNSServiceQueryRecord(15000, 0, <mask.hash: 'yRIqMWoUp24me4cRNsKcSw=='>, AAAA) START PID[35965](com.docker.back)
default 11:30:50.505346+0200  mDNSResponder [R8232] DNSServiceQueryRecord(15000, 0, <mask.hash: '7kYhPsTUhPrFyR3f71PvJg=='>, Addr) STOP PID[35965](com.docker.back)
default 11:30:50.505417+0200  mDNSResponder [R8233] DNSServiceQueryRecord(15000, 0, <mask.hash: '7kYhPsTUhPrFyR3f71PvJg=='>, AAAA) STOP PID[35965](com.docker.back)
default 11:30:51.434710+0200  mDNSResponder [R8234] DNSServiceQueryRecord(15000, 0, <mask.hash: 'yRIqMWoUp24me4cRNsKcSw=='>, Addr) START PID[35965](com.docker.back)
default 11:30:51.435091+0200  mDNSResponder [R8235] DNSServiceQueryRecord(15000, 0, <mask.hash: 'yRIqMWoUp24me4cRNsKcSw=='>, AAAA) START PID[35965](com.docker.back)
default 11:30:51.435590+0200  mDNSResponder [R8234] DNSServiceQueryRecord(15000, 0, <mask.hash: '7kYhPsTUhPrFyR3f71PvJg=='>, Addr) STOP PID[35965](com.docker.back)
default 11:30:51.435661+0200  mDNSResponder [R8235] DNSServiceQueryRecord(15000, 0, <mask.hash: '7kYhPsTUhPrFyR3f71PvJg=='>, AAAA) STOP PID[35965](com.docker.back)

docker-robott commented 2 years ago

Issues go stale after 90 days of inactivity. Mark the issue as fresh with /remove-lifecycle stale comment. Stale issues will be closed after an additional 30 days of inactivity.

Prevent issues from auto-closing with an /lifecycle frozen comment.

If this issue is safe to close now please do so.

Send feedback to Docker Community Slack channels #docker-for-mac or #docker-for-windows. /lifecycle stale

docker-robott commented 2 years ago

Closed issues are locked after 30 days of inactivity. This helps our team focus on active issues.

If you have found a problem that seems similar to this, please open a new issue.

Send feedback to Docker Community Slack channels #docker-for-mac or #docker-for-windows. /lifecycle locked

docker / for-mac