k3d-io / k3d

Little helper to run CNCF's k3s in Docker
https://k3d.io/
MIT License
5.46k stars 462 forks source link

[BUG] Cluster Created Failed by cgroup error #200

Closed winrey closed 4 years ago

winrey commented 4 years ago

INFOMATION

What did you expect to happen?

Print the config file path.

Screenshots or terminal output

FATA[0000] No server container for cluster k3s-default

Which OS & Architecture?

Which version of k3d?

k3d version v1.6.0

Which version of docker?

Client: Docker Engine - Community
 Version:           19.03.6
 API version:       1.40
 Go version:        go1.12.16
 Git commit:        369ce74
 Built:             Thu Feb 13 01:28:27 2020
 OS/Arch:           linux/arm64
 Experimental:      false

Server: Docker Engine - Community
 Engine:
  Version:          19.03.6
  API version:      1.40 (minimum version 1.12)
  Go version:       go1.12.16
  Git commit:       369ce74
  Built:            Thu Feb 13 01:26:59 2020
  OS/Arch:          linux/arm64
  Experimental:     false
 containerd:
  Version:          1.2.10
  GitCommit:        b34a5c8af56e510852c35414db4c1f4fa6172339
 runc:
  Version:          1.0.0-rc8+dev
  GitCommit:        3e425f80a8c931f88e6d94a8c831b9d5aa481657
 docker-init:
  Version:          0.18.0
  GitCommit:        fec3683

DESCRIPTION

I try to create a cluster and failed. The creating log seems well but there is nothing when excute docker ps. I cannot got config file by excute k3d get-kubeconfig --name='k3s-default' either.

I found latter that the container meet an error and exited.

Here is the logs:

Creating

$ sudo k3d create
INFO[0000] Created cluster network with ID 06f4499ff47bbf7db642c8350202291d39d921304036636b4cc44becd13dd8b6
INFO[0000] Created docker volume  k3d-k3s-default-images
INFO[0000] Creating cluster [k3s-default]
INFO[0000] Creating server using docker.io/rancher/k3s:v1.17.2-k3s1...
INFO[0002] SUCCESS: created cluster [k3s-default]
INFO[0002] You can now use the cluster with:

export KUBECONFIG="$(k3d get-kubeconfig --name='k3s-default')"
kubectl cluster-info

Get Config File

$ k3d get-kubeconfig --name='k3s-default' 
FATA[0000] No server container for cluster k3s-default

Container log

$ docker logs k3d-k3s-default-server

time="2020-03-02T19:14:27.217118973Z" level=info msg="Starting k3s v1.17.2+k3s1 (cdab19b0)"
time="2020-03-02T19:14:27.244604148Z" level=info msg="Kine listening on unix://kine.sock"
time="2020-03-02T19:14:27.801930806Z" level=info msg="Active TLS secret  (ver=) (count 7): map[listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-172.20.0.2:172.20.0.2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/hash:1a8eeae339020a833aa4d180ec4196860b3a86687e426ee97073dda33ed2aa39]"
time="2020-03-02T19:14:27.841485873Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=unknown --authorization-mode=Node,RBAC --basic-auth-file=/var/lib/rancher/k3s/server/cred/passwd --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --enable-admission-plugins=NodeRestriction --etcd-servers=unix://kine.sock --insecure-port=0 --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=k3s --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-cluster-ip-range=10.43.0.0/16 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"
Flag --basic-auth-file has been deprecated, Basic authentication mode is deprecated and will be removed in a future release. It is not recommended for production environments.
I0302 19:14:27.842821       7 server.go:622] external host was not specified, using 172.20.0.2
I0302 19:14:27.843484       7 server.go:163] Version: v1.17.2+k3s1
I0302 19:14:29.910423       7 plugins.go:158] Loaded 11 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,MutatingAdmissionWebhook,RuntimeClass.
I0302 19:14:29.910491       7 plugins.go:161] Loaded 7 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,ValidatingAdmissionWebhook,RuntimeClass,ResourceQuota.
I0302 19:14:29.913653       7 plugins.go:158] Loaded 11 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,MutatingAdmissionWebhook,RuntimeClass.
I0302 19:14:29.913703       7 plugins.go:161] Loaded 7 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,ValidatingAdmissionWebhook,RuntimeClass,ResourceQuota.
I0302 19:14:29.973010       7 master.go:267] Using reconciler: lease
I0302 19:14:30.056905       7 rest.go:115] the default service ipfamily for this cluster is: IPv4
W0302 19:14:31.003913       7 genericapiserver.go:404] Skipping API batch/v2alpha1 because it has no resources.
W0302 19:14:31.038909       7 genericapiserver.go:404] Skipping API discovery.k8s.io/v1alpha1 because it has no resources.
W0302 19:14:31.070494       7 genericapiserver.go:404] Skipping API node.k8s.io/v1alpha1 because it has no resources.
W0302 19:14:31.126430       7 genericapiserver.go:404] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
W0302 19:14:31.136886       7 genericapiserver.go:404] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
W0302 19:14:31.175927       7 genericapiserver.go:404] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
W0302 19:14:31.241971       7 genericapiserver.go:404] Skipping API apps/v1beta2 because it has no resources.
W0302 19:14:31.242042       7 genericapiserver.go:404] Skipping API apps/v1beta1 because it has no resources.
I0302 19:14:31.274410       7 plugins.go:158] Loaded 11 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,MutatingAdmissionWebhook,RuntimeClass.
I0302 19:14:31.274473       7 plugins.go:161] Loaded 7 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,ValidatingAdmissionWebhook,RuntimeClass,ResourceQuota.
I0302 19:14:36.864416       7 dynamic_cafile_content.go:166] Starting client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt
I0302 19:14:36.864416       7 dynamic_cafile_content.go:166] Starting request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt
I0302 19:14:36.865106       7 dynamic_serving_content.go:129] Starting serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key
I0302 19:14:36.866475       7 secure_serving.go:178] Serving securely on 127.0.0.1:6444
I0302 19:14:36.866549       7 tlsconfig.go:219] Starting DynamicServingCertificateController
I0302 19:14:36.866608       7 controller.go:81] Starting OpenAPI AggregationController
I0302 19:14:36.866648       7 crd_finalizer.go:263] Starting CRDFinalizer
I0302 19:14:36.866710       7 customresource_discovery_controller.go:208] Starting DiscoveryController
I0302 19:14:36.866738       7 establishing_controller.go:73] Starting EstablishingController
I0302 19:14:36.866786       7 nonstructuralschema_controller.go:191] Starting NonStructuralSchemaConditionController
I0302 19:14:36.866845       7 apiapproval_controller.go:185] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0302 19:14:36.866901       7 controller.go:85] Starting OpenAPI controller
I0302 19:14:36.867826       7 available_controller.go:386] Starting AvailableConditionController
I0302 19:14:36.867861       7 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0302 19:14:36.867930       7 autoregister_controller.go:140] Starting autoregister controller
I0302 19:14:36.867943       7 cache.go:32] Waiting for caches to sync for autoregister controller
I0302 19:14:36.866717       7 naming_controller.go:288] Starting NamingConditionController
I0302 19:14:36.881886       7 apiservice_controller.go:94] Starting APIServiceRegistrationController
I0302 19:14:36.881936       7 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0302 19:14:36.885296       7 crdregistration_controller.go:111] Starting crd-autoregister controller
I0302 19:14:36.885350       7 shared_informer.go:197] Waiting for caches to sync for crd-autoregister
I0302 19:14:36.904215       7 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0302 19:14:36.904275       7 shared_informer.go:197] Waiting for caches to sync for cluster_authentication_trust_controller
I0302 19:14:36.904412       7 dynamic_cafile_content.go:166] Starting client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt
I0302 19:14:36.904494       7 dynamic_cafile_content.go:166] Starting request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt
I0302 19:14:36.987379       7 cache.go:39] Caches are synced for AvailableConditionController controller
I0302 19:14:36.988003       7 cache.go:39] Caches are synced for autoregister controller
I0302 19:14:36.992143       7 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0302 19:14:36.992212       7 shared_informer.go:204] Caches are synced for crd-autoregister
I0302 19:14:37.006386       7 shared_informer.go:204] Caches are synced for cluster_authentication_trust_controller
E0302 19:14:37.021603       7 controller.go:150] Unable to perform initial Kubernetes service initialization: Service "kubernetes" is invalid: spec.clusterIP: Invalid value: "10.43.0.1": cannot allocate resources of type serviceipallocations at this time
E0302 19:14:37.028069       7 controller.go:155] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/172.20.0.2, ResourceVersion: 0, AdditionalErrorMsg:
I0302 19:14:37.864403       7 controller.go:107] OpenAPI AggregationController: Processing item
I0302 19:14:37.864493       7 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0302 19:14:37.864555       7 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0302 19:14:37.881134       7 storage_scheduling.go:133] created PriorityClass system-node-critical with value 2000001000
I0302 19:14:37.890367       7 storage_scheduling.go:133] created PriorityClass system-cluster-critical with value 2000000000
I0302 19:14:37.890433       7 storage_scheduling.go:142] all system priority classes are created successfully or already exist.
I0302 19:14:38.698454       7 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0302 19:14:38.785476       7 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0302 19:14:38.931404       7 lease.go:224] Resetting endpoints for master service "kubernetes" to [172.20.0.2]
I0302 19:14:38.933135       7 controller.go:606] quota admission added evaluator for: endpoints
time="2020-03-02T19:14:38.956022437Z" level=info msg="Running kube-scheduler --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --port=10251 --secure-port=0"
time="2020-03-02T19:14:38.958445391Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --cluster-signing-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --port=10252 --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=0 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.key --use-service-account-credentials=true"
I0302 19:14:38.980594       7 controllermanager.go:161] Version: v1.17.2+k3s1
time="2020-03-02T19:14:38.980697946Z" level=info msg="Creating CRD addons.k3s.cattle.io"
I0302 19:14:38.982281       7 deprecated_insecure_serving.go:53] Serving insecurely on [::]:10252
time="2020-03-02T19:14:38.990512851Z" level=info msg="Waiting for cloudcontroller rbac role to be created"
time="2020-03-02T19:14:38.997752083Z" level=info msg="Creating CRD helmcharts.helm.cattle.io"
W0302 19:14:39.006961       7 authorization.go:47] Authorization is disabled
W0302 19:14:39.007030       7 authentication.go:92] Authentication is disabled
I0302 19:14:39.007061       7 deprecated_insecure_serving.go:51] Serving healthz insecurely on [::]:10251
time="2020-03-02T19:14:39.042532095Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available"
I0302 19:14:39.333347       7 plugins.go:100] No cloud provider specified.
I0302 19:14:39.340397       7 shared_informer.go:197] Waiting for caches to sync for tokens
I0302 19:14:39.354870       7 controller.go:606] quota admission added evaluator for: serviceaccounts
I0302 19:14:39.361447       7 controllermanager.go:533] Started "podgc"
I0302 19:14:39.361840       7 gc_controller.go:88] Starting GC controller
I0302 19:14:39.361877       7 shared_informer.go:197] Waiting for caches to sync for GC
I0302 19:14:39.387476       7 controllermanager.go:533] Started "job"
I0302 19:14:39.387550       7 job_controller.go:143] Starting job controller
I0302 19:14:39.387573       7 shared_informer.go:197] Waiting for caches to sync for job
I0302 19:14:39.412346       7 controllermanager.go:533] Started "replicaset"
I0302 19:14:39.412495       7 replica_set.go:180] Starting replicaset controller
I0302 19:14:39.412522       7 shared_informer.go:197] Waiting for caches to sync for ReplicaSet
I0302 19:14:39.431735       7 controllermanager.go:533] Started "csrcleaner"
I0302 19:14:39.431840       7 cleaner.go:81] Starting CSR cleaner controller
I0302 19:14:39.440641       7 shared_informer.go:204] Caches are synced for tokens
I0302 19:14:39.464758       7 controllermanager.go:533] Started "ttl"
W0302 19:14:39.465356       7 core.go:246] configure-cloud-routes is set, but no cloud provider specified. Will not configure cloud provider routes.
W0302 19:14:39.465568       7 controllermanager.go:525] Skipping "route"
W0302 19:14:39.465878       7 controllermanager.go:525] Skipping "ttl-after-finished"
I0302 19:14:39.466342       7 ttl_controller.go:116] Starting TTL controller
I0302 19:14:39.466508       7 shared_informer.go:197] Waiting for caches to sync for TTL
time="2020-03-02T19:14:39.550233790Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available"
time="2020-03-02T19:14:39.583854729Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-1.81.0.tgz"
time="2020-03-02T19:14:39.584752354Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml"
time="2020-03-02T19:14:39.585063716Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml"
time="2020-03-02T19:14:39.585289802Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml"
time="2020-03-02T19:14:39.585497556Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml"
time="2020-03-02T19:14:39.585736587Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml"
time="2020-03-02T19:14:39.586002931Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml"
time="2020-03-02T19:14:39.586233999Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml"
time="2020-03-02T19:14:39.586499344Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml"
time="2020-03-02T19:14:39.586721190Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml"
time="2020-03-02T19:14:39.586951573Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml"
time="2020-03-02T19:14:39.587150049Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml"
time="2020-03-02T19:14:39.587360895Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml"
time="2020-03-02T19:14:39.688235896Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller"
time="2020-03-02T19:14:39.688520426Z" level=info msg="Waiting for master node  startup: resource name may not be empty"
time="2020-03-02T19:14:39.690084625Z" level=info msg="Node token is available at /var/lib/rancher/k3s/server/token"
time="2020-03-02T19:14:39.690440523Z" level=info msg="To join node to cluster: k3s agent -s https://172.20.0.2:6443 -t ${NODE_TOKEN}"
2020-03-02 19:14:39.789477 I | http: TLS handshake error from 127.0.0.1:49652: remote error: tls: bad certificate
I0302 19:14:39.810713       7 controller.go:606] quota admission added evaluator for: addons.k3s.cattle.io
time="2020-03-02T19:14:39.831025653Z" level=info msg="Wrote kubeconfig /output/kubeconfig.yaml"
time="2020-03-02T19:14:39.831252665Z" level=info msg="Run: k3s kubectl"
time="2020-03-02T19:14:39.831555898Z" level=info msg="k3s is up and running"
time="2020-03-02T19:14:39.832285786Z" level=error msg="Failed to find memory cgroup, you may need to add \"cgroup_memory=1 cgroup_enable=memory\" to your linux cmdline (/boot/cmdline.txt on a Raspberry Pi)"
time="2020-03-02T19:14:39.832768699Z" level=fatal msg="failed to find memory cgroup, you may need to add \"cgroup_memory=1 cgroup_enable=memory\" to your linux cmdline (/boot/cmdline.txt on a Raspberry Pi)"

I don't have the /boot/cmdline.txt and try to create it with cgroup_memory=1 cgroup_enable=memory, but it doesn't work.

Check config

$ curl -sfL https://raw.githubusercontent.com/rancher/k3s/master/contrib/util/check-config.sh | sh -

Verifying binaries in .:
- sha256sum: sha256sums unavailable
- links: link list unavailable

System:
- /sbin iptables v1.6.1: older than v1.8
- swap: disabled
- routes: ok

Limits:
- /proc/sys/kernel/keys/root_maxkeys: 1000000

info: reading kernel config from /proc/config.gz ...

Generally Necessary:
- cgroup hierarchy: properly mounted [/sys/fs/cgroup]
- /sbin/apparmor_parser
apparmor: enabled and tools installed
- CONFIG_NAMESPACES: enabled
- CONFIG_NET_NS: enabled
- CONFIG_PID_NS: enabled
- CONFIG_IPC_NS: enabled
- CONFIG_UTS_NS: enabled
- CONFIG_CGROUPS: enabled
- CONFIG_CGROUP_CPUACCT: enabled
- CONFIG_CGROUP_DEVICE: enabled
- CONFIG_CGROUP_FREEZER: enabled
- CONFIG_CGROUP_SCHED: enabled
- CONFIG_CPUSETS: enabled
- CONFIG_MEMCG: enabled
- CONFIG_KEYS: enabled
- CONFIG_VETH: enabled (as module)
- CONFIG_BRIDGE: enabled (as module)
- CONFIG_BRIDGE_NETFILTER: enabled (as module)
- CONFIG_NF_NAT_IPV4: missing (fail)
- CONFIG_IP_NF_FILTER: enabled (as module)
- CONFIG_IP_NF_TARGET_MASQUERADE: enabled (as module)
- CONFIG_NETFILTER_XT_MATCH_ADDRTYPE: enabled (as module)
- CONFIG_NETFILTER_XT_MATCH_CONNTRACK: enabled (as module)
- CONFIG_NETFILTER_XT_MATCH_IPVS: enabled (as module)
- CONFIG_IP_NF_NAT: enabled (as module)
- CONFIG_NF_NAT: enabled (as module)
cgroup_enable=cpuset cgroup_memory=1 cgroup_enable=memory
~
- CONFIG_NF_NAT_NEEDED: missing (fail)
- CONFIG_POSIX_MQUEUE: enabled

cgroup_enable=cpuset cgroup_memory=1 cgroup_enable=memory
Optional Features:
- CONFIG_USER_NS: enabled
- CONFIG_SECCOMP: enabled
- CONFIG_CGROUP_PIDS: enabled
- CONFIG_BLK_CGROUP: enabled
- CONFIG_BLK_DEV_THROTTLING: enabled
- CONFIG_CGROUP_PERF: enabled
- CONFIG_CGROUP_HUGETLB: missing
- CONFIG_NET_CLS_CGROUP: enabled (as module)
- CONFIG_CGROUP_NET_PRIO: enabled
- CONFIG_CFS_BANDWIDTH: enabled
- CONFIG_FAIR_GROUP_SCHED: enabled
- CONFIG_RT_GROUP_SCHED: missing
- CONFIG_IP_NF_TARGET_REDIRECT: enabled (as module)
- CONFIG_IP_SET: enabled (as module)
- CONFIG_IP_VS: enabled (as module)
- CONFIG_IP_VS_NFCT: enabled
- CONFIG_IP_VS_PROTO_TCP: enabled
- CONFIG_IP_VS_PROTO_UDP: enabled
- CONFIG_IP_VS_RR: enabled (as module)
- CONFIG_EXT4_FS: enabled
- CONFIG_EXT4_FS_POSIX_ACL: enabled
- CONFIG_EXT4_FS_SECURITY: enabled
- Network Drivers:
  - "overlay":
    - CONFIG_VXLAN: enabled (as module)
      Optional (for encrypted networks):
      - CONFIG_CRYPTO: enabled
      - CONFIG_CRYPTO_AEAD: enabled
      - CONFIG_CRYPTO_GCM: enabled
      - CONFIG_CRYPTO_SEQIV: enabled
      - CONFIG_CRYPTO_GHASH: enabled
      - CONFIG_XFRM: enabled
      - CONFIG_XFRM_USER: enabled (as module)
      - CONFIG_XFRM_ALGO: enabled (as module)
      - CONFIG_INET_ESP: enabled (as module)
      - CONFIG_INET_XFRM_MODE_TRANSPORT: missing
- Storage Drivers:
  - "overlay":
    - CONFIG_OVERLAY_FS: enabled (as module)

STATUS: 2 (fail)
iwilltry42 commented 4 years ago

Hi there, thanks for opening this issue. However, this doesn't seem to be an issue with k3d (probably not even with k3s), but rather with your specific setup.

I don't have the /boot/cmdline.txt and try to create it with cgroup_memory=1 cgroup_enable=memory, but it doesn't work. What exactly does this mean? You couldn't create the file? Or k3d/k3s still didn't work after a reboot after applying those changes? You can check the section Enable container features on this post https://blog.alexellis.io/test-drive-k3s-on-raspberry-pi/ for the cmdline.txt settings (Note: the file only has one line, no linebreaks/CRs).

iwilltry42 commented 4 years ago

Closing this due to inactivity