search

bitnami / charts

Bitnami Helm Charts
https://bitnami.com
Other
8.9k stars 9.17k forks source link

zookeeper can not start in k3s #11188

Closed zigaai closed 2 years ago

zigaai commented 2 years ago

Name and Version

docker.io/bitnami/zookeeper:3.8.0-debian-11-r6

What steps will reproduce the bug?

  1. helm install zookeeper bitnami/zookeeper -n zookeeper
  2. the pod still In Progress status and the error message is 0/1 nodes are available: 1 Insufficient cpu., but the resource is enough
  3. kubectl get all -o wide 
    
NAME              READY   STATUS    RESTARTS   AGE    IP       NODE     NOMINATED NODE   READINESS GATES
pod/zookeeper-0   0/1     Pending   0          118s   <none>   <none>   <none>           <none>

NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR service/zookeeper-headless ClusterIP None 2181/TCP,2888/TCP,3888/TCP 118s app.kubernetes.io/component=zookeeper,app.kubernetes.io/instance=zookeeper,app.kubernetes.io/name=zookeeper service/zookeeper ClusterIP 10.43.233.218 2181/TCP,2888/TCP,3888/TCP 118s app.kubernetes.io/component=zookeeper,app.kubernetes.io/instance=zookeeper,app.kubernetes.io/name=zookeeper

NAME READY AGE CONTAINERS IMAGES statefulset.apps/zookeeper 0/1 118s zookeeper docker.io/bitnami/zookeeper:3.8.0-debian-11-r6

4. `kubectl top node`

NAME CPU(cores) CPU% MEMORY(bytes) MEMORY%
debian 354m 8% 10878Mi 67% 


### Are you using any custom parameters or values?

```yaml
global:
  ...
  storageClass: "longhorn"
...
persistence:
  ...
  storageClass: "longhorn"
  size: 1Gi

What is the expected behavior?

No response

What do you see instead?

what's the problem with this?

Additional information

No response

zigaai commented 2 years ago

image image

rafariossaa commented 2 years ago

Hi @zigaai I think the error is pretty clear here, there is not enough resources (CPU), it doesn't seem related to the chart itself.

zigaai commented 2 years ago

Hi @zigaai I think the error is pretty clear here, there is not enough resources (CPU), it doesn't seem related to the chart itself.

but i check my nodes, it seems has enough resources image

kubectl describe node

Name:               debian
Roles:              control-plane,master
Labels:             beta.kubernetes.io/arch=amd64
                    beta.kubernetes.io/instance-type=k3s
                    beta.kubernetes.io/os=linux
                    kubernetes.io/arch=amd64
                    kubernetes.io/hostname=debian
                    kubernetes.io/os=linux
                    node-role.kubernetes.io/control-plane=true
                    node-role.kubernetes.io/master=true
                    node.kubernetes.io/instance-type=k3s
Annotations:        alpha.kubernetes.io/provided-node-ip: 192.168.10.150
                    csi.volume.kubernetes.io/nodeid: {"driver.longhorn.io":"debian"}
                    flannel.alpha.coreos.com/backend-data: {"VNI":1,"VtepMAC":"22:47:a2:94:cc:71"}
                    flannel.alpha.coreos.com/backend-type: vxlan
                    flannel.alpha.coreos.com/kube-subnet-manager: true
                    flannel.alpha.coreos.com/public-ip: 10.0.2.15
                    k3s.io/hostname: debian
                    k3s.io/internal-ip: 192.168.10.150
                    k3s.io/node-args: ["server","--advertise-address","192.168.10.150","--node-ip","192.168.10.150","--service-node-port-range","30000-50000"]
                    k3s.io/node-config-hash: SIIMM7GJNP54S3O52WTPM3YWWAXRA6WZ6RXSF5MIFQFMRVDTGTPA====
                    k3s.io/node-env: {"K3S_DATA_DIR":"/var/lib/rancher/k3s/data/8c2b0191f6e36ec6f3cb68e2302fcc4be850c6db31ec5f8a74e4b3be403101d8"}
                    node.alpha.kubernetes.io/ttl: 0
                    volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp:  Thu, 23 Jun 2022 23:02:12 +0800
Taints:             <none>
Unschedulable:      false
Lease:
  HolderIdentity:  debian
  AcquireTime:     <unset>
  RenewTime:       Fri, 15 Jul 2022 16:32:03 +0800
Conditions:
  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
  ----             ------  -----------------                 ------------------                ------                       -------
  MemoryPressure   False   Fri, 15 Jul 2022 16:27:12 +0800   Thu, 23 Jun 2022 23:02:12 +0800   KubeletHasSufficientMemory   kubelet has sufficient memory available
  DiskPressure     False   Fri, 15 Jul 2022 16:27:12 +0800   Thu, 23 Jun 2022 23:02:12 +0800   KubeletHasNoDiskPressure     kubelet has no disk pressure
  PIDPressure      False   Fri, 15 Jul 2022 16:27:12 +0800   Thu, 23 Jun 2022 23:02:12 +0800   KubeletHasSufficientPID      kubelet has sufficient PID available
  Ready            True    Fri, 15 Jul 2022 16:27:12 +0800   Fri, 15 Jul 2022 09:02:19 +0800   KubeletReady                 kubelet is posting ready status. AppArmor enabled
Addresses:
  InternalIP:  192.168.10.150
  Hostname:    debian
Capacity:
  cpu:                4
  ephemeral-storage:  101639152Ki
  hugepages-2Mi:      0
  memory:             16393068Ki
  pods:               110
Allocatable:
  cpu:                4
  ephemeral-storage:  98874566989
  hugepages-2Mi:      0
  memory:             16393068Ki
  pods:               110
System Info:
  Machine ID:                 58c5f053878840ad89dbdd03f5f9049b
  System UUID:                42aa6ca8-3fd7-6045-abcf-a9c7056b7648
  Boot ID:                    57a31c1c-1e3e-46d8-b7de-68ca3cb5b7bd
  Kernel Version:             5.10.0-15-amd64
  OS Image:                   Debian GNU/Linux 11 (bullseye)
  Operating System:           linux
  Architecture:               amd64
  Container Runtime Version:  containerd://1.5.11-k3s2
  Kubelet Version:            v1.23.6+k3s1
  Kube-Proxy Version:         v1.23.6+k3s1
PodCIDR:                      10.42.0.0/24
PodCIDRs:                     10.42.0.0/24
ProviderID:                   k3s://debian
Non-terminated Pods:          (52 in total)
  Namespace                   Name                                              CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
  ---------                   ----                                              ------------  ----------  ---------------  -------------  ---
  gitlab                      gitlab-certmanager-774db6b45f-xkzff               0 (0%)        0 (0%)      0 (0%)           0 (0%)         20d
  gitlab                      gitlab-certmanager-cainjector-75f8fbb78d-q9gzd    0 (0%)        0 (0%)      0 (0%)           0 (0%)         20d
  longhorn-system             csi-attacher-7bf4b7f996-4pwpw                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  gitlab                      gitlab-certmanager-webhook-6f44b5784c-8jwk4       0 (0%)        0 (0%)      0 (0%)           0 (0%)         20d
  kube-system                 svclb-traefik-wk54s                               0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             engine-image-ei-df38d2e5-99bz7                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  kube-system                 local-path-provisioner-6c79684f77-x6f2w           0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-resizer-6d8cf5f99f-fd2c5                      0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  platform                    xxl-job-c44799548-phtn2                           0 (0%)        0 (0%)      0 (0%)           0 (0%)         19d
  longhorn-system             longhorn-conversion-webhook-5dc58756b6-p575k      0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-resizer-6d8cf5f99f-ggffj                      0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-provisioner-869bdc4b79-478ft                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-attacher-7bf4b7f996-49qgs                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-snapshotter-588457fcdf-pl6z5                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-resizer-6d8cf5f99f-d99d6                      0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             longhorn-conversion-webhook-5dc58756b6-2h8k5      0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-provisioner-869bdc4b79-26fj5                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-snapshotter-588457fcdf-v9mfp                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-snapshotter-588457fcdf-tf5q6                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-provisioner-869bdc4b79-jdpr9                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             csi-attacher-7bf4b7f996-569bf                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  gitlab                      gitlab-kas-565d4ccf64-6fwt6                       100m (2%)     0 (0%)      100M (0%)        0 (0%)         20d
  kube-system                 coredns-d76bd69b-5qwjl                            100m (2%)     0 (0%)      70Mi (0%)        170Mi (1%)     21d
  kube-system                 metrics-server-7cd5fcb6b7-c4zjv                   100m (2%)     0 (0%)      70Mi (0%)        0 (0%)         21d
  longhorn-system             longhorn-admission-webhook-8b7f74576-crt8z        0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             longhorn-admission-webhook-8b7f74576-k5jq9        0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  gitlab                      gitlab-kas-565d4ccf64-b4h4h                       100m (2%)     0 (0%)      100M (0%)        0 (0%)         20d
  longhorn-system             longhorn-manager-jql7l                            0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  longhorn-system             longhorn-ui-b7c844b49-b6c4s                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  gitlab                      gitlab-registry-5c5f8c9bfd-rndr6                  50m (1%)      0 (0%)      32Mi (0%)        0 (0%)         20d
  longhorn-system             longhorn-driver-deployer-6bd59c9f76-kb22c         0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  gitlab                      gitlab-registry-5c5f8c9bfd-ck8nw                  50m (1%)      0 (0%)      32Mi (0%)        0 (0%)         20d
  gitlab                      gitlab-toolbox-b54fc7d64-bdlcq                    50m (1%)      0 (0%)      350M (2%)        0 (0%)         20d
  longhorn-system             longhorn-csi-plugin-qxrtp                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  gitlab                      gitlab-gitlab-exporter-8596746856-mq864           75m (1%)      0 (0%)      100M (0%)        0 (0%)         20d
  longhorn-system             instance-manager-e-3b293846                       480m (12%)    0 (0%)      0 (0%)           0 (0%)         7h27m
  kube-system                 traefik-df4ff85d6-rjnr6                           0 (0%)        0 (0%)      0 (0%)           0 (0%)         21d
  gitlab                      gitlab-gitlab-shell-7bd45cd88b-tg6xp              50m (1%)      0 (0%)      6M (0%)          0 (0%)         20d
  gitlab                      gitlab-gitlab-shell-7bd45cd88b-rzcg8              50m (1%)      0 (0%)      6M (0%)          0 (0%)         20d
  longhorn-system             instance-manager-r-7b553801                       480m (12%)    0 (0%)      0 (0%)           0 (0%)         7h23m
  platform                    minio-78746b696b-f8tsg                            0 (0%)        0 (0%)      512Mi (3%)       0 (0%)         7h23m
  platform                    redis-master-0                                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         7h23m
  gitlab                      gitlab-gitaly-0                                   100m (2%)     0 (0%)      200Mi (1%)       0 (0%)         7h23m
  gitlab                      gitlab-redis-master-0                             0 (0%)        0 (0%)      0 (0%)           0 (0%)         7h21m
  gitlab                      docker-dind-7d9d687b9f-jjt5f                      0 (0%)        0 (0%)      0 (0%)           0 (0%)         7h23m
  platform                    elasticsearch-master-0                            100m (2%)     1 (25%)     512Mi (3%)       1Gi (6%)       7h23m
  platform                    kibana-kibana-754477d6f8-7r469                    100m (2%)     500m (12%)  256Mi (1%)       512Mi (3%)     20d
  gitlab                      gitlab-webservice-default-7678cb667-gdb6h         400m (10%)    0 (0%)      2600M (15%)      0 (0%)         20d
  gitlab                      gitlab-sidekiq-all-in-1-v2-58bc49b45f-s79ds       900m (22%)    0 (0%)      2G (11%)         0 (0%)         20d
  gitlab                      gitlab-webservice-default-7678cb667-8bzr6         400m (10%)    0 (0%)      2600M (15%)      0 (0%)         20d
  gitlab                      gitlab-runner-77f75bbd87-gkqjk                    0 (0%)        0 (0%)      0 (0%)           0 (0%)         20d
  gitlab                      gitlab-minio-dd4c6d959-dmlsg                      100m (2%)     0 (0%)      128Mi (0%)       0 (0%)         7h25m
Allocated resources:
  (Total limits may be over 100 percent, i.e., overcommitted.)
  Resource           Requests          Limits
  --------           --------          ------
  cpu                3785m (94%)       1500m (37%)
  memory             9762019712 (58%)  1706Mi (10%)
  ephemeral-storage  0 (0%)            0 (0%)
  hugepages-2Mi      0 (0%)            0 (0%)
Events:              <none>
rafariossaa commented 2 years ago

No sure about the screenshot, but according to the output of kubectl describe node, you are already at 94% of CPU resources.

zigaai commented 2 years ago

No sure about the screenshot, but according to the output of kubectl describe node, you are already at 94% of CPU resources.

i see, thank you for your reply