IBM / ibm-block-csi-driver

The IBM block storage CSI driver enables container orchestrators, such as Kubernetes and Openshift, to manage the life-cycle of persistent storage
Apache License 2.0
33 stars 25 forks source link

csi-volume-group container is throttling #685

Open ZleFox opened 1 year ago

ZleFox commented 1 year ago

I have updated to 1.11.1 and I see throttling warnings for csi-volume-group container in the ibm-block-csi-controller StatefulSet Even if I update the resource limits and requests, the operator is bringing them back. In the log of the container I see client throttling warnings, which are typical for kubectl with no permission for its cache:

I0817 07:55:37.747308 1 request.go:601] Waited for 1.041001839s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis/maps.k8s.elastic.co/v1alpha1?timeout=32s

The container is with RO filesystem, as it should be, and I can't edit the StatefulSet, as the operator is taking care of it. Can you fix the image, or add resource fields in the CRD for the controller? The csi-volume-group container is using this image; quay.io/ibmcsiblock/csi-volume-group-operator:v0.9.0

warning from the prometheus: description = 29.05% throttling of CPU in namespace ibm-stor for container csi-volume-group in pod ibm-block-csi-controller-0. Kubernetes: 1.24.16