search

dell / csm

Dell Container Storage Modules (CSM)
Apache License 2.0
69 stars 15 forks source link

[QUESTION]: kubelet metrics doesn't contain kubelet_volume metrics from powerflex-csi #236

Closed TomasKohout closed 2 years ago

TomasKohout commented 2 years ago

Hi :slightly_smiling_face: ,

we've noticed that kubelet_volume metrics are gone since upgrade to v2.1.0 of csi-powerflex.

It there anything we can do to make those metrics work?

Thanks a lot. :slightly_smiling_face:

JacobGros commented 2 years ago

Hello Can you let us know:

  1. which environment you're running on
  2. your values file
  3. the upgrade process you took
  4. expected vs actual behavior

Thanks, Jacob

TomasKohout commented 2 years ago
  1. kubernetes 1.21.9
  2. 
version: 2.1.0-mall.2

images: driverRepository: ---redacted----

attacher: resources: requests: cpu: 10m memory: 100Mi limits: cpu: 1 memory: 1Gi

controller: volumeNamePrefix: k8s resources: requests: cpu: 10m memory: 100Mi limits: cpu: 1 memory: 1Gi

driver: resources: requests: cpu: 10m memory: 100Mi limits: cpu: 1 memory: 1Gi

provisioner: resources: requests: cpu: 10m memory: 100Mi limits: cpu: 1 memory: 1Gi

registrar: resources: requests: cpu: 10m memory: 100Mi limits: cpu: 1 memory: 1Gi

resizer: resources: requests: cpu: 10m memory: 100Mi limits: cpu: 1 memory: 1Gi

sdc: resources: requests: cpu: 10m memory: 100Mi limits: cpu: 1 memory: 1Gi

snapshotter: resources: requests: cpu: 10m memory: 100Mi limits: cpu: 1 memory: 1Gi



3. Reinstallation on one cluster, helm upgrade on the other.
4. kubelet_volume_* metrics contains information about PVCs mounted on each worker node.
JacobGros commented 2 years ago

PVC_metrics support was added in 2.1, possibly affecting the volume metrics. Can you try enabling health monitor in the node section of values? See Volume Health Monitoring documentation for details.

Thanks, Jacob

TomasKohout commented 2 years ago

Yep, enabling this for node DS fixed the issue. Thanks a lot. :slightly_smiling_face: