GRPC error: rpc error: code = Internal desc = Failed to create volume

[nin0-0]

HPE CSI driver 2.4.1 Alletra 9000

PVC error info for (pvc-2197dc61-1192-49fa-9309-c4cafec9021d): Checked logs from controller - 14:28 it was trying to bind pvc, got errors, then all time retrying and finally bounded at 00:24:04 via HPE CSI Driver

# oc logs pod/hpe-csi-controller-b99f997d8-mq95b -n hpe-csi-driver | less

I0409 14:28:06.685755       1 connection.go:245] GRPC request: {"capacity_range":{"required_bytes":143881404416},"name":"pvc-2197dc61-1192-49fa-9309-c4cafec9021d","parameters":{"accessProtocol":"fc","allowMutations":"hostSeesVLUN","csi.storage.k8s.io/pv/name":"pvc-2197dc61-1192-49fa-9309-c4cafec9021d","csi.storage.k8s.io/pvc/name":"data-bru-lab-crdl-sess-db-crdlcluster-0","csi.storage.k8s.io/pvc/namespace":"mavenirvsrelab-crdl-ims","description":"Volume created by the HPE CSI Driver for Kubernetes","hostSeesVLUN":"true"},"secrets":"***stripped***","volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"xfs"}},"access_mode":{"mode":1}}]}
I0409 14:28:12.777821       1 connection.go:252] GRPC error: rpc error: code = Internal desc = Failed to create volume pvc-2197dc61-1192-49fa-9309-c4cafec9021d, Post "http://alletra9000-csp-svc:8080/containers
/v1/volumes": http: ContentLength=507 with Body length 0
I0409 14:28:12.777850       1 controller.go:848] CreateVolume failed, supports topology = false, node selected false => may reschedule = false => state = Finished: rpc error: code = Internal desc = Failed to c
reate volume pvc-2197dc61-1192-49fa-9309-c4cafec9021d, Post "http://alletra9000-csp-svc:8080/containers/v1/volumes": http: ContentLength=507 with Body length 0
I0409 14:28:12.777895       1 controller.go:1075] Final error received, removing PVC 2197dc61-1192-49fa-9309-c4cafec9021d from claims in progress
W0409 14:28:12.777907       1 controller.go:934] Retrying syncing claim "2197dc61-1192-49fa-9309-c4cafec9021d", failure 0 

[datamattsson]

What does the CSP log say about this? You could be hitting a known issue we've addressed with v2.4.2 released yesterday.

[id956729]

What is CSP?

[id956729]

We have hpe-csi-operator.v2.4.1

[datamattsson]

v2.4.2 of the operator will be released shortly.

[id956729]

Hello, you are right, it's a bug in v2.4.1, we can close this

# oc logs -l app=primera3par-csp -n hpe-csi-driver -f 
net/http.HandlerFunc.ServeHTTP(0xc0004a4000?, {0x1ae8050?, 0xc0001880e0?}, 0xe31622d65009?)
        /usr/lib/golang/src/net/http/server.go:2122 +0x2f
github.com/gorilla/mux.(*Router).ServeHTTP(0xc000001380, {0x1ae8050, 0xc0001880e0}, 0xc0001d2100)
        /usr/src/main/vendor/github.com/gorilla/mux/mux.go:210 +0x1cf
net/http.serverHandler.ServeHTTP({0x1adc178?}, {0x1ae8050, 0xc0001880e0}, 0xc0001d2100)
        /usr/lib/golang/src/net/http/server.go:2936 +0x316
net/http.(*conn).serve(0xc000714000, {0x1ae8848, 0xc0001102d0})
        /usr/lib/golang/src/net/http/server.go:1995 +0x612
created by net/http.(*Server).Serve
        /usr/lib/golang/src/net/http/server.go:3089 +0x5ed
^C

[nin0-0]

Can you release it asap in openshift marketplace? It's not so easy to install lower version, thanks

[nin0-0]

We're seeing in our storage backend 8.5k PVCs created, but on the openshift nprod we're seeing only ~150

I have a feeling this was to do with the operator being broken? advise us what to do please since our storage is filling up and I don't know if the PVCs are just exported or actual used ?

[nin0-0]

it was old and forgotten config in a lab where hostseesvlun was missing