kubernetes-sigs / vsphere-csi-driver

vSphere storage Container Storage Interface (CSI) plugin
https://docs.vmware.com/en/VMware-vSphere-Container-Storage-Plug-in/index.html
Apache License 2.0
288 stars 173 forks source link

Cannot attach volume to app after pod restart! #2898

Open tieungao88 opened 1 month ago

tieungao88 commented 1 month ago

Is this a BUG REPORT or FEATURE REQUEST?:

Uncomment only one, leave it on its own line:

/kind bug /kind feature

What happened: Cannot attach volume to app after pod restart. But New application can attach new volume. Error: `{"level":"info","time":"2024-05-16T03:58:48.718548184Z","caller":"wcpguest/controller_helper.go:308","msg":"attacherTimeout is set to 4 minutes","TraceId":"1c0d37ed-f451-48a4-9304-7f23547009dd"}

{"level":"error","time":"2024-05-16T03:58:49.809722034Z","caller":"wcpguest/controller.go:585","msg":"observed Error: \"failed to attach cns volume\" is set on the volume \"5ed131da-510b-475a-974b-52adfd679033-d22ba578-98e9-4858-84f1-5c48dde8cb17\" on virtualmachine

\"br-m82a1-vt-chatbot-rb2rx-69fd446787-5dzxq\"","TraceId":"1c0d37ed-f451-48a4-9304-7f23547009dd","stacktrace":"sigs.k8s.io/vsphere-csi-driver/v2/pkg/csi/service/wcpguest.controllerPublishForBlockVolume\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/src/pkg/csi/service/wcpguest/controller.go:585\nsigs.k8s.io/vsphere-csi-driver/v2/pkg/csi/service/wcpguest.(controller).ControllerPublishVolume.func1\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/src/pkg/csi/service/wcpguest/controller.go:459\nsigs.k8s.io/vsphere-csi-driver/v2/pkg/csi/service/wcpguest.(controller).ControllerPublishVolume\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/src/pkg/csi/service/wcpguest/controller.go:461\ngithub.com/container-storage-interface/spec/lib/go/csi._Controller_ControllerPublishVolume_Handler.func1\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/container-storage-interface/spec@v1.4.0/lib/go/csi/csi.pb.go:5632\ngithub.com/rexray/gocsi/middleware/serialvolume.(interceptor).controllerPublishVolume\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/middleware/serialvolume/serial_volume_locker.go:120\ngithub.com/rexray/gocsi/middleware/serialvolume.(interceptor).handle\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/middleware/serialvolume/serial_volume_locker.go:86\ngithub.com/rexray/gocsi/utils.ChainUnaryServer.func2.1.1\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/utils/utils_middleware.go:99\ngithub.com/rexray/gocsi/middleware/specvalidator.(interceptor).handleServer.func1\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/middleware/specvalidator/spec_validator.go:178\ngithub.com/rexray/gocsi/middleware/specvalidator.(interceptor).handle\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/middleware/specvalidator/spec_validator.go:218\ngithub.com/rexray/gocsi/middleware/specvalidator.(interceptor).handleServer\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/middleware/specvalidator/spec_validator.go:177\ngithub.com/rexray/gocsi/utils.ChainUnaryServer.func2.1.1\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/utils/utils_middleware.go:99\ngithub.com/rexray/gocsi.(StoragePlugin).injectContext\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/middleware.go:231\ngithub.com/rexray/gocsi/utils.ChainUnaryServer.func2.1.1\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/utils/utils_middleware.go:99\ngithub.com/rexray/gocsi/utils.ChainUnaryServer.func2\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/rexray/gocsi@v1.2.2/utils/utils_middleware.go:106\ngithub.com/container-storage-interface/spec/lib/go/csi._Controller_ControllerPublishVolume_Handler\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/github.com/container-storage-interface/spec@v1.4.0/lib/go/csi/csi.pb.go:5634\ngoogle.golang.org/grpc.(Server).processUnaryRPC\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/google.golang.org/grpc@v1.27.1/server.go:1024\ngoogle.golang.org/grpc.(Server).handleStream\n\t/build/mts/release/bora-19819855/cayman_vsphere_csi_driver/vsphere_csi_driver/go/pkg/mod/google.golang.org/grpc@v1.27.1/server.go:1313\ngoogle.golang.org/grpc.(*Server).serveStreams.func1.1\n\t/build/mts/release/bora-19819855/cayman_vsphere`

What you expected to happen:

How to reproduce it (as minimally and precisely as possible): I don't know.

Anything else we need to know?:

Environment: