Deploy ember-csi-operator to OCP according to https://github.com/embercsi/ember-csi-operator
NAME VERSION AVAILABLE PROGRESSING SINCE STATUS
version 4.3.0-0.nightly-2019-12-29-173422 True False 28h Cluster version is 4.3.0-0.nightly-2019-12-29-173422
Create pvc, app to test but no pv is created
oc describe pvc ember-csi-pvc
Name: ember-csi-pvc
Namespace: demoapp
StorageClass: my-ceph.ember-csi.io-sc
Status: Pending
Volume:
Labels:
Annotations: volume.beta.kubernetes.io/storage-provisioner: my-ceph.ember-csi.io
Finalizers: [kubernetes.io/pvc-protection]
Capacity:
Access Modes:
VolumeMode: Filesystem
Events:
Type Reason Age From Message
Normal ExternalProvisioning 6s (x6 over 69s) persistentvolume-controller waiting for a volume to be created, either by external provisioner "my-ceph.ember-csi.io" or manually created by system administrator
Mounted By: my-csi-app
W0102 20:18:28.503719 1 deprecatedflags.go:53] Warning: option provisioner="my-ceph.ember-csi.io" is deprecated and has no effect
I0102 20:18:28.503800 1 feature_gate.go:226] feature gates: &{map[Topology:true]}
I0102 20:18:28.503823 1 csi-provisioner.go:95] Version: v1.1.0-0-gcecb5a96
I0102 20:18:28.503839 1 csi-provisioner.go:109] Building kube configs for running in cluster...
I0102 20:18:28.586631 1 connection.go:151] Connecting to unix:///csi-data/csi.sock
I0102 20:18:32.529469 1 connection.go:261] Probing CSI driver for readiness
I0102 20:18:32.529508 1 connection.go:180] GRPC call: /csi.v1.Identity/Probe
I0102 20:18:32.529518 1 connection.go:181] GRPC request: {}
I0102 20:18:32.534075 1 connection.go:183] GRPC response: {"ready":{"value":true}}
I0102 20:18:32.534578 1 connection.go:184] GRPC error:
I0102 20:18:32.534599 1 connection.go:180] GRPC call: /csi.v1.Identity/GetPluginInfo
I0102 20:18:32.534608 1 connection.go:181] GRPC request: {}
I0102 20:18:32.538798 1 connection.go:183] GRPC response: {"manifest":{"cinder-driver":"RBDDriver","cinder-driver-supported":"True","cinder-driver-version":"1.2.0","cinder-version":"15.1.0.dev125","cinderlib-version":"1.0.1.dev3","mode":"controller","persistence":"CRDPersistence"},"name":"ember-csi.io","vendor_version":"0.9.0-44-gf161c3c+19122019161820487031859"}
I0102 20:18:32.539646 1 connection.go:184] GRPC error:
I0102 20:18:32.539662 1 csi-provisioner.go:149] Detected CSI driver ember-csi.io
I0102 20:18:32.539677 1 connection.go:180] GRPC call: /csi.v1.Identity/GetPluginCapabilities
I0102 20:18:32.539686 1 connection.go:181] GRPC request: {}
I0102 20:18:32.544832 1 connection.go:183] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}}]}
I0102 20:18:32.545839 1 connection.go:184] GRPC error:
I0102 20:18:32.545865 1 connection.go:180] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I0102 20:18:32.545874 1 connection.go:181] GRPC request: {}
I0102 20:18:32.550529 1 connection.go:183] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":8}}}]}
I0102 20:18:32.554534 1 connection.go:184] GRPC error:
I0102 20:18:32.555593 1 controller.go:621] Using saving PVs to API server in background
I0102 20:18:32.555868 1 controller.go:769] Starting provisioner controller ember-csi.io_my-ceph-controller-0_0c2c0085-2d9d-11ea-a1d9-0a580a830013!
I0102 20:18:32.556539 1 reflector.go:123] Starting reflector v1.PersistentVolumeClaim (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:800
I0102 20:18:32.556578 1 reflector.go:161] Listing and watching v1.PersistentVolumeClaim from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:800
I0102 20:18:32.557169 1 volume_store.go:90] Starting save volume queue
I0102 20:18:32.557414 1 reflector.go:123] Starting reflector v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:803
I0102 20:18:32.557435 1 reflector.go:161] Listing and watching v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:803
I0102 20:18:32.557869 1 reflector.go:123] Starting reflector v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:806
I0102 20:18:32.557895 1 reflector.go:161] Listing and watching v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:806
I0102 20:18:32.656432 1 shared_informer.go:123] caches populated
I0102 20:18:32.656650 1 controller.go:979] Final error received, removing PVC 41ae847e-a383-4a56-a7dd-e2a2cb0e7655 from claims in progress
I0102 20:18:32.656668 1 controller.go:818] Started provisioner controller ember-csi.io_my-ceph-controller-0_0c2c0085-2d9d-11ea-a1d9-0a580a830013!
I0102 20:18:32.656673 1 controller.go:902] Provisioning succeeded, removing PVC 41ae847e-a383-4a56-a7dd-e2a2cb0e7655 from claims in progress
I0102 20:22:39.647669 1 streamwatcher.go:107] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=13, ErrCode=NO_ERROR, debug=""
I0102 20:22:39.650857 1 reflector.go:370] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:803: Watch close - v1.PersistentVolume total 0 items received
I0102 20:22:39.723217 1 streamwatcher.go:107] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=13, ErrCode=NO_ERROR, debug=""
I0102 20:22:39.723276 1 reflector.go:370] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:806: Watch close - v1.StorageClass total 0 items received
I0102 20:22:39.723704 1 streamwatcher.go:107] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=13, ErrCode=NO_ERROR, debug=""
I0102 20:22:39.723729 1 reflector.go:370] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:800: Watch close - v1.PersistentVolumeClaim total 0 items received
W0102 20:22:39.900193 1 reflector.go:289] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:806: watch of v1.StorageClass ended with: too old resource version: 316368 (317507)
W0102 20:22:39.900359 1 reflector.go:289] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:800: watch of *v1.PersistentVolumeClaim ended with: too old resource version: 314203 (317500)
Deploy ember-csi-operator to OCP according to https://github.com/embercsi/ember-csi-operator NAME VERSION AVAILABLE PROGRESSING SINCE STATUS version 4.3.0-0.nightly-2019-12-29-173422 True False 28h Cluster version is 4.3.0-0.nightly-2019-12-29-173422
1.After deployment, ember-csi-operator is running pod/ember-csi-operator-7cfb6b9c67-cqlkl 1/1 Running 0 22h pod/my-ceph-controller-0 5/5 Running 0 9h pod/my-ceph-node-0-hf9tr 2/2 Running 0 9h pod/my-ceph-node-0-pjhpr 2/2 Running 0 9h oc get pod/my-ceph-controller-0 -o yaml | grep image image: embercsi/ember-csi:master imagePullPolicy: Always image: quay.io/k8scsi/csi-attacher:v1.1.1 imagePullPolicy: IfNotPresent image: quay.io/k8scsi/csi-provisioner:v1.1.0 imagePullPolicy: IfNotPresent image: quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1 imagePullPolicy: IfNotPresent image: quay.io/k8scsi/csi-snapshotter:v1.1.0 imagePullPolicy: IfNotPresent imagePullSecrets: image: quay.io/k8scsi/csi-cluster-driver-registrar:v1.0.1 imageID: quay.io/k8scsi/csi-cluster-driver-registrar@sha256:fafd75ae5442f192cfa8c2e792903aee30d5884b62e802e4464b0a895d21e3ef image: docker.io/embercsi/ember-csi:master imageID: docker.io/embercsi/ember-csi@sha256:95ca3849471d65bb9500ad9169fdffccc3c31e468d40de33a746e38418150069 image: quay.io/k8scsi/csi-attacher:v1.1.1 imageID: quay.io/k8scsi/csi-attacher@sha256:e4db94969e1d463807162a1115192ed70d632a61fbeb3bdc97b40fe9ce78c831 image: quay.io/k8scsi/csi-provisioner:v1.1.0 imageID: quay.io/k8scsi/csi-provisioner@sha256:9828f32a1b350bef5f813857c2a3223e8aec79a9762bd78545eaea8fa79735d1 image: quay.io/k8scsi/csi-snapshotter:v1.1.0 imageID: quay.io/k8scsi/csi-snapshotter@sha256:a49e0da1af6f2bf717e41ba1eee8b5e6a1cbd66a709dd92cc43fe475fe2589eb
Labels:
Access Modes:
VolumeMode: Filesystem Events: Type Reason Age From Message
Normal ExternalProvisioning 6s (x6 over 69s) persistentvolume-controller waiting for a volume to be created, either by external provisioner "my-ceph.ember-csi.io" or manually created by system administrator Mounted By: my-csi-app
W0102 20:18:28.503719 1 deprecatedflags.go:53] Warning: option provisioner="my-ceph.ember-csi.io" is deprecated and has no effect I0102 20:18:28.503800 1 feature_gate.go:226] feature gates: &{map[Topology:true]} I0102 20:18:28.503823 1 csi-provisioner.go:95] Version: v1.1.0-0-gcecb5a96 I0102 20:18:28.503839 1 csi-provisioner.go:109] Building kube configs for running in cluster... I0102 20:18:28.586631 1 connection.go:151] Connecting to unix:///csi-data/csi.sock I0102 20:18:32.529469 1 connection.go:261] Probing CSI driver for readiness I0102 20:18:32.529508 1 connection.go:180] GRPC call: /csi.v1.Identity/Probe I0102 20:18:32.529518 1 connection.go:181] GRPC request: {} I0102 20:18:32.534075 1 connection.go:183] GRPC response: {"ready":{"value":true}} I0102 20:18:32.534578 1 connection.go:184] GRPC error:
I0102 20:18:32.534599 1 connection.go:180] GRPC call: /csi.v1.Identity/GetPluginInfo
I0102 20:18:32.534608 1 connection.go:181] GRPC request: {}
I0102 20:18:32.538798 1 connection.go:183] GRPC response: {"manifest":{"cinder-driver":"RBDDriver","cinder-driver-supported":"True","cinder-driver-version":"1.2.0","cinder-version":"15.1.0.dev125","cinderlib-version":"1.0.1.dev3","mode":"controller","persistence":"CRDPersistence"},"name":"ember-csi.io","vendor_version":"0.9.0-44-gf161c3c+19122019161820487031859"}
I0102 20:18:32.539646 1 connection.go:184] GRPC error:
I0102 20:18:32.539662 1 csi-provisioner.go:149] Detected CSI driver ember-csi.io
I0102 20:18:32.539677 1 connection.go:180] GRPC call: /csi.v1.Identity/GetPluginCapabilities
I0102 20:18:32.539686 1 connection.go:181] GRPC request: {}
I0102 20:18:32.544832 1 connection.go:183] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}}]}
I0102 20:18:32.545839 1 connection.go:184] GRPC error:
I0102 20:18:32.545865 1 connection.go:180] GRPC call: /csi.v1.Controller/ControllerGetCapabilities
I0102 20:18:32.545874 1 connection.go:181] GRPC request: {}
I0102 20:18:32.550529 1 connection.go:183] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":2}}},{"Type":{"Rpc":{"type":3}}},{"Type":{"Rpc":{"type":4}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":6}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":8}}}]}
I0102 20:18:32.554534 1 connection.go:184] GRPC error:
I0102 20:18:32.555593 1 controller.go:621] Using saving PVs to API server in background
I0102 20:18:32.555868 1 controller.go:769] Starting provisioner controller ember-csi.io_my-ceph-controller-0_0c2c0085-2d9d-11ea-a1d9-0a580a830013!
I0102 20:18:32.556539 1 reflector.go:123] Starting reflector v1.PersistentVolumeClaim (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:800
I0102 20:18:32.556578 1 reflector.go:161] Listing and watching v1.PersistentVolumeClaim from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:800
I0102 20:18:32.557169 1 volume_store.go:90] Starting save volume queue
I0102 20:18:32.557414 1 reflector.go:123] Starting reflector v1.PersistentVolume (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:803
I0102 20:18:32.557435 1 reflector.go:161] Listing and watching v1.PersistentVolume from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:803
I0102 20:18:32.557869 1 reflector.go:123] Starting reflector v1.StorageClass (15m0s) from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:806
I0102 20:18:32.557895 1 reflector.go:161] Listing and watching v1.StorageClass from sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:806
I0102 20:18:32.656432 1 shared_informer.go:123] caches populated
I0102 20:18:32.656650 1 controller.go:979] Final error received, removing PVC 41ae847e-a383-4a56-a7dd-e2a2cb0e7655 from claims in progress
I0102 20:18:32.656668 1 controller.go:818] Started provisioner controller ember-csi.io_my-ceph-controller-0_0c2c0085-2d9d-11ea-a1d9-0a580a830013!
I0102 20:18:32.656673 1 controller.go:902] Provisioning succeeded, removing PVC 41ae847e-a383-4a56-a7dd-e2a2cb0e7655 from claims in progress
I0102 20:22:39.647669 1 streamwatcher.go:107] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=13, ErrCode=NO_ERROR, debug=""
I0102 20:22:39.650857 1 reflector.go:370] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:803: Watch close - v1.PersistentVolume total 0 items received
I0102 20:22:39.723217 1 streamwatcher.go:107] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=13, ErrCode=NO_ERROR, debug=""
I0102 20:22:39.723276 1 reflector.go:370] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:806: Watch close - v1.StorageClass total 0 items received
I0102 20:22:39.723704 1 streamwatcher.go:107] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=13, ErrCode=NO_ERROR, debug=""
I0102 20:22:39.723729 1 reflector.go:370] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:800: Watch close - v1.PersistentVolumeClaim total 0 items received
W0102 20:22:39.900193 1 reflector.go:289] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:806: watch of v1.StorageClass ended with: too old resource version: 316368 (317507)
W0102 20:22:39.900359 1 reflector.go:289] sigs.k8s.io/sig-storage-lib-external-provisioner/controller/controller.go:800: watch of *v1.PersistentVolumeClaim ended with: too old resource version: 314203 (317500)