rackerlabs / spot-roadmap

Spot roadmap
Other
6 stars 0 forks source link

ReadWriteMany persistentvolumes #8

Open sirishkr opened 8 months ago

sirishkr commented 8 months ago

See post from user: Are RWX volumes supported? I've run into all kinds of trouble trying to provision them - some where they get stuck pending create, some where pods can't write to them (getting permission denied), even where they're marked busy and can't be multi-attached.

An example... this helm-managed PVC (storageclass sata):

kind: PersistentVolumeClaim apiVersion: v1 metadata: name: [REDACTED] namespace: [REDACTED] labels: app.kubernetes.io/managed-by: Helm annotations: helm.sh/resource-policy: keep meta.helm.sh/release-name: [REDACTED] meta.helm.sh/release-namespace: [REDACTED] pv.kubernetes.io/bind-completed: 'yes' pv.kubernetes.io/bound-by-controller: 'yes' volume.beta.kubernetes.io/storage-provisioner: cinder.csi.openstack.org volume.kubernetes.io/storage-provisioner: cinder.csi.openstack.org finalizers:

...results in my pods not being able to create directories. (mkdir: can't create directory '/[redacted]/[redacted]': Permission denied). Also, if I change the replica counts for the above to >1, I get this on whichever pods come in after the first:

{"badRequest": {"message": "Invalid volume: volume '7424bfec-8d16-49c1-b584-e0951bd75a6f' status must be 'available'. Currently in 'attaching'", "code": 400}}

It's plenty happy with a single pod if the access modes are set to RWO, though.