Create distributed-replicated volume in storageclass

[es1o]

Hi, I use heketi to create dynamic glusterfs volumes. I created storage class:

kind: StorageClass
apiVersion: storage.k8s.io/v1beta1
parameters:
  resturl: http://heketi-storage-glusterfs.cluster.local
  restuser: admin
  secretName: heketi-storage-admin-secret
  secretNamespace: glusterfs
  volumetype: replicate:2
provisioner: kubernetes.io/glusterfs
metadata:
  name: glusterfs-storage-replica-2

I don't know how to create distributed replicated volume with 2 replicas and 2 distributed parts. In documentation I found only how to create replica, distributed volume and disperse volume. Is it possible to create 2x2 volume dynamically?

[nixpanic]

I don't know how to create distributed replicated volume with 2 replicas and 2 distributed parts. In documentation I found only how to create replica, distributed volume and disperse volume. Is it possible to create 2x2 volume dynamically?

Heketi tries to create bricks of the size that fits on the block devices. As long as the replicated bricks fit on the block devices, it will not (need to) create a distributed volume.

There is no real way to force Heketi to create distributed-replicated volumes from a StorageClass. You can however expand the volume, and that way Heketi will allocate an two additional bricks for the volume.

[es1o]

@nixpanic Unfortunatelly it doesn't work because I have 6 nodes, with 80GB on each node and when I try create 120GB volume I get a error: Failed to provision volume with StorageClass "glusterfs-storage-replica-2": glusterfs: create volume err: error creating volume No space

I would like to create distributed-replicated with 4 nodes and 60GB on each node, but looks like heketi tries to create replicate:2 volume.

[phlogistonjohn]

Hi @es1o, as @nixpanic mentioned heketi does not have an explicit method to create that layout, but ought to be able to do it implictly. Since this seems like a straight heketi issue, can I ask you to file a new issue at heketi and provide heketi logs from when the failure condition occured? You can then close this issue

[es1o]

Thank you. I'created issue in heketi repository.