gluster / gluster-kubernetes

GlusterFS Native Storage Service for Kubernetes
Apache License 2.0
874 stars 390 forks source link

Error: Failed to allocate new volume: No space #631

Closed suadhika closed 4 years ago

suadhika commented 4 years ago

I am using Openstack for my kubernetes Node: I have 1 Mster and 2 worker in it.

I have 2 volumes of 200GB each attached to the each worker- dev/vdb.

While installing the gluster-kubernetes I am getting the below Error:

Error: Failed to allocate new volume: No space command terminated with exit code 255 Failed on setup openshift heketi storage This may indicate that the storage must be wiped and the GlusterFS nodes must be reset.

Configuration: kubernetes 1.16 / coreos

core@test-eu-k8s-k8s-master-nf-1 ~/gluster-kubernetes $ kubectl get nodes NAME STATUS ROLES AGE VERSION test-eu-k8s-k8s-master-nf-1 Ready master 19d v1.16.2 test-eu-k8s-k8s-node-nf-1 Ready <none> 19d v1.16.2 test-eu-k8s-k8s-node-nf-2 Ready <none> 19d v1.16.2

My topology.json.sample { "clusters": [ { "nodes": [ { "node": { "hostnames": { "manage": [ "test-eu-k8s-k8s-node-nf-1" ], "storage": [ "172.21.97.105" ] }, "zone": 1 }, "devices": [ "/dev/vdb" ] }, { "node": { "hostnames": { "manage": [ "test-eu-k8s-k8s-node-nf-2" ], "storage": [ "172.21.97.102" ] }, "zone": 1 }, "devices": [ "/dev/vdb" ] } ] } ] }

The error:

Using Kubernetes CLI. Using namespace "default". Checking for pre-existing resources... GlusterFS pods ... not found. deploy-heketi pod ... not found. heketi pod ... not found. gluster-s3 pod ... not found. Creating initial resources ... serviceaccount/heketi-service-account created clusterrolebinding.rbac.authorization.k8s.io/heketi-sa-view created clusterrolebinding.rbac.authorization.k8s.io/heketi-sa-view labeled OK node/test-eu-k8s-k8s-node-nf-1 labeled node/test-eu-k8s-k8s-node-nf-2 labeled daemonset.apps/glusterfs created Waiting for GlusterFS pods to start ... OK secret/heketi-config-secret created secret/heketi-config-secret labeled service/deploy-heketi created deployment.apps/deploy-heketi created Waiting for deploy-heketi pod to start ... OK Creating cluster ... ID: ad68d55094021aab45e1787211bddb9e Allowing file volumes on cluster. Allowing block volumes on cluster. Creating node test-eu-k8s-k8s-node-nf-1 ... ID: 286a9afcb058acd6ca548ebd12d05f97 ^[[DAdding device /dev/vdb ... OK Creating node test-eu-k8s-k8s-node-nf-2 ... ID: 7643d57e7a2a417e70e32c85e7acdb18 Adding device /dev/vdb ... OK heketi topology loaded. Error: Failed to allocate new volume: No space command terminated with exit code 255 Failed on setup openshift heketi storage This may indicate that the storage must be wiped and the GlusterFS nodes must be reset.

suadhika commented 4 years ago

When I run kubectl exec -i deploy-heketi-796569fd84-xrctl -- heketi-cli -s http://localhost:8080 --user admin --secret user cluster list

I get- Error: Invalid JWT token: signature is invalid (client and server secrets may not match) command terminated with exit code 255

suadhika commented 4 years ago

Need 3 nodes states. Wrong password given.