search

gluster / gluster-kubernetes

GlusterFS Native Storage Service for Kubernetes
Apache License 2.0
875 stars 390 forks source link

heketi-storage-copy-job #507

Open thbeh opened 6 years ago

thbeh commented 6 years ago

Hi, this is not an issue per say.

I manage to deploy glusterfs on k8s as per the instructions and all running well except the heketi-storage-copy-job says Terminated:Completed in the dashboard. There's no logs registered when I do kubeclt logs heketi-storage-copy-job-xxxxx.

What is this process and would it effect anything overtime?

ygqygq2 commented 6 years ago

The job also "ContainerCreating", the logs like that:

MountVolume.SetUp failed for volume "heketi-storage" : mount failed: mount failed: exit status 32 
Mounting command: systemd-run Mounting arguments: --description=Kubernetes transient mount for 
/var/lib/kubelet/pods/e2531fbe-a133-11e8-b55d-
000c2931d938/volumes/kubernetes.io~glusterfs/heketi-storage --scope -- mount -t 
glusterfs -o log-file=/var/lib/kubelet/plugins/kubernetes.io/glusterfs/heketi-storage/heketi-storage-copy-job-ptnx4-glusterfs.log,
backup-volfile-servers=192.168.105.95:192.168.105.96:192.168.105.98,log-level=ERROR 
192.168.105.95:heketidbstorage /var/lib/kubelet/pods/e2531fbe-a133-11e8-b55d-
000c2931d938/volumes/kubernetes.io~glusterfs/heketi-storage 
Output: Running scope as unit run-53418.scope. mount: 
unknown filesystem type 'glusterfs' 
the following error information was pulled from the glusterfs log to help diagnose this issue: could not open log file for pod heketi-storage-copy-job-ptnx4

What's wrong about it?

nixpanic commented 6 years ago

On Thu, Aug 16, 2018 at 02:45:09AM -0700, Chinge_Yang wrote:

The job also "ContainerCreating", the logs like that:

MountVolume.SetUp failed for volume "heketi-storage" : mount failed: mount failed: exit status 32 Mounting command: systemd-run Mounting arguments: --description=Kubernetes transient mount for /var/lib/kubelet/pods/e2531fbe-a133-11e8-b55d-000c2931d938/volumes/kubernetes.io~glusterfs/heketi-storage --scope -- mount -t glusterfs -o log-file=/var/lib/kubelet/plugins/kubernetes.io/glusterfs/heketi-storage/heketi-storage-copy-job-ptnx4-glusterfs.log,backup-volfile-servers=192.168.105.95:192.168.105.96:192.168.105.98,log-level=ERROR 192.168.105.95:heketidbstorage /var/lib/kubelet/pods/e2531fbe-a133-11e8-b55d-000c2931d938/volumes/kubernetes.io~glusterfs/heketi-storage Output: Running scope as unit run-53418.scope. mount: unknown filesystem type 'glusterfs' the following error information was pulled from the glusterfs log to help diagnose this issue: could not open log file for pod heketi-storage-copy-job-ptnx4

What's wrong about it?

You need to make sure you can mount a Gluster Volume on the node where PVCs are consumed. On Fedora/CentOS/RHEL systems this means the package 'glusterfs-fuse' needs to be installed.

ygqygq2 commented 6 years ago

@nixpanic On deploy-heketi-559446b649-h2vr5 pod's node?

Yes, you are right. heketi-storage-copy-job-ptnx4 0/1 Completed 0 14h

nixpanic commented 6 years ago

You will need to install the GlusterFS FUSE mount tools on all nodes where the a Gluster Volume should get mounted. The heketi-storage-copy-job definitely requires it. All nodes that run pods with a PVC created on Gluster need it too.