search

gluster / gluster-kubernetes

GlusterFS Native Storage Service for Kubernetes
Apache License 2.0
875 stars 390 forks source link

Failed to create snapshot for gluster volume in gluster container #495

Closed MartinForReal closed 6 years ago

MartinForReal commented 6 years ago

I installed nfs-ganesha and started but it doesn't work

[2018-07-05 07:16:45.220065] W [MSGID: 101095] [xlator.c:162:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.13.2/xlator/nfs/server.so: cannot open shared object file: No such file or directory
[2018-07-05 07:16:45.299498] E [MSGID: 106062] [glusterd-snapshot.c:6396:glusterd_do_snap_cleanup] 0-glusterd: Unable to get volume name
[2018-07-05 07:16:45.299523] W [MSGID: 106040] [glusterd-snapshot.c:8244:glusterd_snapshot_create_postvalidate] 0-management: cleanup operation failed
[2018-07-05 07:16:45.299536] W [MSGID: 106030] [glusterd-snapshot.c:9221:glusterd_snapshot_postvalidate] 0-management: Snapshot create post-validation failed
[2018-07-05 07:16:45.299544] W [MSGID: 106121] [glusterd-mgmt.c:449:gd_mgmt_v3_post_validate_fn] 0-management: postvalidate operation failed
[2018-07-05 07:16:45.299552] E [MSGID: 106121] [glusterd-mgmt.c:1852:glusterd_mgmt_v3_post_validate] 0-management: Post Validation failed for operation Snapshot on local node
[2018-07-05 07:16:45.299561] E [MSGID: 106122] [glusterd-mgmt.c:2556:glusterd_mgmt_v3_initiate_snap_phases] 0-management: Post Validation Failed.so: cannot open shared object file: No such file or directo
ry
The message "W [MSGID: 101095] [xlator.c:162:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.13.2/xlator/nfs/server.so: cannot open shared object file: No such file or directory" repeated 2 times
between [2018-07-05 07:16:44.888335] and [2018-07-05 07:16:45.062105]
[2018-07-05 07:16:45.218940] E [MSGID: 106030] [glusterd-snapshot.c:4745:glusterd_take_lvm_snapshot] 0-management: taking snapshot of the brick (/data/glusterfs/vol1) of device /dev/mapper/vg-data failed
[2018-07-05 07:16:45.219012] E [MSGID: 106030] [glusterd-snapshot.c:5164:glusterd_take_brick_snapshot] 0-management: Failed to take snapshot of brick 172.30.0.39:/data/glusterfs/vol1
[2018-07-05 07:16:45.219025] E [MSGID: 106030] [glusterd-snapshot.c:6525:glusterd_take_brick_snapshot_task] 0-management: Failed to take backend snapshot for brick 172.30.0.39:/run/gluster/snaps/f34f7ab93
db2422299cb0a8af710a9ca/brick1/vol1 volume(f34f7ab93db2422299cb0a8af710a9ca)
[2018-07-05 07:16:45.219082] E [MSGID: 106030] [glusterd-snapshot.c:6667:glusterd_schedule_brick_snapshot] 0-management: Failed to create snapshot
[2018-07-05 07:16:45.219123] E [MSGID: 106030] [glusterd-snapshot.c:6983:glusterd_snapshot_create_commit] 0-management: Failed to take backend snapshot snapshot4glustervol_GMT-2018.07.05-07.16.44
[2018-07-05 07:16:45.219588] E [MSGID: 106030] [glusterd-snapshot.c:8424:glusterd_snapshot] 0-management: Failed to create snapshot
[2018-07-05 07:16:45.219606] W [MSGID: 106123] [glusterd-mgmt.c:290:gd_mgmt_v3_commit_fn] 0-management: Snapshot Commit Failed
[2018-07-05 07:16:45.219615] E [MSGID: 106123] [glusterd-mgmt.c:1596:glusterd_mgmt_v3_commit] 0-management: Commit failed for operation Snapshot on local node
[2018-07-05 07:16:45.219626] E [MSGID: 106123] [glusterd-mgmt.c:2497:glusterd_mgmt_v3_initiate_snap_phases] 0-management: Commit Op Failed
[2018-07-05 07:16:45.220065] W [MSGID: 101095] [xlator.c:162:xlator_volopt_dynload] 0-xlator: /usr/lib64/glusterfs/3.13.2/xlator/nfs/server.so: cannot open shared object file: No such file or directory
[2018-07-05 07:16:45.299498] E [MSGID: 106062] [glusterd-snapshot.c:6396:glusterd_do_snap_cleanup] 0-glusterd: Unable to get volume name
[2018-07-05 07:16:45.299523] W [MSGID: 106040] [glusterd-snapshot.c:8244:glusterd_snapshot_create_postvalidate] 0-management: cleanup operation failed
[2018-07-05 07:16:45.299536] W [MSGID: 106030] [glusterd-snapshot.c:9221:glusterd_snapshot_postvalidate] 0-management: Snapshot create post-validation failed
[2018-07-05 07:16:45.299544] W [MSGID: 106121] [glusterd-mgmt.c:449:gd_mgmt_v3_post_validate_fn] 0-management: postvalidate operation failed
[2018-07-05 07:16:45.299552] E [MSGID: 106121] [glusterd-mgmt.c:1852:glusterd_mgmt_v3_post_validate] 0-management: Post Validation failed for operation Snapshot on local node
[2018-07-05 07:16:45.299561] E [MSGID: 106122] [glusterd-mgmt.c:2556:glusterd_mgmt_v3_initiate_snap_phases] 0-management: Post Validation Failed2018-07-05 07:16:45.299561] E [MSGID: 106122] [glusterd-mgmt
.c:2556:glusterd_mgmt_v3_initiate_snap_phases] 0-management: Post Validation Failed
nixpanic commented 6 years ago

The gluster-kubernetes project is for deploying a Gluster environment within Kubernetes. It does not offer the option to install nfs-ganesha or make snapshots. This is likely the wrong project to report your problem.

Best is probably to email gluster-users@gluster.org with more details so that a broader audience can help out. Explain carefully what you have done, and what you want to achieve.

MartinForReal commented 6 years ago

Thanks for clarifying that snapshot is not supported. We are trying to deploy glusterfs in kubernetes cluster and we want to know if snapshot feature is supported when glusterfs is started in container.

nixpanic commented 6 years ago

Snapshots can work within containers. The functionality is partially there in heketi, it is used by the volume clone interface. Questions or problems with that should be discussed in the Heketi project.

MartinForReal commented 6 years ago

gluster client is invoked when snapshot request is received by heketi. and I think the creating snapshot request would be redirected to glusterd. And I searched the internet and found that lvm snapshot (which is the way how glusterfs implement snapshot) may be corrupted due to the limit of udev's functionality.