search

gluster / glusterfs

Gluster Filesystem : Build your distributed storage in minutes
https://www.gluster.org
GNU General Public License v2.0
4.75k stars 1.08k forks source link

the .glusterfs folder is always missing #4226

Open PandyYang opened 1 year ago

PandyYang commented 1 year ago

Description of problem: The .glusterfs folder is always missing, causes storage service to be unavailable

The exact command to reproduce the issue: highly concurrent reading, writing and deleting in glusterfs using python

Mandatory info: - The output of the gluster volume info command:

Volume Name: vk-volume-1
Type: Distribute
Volume ID: dc773e4c-0005-49f3-b50c-ab0595b27129
Status: Started
Snapshot Count: 0
Number of Bricks: 3
Transport-type: tcp
Bricks:
Brick1: gluster2:/opt/brick1/store
Brick2: gluster1:/opt/brick1/store
Brick3: gluster3:/opt/brick1/store
Options Reconfigured:
performance.client-io-threads: on
transport.address-family: inet
storage.fips-mode-rchecksum: on
nfs.disable: on

- The output of the gluster volume status command:

Status of volume: vk-volume-1
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick gluster2:/opt/brick1/store            49152     0          Y       21136
Brick gluster1:/opt/brick1/store            49152     0          Y       18853
Brick gluster3:/opt/brick1/store            N/A       N/A        N       N/A  

Task Status of Volume vk-volume-1
------------------------------------------------------------------------------
There are no active volume tasks

- The output of the gluster volume heal command:

Launching heal operation to perform index self heal on volume vk-volume-1 has been unsuccessful:
Self-heal-daemon is disabled. Heal will not be triggered on volume vk-volume-1

**- Provide logs present on following locations of client and server nodes - /var/log/glusterfs/

root@gluster3:/var/log/glusterfs# tail -n 200 glusterd.log
[2023-09-26 01:00:54.126469] I [MSGID: 106143] [glusterd-pmap.c:389:pmap_registry_remove] 0-pmap: removing brick /opt/brick1/store on port 49152 
[2023-09-26 02:38:03.118440] I [MSGID: 106488] [glusterd-handler.c:1400:__glusterd_handle_cli_get_volume] 0-management: Received get vol req

**- Is there any crash ? Provide the backtrace and coredump not found.

Additional info: The volume is mounted as a virtual drive letter on other machines. After running for a period of time, it is found that the .glusterfs folder is missing from the machine. and the storage service is unavaliable now.

- The operating system / glusterfs version:

sys:

root@gluster3:/var/log/glusterfs#     lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 16.04.7 LTS
Release:    16.04

glusterfs:

root@gluster3:/var/log/glusterfs#  gluster --version
glusterfs 7.9
Repository revision: git://git.gluster.org/glusterfs.git
Copyright (c) 2006-2016 Red Hat, Inc. <https://www.gluster.org/>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
It is licensed to you under your choice of the GNU Lesser
General Public License, version 3 or any later version (LGPLv3
or later), or the GNU General Public License, version 2 (GPLv2),
in all cases as published by the Free Software Foundation.

Note: Please hide any confidential data which you don't want to share in public like IP address, file name, hostname or any other configuration

busishe commented 1 week ago

Hi ,I met the same problem.do you have any idea now?