gluster / glusterfs

Gluster Filesystem : Build your distributed storage in minutes
https://www.gluster.org
GNU General Public License v2.0
4.54k stars 1.07k forks source link

Mounting with ipv6 address leads to failure #4269

Open sbr-0726 opened 6 months ago

sbr-0726 commented 6 months ago

I am seeing this error in a pure IPv6 host network on gluster 11 version. Same was working fine in gluster 9.6. I could see Address used for DNS resolution is truncated from 2620:100:c:e085:20c:29ff:fe6c:a2da to 2620:100:c:e085:20c:29ff:fe6c, Dont see any additional config required compared to 9.6

[2023-11-23 06:58:21.904786 +0000] I [MSGID: 100030] [glusterfsd.c:2874:main] 0-/usr/sbin/glusterfsd: Started running version [{arg=/usr/sbin/glusterfsd}, {version=11.0}, {cmdlinestr=/usr/sbin/glusterfsd -s 2620:100:c:e085:20c:29ff:fe6c:a2da --volfile-id efa_logs.2620:100:c:e085:20c:29ff:fe6c:a2da.opt-efa-logs -p /var/run/gluster/vols/efa_logs/2620:100:c:e085:20c:29ff:fe6c:a2da-opt-efa-logs.pid -S /var/run/gluster/cc576d02637e77d6.socket --brick-name /opt/efa/logs -l /var/log/glusterfs/bricks/opt-efa-logs.log --xlator-option *-posix.glusterd-uuid=9055012b-6f08-412b-8a90-2de306657390 --process-name brick --brick-port 59322 --xlator-option efa_logs-server.listen-port=59322 --xlator-option transport.address-family=inet6}] [2023-11-23 06:58:21.905228 +0000] I [glusterfsd.c:2563:daemonize] 0-glusterfs: Pid of current running process is 30229 [2023-11-23 06:58:21.908664 +0000] I [socket.c:917:__socket_server_bind] 0-socket.glusterfsd: closing (AF_UNIX) reuse check socket 9 [2023-11-23 06:58:21.916450 +0000] E [MSGID: 101073] [name.c:255:gf_resolve_ip6] 0-resolver: error in getaddrinfo [{family=10}, {ret=Temporary failure in name resolution}] [2023-11-23 06:58:21.916470 +0000] E [name.c:384:af_inet_client_get_remote_sockaddr] 0-glusterfs: DNS resolution failed on host 2620:100:c:e085:20c:29ff:fe6c [2023-11-23 06:58:21.916585 +0000] I [glusterfsd-mgmt.c:2774:mgmt_rpc_notify] 0-glusterfsd-mgmt: disconnected from remote-host: 2620:100:c:e085:20c:29ff:fe6c [2023-11-23 06:58:21.916605 +0000] I [glusterfsd-mgmt.c:2802:mgmt_rpc_notify] 0-glusterfsd-mgmt: Port-mapper is active, Giving up on the backup volfile servers [2023-11-23 06:58:21.916639 +0000] I [MSGID: 101188] [event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Started thread with index [{index=1}] [2023-11-23 06:58:21.916659 +0000] I [MSGID: 101188] [event-epoll.c:644:event_dispatch_epoll_worker] 0-epoll: Started thread with index [{index=0}] [2023-11-23 06:58:21.916709 +0000] W [glusterfsd.c:1428:cleanup_and_exit] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(+0xcb9b) [0x7f1e8a950b9b] -->/usr/sbin/glusterfsd(+0x11f51) [0x555c33afcf51] -->/usr/sbin/glusterfsd(cleanup_and_exit+0x54) [0x555c33af3c64] ) 0-: received signum (1), shutting down [2023-11-23 06:58:21.917253 +0000] E [MSGID: 101073] [name.c:255:gf_resolve_ip6] 0-resolver: error in getaddrinfo [{family=10}, {ret=Temporary failure in name resolution}] [2023-11-23 06:58:21.917270 +0000] E [name.c:384:af_inet_client_get_remote_sockaddr] 0-glusterfs: DNS resolution failed on host 2620:100:c:e085:20c:29ff:fe6c [2023-11-23 06:58:21.917344 +0000] I [socket.c:3654:socket_submit_outgoing_msg] 0-glusterfs: not connected (priv->connected = -1) [2023-11-23 06:58:21.917362 +0000] W [rpc-clnt.c:1641:rpc_clnt_submit] 0-glusterfs: failed to submit rpc-request (unique: 0, XID: 0x2 Program: Gluster Portmap, ProgVers: 1, Proc: 5) to rpc-transport (glusterfs) [2023-11-23 06:58:21.917415 +0000] W [glusterfsd.c:1428:cleanup_and_exit] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(+0xcb9b) [0x7f1e8a950b9b] -->/usr/sbin/glusterfsd(+0x11f51) [0x555c33afcf51] -->/usr/sbin/glusterfsd(cleanup_and_exit+0x54) [0x555c33af3c64] ) 0-: received signum (1), shutting down

output for gluster volume info command

Volume Name: efa_logs Type: Distributed-Replicate Volume ID: 54cec617-addf-4fff-8917-c59d93f03838 Status: Started Snapshot Count: 0 Number of Bricks: 1 x 2 = 2 Transport-type: tcp Bricks: Brick1: 2620:100:c:e085:20c:29ff:fe6c:a2da:/opt/efa/logs Brick2: 2620:100:c:e085:20c:29ff:fea3:9e67:/opt/efa/logs Options Reconfigured: ssl.ca-list: /opt/efadata/glusterfs/glusterfs.extreme-ca-chain.pem ssl.own-cert: /opt/efadata/glusterfs/glusterfs.pem ssl.private-key: /opt/efadata/glusterfs/glusterfs.key.pem ssl.cipher-list: HIGH:!SSLv2:!SSLv3:!TLSv1:!TLSv1.1:TLSv1.2:!3DES:!RC4:!aNULL:!ADH auth.ssl-allow: 2620:100:c:e085:20c:29ff:fe6c:a2da,2620:100:c:e085:20c:29ff:fea3:9e67 server.ssl: on client.ssl: on ssl.certificate-depth: 3 network.ping-timeout: 2 performance.open-behind: on cluster.favorite-child-policy: mtime storage.owner-gid: 1001 storage.owner-uid: 0 cluster.granular-entry-heal: on storage.fips-mode-rchecksum: on transport.address-family: inet6 nfs.disable: on performance.client-io-threads: off

output for gluster volume status

Gluster process TCP Port RDMA Port Online Pid

Brick 2620:100:c:e085:20c:29ff:fe6c:a2da:/opt/efa/logs N/A N/A N N/A Brick 2620:100:c:e085:20c:29ff:fea3:9e67:/opt/efa/logs N/A N/A N N/A Self-heal Daemon on localhost N/A N/A Y 30241 Self-heal Daemon on 2620:100:c:e085:20c:29ff:fea3:9e67 N/A N/A Y 29398

cat /etc/glusterfs/glusterd.vol

volume management type mgmt/glusterd option working-directory /var/lib/glusterd option transport-type socket option transport.socket.keepalive-time 10 option transport.socket.keepalive-interval 2 option transport.socket.read-fail-log off option transport.socket.listen-port 24007 option ping-timeout 0 option event-threads 1 option transport.address-family inet6 option max-port 60999 end-volume