search

gluster / glusterfs

Gluster Filesystem : Build your distributed storage in minutes
https://www.gluster.org
GNU General Public License v2.0
4.51k stars 1.07k forks source link

Symlinking to a file with a long filepath results in a broken link #4342

Open ovlindho opened 3 weeks ago

ovlindho commented 3 weeks ago

Description of problem: If I create a symbolic link to a file on Glusterfs that has a long enough filepath it results in a link that does not point anywhere.

The exact command to reproduce the issue:

echo test > /mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_target
ln -s /mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_target /mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_link

The full output of the command that failed:

ls -la /mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_link
ls: cannot read symbolic link '/mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_link': Invalid argument
lrwxrwxrwx 1 rocky rocky 257 Apr 24 12:00 /mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_link

Expected results: Listing of the link and its target.

Mandatory info: - The output of the gluster volume info command:

Volume Name: glustervol1
Type: Distribute
Volume ID: bbaab415-bbf7-4c2d-abca-882bd5d87873
Status: Started
Snapshot Count: 0
Number of Bricks: 10
Transport-type: tcp
Bricks:
Brick1: glusterfs-server-1:/bricks/brick1/glustervol1
Brick2: glusterfs-server-2:/bricks/brick1/glustervol1
Brick3: glusterfs-server-3:/bricks/brick1/glustervol1
Brick4: glusterfs-server-4:/bricks/brick1/glustervol1
Brick5: glusterfs-server-5:/bricks/brick1/glustervol1
Brick6: glusterfs-server-1:/bricks/brick2/glustervol1
Brick7: glusterfs-server-2:/bricks/brick2/glustervol1
Brick8: glusterfs-server-3:/bricks/brick2/glustervol1
Brick9: glusterfs-server-4:/bricks/brick2/glustervol1
Brick10: glusterfs-server-5:/bricks/brick2/glustervol1
Options Reconfigured:
server.outstanding-rpc-limit: 128
server.event-threads: 10
performance.qr-cache-timeout: 600
performance.read-ahead: off
performance.flush-behind: on
performance.write-behind: on
performance.write-behind-window-size: 4MB
performance.parallel-readdir: off
performance.nl-cache-positive-entry: on
performance.nl-cache-limit: 10MB
performance.io-thread-count: 32
performance.io-cache: off
performance.cache-size: 1GB
performance.cache-max-file-size: 2MB
cluster.lookup-optimize: off
client.event-threads: 4
performance.nl-cache-timeout: 600
performance.nl-cache: on
network.inode-lru-limit: 500000
performance.md-cache-timeout: 600
performance.cache-invalidation: on
performance.stat-prefetch: on
features.cache-invalidation-timeout: 600
features.cache-invalidation: on
storage.fips-mode-rchecksum: on
transport.address-family: inet
nfs.disable: on

- The output of the gluster volume status command:

Status of volume: glustervol1
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick glusterfs-server-1:/bricks/brick1/glu
stervol1                                    49589     0          Y       1487 
Brick glusterfs-server-2:/bricks/brick1/glu
stervol1                                    53438     0          Y       2473 
Brick glusterfs-server-3:/bricks/brick1/glu
stervol1                                    54387     0          Y       1423 
Brick glusterfs-server-4:/bricks/brick1/glu
stervol1                                    58299     0          Y       1440 
Brick glusterfs-server-5:/bricks/brick1/glu
stervol1                                    59008     0          Y       1715 
Brick glusterfs-server-1:/bricks/brick2/glu
stervol1                                    59360     0          Y       2103 
Brick glusterfs-server-2:/bricks/brick2/glu
stervol1                                    53761     0          Y       3094 
Brick glusterfs-server-3:/bricks/brick2/glu
stervol1                                    58252     0          Y       1947 
Brick glusterfs-server-4:/bricks/brick2/glu
stervol1                                    50718     0          Y       1780 
Brick glusterfs-server-5:/bricks/brick2/glu
stervol1                                    58373     0          Y       2015 

Task Status of Volume glustervol1
------------------------------------------------------------------------------
There are no active volume tasks

- The output of the gluster volume heal command:

Launching heal operation to perform index self heal on volume glustervol1 has been unsuccessful:
Self-heal-daemon is disabled. Heal will not be triggered on volume glustervol1

- Provide logs present on following locations of client and server nodes - /var/log/glusterfs/ Client node:

[2024-04-24 12:02:33.177153 +0000] W [fuse-bridge.c:2159:fuse_readlink_cbk] 0-glusterfs-fuse: 392667016: /symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_link => -1 (Invalid argument)

No errors or warnings on the server nodes. - Is there any crash ? Provide the backtrace and coredump No.

Additional info: All the glusterfs servers and clients are virtual machines within an Openstack deployment. The glusterfs bricks are created on Openstack Volumes. All the clients mount glusterfs with option noatime. On a NFS mount (not Glusterfs) the above command produces a valid link.

- The operating system / glusterfs version: Rocky Linux 9.0 / glusterfs 11.1

Note: Please hide any confidential data which you don't want to share in public like IP address, file name, hostname or any other configuration

mohit84 commented 3 weeks ago

Can you run the command with strace (strace -Tttf ) and share the data with brick logs?

ovlindho commented 3 weeks ago

Here is the strace for the link creation:

``` 07:29:55.075065 execve("/usr/bin/ln", ["ln", "-s", "/mnt/glustervol1//symlink-test/0"..., "/mnt/glustervol1//symlink-test/0"...], 0x7ffd6a2b1350 /* 30 vars */) = 0 <0.000219> 07:29:55.075422 brk(NULL) = 0x5562ba196000 <0.000027> 07:29:55.075561 arch_prctl(0x3001 /* ARCH_??? */, 0x7ffd5e19d960) = -1 EINVAL (Invalid argument) <0.000025> 07:29:55.075668 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) <0.000028> 07:29:55.075770 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000028> 07:29:55.075852 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=21459, ...}, AT_EMPTY_PATH) = 0 <0.000026> 07:29:55.075945 mmap(NULL, 21459, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33d0113000 <0.000027> 07:29:55.076021 close(3) = 0 <0.000025> 07:29:55.076092 openat(AT_FDCWD, "/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 <0.000027> 07:29:55.076169 read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0p\0\4\0\0\0\0\0"..., 832) = 832 <0.000027> 07:29:55.076242 pread64(3, "\6\0\0\0\4\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0"..., 784, 64) = 784 <0.000018> 07:29:55.076303 pread64(3, "\4\0\0\0 \0\0\0\5\0\0\0GNU\0\2\0\0\300\4\0\0\0\3\0\0\0\0\0\0\0"..., 48, 848) = 48 <0.000017> 07:29:55.076363 pread64(3, "\4\0\0\0\24\0\0\0\3\0\0\0GNU\0-\345a\277kX\335i\221Q\7\3404\342 \202"..., 68, 896) = 68 <0.000017> 07:29:55.076421 newfstatat(3, "", {st_mode=S_IFREG|0755, st_size=2387016, ...}, AT_EMPTY_PATH) = 0 <0.000017> 07:29:55.076482 mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f33d0111000 <0.000018> 07:29:55.076553 pread64(3, "\6\0\0\0\4\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0"..., 784, 64) = 784 <0.000018> 07:29:55.076616 mmap(NULL, 2133936, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f33cff08000 <0.000020> 07:29:55.076687 mprotect(0x7f33cff30000, 1892352, PROT_NONE) = 0 <0.000022> 07:29:55.076748 mmap(0x7f33cff30000, 1527808, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x28000) = 0x7f33cff30000 <0.000023> 07:29:55.076810 mmap(0x7f33d00a5000, 360448, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x19d000) = 0x7f33d00a5000 <0.000021> 07:29:55.076870 mmap(0x7f33d00fe000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1f5000) = 0x7f33d00fe000 <0.000020> 07:29:55.076932 mmap(0x7f33d0104000, 53168, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f33d0104000 <0.000019> 07:29:55.076999 close(3) = 0 <0.000016> 07:29:55.077061 mmap(NULL, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f33cff05000 <0.000017> 07:29:55.077121 arch_prctl(ARCH_SET_FS, 0x7f33cff05740) = 0 <0.000016> 07:29:55.077179 set_tid_address(0x7f33cff05a10) = 2563598 <0.000024> 07:29:55.077249 set_robust_list(0x7f33cff05a20, 24) = 0 <0.000024> 07:29:55.077316 rseq(0x7f33cff060e0, 0x20, 0, 0x53053053) = 0 <0.000024> 07:29:55.077420 mprotect(0x7f33d00fe000, 16384, PROT_READ) = 0 <0.000030> 07:29:55.077516 mprotect(0x5562b8917000, 4096, PROT_READ) = 0 <0.000036> 07:29:55.077600 mprotect(0x7f33d014d000, 8192, PROT_READ) = 0 <0.000025> 07:29:55.077696 prlimit64(0, RLIMIT_STACK, NULL, {rlim_cur=8192*1024, rlim_max=RLIM64_INFINITY}) = 0 <0.000024> 07:29:55.077779 munmap(0x7f33d0113000, 21459) = 0 <0.000030> 07:29:55.077874 getrandom("\x14\xb1\x9c\x3c\x67\x7d\xfb\x7c", 8, GRND_NONBLOCK) = 8 <0.000025> 07:29:55.077953 brk(NULL) = 0x5562ba196000 <0.000025> 07:29:55.078033 brk(0x5562ba1b7000) = 0x5562ba1b7000 <0.000018> 07:29:55.078094 openat(AT_FDCWD, "/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000021> 07:29:55.078168 openat(AT_FDCWD, "/usr/share/locale/locale.alias", O_RDONLY|O_CLOEXEC) = 3 <0.000021> 07:29:55.078236 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=2998, ...}, AT_EMPTY_PATH) = 0 <0.000018> 07:29:55.078303 read(3, "# Locale name alias data base.\n#"..., 4096) = 2998 <0.000018> 07:29:55.078375 read(3, "", 4096) = 0 <0.000018> 07:29:55.078432 close(3) = 0 <0.000017> 07:29:55.078498 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_IDENTIFICATION", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000019> 07:29:55.078581 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_IDENTIFICATION", O_RDONLY|O_CLOEXEC) = 3 <0.000020> 07:29:55.078643 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=369, ...}, AT_EMPTY_PATH) = 0 <0.000030> 07:29:55.078721 mmap(NULL, 369, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33d014c000 <0.000019> 07:29:55.078779 close(3) = 0 <0.000016> 07:29:55.078836 openat(AT_FDCWD, "/usr/lib64/gconv/gconv-modules.cache", O_RDONLY) = 3 <0.000019> 07:29:55.078897 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=26988, ...}, AT_EMPTY_PATH) = 0 <0.000017> 07:29:55.078960 mmap(NULL, 26988, PROT_READ, MAP_SHARED, 3, 0) = 0x7f33cfefe000 <0.000021> 07:29:55.079020 close(3) = 0 <0.000016> 07:29:55.079078 futex(0x7f33d0103a6c, FUTEX_WAKE_PRIVATE, 2147483647) = 0 <0.000016> 07:29:55.079142 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_MEASUREMENT", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000018> 07:29:55.079205 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_MEASUREMENT", O_RDONLY|O_CLOEXEC) = 3 <0.000019> 07:29:55.079266 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=23, ...}, AT_EMPTY_PATH) = 0 <0.000017> 07:29:55.079326 mmap(NULL, 23, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33d0118000 <0.000019> 07:29:55.079384 close(3) = 0 <0.000016> 07:29:55.079446 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_TELEPHONE", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000018> 07:29:55.079509 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_TELEPHONE", O_RDONLY|O_CLOEXEC) = 3 <0.000029> 07:29:55.079580 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=59, ...}, AT_EMPTY_PATH) = 0 <0.000018> 07:29:55.079642 mmap(NULL, 59, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33d0117000 <0.000030> 07:29:55.079714 close(3) = 0 <0.000017> 07:29:55.079776 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_ADDRESS", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000019> 07:29:55.079839 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_ADDRESS", O_RDONLY|O_CLOEXEC) = 3 <0.000019> 07:29:55.079899 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=167, ...}, AT_EMPTY_PATH) = 0 <0.000017> 07:29:55.079960 mmap(NULL, 167, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33d0116000 <0.000019> 07:29:55.080024 close(3) = 0 <0.000020> 07:29:55.080098 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_NAME", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000027> 07:29:55.080177 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_NAME", O_RDONLY|O_CLOEXEC) = 3 <0.000028> 07:29:55.080254 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=77, ...}, AT_EMPTY_PATH) = 0 <0.000025> 07:29:55.080331 mmap(NULL, 77, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33d0115000 <0.000026> 07:29:55.080403 close(3) = 0 <0.000023> 07:29:55.080480 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_PAPER", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000026> 07:29:55.080564 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_PAPER", O_RDONLY|O_CLOEXEC) = 3 <0.000023> 07:29:55.080636 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=34, ...}, AT_EMPTY_PATH) = 0 <0.000034> 07:29:55.080723 mmap(NULL, 34, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33d0114000 <0.000028> 07:29:55.080798 close(3) = 0 <0.000025> 07:29:55.080875 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_MESSAGES", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000026> 07:29:55.080953 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_MESSAGES", O_RDONLY|O_CLOEXEC) = 3 <0.000028> 07:29:55.081032 newfstatat(3, "", {st_mode=S_IFDIR|0755, st_size=29, ...}, AT_EMPTY_PATH) = 0 <0.000019> 07:29:55.081107 close(3) = 0 <0.000018> 07:29:55.081163 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES", O_RDONLY|O_CLOEXEC) = 3 <0.000019> 07:29:55.081236 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=57, ...}, AT_EMPTY_PATH) = 0 <0.000018> 07:29:55.081299 mmap(NULL, 57, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33d0113000 <0.000020> 07:29:55.081358 close(3) = 0 <0.000020> 07:29:55.081428 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_MONETARY", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000027> 07:29:55.081506 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_MONETARY", O_RDONLY|O_CLOEXEC) = 3 <0.000037> 07:29:55.081592 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=286, ...}, AT_EMPTY_PATH) = 0 <0.000026> 07:29:55.081672 mmap(NULL, 286, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33cfefd000 <0.000029> 07:29:55.081759 close(3) = 0 <0.000017> 07:29:55.081825 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_COLLATE", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000020> 07:29:55.081893 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_COLLATE", O_RDONLY|O_CLOEXEC) = 3 <0.000020> 07:29:55.081954 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=2586930, ...}, AT_EMPTY_PATH) = 0 <0.000018> 07:29:55.082016 mmap(NULL, 2586930, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33cfc85000 <0.000019> 07:29:55.082074 close(3) = 0 <0.000016> 07:29:55.082144 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_TIME", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000019> 07:29:55.082208 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_TIME", O_RDONLY|O_CLOEXEC) = 3 <0.000020> 07:29:55.082270 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=3284, ...}, AT_EMPTY_PATH) = 0 <0.000017> 07:29:55.082332 mmap(NULL, 3284, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33cfc84000 <0.000019> 07:29:55.082391 close(3) = 0 <0.000016> 07:29:55.082454 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_NUMERIC", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000018> 07:29:55.082516 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_NUMERIC", O_RDONLY|O_CLOEXEC) = 3 <0.000027> 07:29:55.082584 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=54, ...}, AT_EMPTY_PATH) = 0 <0.000018> 07:29:55.082650 mmap(NULL, 54, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33cfc83000 <0.000050> 07:29:55.082748 close(3) = 0 <0.000027> 07:29:55.082820 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_CTYPE", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000019> 07:29:55.082884 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_CTYPE", O_RDONLY|O_CLOEXEC) = 3 <0.000020> 07:29:55.082945 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=346132, ...}, AT_EMPTY_PATH) = 0 <0.000017> 07:29:55.083011 mmap(NULL, 346132, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f33cfc2e000 <0.000024> 07:29:55.083080 close(3) = 0 <0.000025> 07:29:55.083158 symlinkat("/mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_target", AT_FDCWD, "/mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_link") = 0 <0.002578> 07:29:55.085805 lseek(0, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) <0.000025> 07:29:55.085877 close(0) = 0 <0.000016> 07:29:55.085931 close(1) = 0 <0.000016> 07:29:55.085985 close(2) = 0 <0.000015> 07:29:55.086040 exit_group(0) = ? 07:29:55.086173 +++ exited with 0 +++ ```

And here for ls:

``` 07:29:55.089229 execve("/usr/bin/ls", ["ls", "/mnt/glustervol1//symlink-test/0"...], 0x7fff1e11f2c0 /* 30 vars */) = 0 <0.000289> 07:29:55.089658 brk(NULL) = 0x55fef0f9b000 <0.000041> 07:29:55.089815 arch_prctl(0x3001 /* ARCH_??? */, 0x7ffcecfab780) = -1 EINVAL (Invalid argument) <0.000016> 07:29:55.089935 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory) <0.000028> 07:29:55.090022 openat(AT_FDCWD, "/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3 <0.000020> 07:29:55.090095 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=21459, ...}, AT_EMPTY_PATH) = 0 <0.000027> 07:29:55.090196 mmap(NULL, 21459, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899ab5000 <0.000023> 07:29:55.090259 close(3) = 0 <0.000016> 07:29:55.090344 openat(AT_FDCWD, "/lib64/libselinux.so.1", O_RDONLY|O_CLOEXEC) = 3 <0.000032> 07:29:55.090427 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0Pp\0\0\0\0\0\0"..., 832) = 832 <0.000018> 07:29:55.090497 newfstatat(3, "", {st_mode=S_IFREG|0755, st_size=175552, ...}, AT_EMPTY_PATH) = 0 <0.000017> 07:29:55.090576 mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f8899ab3000 <0.000025> 07:29:55.090649 mmap(NULL, 181896, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f8899a86000 <0.000038> 07:29:55.090736 mmap(0x7f8899a8c000, 110592, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f8899a8c000 <0.000025> 07:29:55.090803 mmap(0x7f8899aa7000, 32768, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x21000) = 0x7f8899aa7000 <0.000028> 07:29:55.090870 mmap(0x7f8899aaf000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x28000) = 0x7f8899aaf000 <0.000028> 07:29:55.090941 mmap(0x7f8899ab1000, 5768, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f8899ab1000 <0.000025> 07:29:55.091018 close(3) = 0 <0.000016> 07:29:55.091080 openat(AT_FDCWD, "/lib64/libcap.so.2", O_RDONLY|O_CLOEXEC) = 3 <0.000022> 07:29:55.091151 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0p'\0\0\0\0\0\0"..., 832) = 832 <0.000084> 07:29:55.091290 newfstatat(3, "", {st_mode=S_IFREG|0755, st_size=36944, ...}, AT_EMPTY_PATH) = 0 <0.000017> 07:29:55.091361 mmap(NULL, 36920, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f8899a7c000 <0.000021> 07:29:55.091459 mmap(0x7f8899a7e000, 16384, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f8899a7e000 <0.000024> 07:29:55.091539 mmap(0x7f8899a82000, 8192, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f8899a82000 <0.000021> 07:29:55.091643 mmap(0x7f8899a84000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7000) = 0x7f8899a84000 <0.000033> 07:29:55.091749 close(3) = 0 <0.000016> 07:29:55.091807 openat(AT_FDCWD, "/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3 <0.000020> 07:29:55.091873 read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0p\0\4\0\0\0\0\0"..., 832) = 832 <0.000020> 07:29:55.091945 pread64(3, "\6\0\0\0\4\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0"..., 784, 64) = 784 <0.000018> 07:29:55.092011 pread64(3, "\4\0\0\0 \0\0\0\5\0\0\0GNU\0\2\0\0\300\4\0\0\0\3\0\0\0\0\0\0\0"..., 48, 848) = 48 <0.000016> 07:29:55.092069 pread64(3, "\4\0\0\0\24\0\0\0\3\0\0\0GNU\0-\345a\277kX\335i\221Q\7\3404\342 \202"..., 68, 896) = 68 <0.000018> 07:29:55.092133 newfstatat(3, "", {st_mode=S_IFREG|0755, st_size=2387016, ...}, AT_EMPTY_PATH) = 0 <0.000025> 07:29:55.092211 pread64(3, "\6\0\0\0\4\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0"..., 784, 64) = 784 <0.000025> 07:29:55.092283 mmap(NULL, 2133936, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f8899873000 <0.000027> 07:29:55.092355 mprotect(0x7f889989b000, 1892352, PROT_NONE) = 0 <0.000033> 07:29:55.092431 mmap(0x7f889989b000, 1527808, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x28000) = 0x7f889989b000 <0.000028> 07:29:55.092510 mmap(0x7f8899a10000, 360448, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x19d000) = 0x7f8899a10000 <0.000042> 07:29:55.092591 mmap(0x7f8899a69000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1f5000) = 0x7f8899a69000 <0.000027> 07:29:55.092670 mmap(0x7f8899a6f000, 53168, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f8899a6f000 <0.000019> 07:29:55.092795 close(3) = 0 <0.000017> 07:29:55.092860 openat(AT_FDCWD, "/lib64/libpcre2-8.so.0", O_RDONLY|O_CLOEXEC) = 3 <0.000030> 07:29:55.092939 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260$\0\0\0\0\0\0"..., 832) = 832 <0.000030> 07:29:55.093021 newfstatat(3, "", {st_mode=S_IFREG|0755, st_size=617416, ...}, AT_EMPTY_PATH) = 0 <0.000047> 07:29:55.093123 mmap(NULL, 614960, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f88997dc000 <0.000036> 07:29:55.093213 mprotect(0x7f88997de000, 602112, PROT_NONE) = 0 <0.000040> 07:29:55.093307 mmap(0x7f88997de000, 438272, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f88997de000 <0.000028> 07:29:55.093388 mmap(0x7f8899849000, 159744, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6d000) = 0x7f8899849000 <0.000053> 07:29:55.093483 mmap(0x7f8899871000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x94000) = 0x7f8899871000 <0.000019> 07:29:55.093574 close(3) = 0 <0.000016> 07:29:55.093640 mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f88997da000 <0.000040> 07:29:55.093727 arch_prctl(ARCH_SET_FS, 0x7f88997dac40) = 0 <0.000024> 07:29:55.093813 set_tid_address(0x7f88997daf10) = 2563602 <0.000025> 07:29:55.093905 set_robust_list(0x7f88997daf20, 24) = 0 <0.000026> 07:29:55.093977 rseq(0x7f88997db5e0, 0x20, 0, 0x53053053) = 0 <0.000024> 07:29:55.094135 mprotect(0x7f8899a69000, 16384, PROT_READ) = 0 <0.000020> 07:29:55.094214 mprotect(0x7f8899871000, 4096, PROT_READ) = 0 <0.000025> 07:29:55.094307 mprotect(0x7f8899a84000, 4096, PROT_READ) = 0 <0.000018> 07:29:55.094444 mprotect(0x7f8899aaf000, 4096, PROT_READ) = 0 <0.000018> 07:29:55.094566 mprotect(0x55fef0f37000, 8192, PROT_READ) = 0 <0.000019> 07:29:55.094626 mprotect(0x7f8899aef000, 8192, PROT_READ) = 0 <0.000040> 07:29:55.094748 prlimit64(0, RLIMIT_STACK, NULL, {rlim_cur=8192*1024, rlim_max=RLIM64_INFINITY}) = 0 <0.000019> 07:29:55.094829 munmap(0x7f8899ab5000, 21459) = 0 <0.000025> 07:29:55.094909 prctl(PR_CAPBSET_READ, CAP_MAC_OVERRIDE) = 1 <0.000017> 07:29:55.094965 prctl(PR_CAPBSET_READ, 0x30 /* CAP_??? */) = -1 EINVAL (Invalid argument) <0.000018> 07:29:55.095026 prctl(PR_CAPBSET_READ, CAP_CHECKPOINT_RESTORE) = 1 <0.000016> 07:29:55.095084 prctl(PR_CAPBSET_READ, 0x2c /* CAP_??? */) = -1 EINVAL (Invalid argument) <0.000017> 07:29:55.095142 prctl(PR_CAPBSET_READ, 0x2a /* CAP_??? */) = -1 EINVAL (Invalid argument) <0.000018> 07:29:55.095198 prctl(PR_CAPBSET_READ, 0x29 /* CAP_??? */) = -1 EINVAL (Invalid argument) <0.000018> 07:29:55.095287 statfs("/sys/fs/selinux", {f_type=SYSFS_MAGIC, f_bsize=4096, f_blocks=0, f_bfree=0, f_bavail=0, f_files=0, f_ffree=0, f_fsid={val=[0, 0]}, f_namelen=255, f_frsize=4096, f_flags=ST_VALID|ST_NOSUID|ST_NODEV|ST_NOEXEC|ST_RELATIME}) = 0 <0.000023> 07:29:55.095371 statfs("/selinux", 0x7ffcecfab710) = -1 ENOENT (No such file or directory) <0.000027> 07:29:55.095455 getrandom("\xc0\xa2\xa3\x35\x91\x94\x9f\xa3", 8, GRND_NONBLOCK) = 8 <0.000024> 07:29:55.095529 brk(NULL) = 0x55fef0f9b000 <0.000029> 07:29:55.095600 brk(0x55fef0fbc000) = 0x55fef0fbc000 <0.000019> 07:29:55.095692 openat(AT_FDCWD, "/proc/filesystems", O_RDONLY|O_CLOEXEC) = 3 <0.000030> 07:29:55.095775 newfstatat(3, "", {st_mode=S_IFREG|0444, st_size=0, ...}, AT_EMPTY_PATH) = 0 <0.000020> 07:29:55.095846 read(3, "nodev\tsysfs\nnodev\ttmpfs\nnodev\tbd"..., 1024) = 412 <0.000038> 07:29:55.095929 close(3) = 0 <0.000019> 07:29:55.096007 openat(AT_FDCWD, "/proc/mounts", O_RDONLY|O_CLOEXEC) = 3 <0.000038> 07:29:55.096087 newfstatat(3, "", {st_mode=S_IFREG|0444, st_size=0, ...}, AT_EMPTY_PATH) = 0 <0.000018> 07:29:55.096159 read(3, "proc /proc proc rw,nosuid,nodev,"..., 1024) = 1024 <0.000063> 07:29:55.096264 read(3, "ime,pagesize=2M 0 0\nmqueue /dev/"..., 1024) = 1024 <0.000058> 07:29:55.096363 read(3, "utofs rw,relatime,fd=13,pgrp=109"..., 1024) = 957 <0.000091> 07:29:55.096497 read(3, "", 1024) = 0 <0.000017> 07:29:55.096584 close(3) = 0 <0.000019> 07:29:55.096643 access("/etc/selinux/config", F_OK) = 0 <0.000039> 07:29:55.096758 openat(AT_FDCWD, "/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000023> 07:29:55.096834 openat(AT_FDCWD, "/usr/share/locale/locale.alias", O_RDONLY|O_CLOEXEC) = 3 <0.000027> 07:29:55.096930 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=2998, ...}, AT_EMPTY_PATH) = 0 <0.000022> 07:29:55.097010 read(3, "# Locale name alias data base.\n#"..., 4096) = 2998 <0.000020> 07:29:55.097089 read(3, "", 4096) = 0 <0.000016> 07:29:55.097143 close(3) = 0 <0.000017> 07:29:55.097218 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_IDENTIFICATION", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000023> 07:29:55.097334 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_IDENTIFICATION", O_RDONLY|O_CLOEXEC) = 3 <0.000021> 07:29:55.097397 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=369, ...}, AT_EMPTY_PATH) = 0 <0.000021> 07:29:55.097474 mmap(NULL, 369, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899aee000 <0.000020> 07:29:55.097554 close(3) = 0 <0.000017> 07:29:55.097633 openat(AT_FDCWD, "/usr/lib64/gconv/gconv-modules.cache", O_RDONLY) = 3 <0.000020> 07:29:55.097711 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=26988, ...}, AT_EMPTY_PATH) = 0 <0.000021> 07:29:55.097788 mmap(NULL, 26988, PROT_READ, MAP_SHARED, 3, 0) = 0x7f88997d3000 <0.000027> 07:29:55.097861 close(3) = 0 <0.000022> 07:29:55.097930 futex(0x7f8899a6ea6c, FUTEX_WAKE_PRIVATE, 2147483647) = 0 <0.000024> 07:29:55.098007 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_MEASUREMENT", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000019> 07:29:55.098070 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_MEASUREMENT", O_RDONLY|O_CLOEXEC) = 3 <0.000024> 07:29:55.098153 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=23, ...}, AT_EMPTY_PATH) = 0 <0.000025> 07:29:55.098229 mmap(NULL, 23, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899aba000 <0.000027> 07:29:55.098302 close(3) = 0 <0.000022> 07:29:55.098378 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_TELEPHONE", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000019> 07:29:55.098441 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_TELEPHONE", O_RDONLY|O_CLOEXEC) = 3 <0.000024> 07:29:55.098522 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=59, ...}, AT_EMPTY_PATH) = 0 <0.000035> 07:29:55.098611 mmap(NULL, 59, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899ab9000 <0.000029> 07:29:55.098705 close(3) = 0 <0.000024> 07:29:55.098784 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_ADDRESS", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000019> 07:29:55.098852 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_ADDRESS", O_RDONLY|O_CLOEXEC) = 3 <0.000026> 07:29:55.098923 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=167, ...}, AT_EMPTY_PATH) = 0 <0.000023> 07:29:55.099000 mmap(NULL, 167, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899ab8000 <0.000027> 07:29:55.099072 close(3) = 0 <0.000017> 07:29:55.099148 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_NAME", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000019> 07:29:55.099212 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_NAME", O_RDONLY|O_CLOEXEC) = 3 <0.000019> 07:29:55.099284 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=77, ...}, AT_EMPTY_PATH) = 0 <0.000023> 07:29:55.099359 mmap(NULL, 77, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899ab7000 <0.000026> 07:29:55.099432 close(3) = 0 <0.000024> 07:29:55.099508 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_PAPER", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000018> 07:29:55.099582 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_PAPER", O_RDONLY|O_CLOEXEC) = 3 <0.000026> 07:29:55.099656 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=34, ...}, AT_EMPTY_PATH) = 0 <0.000040> 07:29:55.099744 mmap(NULL, 34, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899ab6000 <0.000026> 07:29:55.099816 close(3) = 0 <0.000026> 07:29:55.099894 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_MESSAGES", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000018> 07:29:55.099954 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_MESSAGES", O_RDONLY|O_CLOEXEC) = 3 <0.000019> 07:29:55.100013 newfstatat(3, "", {st_mode=S_IFDIR|0755, st_size=29, ...}, AT_EMPTY_PATH) = 0 <0.000020> 07:29:55.100148 close(3) = 0 <0.000015> 07:29:55.100201 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES", O_RDONLY|O_CLOEXEC) = 3 <0.000016> 07:29:55.100258 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=57, ...}, AT_EMPTY_PATH) = 0 <0.000027> 07:29:55.100360 mmap(NULL, 57, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899ab5000 <0.000075> 07:29:55.100485 close(3) = 0 <0.000020> 07:29:55.100592 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_MONETARY", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000105> 07:29:55.100759 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_MONETARY", O_RDONLY|O_CLOEXEC) = 3 <0.000090> 07:29:55.100939 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=286, ...}, AT_EMPTY_PATH) = 0 <0.000022> 07:29:55.101084 mmap(NULL, 286, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f88997d2000 <0.000033> 07:29:55.101161 close(3) = 0 <0.000018> 07:29:55.101276 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_COLLATE", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000036> 07:29:55.101423 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_COLLATE", O_RDONLY|O_CLOEXEC) = 3 <0.000038> 07:29:55.101504 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=2586930, ...}, AT_EMPTY_PATH) = 0 <0.000018> 07:29:55.101587 mmap(NULL, 2586930, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f889955a000 <0.000026> 07:29:55.101658 close(3) = 0 <0.000040> 07:29:55.101751 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_TIME", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000029> 07:29:55.101831 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_TIME", O_RDONLY|O_CLOEXEC) = 3 <0.000049> 07:29:55.101924 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=3284, ...}, AT_EMPTY_PATH) = 0 <0.000046> 07:29:55.102018 mmap(NULL, 3284, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899559000 <0.000035> 07:29:55.102101 close(3) = 0 <0.000019> 07:29:55.102209 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_NUMERIC", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000020> 07:29:55.102285 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_NUMERIC", O_RDONLY|O_CLOEXEC) = 3 <0.000022> 07:29:55.102356 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=54, ...}, AT_EMPTY_PATH) = 0 <0.000028> 07:29:55.102428 mmap(NULL, 54, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899558000 <0.000027> 07:29:55.102516 close(3) = 0 <0.000037> 07:29:55.102640 openat(AT_FDCWD, "/usr/lib/locale/en_US.UTF-8/LC_CTYPE", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory) <0.000029> 07:29:55.102734 openat(AT_FDCWD, "/usr/lib/locale/en_US.utf8/LC_CTYPE", O_RDONLY|O_CLOEXEC) = 3 <0.000025> 07:29:55.102829 newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=346132, ...}, AT_EMPTY_PATH) = 0 <0.000020> 07:29:55.102924 mmap(NULL, 346132, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f8899503000 <0.000031> 07:29:55.103032 close(3) = 0 <0.000031> 07:29:55.103148 ioctl(1, TCGETS, {B38400 opost isig icanon echo ...}) = 0 <0.000029> 07:29:55.103225 ioctl(1, TIOCGWINSZ, {ws_row=54, ws_col=189, ws_xpixel=0, ws_ypixel=0}) = 0 <0.000018> 07:29:55.103327 statx(AT_FDCWD, "/mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_link", AT_STATX_SYNC_AS_STAT, STATX_MODE, 0x7ffcecfab290) = -1 EINVAL (Invalid argument) <0.001166> 07:29:55.104574 openat(AT_FDCWD, "/usr/share/locale/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000028> 07:29:55.104661 openat(AT_FDCWD, "/usr/share/locale/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000299> 07:29:55.105060 openat(AT_FDCWD, "/usr/share/locale/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000022> 07:29:55.105136 openat(AT_FDCWD, "/usr/share/locale/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000020> 07:29:55.105210 openat(AT_FDCWD, "/usr/share/locale/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000026> 07:29:55.105277 openat(AT_FDCWD, "/usr/share/locale/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000042> 07:29:55.105383 write(2, "ls: ", 4ls: ) = 4 <0.000028> 07:29:55.105454 write(2, "cannot access '/mnt/glustervol1/"..., 271cannot access '/mnt/glustervol1//symlink-test/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000/test_link') = 271 <0.000030> 07:29:55.105577 openat(AT_FDCWD, "/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000020> 07:29:55.105644 openat(AT_FDCWD, "/usr/share/locale/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000041> 07:29:55.105734 openat(AT_FDCWD, "/usr/share/locale/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000025> 07:29:55.105809 openat(AT_FDCWD, "/usr/share/locale/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000021> 07:29:55.105891 openat(AT_FDCWD, "/usr/share/locale/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000018> 07:29:55.105950 openat(AT_FDCWD, "/usr/share/locale/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory) <0.000024> 07:29:55.106055 write(2, ": Invalid argument", 18: Invalid argument) = 18 <0.000043> 07:29:55.106142 write(2, "\n", 1 ) = 1 <0.000028> 07:29:55.106212 close(1) = 0 <0.000016> 07:29:55.106272 close(2) = 0 <0.000032> 07:29:55.106357 exit_group(2) = ? 07:29:55.106583 +++ exited with 2 +++ ```

On the brick logs I see lines like:

[2024-04-25 07:29:52.861208 +0000] I [posix-entry-ops.c:382:posix_lookup] 0-glustervol1-posix: <gfid:c05a2fe7-06c9-42ff-95ad-97ffa07572da>/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000: inode path not completely resolved. Asking for full path
mohit84 commented 3 weeks ago

Here is the strace for the link creation:

And here for ls:

On the brick logs I see lines like:

[2024-04-25 07:29:52.861208 +0000] I [posix-entry-ops.c:382:posix_lookup] 0-glustervol1-posix: <gfid:c05a2fe7-06c9-42ff-95ad-97ffa07572da>/0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000: inode path not completely resolved. Asking for full path

It seems there is no issue with link creation but lookup operation is failing. I have tested the same in my environment , it is working fine. It is calling statx not stat, in previous version it call stat. I have to test it on latest rhel version then can update on the same.

ovlindho commented 1 week ago

Any news about this?