Alluxio / alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud
https://www.alluxio.io
Apache License 2.0
6.79k stars 2.93k forks source link

use alluxio-fuse-sidecar mode,when alluxio cluster is work,the application with sidecar pod return error message #17467

Open suntao1983 opened 1 year ago

suntao1983 commented 1 year ago

Alluxio Version: What version of Alluxio are you using? 2.9.3 Describe the bug I deploy alluxio with k8s helm template in kubesphere, use alluxio-fuse-sidecar mode,when alluxio cluster is work,the application with sidecar pod return error message.

To Reproduce 1、deploy alluxio cluster in k8s,one master/7 worker 2、cluster is working,and i run alluxio runTests is ok 3、use deploy.yaml in my app project, to deploy application with one alluxio-fuse-siedecar in one pod, pod is running 4、the alluxio-fuse-sidecar container return an error message after a while , like this: Caused by: io.netty.channel AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: comliance-toolchain-86d59d5867-7kmns/10.2.162.140:19998 .

Expected behavior comliance-toolchain-86d59d5867-7kmns/10.2.162.140
comliance-toolchain-86d59d5867-7kmns is the name of the app with sidecar pod, 10.2.162.140 is pod ip. I think the host in the error log maybe the alluxio master host is just right. when i login in the container shell , cat /opt/alluxio-2.3.0-SNAPSHOT/conf/alluxio-env.sh, the variable HOSTNAME is this value.

Urgency I want to use local path in my app mount path ,to read/write the file , and then the change update to UFS. But now cannot connect with alluxio cluster, i suggest maybe there is something wrong with my configuration , but there is not docs to guid it.

Are you planning to fix it no

Additional context Add any other context about the problem here.

suntao1983 commented 1 year ago

lQDPJxPfj9hDvb7NC9DND8CwIhajgTMPHhYEYfWsqYBvAA_4032_3024

lQDPJw4C5SgjnH7NC9DND8CwKzcgGRhSoegEYfWAEQBvAA_4032_3024

lQDPJwWPNRtkHb7ND8DNC9CwDEv6JVWreVEEYfWW7MBvAA_3024_4032

ChunxuTang commented 1 year ago

Thanks for raising the question. @ssz1997 Would you mind taking a look at the issue?

ssz1997 commented 1 year ago

Hi @suntao1983 I'm seeing your alluxio is under path /opt/alluxio-2.3.0-SNAPSHOT. Can you double check your alluxio version? Please use the latest version if possible.

suntao1983 commented 1 year ago

Hi @suntao1983 I'm seeing your alluxio is under path /opt/alluxio-2.3.0-SNAPSHOT. Can you double check your alluxio version? Please use the latest version if possible.

alluxio-2.3.0-SNAPSHOT is the alluxio-fuse version, alluxio cluster version is 2.9.0

ssz1997 commented 1 year ago

@suntao1983 Is there a reason why you are using 2.3.0 for alluxio fuse? That is one of the earliest versions of alluxio fuse, which I'm sure has a lot of bugs and performance issues.

suntao1983 commented 1 year ago

@suntao1983 Is there a reason why you are using 2.3.0 for alluxio fuse? That is one of the earliest versions of alluxio fuse, which I'm sure has a lot of bugs and performance issues.

alluxio-fuse didnot give a latest version image, i found in the aliyun and dockerhub , but not found

ssz1997 commented 1 year ago

@suntao1983 You can use the same image for Alluxio and Alluxio Fuse. Now they share the same image. Make sure to include the conf configmap generated by helm for your Alluxio fuse container too. AlluxioFuse needs the hostname of Alluxio master, which is included in the configmap.

suntao1983 commented 1 year ago

the issue is fix , it maybe version problem. but now happen the app mount path dont work

suntao1983 commented 1 year ago

lQDPJwtq9uTDRgbND8DNC9CwcbqBJzb2TFkEYy1oYoBAAA_3024_4032 lQDPJwnayUCHzAbND8DNC9Cw2N9gCi3Ic3AEYy109oBAAA_3024_4032

suntao1983 commented 1 year ago

lQDPJwnayUCHzAbND8DNC9Cw2N9gCi3Ic3AEYy109oBAAA_3024_4032 this is the sidecar container

lQDPJx4_SSNGtobNC9DND8CwpHrmwF576IcEYy4Rs8CyAA_4032_3024 this is the app container

ssz1997 commented 1 year ago

For your fuse container, try mount Alluxio into a subdirectory of /mnt/alluxio-fuse, e.g. /mnt/alluxio-fuse/alluxio-fuse. This can be configured in the args.

ssz1997 commented 1 year ago

If the mountPath is the same path as Alluxio Fuse mount path, it doesn't work.

github-actions[bot] commented 2 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in two weeks if no further activity occurs. Thank you for your contributions.