Is Alluxio have the docker image that can support cephfs as backend?

[andyzheung]

I want to use fluid + alluxio to accelerate the cephfs read. Is there docker images that can use: 2022-12-20 12:46:44,948 WARN UnderFileSystem$Factory - Failed to create UnderFileSystem by factory alluxio.underfs.cephfs.CephFSUnderFileSystemFactory@6ee7992a: java.lang.NoClassDefFoundError: com/ceph/fs/CephFileAlreadyExistsException 2022-12-20 12:46:44,948 ERROR FileSystemMasterClientServiceHandler - Exit (Error): Mount: request=alluxioPath: "/cephfs" ufsPath: "cephfs://10.250.60.11\;10.250.60.12\;10.250.60.13/" options { readOnly: false shared: false commonOptions { syncIntervalMs: -1 ttl: -1 ttlAction: FREE } }

[andyzheung]

It seem that you can give some more suggestion. @maobaolong

[andyzheung]

Alluxio dockerfile use Alpine Linux, but I can't find package on apk package manager... I try to use ubuntu 20.04 to build the alluxio images, but it seem can't use.

alluxio-cephfs.zip

Alluxio support cephfs: https://docs.alluxio.io/os/user/2.8.1/cn/ufs/CephFS.html

[LuQQiu]

@andyzheung are you using the Alluxio official docker image which include the Cephfs binaries? @ssz1997 Does fluid docker image contain exactly the same UFS binaries in the lib/ directory? Try to figure out it's a fluid alluxio docker image problem or a general alluxio docker image problem.

[ssz1997]

@LuQQiu The alluxio image used by Fluid is built by running the dev/scripts/generate-tarballs single script in Alluxio repo, so theoretically all the binaries are the same. In reality the alluxio-underfs-cephfs-hadoop-2.8.1.jar in the Alluxio official tarball is 272 Kb larger than the tarball generated by Fluid.

[LuQQiu]

@andyzheung why alluxio official docker image is not suitable in your case? https://hub.docker.com/r/alluxio/alluxio/

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in two weeks if no further activity occurs. Thank you for your contributions.