Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)
1.67k
stars
961
forks
source link
[BUG] use alluxio to accelerate data, but it seems that it does not accelerate。 #4327
Open
ruan875417 opened 1 month ago
What is your environment(Kubernetes version, Fluid version, etc.)
alluixo controller image: fluidcloudnative/alluxioruntime-controller:v1.0.1-14eda3b runtime image: alluxio/alluxio-dev:2.9.0 fuse image: alluxio/alluxio-dev:2.9.0
Describe the bug
use alluxio to accelerate data, but it seems that it does not accelerate。
配置:1个worker, 使用ssd作为缓存介质,缓存容量大小设置为10G
1GiB 文件
业务pod和缓存worker pod不在同一节点上,读取远程缓存数据
社区版读文件, 执行3次:
22.1MB/s,
23.1MB/s,
25.4MB/s
直接挂载zos 1GiB 文件
业务pod直接挂底层zos
读文件, 执行3次:
19.8MB/s,
20.2MB/s,
22.5MB/s
测试语句
读文件
fio -filename=/data/pytorch/1g.txt -direct=1 -iodepth 64 -thread -rw=randread -ioengine=libaio -bs=128K -size=1G -numjobs=10 -runtime=180 -group_reporting -name=rand_1Gread_128K