search

HenrikBengtsson / easycatfs

easycatfs - Easy Mounting of Slow Folders onto Local Disk
https://github.com/HenrikBengtsson/easycatfs
3 stars 0 forks source link

BENCHMARK: md5sum on large file on BeeGFS #6

Open HenrikBengtsson opened 2 years ago

HenrikBengtsson commented 2 years ago

Here is a first benchmark that runs md5sum on a large file that lives on a BeeGFS network file system.

Benchmark script

https://github.com/HenrikBengtsson/easycatfs/blob/94e92aca150d37fde663299e4c67a316917759ee/tests/bench-1.sh#L1-L41

Results

{c4-dev3}$ module load easycatfs/devel
{c4-dev3}$ tests/bench-1.sh
easycatfs and catfs versions:
0.1.2-9001
0.8.0-9000

Test file: 512MiB.bin [536870912 bytes]

Benchmark target (./data):
0:01.35 (user=0.00 kernel=0.89) CPU=66% IO=(in=1048576 out=1048576)
0:01.96 (user=1.29 kernel=0.20) CPU=76% IO=(in=1048576 out=0)
0:02.11 (user=1.41 kernel=0.27) CPU=79% IO=(in=1048576 out=0)

Benchmark local mount (/scratch/henrik/ppid=15048/c4/home/henrik/repositories/easycatfs/data):
Iteration 1:
0:01.37 (user=1.09 kernel=0.19) CPU=93% IO=(in=1048576 out=0)
Iteration 2:
0:01.24 (user=1.01 kernel=0.22) CPU=99% IO=(in=1048576 out=0)
Iteration 3:
0:01.13 (user=0.92 kernel=0.20) CPU=99% IO=(in=1048576 out=0)
Iteration 4:
0:01.28 (user=1.05 kernel=0.22) CPU=99% IO=(in=1048576 out=0)
Iteration 5:
0:01.26 (user=1.03 kernel=0.22) CPU=99% IO=(in=1048576 out=0)
HenrikBengtsson commented 2 years ago

Update tests/bench-1.sh script.

UCSF Wynton HPC (CentOS 7 w/ BeeGFS)

When there's very heavy load on the BeeGFS file system;

easycatfs and catfs versions:
0.1.3
0.8.0-9000

Test file: 1024MiB.bin [1073741824 bytes]

Benchmark target (./data):
-rw-r--r--. 1 hb cbi 1073741824 Jan 12 23:58 data/1024MiB.bin
cp: 0:31.48 (user=0.01 kernel=1.80) CPU=5% IO=(in=2097152 out=2097152)
1. md5sum: 0:36.80 (user=3.50 kernel=1.09) CPU=12% IO=(in=2097152 out=0)
2. md5sum: 0:36.94 (user=3.67 kernel=1.16) CPU=13% IO=(in=2097152 out=0)
3. md5sum: 0:35.27 (user=3.63 kernel=1.15) CPU=13% IO=(in=2097152 out=0)
4. md5sum: 0:36.10 (user=3.66 kernel=1.14) CPU=13% IO=(in=2097152 out=0)
5. md5sum: 0:45.60 (user=3.56 kernel=1.19) CPU=10% IO=(in=2097152 out=0)

Benchmark local mount (/scratch/519700.1.long.q/hb/ppid=47442/wynton/home/cbi/hb/repositories/easycatfs/data):
-rw-r--r--. 1 hb cbi 1073741824 Jan 12 23:58 /scratch/519700.1.long.q/hb/ppid=47442/wynton/home/cbi/hb/repositories/easycatfs/data/1024MiB.bin
1. md5sum: 0:46.80 (user=3.81 kernel=0.57) CPU=9% IO=(in=2097152 out=0)
2. md5sum: 0:02.59 (user=1.85 kernel=0.57) CPU=93% IO=(in=2097152 out=0)
3. md5sum: 0:02.43 (user=1.79 kernel=0.61) CPU=98% IO=(in=2097152 out=0)
4. md5sum: 0:02.41 (user=1.81 kernel=0.57) CPU=98% IO=(in=2097152 out=0)
5. md5sum: 0:02.28 (user=1.77 kernel=0.47) CPU=98% IO=(in=2097152 out=0)

When there's low load on the BeeGFS file system:

easycatfs and catfs versions:
0.1.3
0.8.0-9000

Test file: 1024MiB.bin [1073741824 bytes]

Benchmark target (./data):
-rw-r--r--. 1 hb cbi 1073741824 Jan 12 23:58 data/1024MiB.bin
cp: 0:02.47 (user=0.00 kernel=1.44) CPU=58% IO=(in=2097152 out=2097152)
1. md5sum: 0:05.81 (user=3.11 kernel=0.69) CPU=65% IO=(in=2097152 out=0)
2. md5sum: 0:04.43 (user=3.04 kernel=0.66) CPU=83% IO=(in=2097152 out=0)
3. md5sum: 0:04.05 (user=2.77 kernel=0.55) CPU=82% IO=(in=2097152 out=0)
4. md5sum: 0:04.47 (user=3.02 kernel=0.64) CPU=82% IO=(in=2097152 out=0)
5. md5sum: 0:06.63 (user=3.09 kernel=0.71) CPU=57% IO=(in=2097152 out=0)

Benchmark local mount (/scratch/519708.1.long.q/hb/ppid=48052/wynton/home/cbi/hb/repositories/easycatfs/data):
-rw-r--r--. 1 hb cbi 1073741824 Jan 12 23:58 /scratch/519708.1.long.q/hb/ppid=48052/wynton/home/cbi/hb/repositories/easycatfs/data/1024MiB.bin
1. md5sum: 0:02.61 (user=2.01 kernel=0.40) CPU=92% IO=(in=2097152 out=0)
2. md5sum: 0:02.71 (user=1.99 kernel=0.56) CPU=94% IO=(in=2097152 out=0)
3. md5sum: 0:02.48 (user=1.99 kernel=0.46) CPU=99% IO=(in=2097152 out=0)
4. md5sum: 0:02.58 (user=2.14 kernel=0.43) CPU=99% IO=(in=2097152 out=0)
5. md5sum: 0:02.59 (user=1.96 kernel=0.61) CPU=99% IO=(in=2097152 out=0)

UCSF C4 (CentOS 7 w/ BeeGFS)

When there's very low load on the BeeGFS file system;

easycatfs and catfs versions:
0.1.3
0.8.0-9000

Test file: 1024MiB.bin [1073741824 bytes]

Benchmark target (./data):
-rw-r--r-- 1 henrik cbc 1073741824 Jan 15 12:18 data/1024MiB.bin
cp: 0:03.34 (user=0.00 kernel=2.16) CPU=64% IO=(in=2097152 out=2097152)
1. md5sum: 0:04.32 (user=2.36 kernel=0.94) CPU=76% IO=(in=2097152 out=0)
2. md5sum: 0:04.22 (user=2.17 kernel=0.93) CPU=73% IO=(in=2097152 out=0)
3. md5sum: 0:04.35 (user=2.34 kernel=0.97) CPU=76% IO=(in=2097152 out=0)
4. md5sum: 0:04.23 (user=2.19 kernel=0.92) CPU=73% IO=(in=2097152 out=0)
5. md5sum: 0:04.32 (user=2.29 kernel=0.99) CPU=76% IO=(in=2097152 out=0)

Benchmark local mount (/scratch/henrik/382583/henrik/ppid=49380/c4/home/henrik/repositories/easycatfs/data):
-rw-r--r-- 1 henrik cbc 1073741824 Jan 15 12:18 /scratch/henrik/382583/henrik/ppid=49380/c4/home/henrik/repositories/easycatfs/data/1024MiB.bin
1. md5sum: 0:07.77 (user=2.00 kernel=1.23) CPU=41% IO=(in=2097152 out=0)
2. md5sum: 0:03.48 (user=1.96 kernel=0.70) CPU=76% IO=(in=2097152 out=0)
3. md5sum: 0:03.44 (user=1.99 kernel=0.60) CPU=75% IO=(in=2097152 out=0)
4. md5sum: 0:03.45 (user=2.03 kernel=0.60) CPU=76% IO=(in=2097152 out=0)
5. md5sum: 0:03.76 (user=2.34 kernel=0.59) CPU=78% IO=(in=2097152 out=0)