occlum / reproduce-asplos20

2 stars 3 forks source link

About performance #2

Open jeffy1009 opened 4 years ago

jeffy1009 commented 4 years ago

Hi! I'm trying to reproduce results from asplos20.

This repo does not provide how to run the benchmarks in linux setting, but I managed to set up the benchmarks to run in linux with some struggling. (One of the thing was to set occlum = no in musl configure)

Here are some of the errors I have found, and also there are some questions regarding performance.

For the fish benchmark, the cp busybox/busybox workspace/bin command in run_fish_test.sh script renames busybox to bin instead of moving in into bin folder because the folder did not exist. Correcting it gives much larger performance numbers than given in the paper.

In the pipe benchmark, &buf parameter in write syscall should be buf. But it doesn't seem to effect performance.

Now for the performance, first, the artifact does not include file benchmark so I wrote one myself by modifying pipe benchmark. Now, in my case, lighttpd benchmark and file benchmark show that linux shows much larger throughput. (for 3x ~ 5x). But in the paper it looks like it is almost the same. So I wonder how the benchmark is run in linux.

I'd appreciate your answers!