parsa-epfl / cloudsuite

A Benchmark Suite for Cloud Services.
http://cloudsuite.ch
Other
215 stars 122 forks source link

How to obtain correct and valid results for web-serving? #448

Open fengyusen opened 4 months ago

fengyusen commented 4 months ago

Hello, thank you very much for providing the benchmark, it has been very helpful to me. However, when running the web-serving benchmark, I received the following output. In the benchSummary, passed is true, but the metric is always 0. In the driverSummary, success is 0, and everything is a failure. My command is as follows. I have tried many times, but the results remain the same. Is this result reasonable? How can I modify it to get correct and valid results? Command: run_web_serving() { local database_service="database_server" local memcache_service="memcache_server" local web_service="web_server" local network="cloudsuite"

local server_address=$(hostname -I | awk '{print $1}') echo "Server address: ${server_address}"

docker run -dt --rm --name database_server --network ${network} \ --cpuset-cpus ${server_cpuset} cloudsuite/web-serving:db_server ${server_address} docker run -dt --rm --name memcache_server --network ${network} \ --cpuset-cpus ${server_cpuset} cloudsuite/web-serving:memcached_server docker run -dt --rm --name web_server --network ${network} \ --cpuset-cpus ${server_cpuset} cloudsuite/web-serving:web_server \ /etc/bootstrap.sh ${server_address} ${server_address} sleep 10

docker run -it --rm --name faban_client --network ${network} \ --cpuset-cpus ${client_cpuset} \ cloudsuite/web-serving:faban_client \ ${server_address} 50

docker stop ${database_service} ${memcache_service} ${web_service} }

Output:

BUILD SUCCESSFUL Total time: 1 minute 45 seconds

RESULT: output/TH_50-TM_1000-TY_THINKTIME-DS_fixed/1/summary.xml

<?xml version="1.0" encoding="UTF-8"?> <?xml-stylesheet type="text/xsl" href="../../xslt/summary_report.xsl"?>

1 Sat Jul 20 14:48:22 GMT 2024 Sat Jul 20 14:49:12 GMT 2024 0.000 true 0.000 Sat Jul 20 14:48:22 GMT 2024 Sat Jul 20 14:49:12 GMT 2024 0 50 48.4606 true 0 653 NaN 0.0448 true 0 650 NaN 0.0448 true