programatik29 / rust-web-benchmarks

Benchmarking web frameworks written in rust with rewrk tool.
MIT License
248 stars 33 forks source link

Why is rewrk output different from formatted table? #9

Closed TaeyoonKwon closed 2 years ago

TaeyoonKwon commented 2 years ago

In rewrk output, actix web double scores Rocket in requests but in the table rocket sends more. How can it be?

programatik29 commented 2 years ago

I'm not sure. I didn't benchmark table formatted results.

@samal-rasmussen which parameters did you use for benchmarking?

samal-rasmussen commented 2 years ago

I ran the script exactly as is with no parameters ./hello-world-csv.sh https://github.com/programatik29/rust-web-benchmarks/blob/master/result/hello-world/csv/hello-world-csv.sh

programatik29 commented 2 years ago

I can the script exactly as is with no parameters ./hello-world-csv.sh https://github.com/programatik29/rust-web-benchmarks/blob/master/result/hello-world/csv/hello-world-csv.sh

Can you tweak with thread(should be logical cpu core count) and connection count(try 1000, 2000) parameters and do some more benchmarks(5-10 seconds each should do). Your results seem inconsistent with my benchmark.

programatik29 commented 2 years ago

Removed csv benchmark because it was hard to keep it updated with my results.

samal-rasmussen commented 2 years ago

Results will be different on different machines. If both benchmarks were run on the same machine then the results should be much more similar.