search

tsenart / vegeta

HTTP load testing tool and library. It's over 9000!
http://godoc.org/github.com/tsenart/vegeta/lib
MIT License
23.51k stars 1.36k forks source link

Treat timeouts as errors #402

Closed mb720 closed 5 years ago

mb720 commented 5 years ago

Question

Hi and thanks a lot for vegeta!

I'm testing my locally running server using

vegeta attack -targets targets.txt -timeout=6s -duration=5m > results.bin

When I create the metrics with

vegeta report -type=json results.bin > metrics.json

I can see in metrics.json that an image did not load in time:

Get http://localhost:8080/myImg.jpg: net/http: timeout awaiting response headers

But when creating an HTML plot with

cat results.bin | vegeta plot > plot.htm

those errors are not displayed, making it seem that the test completed all requests successfully.

Is there a way to make those errors stand out?

tsenart commented 5 years ago

Would you be able to provide me with your results.bin for debugging please?

mb720 commented 5 years ago

Thanks for looking into it. Here's the results.bin containing a couple of reported timeouts.

tsenart commented 5 years ago

Fix released: https://github.com/tsenart/vegeta/releases/tag/cli%2Fv12.5.1