rakyll / hey

HTTP load generator, ApacheBench (ab) replacement
Apache License 2.0
17.61k stars 1.17k forks source link

Is there a Default Duration of Load Test? 10 min? #317

Open langong347 opened 5 months ago

langong347 commented 5 months ago

Hi,

I used the following command to send num_requests = {1,10,20,40,....} using a single worker

./hey_linux_amd64 -n $num_requests -c 1 -m POST -H 'Content-Type: application/json' -t 0 -D $test_file $endpoint

On my service dashboard, I noticed that each test lasted for a fixed interval, approx 10 minutes, during which the latency stayed at a constant level. I'm wondering whether hey persists each test until enough response data is gathered such that the results are statistically meaningful?

Screenshot 2024-01-25 at 11 39 43 AM

If this is the correct understanding, should I wait for at least 10min between tests? Previously, I noticed that sending the tests (using one worker each) more frequently would result in overlapping request blocks on my dashboard, although it didn't seem to affect the latencies returned by hey.

Screenshot 2024-01-25 at 11 58 14 AM

Thanks.