Load test with Vegeta - Githubissues

jonwalch commented 4 years ago

https://github.com/tsenart/vegeta https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/load-testing.html

jonwalch commented 4 years ago

Deprioritized because of fargate auto scaling

jonwalch commented 4 years ago

I think our performance is actually fine for now. Might want to beef up instance size later. Latency is still a ? but we won't go down unless we get a shitload of traffic

jonwalch commented 4 years ago

jonwalch@debian:~/Developer$ echo "GET https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop" | ./vegeta attack -insecure -duration=120s -rate=0 -max-workers=10000| tee results.bin | ./vegeta report
Requests      [total, rate, throughput]         665755, 5548.03, 939.54
Duration      [total, attack, wait]             2m12s, 2m0s, 11.598s
Latencies     [min, mean, 50, 90, 95, 99, max]  50.061µs, 1.782s, 169.445ms, 6.619s, 10.024s, 13.854s, 30.063s
Bytes In      [total, mean]                     71155000, 106.88
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           18.57%
Status Codes  [code:count]                      0:28233  204:123640  500:4151  502:453108  503:3815  504:52808  
Error Set:
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": dial tcp 0.0.0.0:0->54.191.208.82:443: socket: too many open files
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": dial tcp: lookup ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com on 192.168.50.1:53: dial udp 192.168.50.1:53: socket: too many open files
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": http2: server sent GOAWAY and closed the connection; LastStreamID=845, ErrCode=INTERNAL_ERROR, debug=""
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": http2: server sent GOAWAY and closed the connection; LastStreamID=969, ErrCode=INTERNAL_ERROR, debug=""
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": dial tcp: lookup ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com on 192.168.50.1:53: no such host
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": dial tcp 0.0.0.0:0->54.148.15.63:443: socket: too many open files
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": dial tcp 0.0.0.0:0->52.40.83.182:443: socket: too many open files
500 Internal Server Error
504 Gateway Timeout
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
Get "https://ecs-whiplash-alb-1422008741.us-west-2.elb.amazonaws.com/stream/prop": context deadline exceeded
502 Bad Gateway
503 Service Unavailable

jonwalch@debian:~/Developer$ cat foo.txt 
GET https://whiplashesports.com/user
x-twitch-opaque-id: "null"

jonwalch@debian:~/Developer$ cat foo.txt | ./vegeta attack -duration=120s -rate=0 -max-workers=10000| tee results.bin | ./vegeta report
Requests      [total, rate, throughput]         1623353, 13527.69, 0.00
Duration      [total, attack, wait]             2m6s, 2m0s, 6.249s
Latencies     [min, mean, 50, 90, 95, 99, max]  46.389µs, 330.781ms, 115.484ms, 466.03ms, 1.307s, 3.644s, 30.104s
Bytes In      [total, mean]                     51961668, 32.01
Bytes Out     [total, mean]                     0, 0.00
Success       [ratio]                           0.00%
Status Codes  [code:count]                      0:48757  404:1574596  
Error Set:
Get "https://whiplashesports.com/user": dial tcp 0.0.0.0:0->99.84.229.15:443: socket: too many open files
Get "https://whiplashesports.com/user": dial tcp 0.0.0.0:0->99.84.229.55:443: socket: too many open files
404 Not Found
Get "https://whiplashesports.com/user": dial tcp 0.0.0.0:0->99.84.229.29:443: socket: too many open files
Get "https://whiplashesports.com/user": dial tcp: lookup whiplashesports.com on 192.168.50.1:53: dial udp 192.168.50.1:53: socket: too many open files
Get "https://whiplashesports.com/user": dial tcp 0.0.0.0:0->99.84.229.53:443: socket: too many open files
Get "https://whiplashesports.com/user": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
Get "https://whiplashesports.com/user": context deadline exceeded
Get "https://whiplashesports.com/user": dial tcp 0.0.0.0:0->13.227.73.76:443: socket: too many open files
Get "https://whiplashesports.com/user": dial tcp 0.0.0.0:0->13.227.73.21:443: socket: too many open files

jonwalch / whiplash

Load test with Vegeta #286