search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update prom/prometheus Docker tag to v2.54.1 #425

Closed renovate[bot] closed 3 days ago

renovate[bot] commented 6 months ago

This PR contains the following updates:

Package Update Change
prom/prometheus minor v2.51.0 -> v2.54.1

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR was generated by Mend Renovate. View the repository job log.

github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 193 5869 total, 0 failed avg: 326ms, p95: 789ms ✅
apollo-router 169 5144 total, 0 failed avg: 499ms, p95: 694ms ✅
wundergraph 149 4556 total, 0 failed avg: 554ms, p95: 968ms ✅
mesh-supergraph-bun 66 2046 total, 0 failed avg: 1464ms, p95: 2461ms ✅
apollo-server 54 1696 total, 0 failed avg: 1805ms, p95: 2319ms ✅
mercurius 30 929 total, 0 failed avg: 3264ms, p95: 4409ms ✅
mesh-supergraph 24 763 total, 0 failed avg: 4044ms, p95: 6383ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 17607 ✗ 0 data_received..................: 515 MB 17 MB/s data_sent......................: 7.0 MB 230 kB/s http_req_blocked...............: avg=85.59µs min=1.58µs med=2.82µs max=249.23ms p(90)=4.09µs p(95)=5.03µs http_req_connecting............: avg=64.55µs min=0s med=0s max=249.04ms p(90)=0s p(95)=0s http_req_duration..............: avg=326.09ms min=8.91ms med=281.83ms max=1.85s p(90)=606.27ms p(95)=789.15ms { expected_response:true }...: avg=326.09ms min=8.91ms med=281.83ms max=1.85s p(90)=606.27ms p(95)=789.15ms http_req_failed................: 0.00% ✓ 0 ✗ 5869 http_req_receiving.............: avg=82.59ms min=37.12µs med=75.63µs max=1.63s p(90)=353.3ms p(95)=580.88ms http_req_sending...............: avg=4.51ms min=7.68µs med=13.24µs max=1.26s p(90)=39.43µs p(95)=729.26µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=238.98ms min=7.73ms med=226.06ms max=855.93ms p(90)=417.92ms p(95)=470.38ms http_reqs......................: 5869 193.560624/s iteration_duration.............: avg=513.83ms min=19.18ms med=428.99ms max=2.91s p(90)=1s p(95)=1.24s iterations.....................: 5869 193.560624/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15432 ✗ 0 data_received..................: 451 MB 15 MB/s data_sent......................: 6.1 MB 201 kB/s http_req_blocked...............: avg=180.98µs min=1.6µs med=3.43µs max=303.83ms p(90)=5.57µs p(95)=7.02µs http_req_connecting............: avg=32.02µs min=0s med=0s max=5.77ms p(90)=0s p(95)=0s http_req_duration..............: avg=499.45ms min=56.84ms med=497.35ms max=1.36s p(90)=641.47ms p(95)=694.12ms { expected_response:true }...: avg=499.45ms min=56.84ms med=497.35ms max=1.36s p(90)=641.47ms p(95)=694.12ms http_req_failed................: 0.00% ✓ 0 ✗ 5144 http_req_receiving.............: avg=19.49ms min=37.81µs med=81.43µs max=770.34ms p(90)=46.81ms p(95)=116.92ms http_req_sending...............: avg=2.63ms min=8.81µs med=16.26µs max=594.26ms p(90)=112.18µs p(95)=3.04ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=477.33ms min=56.75ms med=484.16ms max=839.45ms p(90)=607.96ms p(95)=643.41ms http_reqs......................: 5144 169.061485/s iteration_duration.............: avg=587.19ms min=75.85ms med=560.77ms max=1.86s p(90)=783.39ms p(95)=901.89ms iterations.....................: 5144 169.061485/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13668 ✗ 0 data_received..................: 400 MB 13 MB/s data_sent......................: 5.4 MB 178 kB/s http_req_blocked...............: avg=59.4µs min=1.34µs med=3.21µs max=68.26ms p(90)=5.3µs p(95)=7.38µs http_req_connecting............: avg=33.21µs min=0s med=0s max=59.12ms p(90)=0s p(95)=0s http_req_duration..............: avg=553.5ms min=19.5ms med=539.68ms max=2.74s p(90)=863.7ms p(95)=967.61ms { expected_response:true }...: avg=553.5ms min=19.5ms med=539.68ms max=2.74s p(90)=863.7ms p(95)=967.61ms http_req_failed................: 0.00% ✓ 0 ✗ 4556 http_req_receiving.............: avg=38.43ms min=41.67µs med=92.12µs max=1.6s p(90)=90.57ms p(95)=265.92ms http_req_sending...............: avg=1.6ms min=8.08µs med=15.71µs max=1.01s p(90)=45µs p(95)=462.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=513.45ms min=19.4ms med=505.13ms max=1.25s p(90)=823.69ms p(95)=907.65ms http_reqs......................: 4556 149.7504/s iteration_duration.............: avg=663.82ms min=32.16ms med=618.73ms max=3.36s p(90)=1.01s p(95)=1.17s iterations.....................: 4556 149.7504/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6138 ✗ 0 data_received..................: 180 MB 5.8 MB/s data_sent......................: 2.4 MB 79 kB/s http_req_blocked...............: avg=146.55µs min=1.87µs med=4.27µs max=6.43ms p(90)=6.59µs p(95)=125.69µs http_req_connecting............: avg=132.28µs min=0s med=0s max=5.67ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.46s min=360.26ms med=1.23s max=3.97s p(90)=2.33s p(95)=2.46s { expected_response:true }...: avg=1.46s min=360.26ms med=1.23s max=3.97s p(90)=2.33s p(95)=2.46s http_req_failed................: 0.00% ✓ 0 ✗ 2046 http_req_receiving.............: avg=16.57ms min=42.17µs med=145.7µs max=748.79ms p(90)=2.99ms p(95)=82.2ms http_req_sending...............: avg=340.05µs min=9.46µs med=22.5µs max=171.17ms p(90)=52.99µs p(95)=160.92µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.44s min=359.73ms med=1.22s max=3.97s p(90)=2.31s p(95)=2.45s http_reqs......................: 2046 66.166232/s iteration_duration.............: avg=1.49s min=374.16ms med=1.26s max=4.01s p(90)=2.36s p(95)=2.51s iterations.....................: 2046 66.166232/s vus............................: 91 min=91 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5088 ✗ 0 data_received..................: 149 MB 4.8 MB/s data_sent......................: 2.0 MB 64 kB/s http_req_blocked...............: avg=61.22µs min=1.43µs med=3.22µs max=4.83ms p(90)=5.11µs p(95)=145.82µs http_req_connecting............: avg=47.49µs min=0s med=0s max=2.34ms p(90)=0s p(95)=103.72µs http_req_duration..............: avg=1.8s min=674.68ms med=1.55s max=19.35s p(90)=1.79s p(95)=2.31s { expected_response:true }...: avg=1.8s min=674.68ms med=1.55s max=19.35s p(90)=1.79s p(95)=2.31s http_req_failed................: 0.00% ✓ 0 ✗ 1696 http_req_receiving.............: avg=186µs min=46.43µs med=121.45µs max=29.65ms p(90)=188.61µs p(95)=256.52µs http_req_sending...............: avg=54.93µs min=8.85µs med=16.61µs max=5.54ms p(90)=33.71µs p(95)=109.84µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.8s min=674.55ms med=1.55s max=19.35s p(90)=1.79s p(95)=2.31s http_reqs......................: 1696 54.111737/s iteration_duration.............: avg=1.81s min=682.01ms med=1.56s max=19.4s p(90)=1.81s p(95)=2.33s iterations.....................: 1696 54.111737/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2787 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=132.15µs min=1.47µs med=3.59µs max=5.8ms p(90)=116.86µs p(95)=904.43µs http_req_connecting............: avg=119.48µs min=0s med=0s max=5.76ms p(90)=81.03µs p(95)=711.64µs http_req_duration..............: avg=3.26s min=586.53ms med=3.09s max=7.81s p(90)=4.09s p(95)=4.4s { expected_response:true }...: avg=3.26s min=586.53ms med=3.09s max=7.81s p(90)=4.09s p(95)=4.4s http_req_failed................: 0.00% ✓ 0 ✗ 929 http_req_receiving.............: avg=169.37µs min=44.38µs med=113.4µs max=10.6ms p(90)=197.4µs p(95)=313.45µs http_req_sending...............: avg=99.71µs min=9.06µs med=20.1µs max=2.59ms p(90)=43.62µs p(95)=597.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.26s min=586.31ms med=3.09s max=7.81s p(90)=4.09s p(95)=4.4s http_reqs......................: 929 30.134654/s iteration_duration.............: avg=3.27s min=598.34ms med=3.1s max=7.82s p(90)=4.1s p(95)=4.41s iterations.....................: 929 30.134654/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2289 ✗ 0 data_received..................: 67 MB 2.1 MB/s data_sent......................: 906 kB 29 kB/s http_req_blocked...............: avg=274.6µs min=1.51µs med=4.31µs max=5.27ms p(90)=269.52µs p(95)=2.79ms http_req_connecting............: avg=245.07µs min=0s med=0s max=5.14ms p(90)=206.64µs p(95)=2.44ms http_req_duration..............: avg=4.04s min=1.78s med=3.87s max=8.09s p(90)=5.69s p(95)=6.38s { expected_response:true }...: avg=4.04s min=1.78s med=3.87s max=8.09s p(90)=5.69s p(95)=6.38s http_req_failed................: 0.00% ✓ 0 ✗ 763 http_req_receiving.............: avg=1.33ms min=46.4µs med=187.55µs max=77.69ms p(90)=2.15ms p(95)=3.41ms http_req_sending...............: avg=140.32µs min=8.71µs med=25.26µs max=3.05ms p(90)=164.98µs p(95)=987.31µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.04s min=1.78s med=3.87s max=8.09s p(90)=5.69s p(95)=6.38s http_reqs......................: 763 24.002734/s iteration_duration.............: avg=4.06s min=1.8s med=3.89s max=8.1s p(90)=5.71s p(95)=6.41s iterations.....................: 763 24.002734/s vus............................: 50 min=50 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 187 5671 total, 0 failed avg: 353ms, p95: 778ms ✅
apollo-router 176 5348 total, 0 failed avg: 464ms, p95: 678ms ✅
wundergraph 154 4686 total, 0 failed avg: 532ms, p95: 957ms ✅
mesh-supergraph-bun 72 2220 total, 0 failed avg: 1350ms, p95: 2331ms ✅
apollo-server 53 1688 total, 0 failed avg: 1813ms, p95: 2364ms ✅
mercurius 29 901 total, 0 failed avg: 3360ms, p95: 4391ms ✅
mesh-supergraph 23 751 total, 0 failed avg: 4114ms, p95: 6481ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 17013 ✗ 0 data_received..................: 498 MB 16 MB/s data_sent......................: 6.7 MB 222 kB/s http_req_blocked...............: avg=74.96µs min=1.75µs med=3.37µs max=130.7ms p(90)=5.43µs p(95)=6.51µs http_req_connecting............: avg=58.01µs min=0s med=0s max=130.64ms p(90)=0s p(95)=0s http_req_duration..............: avg=353.3ms min=7.98ms med=315.2ms max=2.18s p(90)=631.3ms p(95)=777.73ms { expected_response:true }...: avg=353.3ms min=7.98ms med=315.2ms max=2.18s p(90)=631.3ms p(95)=777.73ms http_req_failed................: 0.00% ✓ 0 ✗ 5671 http_req_receiving.............: avg=92.87ms min=38.9µs med=97.75µs max=1.75s p(90)=401.47ms p(95)=530.29ms http_req_sending...............: avg=3.76ms min=8.42µs med=16.34µs max=830.42ms p(90)=70.28µs p(95)=1.86ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=256.66ms min=7.82ms med=229.6ms max=814.78ms p(90)=457.15ms p(95)=507.13ms http_reqs......................: 5671 187.114627/s iteration_duration.............: avg=531.8ms min=18.93ms med=461ms max=3.31s p(90)=1s p(95)=1.24s iterations.....................: 5671 187.114627/s vus............................: 89 min=89 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16044 ✗ 0 data_received..................: 469 MB 15 MB/s data_sent......................: 6.3 MB 209 kB/s http_req_blocked...............: avg=35.86µs min=1.32µs med=2.81µs max=21.27ms p(90)=4.12µs p(95)=5.25µs http_req_connecting............: avg=25.72µs min=0s med=0s max=2.84ms p(90)=0s p(95)=0s http_req_duration..............: avg=464.4ms min=16.93ms med=470.43ms max=1.46s p(90)=616.77ms p(95)=677.57ms { expected_response:true }...: avg=464.4ms min=16.93ms med=470.43ms max=1.46s p(90)=616.77ms p(95)=677.57ms http_req_failed................: 0.00% ✓ 0 ✗ 5348 http_req_receiving.............: avg=30.15ms min=36.07µs med=72.22µs max=1.25s p(90)=84.12ms p(95)=187.9ms http_req_sending...............: avg=1.81ms min=8.72µs med=13.46µs max=1s p(90)=38.52µs p(95)=283.52µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=432.42ms min=13.46ms med=452.13ms max=811.16ms p(90)=581.5ms p(95)=616.62ms http_reqs......................: 5348 176.020938/s iteration_duration.............: avg=564.94ms min=27.84ms med=530.58ms max=2.42s p(90)=779.58ms p(95)=977.38ms iterations.....................: 5348 176.020938/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14058 ✗ 0 data_received..................: 411 MB 14 MB/s data_sent......................: 5.6 MB 183 kB/s http_req_blocked...............: avg=94.95µs min=1.42µs med=2.88µs max=154.51ms p(90)=4.68µs p(95)=8.13µs http_req_connecting............: avg=88.44µs min=0s med=0s max=154.44ms p(90)=0s p(95)=0s http_req_duration..............: avg=531.63ms min=27.55ms med=502.34ms max=2.07s p(90)=848.53ms p(95)=957.19ms { expected_response:true }...: avg=531.63ms min=27.55ms med=502.34ms max=2.07s p(90)=848.53ms p(95)=957.19ms http_req_failed................: 0.00% ✓ 0 ✗ 4686 http_req_receiving.............: avg=50.32ms min=39.53µs med=85.13µs max=1.22s p(90)=166.77ms p(95)=389.66ms http_req_sending...............: avg=2.44ms min=7.44µs med=13.66µs max=615.96ms p(90)=38.4µs p(95)=257.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=478.87ms min=27.44ms med=445.1ms max=1.23s p(90)=783.1ms p(95)=873.07ms http_reqs......................: 4686 154.035627/s iteration_duration.............: avg=645.55ms min=45.12ms med=592.39ms max=2.67s p(90)=1.02s p(95)=1.21s iterations.....................: 4686 154.035627/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6660 ✗ 0 data_received..................: 195 MB 6.3 MB/s data_sent......................: 2.6 MB 86 kB/s http_req_blocked...............: avg=45.6µs min=1.44µs med=2.9µs max=5.98ms p(90)=4.76µs p(95)=23.34µs http_req_connecting............: avg=26.06µs min=0s med=0s max=3.66ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.34s min=628.43ms med=1.16s max=3.33s p(90)=2.23s p(95)=2.33s { expected_response:true }...: avg=1.34s min=628.43ms med=1.16s max=3.33s p(90)=2.23s p(95)=2.33s http_req_failed................: 0.00% ✓ 0 ✗ 2220 http_req_receiving.............: avg=12.51ms min=39.05µs med=99.52µs max=545.53ms p(90)=1.34ms p(95)=25.82ms http_req_sending...............: avg=280.34µs min=8.38µs med=13.98µs max=70.01ms p(90)=38.26µs p(95)=145.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.33s min=627.77ms med=1.15s max=3.21s p(90)=2.22s p(95)=2.32s http_reqs......................: 2220 72.129621/s iteration_duration.............: avg=1.37s min=639.39ms med=1.19s max=3.34s p(90)=2.26s p(95)=2.35s iterations.....................: 2220 72.129621/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5064 ✗ 0 data_received..................: 148 MB 4.7 MB/s data_sent......................: 2.0 MB 64 kB/s http_req_blocked...............: avg=26.71µs min=1.57µs med=3.28µs max=1.83ms p(90)=5.32µs p(95)=116.38µs http_req_connecting............: avg=20.7µs min=0s med=0s max=1.8ms p(90)=0s p(95)=86.25µs http_req_duration..............: avg=1.81s min=404.34ms med=1.54s max=20.25s p(90)=1.85s p(95)=2.36s { expected_response:true }...: avg=1.81s min=404.34ms med=1.54s max=20.25s p(90)=1.85s p(95)=2.36s http_req_failed................: 0.00% ✓ 0 ✗ 1688 http_req_receiving.............: avg=166.14µs min=50.32µs med=119.13µs max=17.52ms p(90)=183.91µs p(95)=244.82µs http_req_sending...............: avg=39.46µs min=8.82µs med=17.23µs max=4.21ms p(90)=34.43µs p(95)=60.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.81s min=404.15ms med=1.54s max=20.25s p(90)=1.85s p(95)=2.36s http_reqs......................: 1688 53.932387/s iteration_duration.............: avg=1.82s min=415.77ms med=1.55s max=20.26s p(90)=1.86s p(95)=2.37s iterations.....................: 1688 53.932387/s vus............................: 45 min=45 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2703 ✗ 0 data_received..................: 79 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=151.71µs min=1.57µs med=4.01µs max=5.85ms p(90)=134.92µs p(95)=944.38µs http_req_connecting............: avg=129.57µs min=0s med=0s max=3.88ms p(90)=98.41µs p(95)=884.38µs http_req_duration..............: avg=3.36s min=1s med=3.16s max=7.26s p(90)=4.22s p(95)=4.39s { expected_response:true }...: avg=3.36s min=1s med=3.16s max=7.26s p(90)=4.22s p(95)=4.39s http_req_failed................: 0.00% ✓ 0 ✗ 901 http_req_receiving.............: avg=233.28µs min=46.53µs med=112.19µs max=41.94ms p(90)=183.26µs p(95)=283µs http_req_sending...............: avg=92µs min=8.67µs med=21.37µs max=7.07ms p(90)=104.65µs p(95)=676.32µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.36s min=1s med=3.16s max=7.26s p(90)=4.22s p(95)=4.39s http_reqs......................: 901 29.39226/s iteration_duration.............: avg=3.37s min=1.01s med=3.17s max=7.27s p(90)=4.23s p(95)=4.4s iterations.....................: 901 29.39226/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2253 ✗ 0 data_received..................: 66 MB 2.1 MB/s data_sent......................: 891 kB 28 kB/s http_req_blocked...............: avg=248.04µs min=1.67µs med=4.56µs max=4.04ms p(90)=593.8µs p(95)=2.37ms http_req_connecting............: avg=232.48µs min=0s med=0s max=3.94ms p(90)=433.06µs p(95)=2.28ms http_req_duration..............: avg=4.11s min=1.39s med=3.88s max=7.96s p(90)=5.98s p(95)=6.48s { expected_response:true }...: avg=4.11s min=1.39s med=3.88s max=7.96s p(90)=5.98s p(95)=6.48s http_req_failed................: 0.00% ✓ 0 ✗ 751 http_req_receiving.............: avg=2.25ms min=41µs med=160.78µs max=78.84ms p(90)=2.75ms p(95)=5.14ms http_req_sending...............: avg=140.36µs min=8.95µs med=26.39µs max=3.1ms p(90)=288.53µs p(95)=1.18ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.11s min=1.39s med=3.88s max=7.96s p(90)=5.98s p(95)=6.47s http_reqs......................: 751 23.619499/s iteration_duration.............: avg=4.13s min=1.41s med=3.9s max=7.98s p(90)=5.99s p(95)=6.49s iterations.....................: 751 23.619499/s vus............................: 57 min=57 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 183 5563 total, 0 failed avg: 296ms, p95: 912ms ✅
apollo-router 170 5181 total, 0 failed avg: 324ms, p95: 886ms ✅
wundergraph 154 4673 total, 0 failed avg: 362ms, p95: 946ms ✅
mesh-supergraph-bun 96 2978 total, 0 failed avg: 983ms, p95: 1675ms ✅
apollo-server 71 2221 total, 0 failed avg: 1364ms, p95: 1623ms ✅
mesh-supergraph 55 1722 total, 0 failed avg: 1757ms, p95: 2561ms ✅
mercurius 46 1433 total, 0 failed avg: 2114ms, p95: 2693ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16689 ✗ 0 data_received..................: 488 MB 16 MB/s data_sent......................: 6.6 MB 218 kB/s http_req_blocked...............: avg=79.22µs min=1.56µs med=2.99µs max=143.32ms p(90)=4.32µs p(95)=5.44µs http_req_connecting............: avg=33.4µs min=0s med=0s max=5.52ms p(90)=0s p(95)=0s http_req_duration..............: avg=296.07ms min=9.5ms med=190.67ms max=2.49s p(90)=733.85ms p(95)=911.89ms { expected_response:true }...: avg=296.07ms min=9.5ms med=190.67ms max=2.49s p(90)=733.85ms p(95)=911.89ms http_req_failed................: 0.00% ✓ 0 ✗ 5563 http_req_receiving.............: avg=142.64ms min=32.28µs med=96.36µs max=2.28s p(90)=556.04ms p(95)=748.54ms http_req_sending...............: avg=6.87ms min=8µs med=14.02µs max=1.49s p(90)=115.06µs p(95)=8.35ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=146.55ms min=9.27ms med=136.2ms max=617.38ms p(90)=261.26ms p(95)=295.74ms http_reqs......................: 5563 183.930587/s iteration_duration.............: avg=541.39ms min=19.31ms med=359.47ms max=4.33s p(90)=1.22s p(95)=1.52s iterations.....................: 5563 183.930587/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15543 ✗ 0 data_received..................: 455 MB 15 MB/s data_sent......................: 6.1 MB 203 kB/s http_req_blocked...............: avg=264.1µs min=1.22µs med=3.03µs max=571.21ms p(90)=4.54µs p(95)=6.29µs http_req_connecting............: avg=62.11µs min=0s med=0s max=147.71ms p(90)=0s p(95)=0s http_req_duration..............: avg=324.4ms min=11.75ms med=252.09ms max=2.53s p(90)=706.71ms p(95)=886.11ms { expected_response:true }...: avg=324.4ms min=11.75ms med=252.09ms max=2.53s p(90)=706.71ms p(95)=886.11ms http_req_failed................: 0.00% ✓ 0 ✗ 5181 http_req_receiving.............: avg=115.38ms min=34.27µs med=79.86µs max=2.29s p(90)=490.23ms p(95)=670.76ms http_req_sending...............: avg=4.92ms min=8.25µs med=14.21µs max=1.66s p(90)=65.76µs p(95)=1.04ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=204.08ms min=11.64ms med=198.27ms max=845.87ms p(90)=344.77ms p(95)=404.36ms http_reqs......................: 5181 170.880013/s iteration_duration.............: avg=582.56ms min=25.48ms med=458.02ms max=3.71s p(90)=1.21s p(95)=1.47s iterations.....................: 5181 170.880013/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14019 ✗ 0 data_received..................: 410 MB 14 MB/s data_sent......................: 5.5 MB 183 kB/s http_req_blocked...............: avg=156.35µs min=1.59µs med=3.34µs max=254.36ms p(90)=5.2µs p(95)=9.18µs http_req_connecting............: avg=86.18µs min=0s med=0s max=204.44ms p(90)=0s p(95)=0s http_req_duration..............: avg=362.3ms min=12.06ms med=276.32ms max=2.73s p(90)=771.71ms p(95)=945.72ms { expected_response:true }...: avg=362.3ms min=12.06ms med=276.32ms max=2.73s p(90)=771.71ms p(95)=945.72ms http_req_failed................: 0.00% ✓ 0 ✗ 4673 http_req_receiving.............: avg=141.81ms min=38.61µs med=105.04µs max=2.58s p(90)=555.07ms p(95)=725.5ms http_req_sending...............: avg=6.6ms min=8.79µs med=16.64µs max=963.99ms p(90)=93.36µs p(95)=3.16ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=213.89ms min=11.95ms med=200.5ms max=867.21ms p(90)=368.03ms p(95)=421ms http_reqs......................: 4673 154.465482/s iteration_duration.............: avg=644.17ms min=25.74ms med=544.14ms max=3.8s p(90)=1.27s p(95)=1.56s iterations.....................: 4673 154.465482/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8934 ✗ 0 data_received..................: 261 MB 8.5 MB/s data_sent......................: 3.5 MB 115 kB/s http_req_blocked...............: avg=27.65µs min=1.49µs med=2.9µs max=3.13ms p(90)=4.66µs p(95)=9.92µs http_req_connecting............: avg=20.08µs min=0s med=0s max=3.11ms p(90)=0s p(95)=0s http_req_duration..............: avg=983.45ms min=287.78ms med=848.24ms max=2.11s p(90)=1.58s p(95)=1.67s { expected_response:true }...: avg=983.45ms min=287.78ms med=848.24ms max=2.11s p(90)=1.58s p(95)=1.67s http_req_failed................: 0.00% ✓ 0 ✗ 2978 http_req_receiving.............: avg=10.87ms min=35.67µs med=84.9µs max=542.41ms p(90)=2.43ms p(95)=49.96ms http_req_sending...............: avg=428.23µs min=8.36µs med=13.85µs max=106.13ms p(90)=44.17µs p(95)=158.36µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=972.14ms min=287.41ms med=841.62ms max=2.11s p(90)=1.57s p(95)=1.66s http_reqs......................: 2978 96.544007/s iteration_duration.............: avg=1.02s min=296.59ms med=883.64ms max=2.16s p(90)=1.61s p(95)=1.72s iterations.....................: 2978 96.544007/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6663 ✗ 0 data_received..................: 195 MB 6.3 MB/s data_sent......................: 2.6 MB 85 kB/s http_req_blocked...............: avg=76.04µs min=1.67µs med=3.4µs max=6.05ms p(90)=5.4µs p(95)=21.53µs http_req_connecting............: avg=62.83µs min=0s med=0s max=5.09ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.36s min=546.3ms med=1.23s max=14.34s p(90)=1.43s p(95)=1.62s { expected_response:true }...: avg=1.36s min=546.3ms med=1.23s max=14.34s p(90)=1.43s p(95)=1.62s http_req_failed................: 0.00% ✓ 0 ✗ 2221 http_req_receiving.............: avg=191.9µs min=49.71µs med=117.19µs max=18.54ms p(90)=198.09µs p(95)=299.67µs http_req_sending...............: avg=62.06µs min=8.84µs med=17.23µs max=16.57ms p(90)=34.43µs p(95)=88.72µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.36s min=546.17ms med=1.23s max=14.34s p(90)=1.43s p(95)=1.62s http_reqs......................: 2221 71.645565/s iteration_duration.............: avg=1.37s min=558.97ms med=1.24s max=14.34s p(90)=1.45s p(95)=1.63s iterations.....................: 2221 71.645565/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5166 ✗ 0 data_received..................: 151 MB 4.9 MB/s data_sent......................: 2.0 MB 66 kB/s http_req_blocked...............: avg=129.28µs min=1.28µs med=3.67µs max=5.24ms p(90)=5.51µs p(95)=451.49µs http_req_connecting............: avg=115.29µs min=0s med=0s max=4.62ms p(90)=0s p(95)=231.48µs http_req_duration..............: avg=1.75s min=737.94ms med=1.72s max=3.98s p(90)=2.32s p(95)=2.56s { expected_response:true }...: avg=1.75s min=737.94ms med=1.72s max=3.98s p(90)=2.32s p(95)=2.56s http_req_failed................: 0.00% ✓ 0 ✗ 1722 http_req_receiving.............: avg=1.68ms min=39.61µs med=143.54µs max=123.02ms p(90)=3.04ms p(95)=6.19ms http_req_sending...............: avg=248.36µs min=7.87µs med=19.82µs max=94.38ms p(90)=45.31µs p(95)=420.53µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.75s min=736.29ms med=1.72s max=3.98s p(90)=2.31s p(95)=2.55s http_reqs......................: 1722 55.405885/s iteration_duration.............: avg=1.78s min=754.82ms med=1.75s max=4s p(90)=2.34s p(95)=2.58s iterations.....................: 1722 55.405885/s vus............................: 32 min=32 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4299 ✗ 0 data_received..................: 126 MB 4.1 MB/s data_sent......................: 1.7 MB 55 kB/s http_req_blocked...............: avg=235.27µs min=1.58µs med=3.98µs max=6.38ms p(90)=5.73µs p(95)=2.22ms http_req_connecting............: avg=219.01µs min=0s med=0s max=6.32ms p(90)=0s p(95)=2.14ms http_req_duration..............: avg=2.11s min=495.82ms med=2.06s max=4.49s p(90)=2.57s p(95)=2.69s { expected_response:true }...: avg=2.11s min=495.82ms med=2.06s max=4.49s p(90)=2.57s p(95)=2.69s http_req_failed................: 0.00% ✓ 0 ✗ 1433 http_req_receiving.............: avg=346.19µs min=40.73µs med=115.52µs max=70.58ms p(90)=251.11µs p(95)=474.5µs http_req_sending...............: avg=53.47µs min=8.72µs med=22.75µs max=7.11ms p(90)=40.31µs p(95)=181.47µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.11s min=495.3ms med=2.06s max=4.49s p(90)=2.57s p(95)=2.69s http_reqs......................: 1433 46.674914/s iteration_duration.............: avg=2.12s min=505.43ms med=2.07s max=4.51s p(90)=2.58s p(95)=2.7s iterations.....................: 1433 46.674914/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2173ms 183 12862 total, 0 failed avg: 710ms, p95: 2174ms, max: 6408ms, med: 481ms ✅
apollo-router 2281ms 167 11728 total, 0 failed avg: 830ms, p95: 2281ms, max: 6405ms, med: 680ms ✅
wundergraph 2407ms 158 11062 total, 0 failed avg: 866ms, p95: 2407ms, max: 6774ms, med: 661ms ✅
mesh-supergraph-bun 6238ms 97 6819 total, 0 failed avg: 2741ms, p95: 6239ms, max: 11760ms, med: 2577ms ✅
mesh-supergraph 7669ms 58 4106 total, 0 failed avg: 4698ms, p95: 7670ms, max: 9428ms, med: 4846ms ✅
apollo-server 19936ms 77 5577 total, 0 failed avg: 3701ms, p95: 19937ms, max: 43131ms, med: 2090ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 38586 ✗ 0 data_received..................: 1.1 GB 16 MB/s data_sent......................: 15 MB 218 kB/s http_req_blocked...............: avg=20.11ms min=1.54µs med=3.08µs max=3.74s p(90)=4.82µs p(95)=17.67µs http_req_connecting............: avg=18.07ms min=0s med=0s max=3.74s p(90)=0s p(95)=0s http_req_duration..............: avg=710.13ms min=4.18ms med=481.01ms max=6.4s p(90)=1.65s p(95)=2.17s { expected_response:true }...: avg=710.13ms min=4.18ms med=481.01ms max=6.4s p(90)=1.65s p(95)=2.17s http_req_failed................: 0.00% ✓ 0 ✗ 12862 http_req_receiving.............: avg=232.23ms min=33.05µs med=78.98µs max=5.98s p(90)=877.07ms p(95)=1.46s http_req_sending...............: avg=29.21ms min=7.45µs med=14.45µs max=4s p(90)=2.16ms p(95)=103.97ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=448.68ms min=4.11ms med=338.06ms max=2.78s p(90)=1s p(95)=1.24s http_reqs......................: 12862 183.707817/s iteration_duration.............: avg=1.41s min=11.48ms med=938.96ms max=11.18s p(90)=3.43s p(95)=4.28s iterations.....................: 12862 183.707817/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35184 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 199 kB/s http_req_blocked...............: avg=23.68ms min=1.62µs med=3.3µs max=3.49s p(90)=5.31µs p(95)=18.74µs http_req_connecting............: avg=23.25ms min=0s med=0s max=3.49s p(90)=0s p(95)=0s http_req_duration..............: avg=829.84ms min=5.79ms med=679.97ms max=6.4s p(90)=1.74s p(95)=2.28s { expected_response:true }...: avg=829.84ms min=5.79ms med=679.97ms max=6.4s p(90)=1.74s p(95)=2.28s http_req_failed................: 0.00% ✓ 0 ✗ 11728 http_req_receiving.............: avg=242.82ms min=30.25µs med=82.86µs max=5.05s p(90)=965.22ms p(95)=1.45s http_req_sending...............: avg=29.93ms min=8.12µs med=15.34µs max=4.1s p(90)=706.69µs p(95)=92.42ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=557.08ms min=5.69ms med=471.16ms max=2.65s p(90)=1.08s p(95)=1.25s http_reqs......................: 11728 167.526716/s iteration_duration.............: avg=1.56s min=11.64ms med=1.14s max=10.29s p(90)=3.56s p(95)=4.43s iterations.....................: 11728 167.526716/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 33186 ✗ 0 data_received..................: 971 MB 14 MB/s data_sent......................: 13 MB 188 kB/s http_req_blocked...............: avg=27.94ms min=1.54µs med=3.42µs max=3.96s p(90)=5.69µs p(95)=36.02µs http_req_connecting............: avg=27.6ms min=0s med=0s max=3.96s p(90)=0s p(95)=0s http_req_duration..............: avg=865.97ms min=6.32ms med=660.97ms max=6.77s p(90)=1.81s p(95)=2.4s { expected_response:true }...: avg=865.97ms min=6.32ms med=660.97ms max=6.77s p(90)=1.81s p(95)=2.4s http_req_failed................: 0.00% ✓ 0 ✗ 11062 http_req_receiving.............: avg=250.42ms min=33.52µs med=88.47µs max=6.33s p(90)=1s p(95)=1.41s http_req_sending...............: avg=30.45ms min=7.8µs med=16.08µs max=5.29s p(90)=412.44µs p(95)=101.22ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=585.09ms min=6.21ms med=454.5ms max=3.2s p(90)=1.27s p(95)=1.53s http_reqs......................: 11062 158.003769/s iteration_duration.............: avg=1.68s min=11.74ms med=1.3s max=12.05s p(90)=3.7s p(95)=4.48s iterations.....................: 11062 158.003769/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 20457 ✗ 0 data_received..................: 598 MB 8.5 MB/s data_sent......................: 8.1 MB 116 kB/s http_req_blocked...............: avg=1.88ms min=1.49µs med=2.96µs max=323.64ms p(90)=5.82µs p(95)=235.84µs http_req_connecting............: avg=1.85ms min=0s med=0s max=298.56ms p(90)=0s p(95)=157.61µs http_req_duration..............: avg=2.74s min=6.55ms med=2.57s max=11.76s p(90)=5s p(95)=6.23s { expected_response:true }...: avg=2.74s min=6.55ms med=2.57s max=11.76s p(90)=5s p(95)=6.23s http_req_failed................: 0.00% ✓ 0 ✗ 6819 http_req_receiving.............: avg=24.49ms min=36.58µs med=79.12µs max=1.98s p(90)=4.11ms p(95)=138.38ms http_req_sending...............: avg=2.48ms min=8.3µs med=14.14µs max=505.94ms p(90)=115.6µs p(95)=9.96ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.71s min=6.39ms med=2.56s max=11.75s p(90)=4.79s p(95)=6.21s http_reqs......................: 6819 97.3646/s iteration_duration.............: avg=2.8s min=13.4ms med=2.62s max=11.77s p(90)=5.16s p(95)=6.3s iterations.....................: 6819 97.3646/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 12318 ✗ 0 data_received..................: 360 MB 5.1 MB/s data_sent......................: 4.9 MB 70 kB/s http_req_blocked...............: avg=311.33µs min=1.41µs med=3.95µs max=85.06ms p(90)=189.95µs p(95)=379.44µs http_req_connecting............: avg=292.83µs min=0s med=0s max=84.98ms p(90)=128.77µs p(95)=291.47µs http_req_duration..............: avg=4.69s min=12.58ms med=4.84s max=9.42s p(90)=7.3s p(95)=7.66s { expected_response:true }...: avg=4.69s min=12.58ms med=4.84s max=9.42s p(90)=7.3s p(95)=7.66s http_req_failed................: 0.00% ✓ 0 ✗ 4106 http_req_receiving.............: avg=3.22ms min=36.67µs med=116.09µs max=481.68ms p(90)=2.34ms p(95)=4.97ms http_req_sending...............: avg=225.93µs min=7.9µs med=21.82µs max=171.45ms p(90)=50.27µs p(95)=91.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.69s min=12.5ms med=4.84s max=9.42s p(90)=7.29s p(95)=7.65s http_reqs......................: 4106 58.65489/s iteration_duration.............: avg=4.73s min=18.68ms med=4.88s max=9.54s p(90)=7.34s p(95)=7.72s iterations.....................: 4106 58.65489/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16731 ✗ 0 data_received..................: 490 MB 6.8 MB/s data_sent......................: 6.6 MB 91 kB/s http_req_blocked...............: avg=110.98µs min=1.38µs med=2.68µs max=64.09ms p(90)=9.65µs p(95)=213.94µs http_req_connecting............: avg=101.08µs min=0s med=0s max=63.9ms p(90)=0s p(95)=145.95µs http_req_duration..............: avg=3.7s min=68.97ms med=2.08s max=43.13s p(90)=3s p(95)=19.93s { expected_response:true }...: avg=3.7s min=68.97ms med=2.08s max=43.13s p(90)=3s p(95)=19.93s http_req_failed................: 0.00% ✓ 0 ✗ 5577 http_req_receiving.............: avg=317.04µs min=43.58µs med=106.26µs max=173.75ms p(90)=187.94µs p(95)=286.73µs http_req_sending...............: avg=51.54µs min=8.1µs med=13.64µs max=20.24ms p(90)=34.05µs p(95)=49.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.7s min=68.9ms med=2.08s max=43.13s p(90)=3s p(95)=19.93s http_reqs......................: 5577 77.008723/s iteration_duration.............: avg=3.71s min=75.67ms med=2.1s max=43.14s p(90)=3.01s p(95)=19.94s iterations.....................: 5577 77.008723/s vus............................: 41 min=41 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview