search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update oven/bun Docker tag to v1.0.33 #405

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Type Update Change
oven/bun final patch 1.0.32 -> 1.0.33

Release Notes

oven-sh/bun (oven/bun) ### [`v1.0.33`](https://togithub.com/oven-sh/bun/releases/tag/bun-v1.0.33): Bun v1.0.33 To install Bun v1.0.33: ```bash curl https://bun.sh/install | bash ### or you can use npm ### npm install -g bun ``` To upgrade to Bun v1.0.33: ```bash bun upgrade ``` ##### **[Read Bun v1.0.33's release notes on Bun's blog](https://bun.sh/blog/bun-v1.0.33)** ##### Thank you to 4 contributors! - [@​nellfs](https://togithub.com/nellfs) - [@​zenshixd](https://togithub.com/zenshixd) - [@​Jarred-Sumner](https://togithub.com/Jarred-Sumner) - [@​zackradisic](https://togithub.com/zackradisic) **Full Changelog**: https://github.com/oven-sh/bun/compare/bun-v1.0.32...bun-v1.0.33

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 176 5350 total, 0 failed avg: 500ms, p95: 673ms ✅
apollo-router 165 5039 total, 0 failed avg: 532ms, p95: 723ms ✅
wundergraph 151 4646 total, 0 failed avg: 558ms, p95: 997ms ✅
mesh-supergraph-bun 94 2897 total, 0 failed avg: 1017ms, p95: 1734ms ✅
apollo-server 49 1554 total, 0 failed avg: 1969ms, p95: 2698ms ✅
mercurius 31 960 total, 0 failed avg: 3154ms, p95: 4656ms ✅
mesh-supergraph 30 964 total, 0 failed avg: 3193ms, p95: 4974ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16050 ✗ 0 data_received..................: 469 MB 15 MB/s data_sent......................: 6.4 MB 209 kB/s http_req_blocked...............: avg=27.34µs min=1.43µs med=2.74µs max=36.68ms p(90)=4.1µs p(95)=4.98µs http_req_connecting............: avg=15.72µs min=0s med=0s max=8.06ms p(90)=0s p(95)=0s http_req_duration..............: avg=500.4ms min=25.92ms med=499.1ms max=1.67s p(90)=612.69ms p(95)=672.85ms { expected_response:true }...: avg=500.4ms min=25.92ms med=499.1ms max=1.67s p(90)=612.69ms p(95)=672.85ms http_req_failed................: 0.00% ✓ 0 ✗ 5350 http_req_receiving.............: avg=23.02ms min=36.48µs med=72.75µs max=1.22s p(90)=48.15ms p(95)=137.14ms http_req_sending...............: avg=1.42ms min=8.12µs med=13.25µs max=1.14s p(90)=29.65µs p(95)=151.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=475.95ms min=21.16ms med=487.87ms max=964.88ms p(90)=581.91ms p(95)=613.9ms http_reqs......................: 5350 176.035336/s iteration_duration.............: avg=564.85ms min=44.36ms med=540.49ms max=1.9s p(90)=742.08ms p(95)=842.29ms iterations.....................: 5350 176.035336/s vus............................: 91 min=91 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15117 ✗ 0 data_received..................: 442 MB 15 MB/s data_sent......................: 6.0 MB 197 kB/s http_req_blocked...............: avg=56.8µs min=1.41µs med=2.96µs max=9.38ms p(90)=4.71µs p(95)=5.87µs http_req_connecting............: avg=48.53µs min=0s med=0s max=5.98ms p(90)=0s p(95)=0s http_req_duration..............: avg=531.59ms min=44.66ms med=534.68ms max=1.44s p(90)=669.6ms p(95)=723.04ms { expected_response:true }...: avg=531.59ms min=44.66ms med=534.68ms max=1.44s p(90)=669.6ms p(95)=723.04ms http_req_failed................: 0.00% ✓ 0 ✗ 5039 http_req_receiving.............: avg=18.7ms min=36.82µs med=71.36µs max=798.41ms p(90)=34.05ms p(95)=103.11ms http_req_sending...............: avg=1.94ms min=7.37µs med=13.88µs max=920.24ms p(90)=36.79µs p(95)=187.52µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=510.93ms min=44.6ms med=520.94ms max=919.4ms p(90)=645.72ms p(95)=682.3ms http_reqs......................: 5039 165.552243/s iteration_duration.............: avg=600.27ms min=53.98ms med=582.06ms max=3.02s p(90)=762.82ms p(95)=870.51ms iterations.....................: 5039 165.552243/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13938 ✗ 0 data_received..................: 408 MB 13 MB/s data_sent......................: 5.5 MB 180 kB/s http_req_blocked...............: avg=31.06µs min=1.87µs med=3.63µs max=33.82ms p(90)=5.9µs p(95)=7.32µs http_req_connecting............: avg=16.95µs min=0s med=0s max=8.64ms p(90)=0s p(95)=0s http_req_duration..............: avg=557.88ms min=25.55ms med=526.66ms max=2.03s p(90)=855.91ms p(95)=997.26ms { expected_response:true }...: avg=557.88ms min=25.55ms med=526.66ms max=2.03s p(90)=855.91ms p(95)=997.26ms http_req_failed................: 0.00% ✓ 0 ✗ 4646 http_req_receiving.............: avg=47.24ms min=41.48µs med=108.09µs max=1.12s p(90)=150.7ms p(95)=313.98ms http_req_sending...............: avg=2.33ms min=8.51µs med=17.58µs max=709.43ms p(90)=58.42µs p(95)=381.61µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=508.3ms min=19.67ms med=486.75ms max=1.47s p(90)=792.31ms p(95)=891.85ms http_reqs......................: 4646 151.74356/s iteration_duration.............: avg=654.91ms min=39.95ms med=599.25ms max=2.64s p(90)=1.02s p(95)=1.21s iterations.....................: 4646 151.74356/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8691 ✗ 0 data_received..................: 254 MB 8.3 MB/s data_sent......................: 3.4 MB 112 kB/s http_req_blocked...............: avg=27.46µs min=1.44µs med=3.1µs max=3.64ms p(90)=5.08µs p(95)=9.04µs http_req_connecting............: avg=21µs min=0s med=0s max=3.6ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.01s min=504.88ms med=876.33ms max=2.46s p(90)=1.56s p(95)=1.73s { expected_response:true }...: avg=1.01s min=504.88ms med=876.33ms max=2.46s p(90)=1.56s p(95)=1.73s http_req_failed................: 0.00% ✓ 0 ✗ 2897 http_req_receiving.............: avg=13.54ms min=36.88µs med=95.4µs max=517.3ms p(90)=10.28ms p(95)=93.66ms http_req_sending...............: avg=477.27µs min=8.16µs med=14.5µs max=155.38ms p(90)=39.85µs p(95)=175.56µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1s min=478.13ms med=867.42ms max=2.45s p(90)=1.56s p(95)=1.72s http_reqs......................: 2897 94.106635/s iteration_duration.............: avg=1.04s min=514.52ms med=908.2ms max=2.49s p(90)=1.61s p(95)=1.76s iterations.....................: 2897 94.106635/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4662 ✗ 0 data_received..................: 137 MB 4.4 MB/s data_sent......................: 1.8 MB 59 kB/s http_req_blocked...............: avg=35.26µs min=1.52µs med=3.27µs max=3.26ms p(90)=5.17µs p(95)=188.3µs http_req_connecting............: avg=26.62µs min=0s med=0s max=1.22ms p(90)=0s p(95)=131.25µs http_req_duration..............: avg=1.96s min=538.78ms med=1.63s max=21.23s p(90)=2.03s p(95)=2.69s { expected_response:true }...: avg=1.96s min=538.78ms med=1.63s max=21.23s p(90)=2.03s p(95)=2.69s http_req_failed................: 0.00% ✓ 0 ✗ 1554 http_req_receiving.............: avg=264.68µs min=47.46µs med=122.91µs max=45.8ms p(90)=184.76µs p(95)=225.3µs http_req_sending...............: avg=44.5µs min=8.46µs med=17.61µs max=4.71ms p(90)=35.37µs p(95)=199.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.96s min=538.24ms med=1.63s max=21.23s p(90)=2.03s p(95)=2.69s http_reqs......................: 1554 49.553086/s iteration_duration.............: avg=1.98s min=549.58ms med=1.64s max=21.24s p(90)=2.05s p(95)=2.7s iterations.....................: 1554 49.553086/s vus............................: 43 min=43 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2880 ✗ 0 data_received..................: 84 MB 2.8 MB/s data_sent......................: 1.1 MB 37 kB/s http_req_blocked...............: avg=128.2µs min=1.62µs med=3.77µs max=3.38ms p(90)=103.82µs p(95)=945.71µs http_req_connecting............: avg=119.8µs min=0s med=0s max=3.35ms p(90)=73.86µs p(95)=899.45µs http_req_duration..............: avg=3.15s min=442.8ms med=2.97s max=7.77s p(90)=4.16s p(95)=4.65s { expected_response:true }...: avg=3.15s min=442.8ms med=2.97s max=7.77s p(90)=4.16s p(95)=4.65s http_req_failed................: 0.00% ✓ 0 ✗ 960 http_req_receiving.............: avg=188.04µs min=43.44µs med=118.83µs max=15.28ms p(90)=185.38µs p(95)=237.62µs http_req_sending...............: avg=88.75µs min=8.72µs med=20.79µs max=1.17ms p(90)=44.59µs p(95)=871.63µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.15s min=442.54ms med=2.97s max=7.77s p(90)=4.16s p(95)=4.65s http_reqs......................: 960 31.344701/s iteration_duration.............: avg=3.16s min=453.1ms med=2.98s max=7.79s p(90)=4.18s p(95)=4.66s iterations.....................: 960 31.344701/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2892 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=228.7µs min=1.51µs med=3.59µs max=4.94ms p(90)=106.51µs p(95)=2.07ms http_req_connecting............: avg=211.38µs min=0s med=0s max=4.6ms p(90)=72.33µs p(95)=1.94ms http_req_duration..............: avg=3.19s min=1.19s med=3.08s max=6.34s p(90)=4.39s p(95)=4.97s { expected_response:true }...: avg=3.19s min=1.19s med=3.08s max=6.34s p(90)=4.39s p(95)=4.97s http_req_failed................: 0.00% ✓ 0 ✗ 964 http_req_receiving.............: avg=3.34ms min=42.98µs med=146.8µs max=88.17ms p(90)=1.61ms p(95)=13.07ms http_req_sending...............: avg=73.8µs min=8.35µs med=18.84µs max=15.12ms p(90)=68.67µs p(95)=256.42µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.18s min=1.18s med=3.07s max=6.33s p(90)=4.39s p(95)=4.97s http_reqs......................: 964 30.341204/s iteration_duration.............: avg=3.2s min=1.2s med=3.09s max=6.37s p(90)=4.4s p(95)=4.98s iterations.....................: 964 30.341204/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5037 total, 0 failed avg: 533ms, p95: 737ms ✅
mesh-supergraph-bun 102 3190 total, 0 failed avg: 922ms, p95: 1331ms ✅
wundergraph 102 3184 total, 0 failed avg: 924ms, p95: 1149ms ✅
cosmo 82 2577 total, 0 failed avg: 1155ms, p95: 1393ms ✅
apollo-server 64 1992 total, 0 failed avg: 1527ms, p95: 1878ms ✅
mesh-supergraph 61 1907 total, 0 failed avg: 1575ms, p95: 2397ms ✅
mercurius 12 473 total, 0 failed avg: 7154ms, p95: 8378ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15111 ✗ 0 data_received..................: 442 MB 15 MB/s data_sent......................: 6.0 MB 196 kB/s http_req_blocked...............: avg=37.98µs min=1.42µs med=3.03µs max=8.16ms p(90)=4.84µs p(95)=5.96µs http_req_connecting............: avg=32.36µs min=0s med=0s max=8.13ms p(90)=0s p(95)=0s http_req_duration..............: avg=533.17ms min=266.79ms med=521.4ms max=1.17s p(90)=666.69ms p(95)=737.11ms { expected_response:true }...: avg=533.17ms min=266.79ms med=521.4ms max=1.17s p(90)=666.69ms p(95)=737.11ms http_req_failed................: 0.00% ✓ 0 ✗ 5037 http_req_receiving.............: avg=17.63ms min=35.64µs med=79.17µs max=551.74ms p(90)=63.93ms p(95)=109.98ms http_req_sending...............: avg=1.79ms min=8.59µs med=14.01µs max=395.95ms p(90)=61.88µs p(95)=684.53µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=513.74ms min=266.7ms med=508.77ms max=877.74ms p(90)=629.28ms p(95)=685.75ms http_reqs......................: 5037 165.111007/s iteration_duration.............: avg=600.8ms min=277.85ms med=578.03ms max=1.37s p(90)=777.11ms p(95)=873.6ms iterations.....................: 5037 165.111007/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9570 ✗ 0 data_received..................: 280 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=60.3µs min=1.68µs med=3.25µs max=5.47ms p(90)=5.07µs p(95)=9.31µs http_req_connecting............: avg=54.67µs min=0s med=0s max=5.43ms p(90)=0s p(95)=0s http_req_duration..............: avg=922.03ms min=319.07ms med=896.34ms max=1.87s p(90)=1.21s p(95)=1.33s { expected_response:true }...: avg=922.03ms min=319.07ms med=896.34ms max=1.87s p(90)=1.21s p(95)=1.33s http_req_failed................: 0.00% ✓ 0 ✗ 3190 http_req_receiving.............: avg=15.04ms min=40.01µs med=89.94µs max=603.55ms p(90)=9.71ms p(95)=89.68ms http_req_sending...............: avg=681.68µs min=8.65µs med=15.46µs max=178.52ms p(90)=40.95µs p(95)=222.38µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=906.31ms min=318.84ms med=883.29ms max=1.85s p(90)=1.18s p(95)=1.29s http_reqs......................: 3190 102.391065/s iteration_duration.............: avg=965.81ms min=328.84ms med=934.94ms max=2.02s p(90)=1.28s p(95)=1.41s iterations.....................: 3190 102.391065/s vus............................: 32 min=32 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9552 ✗ 0 data_received..................: 279 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=28.71µs min=1.28µs med=2.61µs max=5.67ms p(90)=4.07µs p(95)=8.63µs http_req_connecting............: avg=17.61µs min=0s med=0s max=2.87ms p(90)=0s p(95)=0s http_req_duration..............: avg=923.96ms min=552.63ms med=917.22ms max=1.44s p(90)=1.08s p(95)=1.14s { expected_response:true }...: avg=923.96ms min=552.63ms med=917.22ms max=1.44s p(90)=1.08s p(95)=1.14s http_req_failed................: 0.00% ✓ 0 ✗ 3184 http_req_receiving.............: avg=15.12ms min=38.87µs med=84.79µs max=333.71ms p(90)=54.78ms p(95)=115.38ms http_req_sending...............: avg=1.41ms min=7.8µs med=12.97µs max=333.59ms p(90)=33.78µs p(95)=203.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=907.42ms min=552.55ms med=906.1ms max=1.36s p(90)=1.05s p(95)=1.12s http_reqs......................: 3184 102.519876/s iteration_duration.............: avg=960.82ms min=569.02ms med=951.99ms max=1.46s p(90)=1.14s p(95)=1.21s iterations.....................: 3184 102.519876/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7731 ✗ 0 data_received..................: 226 MB 7.2 MB/s data_sent......................: 3.1 MB 98 kB/s http_req_blocked...............: avg=64.22µs min=1.34µs med=2.65µs max=10.1ms p(90)=4.12µs p(95)=9.24µs http_req_connecting............: avg=54.7µs min=0s med=0s max=5.8ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=765.29ms med=1.14s max=1.58s p(90)=1.34s p(95)=1.39s { expected_response:true }...: avg=1.15s min=765.29ms med=1.14s max=1.58s p(90)=1.34s p(95)=1.39s http_req_failed................: 0.00% ✓ 0 ✗ 2577 http_req_receiving.............: avg=9.25ms min=39.03µs med=84.21µs max=311.61ms p(90)=17.74ms p(95)=67.81ms http_req_sending...............: avg=1.43ms min=7.67µs med=12.98µs max=242.77ms p(90)=65.68µs p(95)=767.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=765.1ms med=1.13s max=1.58s p(90)=1.33s p(95)=1.38s http_reqs......................: 2577 82.513259/s iteration_duration.............: avg=1.19s min=775.61ms med=1.18s max=1.65s p(90)=1.4s p(95)=1.45s iterations.....................: 2577 82.513259/s vus............................: 51 min=51 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5976 ✗ 0 data_received..................: 175 MB 5.6 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=74.99µs min=1.52µs med=3.15µs max=6.88ms p(90)=4.82µs p(95)=60.94µs http_req_connecting............: avg=65.64µs min=0s med=0s max=5.38ms p(90)=0s p(95)=25.93µs http_req_duration..............: avg=1.52s min=659.64ms med=1.47s max=9.66s p(90)=1.76s p(95)=1.87s { expected_response:true }...: avg=1.52s min=659.64ms med=1.47s max=9.66s p(90)=1.76s p(95)=1.87s http_req_failed................: 0.00% ✓ 0 ✗ 1992 http_req_receiving.............: avg=162.53µs min=47.44µs med=113.29µs max=12.64ms p(90)=180.45µs p(95)=234µs http_req_sending...............: avg=61.13µs min=9.42µs med=16.72µs max=7ms p(90)=32.97µs p(95)=73.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.52s min=659.23ms med=1.47s max=9.66s p(90)=1.76s p(95)=1.87s http_reqs......................: 1992 64.156112/s iteration_duration.............: avg=1.53s min=666.97ms med=1.48s max=9.67s p(90)=1.77s p(95)=1.89s iterations.....................: 1992 64.156112/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5721 ✗ 0 data_received..................: 167 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=112.1µs min=1.61µs med=4.41µs max=9.86ms p(90)=6.45µs p(95)=107.31µs http_req_connecting............: avg=67.63µs min=0s med=0s max=8.8ms p(90)=0s p(95)=70.57µs http_req_duration..............: avg=1.57s min=516.97ms med=1.46s max=3.77s p(90)=2.18s p(95)=2.39s { expected_response:true }...: avg=1.57s min=516.97ms med=1.46s max=3.77s p(90)=2.18s p(95)=2.39s http_req_failed................: 0.00% ✓ 0 ✗ 1907 http_req_receiving.............: avg=1.58ms min=40.77µs med=125µs max=83.54ms p(90)=2.57ms p(95)=9.98ms http_req_sending...............: avg=222.62µs min=9.34µs med=23.85µs max=70.72ms p(90)=41.91µs p(95)=166.83µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.57s min=514.32ms med=1.46s max=3.77s p(90)=2.17s p(95)=2.39s http_reqs......................: 1907 61.745568/s iteration_duration.............: avg=1.59s min=531.78ms med=1.48s max=3.79s p(90)=2.22s p(95)=2.43s iterations.....................: 1907 61.745568/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1419 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 562 kB 15 kB/s http_req_blocked...............: avg=259µs min=1.7µs med=4.26µs max=9.77ms p(90)=713.55µs p(95)=1.62ms http_req_connecting............: avg=174.2µs min=0s med=0s max=2.56ms p(90)=542.01µs p(95)=1.42ms http_req_duration..............: avg=7.15s min=2.95s med=7.43s max=8.76s p(90)=8.21s p(95)=8.37s { expected_response:true }...: avg=7.15s min=2.95s med=7.43s max=8.76s p(90)=8.21s p(95)=8.37s http_req_failed................: 0.00% ✓ 0 ✗ 473 http_req_receiving.............: avg=170.45µs min=67.17µs med=133.02µs max=8.68ms p(90)=199.63µs p(95)=244.7µs http_req_sending...............: avg=96.12µs min=11.17µs med=24.29µs max=894.9µs p(90)=171.23µs p(95)=708.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.15s min=2.95s med=7.43s max=8.76s p(90)=8.21s p(95)=8.37s http_reqs......................: 473 12.649192/s iteration_duration.............: avg=7.16s min=2.95s med=7.44s max=8.76s p(90)=8.21s p(95)=8.38s iterations.....................: 473 12.649192/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
wundergraph 2542ms 163 11446 total, 0 failed avg: 853ms, p95: 2542ms, max: 8906ms, med: 566ms ✅
cosmo 2704ms 175 12276 total, 0 failed avg: 840ms, p95: 2705ms, max: 8119ms, med: 493ms ✅
apollo-router 3348ms 167 11697 total, 0 failed avg: 939ms, p95: 3349ms, max: 9639ms, med: 567ms ✅
mesh-supergraph-bun 5541ms 116 8190 total, 0 failed avg: 2255ms, p95: 5542ms, max: 9307ms, med: 1986ms ✅
mesh-supergraph 6827ms 67 4754 total, 0 failed avg: 4027ms, p95: 6827ms, max: 8676ms, med: 4183ms ✅
apollo-server 23784ms 68 5026 total, 0 failed avg: 4149ms, p95: 23784ms, max: 45074ms, med: 2191ms ✅
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34338 ✗ 0 data_received..................: 1.0 GB 14 MB/s data_sent......................: 14 MB 194 kB/s http_req_blocked...............: avg=22.28ms min=1.53µs med=3.31µs max=5.76s p(90)=5.48µs p(95)=19.17µs http_req_connecting............: avg=20.96ms min=0s med=0s max=5.76s p(90)=0s p(95)=0s http_req_duration..............: avg=853.15ms min=7.52ms med=565.83ms max=8.9s p(90)=1.92s p(95)=2.54s { expected_response:true }...: avg=853.15ms min=7.52ms med=565.83ms max=8.9s p(90)=1.92s p(95)=2.54s http_req_failed................: 0.00% ✓ 0 ✗ 11446 http_req_receiving.............: avg=329.97ms min=31.21µs med=89.94µs max=5.2s p(90)=1.27s p(95)=1.74s http_req_sending...............: avg=39.4ms min=8.41µs med=15.26µs max=4.78s p(90)=331.48µs p(95)=76.67ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=483.77ms min=7.44ms med=339.38ms max=3.22s p(90)=1.08s p(95)=1.3s http_reqs......................: 11446 163.505681/s iteration_duration.............: avg=1.61s min=14.87ms med=1.02s max=11.85s p(90)=4.02s p(95)=5.11s iterations.....................: 11446 163.505681/s vus............................: 1 min=1 max=495 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36828 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=24.62ms min=1.21µs med=2.87µs max=5.47s p(90)=4.73µs p(95)=12.69µs http_req_connecting............: avg=21.46ms min=0s med=0s max=5.38s p(90)=0s p(95)=0s http_req_duration..............: avg=840.14ms min=6.72ms med=492.84ms max=8.11s p(90)=2.13s p(95)=2.7s { expected_response:true }...: avg=840.14ms min=6.72ms med=492.84ms max=8.11s p(90)=2.13s p(95)=2.7s http_req_failed................: 0.00% ✓ 0 ✗ 12276 http_req_receiving.............: avg=360.66ms min=31.02µs med=79.67µs max=7.6s p(90)=1.48s p(95)=2.14s http_req_sending...............: avg=33.27ms min=7.09µs med=13.31µs max=5.02s p(90)=137.14µs p(95)=49.27ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=446.2ms min=6.62ms med=340.07ms max=4.81s p(90)=982.24ms p(95)=1.22s http_reqs......................: 12276 175.358472/s iteration_duration.............: avg=1.51s min=12.21ms med=910.79ms max=11.3s p(90)=3.68s p(95)=4.92s iterations.....................: 12276 175.358472/s vus............................: 1 min=1 max=494 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35091 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 198 kB/s http_req_blocked...............: avg=14.65ms min=1.48µs med=3.7µs max=5.12s p(90)=6.11µs p(95)=14.91µs http_req_connecting............: avg=14.38ms min=0s med=0s max=5.12s p(90)=0s p(95)=0s http_req_duration..............: avg=938.67ms min=6.66ms med=566.75ms max=9.63s p(90)=2.37s p(95)=3.34s { expected_response:true }...: avg=938.67ms min=6.66ms med=566.75ms max=9.63s p(90)=2.37s p(95)=3.34s http_req_failed................: 0.00% ✓ 0 ✗ 11697 http_req_receiving.............: avg=435.81ms min=30.6µs med=99.1µs max=9.3s p(90)=1.71s p(95)=2.47s http_req_sending...............: avg=37.59ms min=8.74µs med=18.13µs max=6.91s p(90)=258.11µs p(95)=67.19ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=465.26ms min=6.56ms med=420.24ms max=3.57s p(90)=857.79ms p(95)=1s http_reqs......................: 11697 167.096653/s iteration_duration.............: avg=1.63s min=12.4ms med=974.3ms max=14.43s p(90)=4.04s p(95)=5.33s iterations.....................: 11697 167.096653/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24570 ✗ 0 data_received..................: 719 MB 10 MB/s data_sent......................: 9.7 MB 139 kB/s http_req_blocked...............: avg=1.69ms min=1.58µs med=3.14µs max=348.64ms p(90)=5.78µs p(95)=218.99µs http_req_connecting............: avg=1.66ms min=0s med=0s max=348.57ms p(90)=0s p(95)=148.11µs http_req_duration..............: avg=2.25s min=5.45ms med=1.98s max=9.3s p(90)=4.2s p(95)=5.54s { expected_response:true }...: avg=2.25s min=5.45ms med=1.98s max=9.3s p(90)=4.2s p(95)=5.54s http_req_failed................: 0.00% ✓ 0 ✗ 8190 http_req_receiving.............: avg=22.75ms min=34.32µs med=79.19µs max=1.5s p(90)=5.82ms p(95)=124.92ms http_req_sending...............: avg=2.74ms min=8.53µs med=14.6µs max=424.87ms p(90)=126.23µs p(95)=11.46ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.22s min=5.25ms med=1.94s max=9.14s p(90)=4.12s p(95)=5.5s http_reqs......................: 8190 116.991724/s iteration_duration.............: avg=2.31s min=12.17ms med=2.06s max=9.44s p(90)=4.31s p(95)=5.62s iterations.....................: 8190 116.991724/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14262 ✗ 0 data_received..................: 417 MB 6.0 MB/s data_sent......................: 5.6 MB 81 kB/s http_req_blocked...............: avg=558.85µs min=1.54µs med=3.81µs max=183.39ms p(90)=178.56µs p(95)=447.11µs http_req_connecting............: avg=506.97µs min=0s med=0s max=183.33ms p(90)=116.45µs p(95)=373µs http_req_duration..............: avg=4.02s min=13.99ms med=4.18s max=8.67s p(90)=6.39s p(95)=6.82s { expected_response:true }...: avg=4.02s min=13.99ms med=4.18s max=8.67s p(90)=6.39s p(95)=6.82s http_req_failed................: 0.00% ✓ 0 ✗ 4754 http_req_receiving.............: avg=3.8ms min=38.34µs med=103.79µs max=484.81ms p(90)=1.53ms p(95)=10.93ms http_req_sending...............: avg=401.11µs min=8.67µs med=19.69µs max=146.61ms p(90)=53.74µs p(95)=130.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.02s min=13.76ms med=4.17s max=8.67s p(90)=6.37s p(95)=6.82s http_reqs......................: 4754 67.893911/s iteration_duration.............: avg=4.06s min=20.49ms med=4.21s max=8.69s p(90)=6.45s p(95)=6.9s iterations.....................: 4754 67.893911/s vus............................: 2 min=2 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15078 ✗ 0 data_received..................: 442 MB 6.0 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=93.73µs min=1.4µs med=3.38µs max=61.21ms p(90)=98.93µs p(95)=300.55µs http_req_connecting............: avg=83.37µs min=0s med=0s max=61.03ms p(90)=0s p(95)=226.29µs http_req_duration..............: avg=4.14s min=79.45ms med=2.19s max=45.07s p(90)=3.55s p(95)=23.78s { expected_response:true }...: avg=4.14s min=79.45ms med=2.19s max=45.07s p(90)=3.55s p(95)=23.78s http_req_failed................: 0.00% ✓ 0 ✗ 5026 http_req_receiving.............: avg=326.65µs min=46.9µs med=118.41µs max=157.32ms p(90)=183.12µs p(95)=226.24µs http_req_sending...............: avg=88.6µs min=8.52µs med=16.98µs max=30.38ms p(90)=42.62µs p(95)=64.5µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.14s min=79.35ms med=2.19s max=45.07s p(90)=3.55s p(95)=23.78s http_reqs......................: 5026 68.719121/s iteration_duration.............: avg=4.16s min=89.92ms med=2.2s max=45.08s p(90)=3.56s p(95)=23.79s iterations.....................: 5026 68.719121/s vus............................: 16 min=16 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4643 total, 0 failed avg: 611ms, p95: 779ms ✅
wundergraph 102 3176 total, 0 failed avg: 931ms, p95: 1167ms ✅
mesh-supergraph-bun 85 2640 total, 0 failed avg: 1136ms, p95: 1684ms ✅
cosmo 79 2488 total, 0 failed avg: 1198ms, p95: 1458ms ✅
apollo-server 48 1534 total, 0 failed avg: 2025ms, p95: 2388ms ✅
mesh-supergraph 30 977 total, 0 failed avg: 3174ms, p95: 5281ms ✅
mercurius 11 451 total, 0 failed avg: 7567ms, p95: 8994ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13929 ✗ 0 data_received..................: 407 MB 13 MB/s data_sent......................: 5.5 MB 179 kB/s http_req_blocked...............: avg=42.77µs min=1.35µs med=2.72µs max=60.04ms p(90)=4.09µs p(95)=5.32µs http_req_connecting............: avg=22.11µs min=0s med=0s max=6.24ms p(90)=0s p(95)=0s http_req_duration..............: avg=610.67ms min=331.59ms med=608.19ms max=1.05s p(90)=729.93ms p(95)=779.21ms { expected_response:true }...: avg=610.67ms min=331.59ms med=608.19ms max=1.05s p(90)=729.93ms p(95)=779.21ms http_req_failed................: 0.00% ✓ 0 ✗ 4643 http_req_receiving.............: avg=6.43ms min=36.72µs med=66.08µs max=257ms p(90)=3.85ms p(95)=50.74ms http_req_sending...............: avg=798.13µs min=8.19µs med=13.31µs max=157.59ms p(90)=30.49µs p(95)=164.14µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=603.43ms min=331.54ms med=604.28ms max=1.05s p(90)=716.35ms p(95)=752.27ms http_reqs......................: 4643 150.928425/s iteration_duration.............: avg=655.68ms min=340.94ms med=646.83ms max=1.15s p(90)=800.53ms p(95)=847.96ms iterations.....................: 4643 150.928425/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9528 ✗ 0 data_received..................: 279 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=145.2µs min=1.54µs med=2.8µs max=42.58ms p(90)=4.46µs p(95)=9.1µs http_req_connecting............: avg=122.78µs min=0s med=0s max=8.66ms p(90)=0s p(95)=0s http_req_duration..............: avg=930.51ms min=533.91ms med=925.7ms max=1.49s p(90)=1.09s p(95)=1.16s { expected_response:true }...: avg=930.51ms min=533.91ms med=925.7ms max=1.49s p(90)=1.09s p(95)=1.16s http_req_failed................: 0.00% ✓ 0 ✗ 3176 http_req_receiving.............: avg=12.09ms min=41.4µs med=83.99µs max=445.2ms p(90)=41.23ms p(95)=83.15ms http_req_sending...............: avg=1.22ms min=8.25µs med=13.48µs max=220.53ms p(90)=48.04µs p(95)=213.44µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=917.19ms min=533.67ms med=917.53ms max=1.39s p(90)=1.07s p(95)=1.12s http_reqs......................: 3176 102.428255/s iteration_duration.............: avg=968.22ms min=544.2ms med=957.63ms max=1.54s p(90)=1.15s p(95)=1.22s iterations.....................: 3176 102.428255/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7920 ✗ 0 data_received..................: 232 MB 7.5 MB/s data_sent......................: 3.1 MB 101 kB/s http_req_blocked...............: avg=32.56µs min=1.37µs med=2.8µs max=3.24ms p(90)=4.29µs p(95)=9.34µs http_req_connecting............: avg=26.31µs min=0s med=0s max=3.15ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.13s min=511.78ms med=1.09s max=2.14s p(90)=1.47s p(95)=1.68s { expected_response:true }...: avg=1.13s min=511.78ms med=1.09s max=2.14s p(90)=1.47s p(95)=1.68s http_req_failed................: 0.00% ✓ 0 ✗ 2640 http_req_receiving.............: avg=13.46ms min=36.46µs med=87.91µs max=581.28ms p(90)=1.78ms p(95)=59.12ms http_req_sending...............: avg=394.92µs min=7.83µs med=13.46µs max=115.78ms p(90)=30.81µs p(95)=186.76µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.12s min=511.49ms med=1.08s max=2.13s p(90)=1.44s p(95)=1.63s http_reqs......................: 2640 85.064652/s iteration_duration.............: avg=1.16s min=526.72ms med=1.12s max=2.23s p(90)=1.51s p(95)=1.7s iterations.....................: 2640 85.064652/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7464 ✗ 0 data_received..................: 218 MB 7.0 MB/s data_sent......................: 3.0 MB 95 kB/s http_req_blocked...............: avg=36.27µs min=1.29µs med=2.64µs max=4.3ms p(90)=4.39µs p(95)=10.02µs http_req_connecting............: avg=28.77µs min=0s med=0s max=4.27ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=796.75ms med=1.18s max=1.71s p(90)=1.37s p(95)=1.45s { expected_response:true }...: avg=1.19s min=796.75ms med=1.18s max=1.71s p(90)=1.37s p(95)=1.45s http_req_failed................: 0.00% ✓ 0 ✗ 2488 http_req_receiving.............: avg=12.05ms min=39.22µs med=77.04µs max=370.46ms p(90)=31.08ms p(95)=78.83ms http_req_sending...............: avg=1.13ms min=7.98µs med=12.97µs max=172.79ms p(90)=53.3µs p(95)=522.03µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=796.64ms med=1.17s max=1.64s p(90)=1.34s p(95)=1.39s http_reqs......................: 2488 79.984926/s iteration_duration.............: avg=1.23s min=824.72ms med=1.21s max=1.72s p(90)=1.41s p(95)=1.49s iterations.....................: 2488 79.984926/s vus............................: 31 min=31 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4602 ✗ 0 data_received..................: 135 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=76.68µs min=1.61µs med=3.18µs max=7.8ms p(90)=5.06µs p(95)=373.36µs http_req_connecting............: avg=70.67µs min=0s med=0s max=7.77ms p(90)=0s p(95)=309.24µs http_req_duration..............: avg=2.02s min=931.87ms med=1.83s max=13.77s p(90)=2.19s p(95)=2.38s { expected_response:true }...: avg=2.02s min=931.87ms med=1.83s max=13.77s p(90)=2.19s p(95)=2.38s http_req_failed................: 0.00% ✓ 0 ✗ 1534 http_req_receiving.............: avg=358.47µs min=46.08µs med=118.22µs max=88.8ms p(90)=185.1µs p(95)=253.2µs http_req_sending...............: avg=61.73µs min=9.05µs med=16.28µs max=2.9ms p(90)=33.35µs p(95)=430.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.02s min=931.52ms med=1.83s max=13.77s p(90)=2.19s p(95)=2.38s http_reqs......................: 1534 48.301095/s iteration_duration.............: avg=2.03s min=944.33ms med=1.84s max=13.78s p(90)=2.2s p(95)=2.39s iterations.....................: 1534 48.301095/s vus............................: 83 min=83 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2931 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 36 kB/s http_req_blocked...............: avg=257.37µs min=1.41µs med=3.57µs max=5.13ms p(90)=245.11µs p(95)=2.29ms http_req_connecting............: avg=239.55µs min=0s med=0s max=5.1ms p(90)=219.61µs p(95)=2.02ms http_req_duration..............: avg=3.17s min=989.67ms med=3.06s max=7.37s p(90)=4.42s p(95)=5.28s { expected_response:true }...: avg=3.17s min=989.67ms med=3.06s max=7.37s p(90)=4.42s p(95)=5.28s http_req_failed................: 0.00% ✓ 0 ✗ 977 http_req_receiving.............: avg=2.57ms min=42.76µs med=157.57µs max=167.63ms p(90)=1.13ms p(95)=6.73ms http_req_sending...............: avg=60.6µs min=8.76µs med=19.56µs max=9.43ms p(90)=93.67µs p(95)=258.05µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.17s min=989.32ms med=3.06s max=7.37s p(90)=4.41s p(95)=5.28s http_reqs......................: 977 30.626884/s iteration_duration.............: avg=3.18s min=1s med=3.08s max=7.39s p(90)=4.44s p(95)=5.29s iterations.....................: 977 30.626884/s vus............................: 66 min=66 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1353 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 535 kB 14 kB/s http_req_blocked...............: avg=1ms min=1.64µs med=4.06µs max=6.04ms p(90)=5.02ms p(95)=5.52ms http_req_connecting............: avg=61.08µs min=0s med=0s max=1.56ms p(90)=94.89µs p(95)=311.39µs http_req_duration..............: avg=7.56s min=3.44s med=7.77s max=9.5s p(90)=8.75s p(95)=8.99s { expected_response:true }...: avg=7.56s min=3.44s med=7.77s max=9.5s p(90)=8.75s p(95)=8.99s http_req_failed................: 0.00% ✓ 0 ✗ 451 http_req_receiving.............: avg=311.59µs min=59.72µs med=127.02µs max=73.99ms p(90)=191.34µs p(95)=258.29µs http_req_sending...............: avg=44.13µs min=9.8µs med=21.34µs max=990.83µs p(90)=34.17µs p(95)=106.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.56s min=3.44s med=7.77s max=9.5s p(90)=8.75s p(95)=8.99s http_reqs......................: 451 11.984339/s iteration_duration.............: avg=7.57s min=3.45s med=7.78s max=9.51s p(90)=8.75s p(95)=9s iterations.....................: 451 11.984339/s vus............................: 14 min=14 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview