search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @mercuriusjs/gateway to v3 #410

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@mercuriusjs/gateway 2.2.0 -> 3.0.0 age adoption passing confidence

Release Notes

mercurius-js/federation-support (@​mercuriusjs/gateway) ### [`v3.0.0`](https://togithub.com/mercurius-js/mercurius-gateway/releases/tag/v3.0.0) [Compare Source](https://togithub.com/mercurius-js/federation-support/compare/v2.2.0...v3.0.0) ##### What's Changed - chore: updated to mercurius v14 by [@​mcollina](https://togithub.com/mcollina) in [https://github.com/mercurius-js/mercurius-gateway/pull/113](https://togithub.com/mercurius-js/mercurius-gateway/pull/113) **Full Changelog**: https://github.com/mercurius-js/mercurius-gateway/compare/v2.2.0...v3.0.0

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 163 4987 total, 0 failed avg: 541ms, p95: 736ms ✅
wundergraph 105 3260 total, 0 failed avg: 902ms, p95: 1081ms ✅
mesh-supergraph-bun 98 3013 total, 0 failed avg: 968ms, p95: 1393ms ✅
cosmo 80 2508 total, 0 failed avg: 1178ms, p95: 1441ms ✅
mesh-supergraph 64 1991 total, 0 failed avg: 1509ms, p95: 2187ms ✅
apollo-server 62 1922 total, 0 failed avg: 1569ms, p95: 1931ms ✅
mercurius 12 475 total, 0 failed avg: 7129ms, p95: 8319ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14961 ✗ 0 data_received..................: 438 MB 14 MB/s data_sent......................: 5.9 MB 194 kB/s http_req_blocked...............: avg=64.97µs min=1.57µs med=2.97µs max=25.3ms p(90)=4.65µs p(95)=5.79µs http_req_connecting............: avg=52.18µs min=0s med=0s max=6.25ms p(90)=0s p(95)=0s http_req_duration..............: avg=541.38ms min=262.55ms med=531.66ms max=1.01s p(90)=676.25ms p(95)=736.48ms { expected_response:true }...: avg=541.38ms min=262.55ms med=531.66ms max=1.01s p(90)=676.25ms p(95)=736.48ms http_req_failed................: 0.00% ✓ 0 ✗ 4987 http_req_receiving.............: avg=17.19ms min=36.82µs med=79.8µs max=442.77ms p(90)=60.09ms p(95)=107.17ms http_req_sending...............: avg=1.7ms min=8.46µs med=13.71µs max=307.65ms p(90)=35.26µs p(95)=335.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=522.48ms min=262.46ms med=516.89ms max=865.01ms p(90)=645.02ms p(95)=677.91ms http_reqs......................: 4987 163.211491/s iteration_duration.............: avg=607.11ms min=299.9ms med=590.74ms max=1.42s p(90)=779.89ms p(95)=845.13ms iterations.....................: 4987 163.211491/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9780 ✗ 0 data_received..................: 286 MB 9.2 MB/s data_sent......................: 3.9 MB 125 kB/s http_req_blocked...............: avg=53.19µs min=1.39µs med=2.63µs max=47.76ms p(90)=3.83µs p(95)=5.09µs http_req_connecting............: avg=19.77µs min=0s med=0s max=2.21ms p(90)=0s p(95)=0s http_req_duration..............: avg=901.77ms min=537.72ms med=902.59ms max=1.31s p(90)=1.03s p(95)=1.08s { expected_response:true }...: avg=901.77ms min=537.72ms med=902.59ms max=1.31s p(90)=1.03s p(95)=1.08s http_req_failed................: 0.00% ✓ 0 ✗ 3260 http_req_receiving.............: avg=10.97ms min=40.94µs med=82.82µs max=364.8ms p(90)=32.63ms p(95)=67.26ms http_req_sending...............: avg=828.8µs min=7.58µs med=12.87µs max=157.42ms p(90)=34.88µs p(95)=146.82µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=889.97ms min=537.23ms med=893.9ms max=1.2s p(90)=1.01s p(95)=1.04s http_reqs......................: 3260 105.039948/s iteration_duration.............: avg=938.55ms min=560.26ms med=938.96ms max=1.36s p(90)=1.07s p(95)=1.12s iterations.....................: 3260 105.039948/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9039 ✗ 0 data_received..................: 264 MB 8.6 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=22.84µs min=1.63µs med=3.29µs max=3.69ms p(90)=5.25µs p(95)=10.31µs http_req_connecting............: avg=16.19µs min=0s med=0s max=2.04ms p(90)=0s p(95)=0s http_req_duration..............: avg=967.99ms min=409.74ms med=950.08ms max=2.01s p(90)=1.27s p(95)=1.39s { expected_response:true }...: avg=967.99ms min=409.74ms med=950.08ms max=2.01s p(90)=1.27s p(95)=1.39s http_req_failed................: 0.00% ✓ 0 ✗ 3013 http_req_receiving.............: avg=15.69ms min=40.1µs med=93.11µs max=654.03ms p(90)=20.03ms p(95)=96.9ms http_req_sending...............: avg=624.86µs min=8.67µs med=15.58µs max=206.75ms p(90)=49.06µs p(95)=190.64µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=951.68ms min=403.47ms med=933.06ms max=1.92s p(90)=1.24s p(95)=1.35s http_reqs......................: 3013 98.289335/s iteration_duration.............: avg=1s min=421.24ms med=984.68ms max=2.09s p(90)=1.33s p(95)=1.45s iterations.....................: 3013 98.289335/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7524 ✗ 0 data_received..................: 220 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=30.68µs min=1.53µs med=2.79µs max=2.32ms p(90)=4.38µs p(95)=10.1µs http_req_connecting............: avg=24.36µs min=0s med=0s max=2.29ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=692.79ms med=1.17s max=1.72s p(90)=1.37s p(95)=1.44s { expected_response:true }...: avg=1.17s min=692.79ms med=1.17s max=1.72s p(90)=1.37s p(95)=1.44s http_req_failed................: 0.00% ✓ 0 ✗ 2508 http_req_receiving.............: avg=16.59ms min=41.33µs med=87.62µs max=341.18ms p(90)=55.8ms p(95)=113.66ms http_req_sending...............: avg=1.95ms min=7.91µs med=13.38µs max=389.42ms p(90)=72.84µs p(95)=779.02µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=692.67ms med=1.16s max=1.67s p(90)=1.33s p(95)=1.38s http_reqs......................: 2508 80.784381/s iteration_duration.............: avg=1.22s min=704.6ms med=1.21s max=1.73s p(90)=1.43s p(95)=1.5s iterations.....................: 2508 80.784381/s vus............................: 29 min=29 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5973 ✗ 0 data_received..................: 175 MB 5.6 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=152.56µs min=1.29µs med=3.58µs max=14.18ms p(90)=5.49µs p(95)=104.56µs http_req_connecting............: avg=127.78µs min=0s med=0s max=12.66ms p(90)=0s p(95)=30.79µs http_req_duration..............: avg=1.5s min=601.34ms med=1.48s max=3.38s p(90)=1.91s p(95)=2.18s { expected_response:true }...: avg=1.5s min=601.34ms med=1.48s max=3.38s p(90)=1.91s p(95)=2.18s http_req_failed................: 0.00% ✓ 0 ✗ 1991 http_req_receiving.............: avg=1.43ms min=38.58µs med=108.75µs max=83.48ms p(90)=1.31ms p(95)=6.21ms http_req_sending...............: avg=338.43µs min=7.99µs med=18.69µs max=106.68ms p(90)=36.77µs p(95)=201.73µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.5s min=578.69ms med=1.48s max=3.38s p(90)=1.91s p(95)=2.18s http_reqs......................: 1991 64.240669/s iteration_duration.............: avg=1.53s min=687.76ms med=1.5s max=3.39s p(90)=1.95s p(95)=2.22s iterations.....................: 1991 64.240669/s vus............................: 1 min=1 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5766 ✗ 0 data_received..................: 169 MB 5.5 MB/s data_sent......................: 2.3 MB 74 kB/s http_req_blocked...............: avg=32.33µs min=1.67µs med=3.66µs max=1.97ms p(90)=5.65µs p(95)=98.03µs http_req_connecting............: avg=25.67µs min=0s med=0s max=1.94ms p(90)=0s p(95)=65.68µs http_req_duration..............: avg=1.56s min=695.19ms med=1.48s max=9.82s p(90)=1.79s p(95)=1.93s { expected_response:true }...: avg=1.56s min=695.19ms med=1.48s max=9.82s p(90)=1.79s p(95)=1.93s http_req_failed................: 0.00% ✓ 0 ✗ 1922 http_req_receiving.............: avg=349.49µs min=50.18µs med=115.25µs max=40.83ms p(90)=192.59µs p(95)=298.37µs http_req_sending...............: avg=64.18µs min=8.9µs med=19.37µs max=20.83ms p(90)=36.57µs p(95)=132.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.56s min=694.99ms med=1.48s max=9.82s p(90)=1.79s p(95)=1.93s http_reqs......................: 1922 62.109868/s iteration_duration.............: avg=1.58s min=702.93ms med=1.5s max=9.84s p(90)=1.81s p(95)=1.95s iterations.....................: 1922 62.109868/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1425 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 564 kB 15 kB/s http_req_blocked...............: avg=185.97µs min=1.77µs med=4.29µs max=7.49ms p(90)=719.46µs p(95)=1.12ms http_req_connecting............: avg=165.77µs min=0s med=0s max=7.47ms p(90)=564.96µs p(95)=1.07ms http_req_duration..............: avg=7.12s min=2.8s med=7.43s max=8.6s p(90)=8.21s p(95)=8.31s { expected_response:true }...: avg=7.12s min=2.8s med=7.43s max=8.6s p(90)=8.21s p(95)=8.31s http_req_failed................: 0.00% ✓ 0 ✗ 475 http_req_receiving.............: avg=139.19µs min=60.08µs med=126.73µs max=654.48µs p(90)=187.82µs p(95)=214.44µs http_req_sending...............: avg=99.36µs min=10.17µs med=23.19µs max=824.7µs p(90)=364.73µs p(95)=607.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.12s min=2.8s med=7.43s max=8.6s p(90)=8.21s p(95)=8.31s http_reqs......................: 475 12.728721/s iteration_duration.............: avg=7.13s min=2.81s med=7.44s max=8.61s p(90)=8.22s p(95)=8.32s iterations.....................: 475 12.728721/s vus............................: 8 min=8 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 177 5407 total, 0 failed avg: 504ms, p95: 644ms ✅
apollo-router 166 5074 total, 0 failed avg: 557ms, p95: 721ms ✅
wundergraph 155 4719 total, 0 failed avg: 553ms, p95: 1016ms ✅
mesh-supergraph-bun 97 2992 total, 0 failed avg: 984ms, p95: 1692ms ✅
apollo-server 48 1521 total, 0 failed avg: 2016ms, p95: 2646ms ✅
mercurius 31 966 total, 0 failed avg: 3130ms, p95: 4421ms ✅
mesh-supergraph 28 906 total, 0 failed avg: 3401ms, p95: 5717ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16221 ✗ 0 data_received..................: 474 MB 16 MB/s data_sent......................: 6.4 MB 211 kB/s http_req_blocked...............: avg=69.74µs min=1.39µs med=2.67µs max=8.17ms p(90)=4.2µs p(95)=5.25µs http_req_connecting............: avg=30.7µs min=0s med=0s max=5.53ms p(90)=0s p(95)=0s http_req_duration..............: avg=503.99ms min=90.52ms med=502.73ms max=1.32s p(90)=600.8ms p(95)=644.33ms { expected_response:true }...: avg=503.99ms min=90.52ms med=502.73ms max=1.32s p(90)=600.8ms p(95)=644.33ms http_req_failed................: 0.00% ✓ 0 ✗ 5407 http_req_receiving.............: avg=16.67ms min=36.17µs med=75.41µs max=758.82ms p(90)=38.04ms p(95)=98.82ms http_req_sending...............: avg=1.44ms min=8.19µs med=12.88µs max=587.86ms p(90)=33.66µs p(95)=211.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=485.87ms min=74.61ms med=494.64ms max=841.89ms p(90)=574.86ms p(95)=599.77ms http_reqs......................: 5407 177.559526/s iteration_duration.............: avg=559.93ms min=120.52ms med=538.6ms max=1.47s p(90)=699.07ms p(95)=804.86ms iterations.....................: 5407 177.559526/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15222 ✗ 0 data_received..................: 445 MB 15 MB/s data_sent......................: 6.0 MB 198 kB/s http_req_blocked...............: avg=18.48µs min=1.35µs med=2.98µs max=6.13ms p(90)=4.71µs p(95)=5.84µs http_req_connecting............: avg=11.81µs min=0s med=0s max=1.91ms p(90)=0s p(95)=0s http_req_duration..............: avg=557.1ms min=193.25ms med=555.11ms max=1.08s p(90)=680.08ms p(95)=720.68ms { expected_response:true }...: avg=557.1ms min=193.25ms med=555.11ms max=1.08s p(90)=680.08ms p(95)=720.68ms http_req_failed................: 0.00% ✓ 0 ✗ 5074 http_req_receiving.............: avg=6.94ms min=36.76µs med=72.96µs max=489.5ms p(90)=8.1ms p(95)=53.19ms http_req_sending...............: avg=1.05ms min=8.03µs med=14.1µs max=413.19ms p(90)=45.36µs p(95)=165.21µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=549.09ms min=147.52ms med=550.04ms max=898.2ms p(90)=664.43ms p(95)=699.54ms http_reqs......................: 5074 166.727354/s iteration_duration.............: avg=595.63ms min=202.56ms med=589.26ms max=1.39s p(90)=736.08ms p(95)=783.08ms iterations.....................: 5074 166.727354/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14157 ✗ 0 data_received..................: 414 MB 14 MB/s data_sent......................: 5.6 MB 184 kB/s http_req_blocked...............: avg=99.54µs min=1.35µs med=2.98µs max=237.92ms p(90)=4.85µs p(95)=6.26µs http_req_connecting............: avg=21.86µs min=0s med=0s max=3.6ms p(90)=0s p(95)=0s http_req_duration..............: avg=552.72ms min=26ms med=517.25ms max=1.97s p(90)=877.67ms p(95)=1.01s { expected_response:true }...: avg=552.72ms min=26ms med=517.25ms max=1.97s p(90)=877.67ms p(95)=1.01s http_req_failed................: 0.00% ✓ 0 ✗ 4719 http_req_receiving.............: avg=52.68ms min=40.74µs med=103.89µs max=1.35s p(90)=163.37ms p(95)=349.2ms http_req_sending...............: avg=2.4ms min=7.59µs med=14.36µs max=748.82ms p(90)=47.52µs p(95)=776.02µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=497.63ms min=25.92ms med=476.34ms max=1.29s p(90)=767.33ms p(95)=879.43ms http_reqs......................: 4719 155.22616/s iteration_duration.............: avg=640.57ms min=41.16ms med=582.45ms max=3.41s p(90)=1.04s p(95)=1.23s iterations.....................: 4719 155.22616/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8976 ✗ 0 data_received..................: 263 MB 8.5 MB/s data_sent......................: 3.6 MB 116 kB/s http_req_blocked...............: avg=48.12µs min=1.32µs med=2.85µs max=3.81ms p(90)=4.56µs p(95)=8.99µs http_req_connecting............: avg=43.24µs min=0s med=0s max=3.75ms p(90)=0s p(95)=0s http_req_duration..............: avg=984.33ms min=453.6ms med=854.77ms max=2.48s p(90)=1.59s p(95)=1.69s { expected_response:true }...: avg=984.33ms min=453.6ms med=854.77ms max=2.48s p(90)=1.59s p(95)=1.69s http_req_failed................: 0.00% ✓ 0 ✗ 2992 http_req_receiving.............: avg=11.26ms min=37.71µs med=82.59µs max=649.57ms p(90)=1.56ms p(95)=51.19ms http_req_sending...............: avg=486.3µs min=8.07µs med=13.63µs max=115.8ms p(90)=37.07µs p(95)=280.63µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=972.58ms min=453.51ms med=849.66ms max=2.48s p(90)=1.56s p(95)=1.68s http_reqs......................: 2992 97.328135/s iteration_duration.............: avg=1.01s min=465ms med=888.03ms max=2.51s p(90)=1.61s p(95)=1.74s iterations.....................: 2992 97.328135/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4563 ✗ 0 data_received..................: 134 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=101.77µs min=1.57µs med=3.79µs max=4.67ms p(90)=6.12µs p(95)=336.57µs http_req_connecting............: avg=94.77µs min=0s med=0s max=4.64ms p(90)=0s p(95)=310.07µs http_req_duration..............: avg=2.01s min=403.4ms med=1.71s max=21.59s p(90)=2.03s p(95)=2.64s { expected_response:true }...: avg=2.01s min=403.4ms med=1.71s max=21.59s p(90)=2.03s p(95)=2.64s http_req_failed................: 0.00% ✓ 0 ✗ 1521 http_req_receiving.............: avg=163.42µs min=55.31µs med=133.27µs max=15.59ms p(90)=189.03µs p(95)=217.07µs http_req_sending...............: avg=58.44µs min=8.84µs med=19.86µs max=7.76ms p(90)=38.95µs p(95)=125.67µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.01s min=403.25ms med=1.71s max=21.59s p(90)=2.03s p(95)=2.64s http_reqs......................: 1521 48.49052/s iteration_duration.............: avg=2.02s min=414.76ms med=1.72s max=21.6s p(90)=2.05s p(95)=2.66s iterations.....................: 1521 48.49052/s vus............................: 45 min=45 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2898 ✗ 0 data_received..................: 85 MB 2.8 MB/s data_sent......................: 1.1 MB 38 kB/s http_req_blocked...............: avg=77.99µs min=1.71µs med=3.95µs max=8.12ms p(90)=105.88µs p(95)=371.73µs http_req_connecting............: avg=59.08µs min=0s med=0s max=7.49ms p(90)=67.52µs p(95)=318.99µs http_req_duration..............: avg=3.12s min=565.48ms med=2.96s max=7.7s p(90)=4.1s p(95)=4.42s { expected_response:true }...: avg=3.12s min=565.48ms med=2.96s max=7.7s p(90)=4.1s p(95)=4.42s http_req_failed................: 0.00% ✓ 0 ✗ 966 http_req_receiving.............: avg=199.11µs min=41.8µs med=121.8µs max=55.45ms p(90)=192.16µs p(95)=250.16µs http_req_sending...............: avg=48.4µs min=8.69µs med=21.62µs max=6.1ms p(90)=41.72µs p(95)=153.78µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.12s min=565.23ms med=2.96s max=7.7s p(90)=4.1s p(95)=4.42s http_reqs......................: 966 31.575019/s iteration_duration.............: avg=3.14s min=575.68ms med=2.97s max=7.7s p(90)=4.11s p(95)=4.43s iterations.....................: 966 31.575019/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2718 ✗ 0 data_received..................: 80 MB 2.5 MB/s data_sent......................: 1.1 MB 34 kB/s http_req_blocked...............: avg=157.99µs min=1.75µs med=4.7µs max=3.57ms p(90)=120.96µs p(95)=1.44ms http_req_connecting............: avg=144.46µs min=0s med=0s max=3.47ms p(90)=87.53µs p(95)=1.36ms http_req_duration..............: avg=3.4s min=795.17ms med=3.27s max=7.33s p(90)=4.83s p(95)=5.71s { expected_response:true }...: avg=3.4s min=795.17ms med=3.27s max=7.33s p(90)=4.83s p(95)=5.71s http_req_failed................: 0.00% ✓ 0 ✗ 906 http_req_receiving.............: avg=3.07ms min=47.12µs med=160.68µs max=90.7ms p(90)=1.78ms p(95)=7.34ms http_req_sending...............: avg=88.28µs min=8.95µs med=28.24µs max=26.52ms p(90)=73.74µs p(95)=194.25µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.39s min=795.02ms med=3.27s max=7.33s p(90)=4.83s p(95)=5.71s http_reqs......................: 906 28.538575/s iteration_duration.............: avg=3.41s min=801.28ms med=3.28s max=7.35s p(90)=4.85s p(95)=5.74s iterations.....................: 906 28.538575/s vus............................: 42 min=42 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 147 4522 total, 0 failed avg: 619ms, p95: 813ms ✅
wundergraph 101 3144 total, 0 failed avg: 936ms, p95: 1176ms ✅
mesh-supergraph-bun 81 2500 total, 0 failed avg: 1184ms, p95: 1816ms ✅
cosmo 79 2485 total, 0 failed avg: 1201ms, p95: 1438ms ✅
apollo-server 47 1470 total, 0 failed avg: 2070ms, p95: 2493ms ✅
mesh-supergraph 28 898 total, 0 failed avg: 3417ms, p95: 5609ms ✅
mercurius 11 450 total, 0 failed avg: 7567ms, p95: 8979ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13566 ✗ 0 data_received..................: 397 MB 13 MB/s data_sent......................: 5.4 MB 176 kB/s http_req_blocked...............: avg=72.85µs min=1.47µs med=2.96µs max=120.69ms p(90)=4.48µs p(95)=5.7µs http_req_connecting............: avg=37.59µs min=0s med=0s max=6.49ms p(90)=0s p(95)=0s http_req_duration..............: avg=619.13ms min=323.06ms med=604.74ms max=1.19s p(90)=757.57ms p(95)=813.04ms { expected_response:true }...: avg=619.13ms min=323.06ms med=604.74ms max=1.19s p(90)=757.57ms p(95)=813.04ms http_req_failed................: 0.00% ✓ 0 ✗ 4522 http_req_receiving.............: avg=13.16ms min=38.93µs med=76.82µs max=432.59ms p(90)=50.01ms p(95)=94ms http_req_sending...............: avg=1.19ms min=8.56µs med=14.09µs max=308.42ms p(90)=39.28µs p(95)=316.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=604.77ms min=322.94ms med=596.4ms max=991.64ms p(90)=734.83ms p(95)=774.61ms http_reqs......................: 4522 147.833887/s iteration_duration.............: avg=669.5ms min=333.47ms med=648.63ms max=1.24s p(90)=832.69ms p(95)=914.46ms iterations.....................: 4522 147.833887/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9432 ✗ 0 data_received..................: 276 MB 8.9 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=25.96µs min=1.6µs med=3.27µs max=2.33ms p(90)=5.08µs p(95)=9.67µs http_req_connecting............: avg=20.88µs min=0s med=0s max=2.29ms p(90)=0s p(95)=0s http_req_duration..............: avg=935.51ms min=560.18ms med=916.09ms max=1.83s p(90)=1.09s p(95)=1.17s { expected_response:true }...: avg=935.51ms min=560.18ms med=916.09ms max=1.83s p(90)=1.09s p(95)=1.17s http_req_failed................: 0.00% ✓ 0 ✗ 3144 http_req_receiving.............: avg=9.29ms min=42.52µs med=88.87µs max=455.35ms p(90)=16.94ms p(95)=50.84ms http_req_sending...............: avg=978.56µs min=7.48µs med=15.14µs max=141.73ms p(90)=51.93µs p(95)=305.95µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=925.24ms min=558.61ms med=910.88ms max=1.38s p(90)=1.08s p(95)=1.14s http_reqs......................: 3144 101.617593/s iteration_duration.............: avg=967.68ms min=592.5ms med=947.4ms max=1.88s p(90)=1.13s p(95)=1.22s iterations.....................: 3144 101.617593/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7500 ✗ 0 data_received..................: 219 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=62.92µs min=1.83µs med=4.12µs max=29.26ms p(90)=6.25µs p(95)=13.08µs http_req_connecting............: avg=36.31µs min=0s med=0s max=7.7ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.18s min=518.75ms med=1.13s max=2.47s p(90)=1.58s p(95)=1.81s { expected_response:true }...: avg=1.18s min=518.75ms med=1.13s max=2.47s p(90)=1.58s p(95)=1.81s http_req_failed................: 0.00% ✓ 0 ✗ 2500 http_req_receiving.............: avg=17.19ms min=42.51µs med=105.06µs max=673.24ms p(90)=11.52ms p(95)=92.05ms http_req_sending...............: avg=443.47µs min=8.95µs med=20.1µs max=138.89ms p(90)=55.65µs p(95)=194.91µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=518.46ms med=1.11s max=2.35s p(90)=1.56s p(95)=1.8s http_reqs......................: 2500 81.057145/s iteration_duration.............: avg=1.21s min=528.17ms med=1.16s max=2.53s p(90)=1.61s p(95)=1.83s iterations.....................: 2500 81.057145/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7455 ✗ 0 data_received..................: 218 MB 7.0 MB/s data_sent......................: 2.9 MB 95 kB/s http_req_blocked...............: avg=83.43µs min=1.41µs med=2.82µs max=5.98ms p(90)=4.54µs p(95)=10.14µs http_req_connecting............: avg=75.45µs min=0s med=0s max=4.68ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=670.71ms med=1.19s max=1.71s p(90)=1.38s p(95)=1.43s { expected_response:true }...: avg=1.2s min=670.71ms med=1.19s max=1.71s p(90)=1.38s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2485 http_req_receiving.............: avg=11.58ms min=39.3µs med=89.99µs max=397.15ms p(90)=37.15ms p(95)=76.91ms http_req_sending...............: avg=1.56ms min=8.07µs med=13.04µs max=265.41ms p(90)=53.64µs p(95)=686.34µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=670.48ms med=1.18s max=1.54s p(90)=1.37s p(95)=1.4s http_reqs......................: 2485 79.810521/s iteration_duration.............: avg=1.23s min=701.61ms med=1.22s max=1.82s p(90)=1.44s p(95)=1.51s iterations.....................: 2485 79.810521/s vus............................: 50 min=50 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4410 ✗ 0 data_received..................: 129 MB 4.1 MB/s data_sent......................: 1.7 MB 56 kB/s http_req_blocked...............: avg=31.44µs min=1.68µs med=4.29µs max=2.31ms p(90)=6.39µs p(95)=134.83µs http_req_connecting............: avg=16.57µs min=0s med=0s max=984.25µs p(90)=0s p(95)=99.12µs http_req_duration..............: avg=2.06s min=867.82ms med=1.83s max=14.91s p(90)=2.26s p(95)=2.49s { expected_response:true }...: avg=2.06s min=867.82ms med=1.83s max=14.91s p(90)=2.26s p(95)=2.49s http_req_failed................: 0.00% ✓ 0 ✗ 1470 http_req_receiving.............: avg=149.68µs min=48.85µs med=126.99µs max=7.05ms p(90)=186.94µs p(95)=229.51µs http_req_sending...............: avg=36.64µs min=9.32µs med=23.34µs max=3.82ms p(90)=40.12µs p(95)=104.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.06s min=867.67ms med=1.83s max=14.91s p(90)=2.26s p(95)=2.49s http_reqs......................: 1470 47.078156/s iteration_duration.............: avg=2.08s min=875.38ms med=1.84s max=14.92s p(90)=2.27s p(95)=2.5s iterations.....................: 1470 47.078156/s vus............................: 27 min=27 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2694 ✗ 0 data_received..................: 79 MB 2.5 MB/s data_sent......................: 1.1 MB 34 kB/s http_req_blocked...............: avg=262.94µs min=1.26µs med=4.48µs max=6.8ms p(90)=302.58µs p(95)=1.86ms http_req_connecting............: avg=247.52µs min=0s med=0s max=6.74ms p(90)=235.6µs p(95)=1.77ms http_req_duration..............: avg=3.41s min=1.29s med=3.27s max=6.88s p(90)=4.5s p(95)=5.6s { expected_response:true }...: avg=3.41s min=1.29s med=3.27s max=6.88s p(90)=4.5s p(95)=5.6s http_req_failed................: 0.00% ✓ 0 ✗ 898 http_req_receiving.............: avg=3.49ms min=42.79µs med=170.17µs max=124.35ms p(90)=2.29ms p(95)=13ms http_req_sending...............: avg=145.94µs min=7.56µs med=24.57µs max=11.24ms p(90)=462.31µs p(95)=889.36µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.41s min=1.29s med=3.27s max=6.88s p(90)=4.5s p(95)=5.6s http_reqs......................: 898 28.416079/s iteration_duration.............: avg=3.43s min=1.29s med=3.28s max=6.89s p(90)=4.52s p(95)=5.63s iterations.....................: 898 28.416079/s vus............................: 41 min=41 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1350 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 534 kB 14 kB/s http_req_blocked...............: avg=888.15µs min=1.49µs med=3.29µs max=13.79ms p(90)=2.91ms p(95)=7.28ms http_req_connecting............: avg=811.81µs min=0s med=0s max=11.29ms p(90)=2.54ms p(95)=7.05ms http_req_duration..............: avg=7.56s min=3.62s med=7.78s max=9.51s p(90)=8.86s p(95)=8.97s { expected_response:true }...: avg=7.56s min=3.62s med=7.78s max=9.51s p(90)=8.86s p(95)=8.97s http_req_failed................: 0.00% ✓ 0 ✗ 450 http_req_receiving.............: avg=134.94µs min=54.19µs med=115.89µs max=1.02ms p(90)=188.09µs p(95)=233.77µs http_req_sending...............: avg=713.19µs min=9.49µs med=19.85µs max=10.43ms p(90)=3.77ms p(95)=4.65ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.56s min=3.62s med=7.78s max=9.51s p(90)=8.86s p(95)=8.97s http_reqs......................: 450 11.984045/s iteration_duration.............: avg=7.57s min=3.63s med=7.79s max=9.52s p(90)=8.87s p(95)=8.98s iterations.....................: 450 11.984045/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
wundergraph 2374ms 163 11449 total, 0 failed avg: 851ms, p95: 2374ms, max: 5307ms, med: 649ms ✅
cosmo 2410ms 175 12256 total, 0 failed avg: 779ms, p95: 2410ms, max: 6121ms, med: 473ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
apollo-router 2913ms 173 12156 total, 0 failed avg: 865ms, p95: 2913ms, max: 9892ms, med: 502ms ✅
mesh-supergraph-bun 5422ms 114 7985 total, 0 failed avg: 2274ms, p95: 5423ms, max: 9339ms, med: 2073ms ✅
mesh-supergraph 6431ms 69 4902 total, 0 failed avg: 3882ms, p95: 6432ms, max: 7962ms, med: 4085ms ✅
apollo-server 24015ms 68 4993 total, 0 failed avg: 4189ms, p95: 24016ms, max: 45214ms, med: 2255ms ✅
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34347 ✗ 0 data_received..................: 1.0 GB 14 MB/s data_sent......................: 14 MB 194 kB/s http_req_blocked...............: avg=24.97ms min=1.52µs med=3.22µs max=3.55s p(90)=5.32µs p(95)=19.37µs http_req_connecting............: avg=24.07ms min=0s med=0s max=3.55s p(90)=0s p(95)=0s http_req_duration..............: avg=850.69ms min=7.05ms med=648.96ms max=5.3s p(90)=1.92s p(95)=2.37s { expected_response:true }...: avg=850.69ms min=7.05ms med=648.96ms max=5.3s p(90)=1.92s p(95)=2.37s http_req_failed................: 0.00% ✓ 0 ✗ 11449 http_req_receiving.............: avg=253.16ms min=34.79µs med=85.57µs max=4.93s p(90)=1.08s p(95)=1.66s http_req_sending...............: avg=39.8ms min=8.29µs med=15.23µs max=3.89s p(90)=285.1µs p(95)=113.13ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=557.72ms min=6.96ms med=360.01ms max=3.98s p(90)=1.27s p(95)=1.54s http_reqs......................: 11449 163.527052/s iteration_duration.............: avg=1.61s min=12.82ms med=1.21s max=10.19s p(90)=3.66s p(95)=4.5s iterations.....................: 11449 163.527052/s vus............................: 1 min=1 max=486 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12255 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 12255 / ✗ 1 checks.........................: 99.99% ✓ 36766 ✗ 2 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=15.58ms min=1.35µs med=2.86µs max=4.63s p(90)=4.62µs p(95)=11.83µs http_req_connecting............: avg=14.33ms min=0s med=0s max=3.74s p(90)=0s p(95)=0s http_req_duration..............: avg=778.63ms min=6.63ms med=472.57ms max=6.12s p(90)=1.87s p(95)=2.41s { expected_response:true }...: avg=778.63ms min=6.63ms med=472.57ms max=6.12s p(90)=1.87s p(95)=2.41s http_req_failed................: 0.00% ✓ 0 ✗ 12256 http_req_receiving.............: avg=293.56ms min=30.49µs med=78.13µs max=5.16s p(90)=1.15s p(95)=1.65s http_req_sending...............: avg=39.89ms min=7.94µs med=13.73µs max=3.63s p(90)=751.99µs p(95)=108.76ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=445.18ms min=6.56ms med=326.61ms max=3.24s p(90)=952.91ms p(95)=1.24s http_reqs......................: 12256 175.066416/s iteration_duration.............: avg=1.49s min=12ms med=970.61ms max=13.48s p(90)=3.57s p(95)=4.5s iterations.....................: 12256 175.066416/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36468 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 206 kB/s http_req_blocked...............: avg=15.68ms min=1.64µs med=3.12µs max=4.26s p(90)=5.3µs p(95)=12.81µs http_req_connecting............: avg=14.86ms min=0s med=0s max=4.26s p(90)=0s p(95)=0s http_req_duration..............: avg=865.26ms min=6.6ms med=501.79ms max=9.89s p(90)=2.2s p(95)=2.91s { expected_response:true }...: avg=865.26ms min=6.6ms med=501.79ms max=9.89s p(90)=2.2s p(95)=2.91s http_req_failed................: 0.00% ✓ 0 ✗ 12156 http_req_receiving.............: avg=406.01ms min=30.88µs med=87.05µs max=9.11s p(90)=1.45s p(95)=2.28s http_req_sending...............: avg=30.03ms min=8.03µs med=14.73µs max=5.07s p(90)=166.69µs p(95)=37.08ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=429.22ms min=6.5ms med=371.76ms max=2.28s p(90)=794.72ms p(95)=961.24ms http_reqs......................: 12156 173.629521/s iteration_duration.............: avg=1.52s min=12.15ms med=871.61ms max=18.14s p(90)=3.76s p(95)=4.93s iterations.....................: 12156 173.629521/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 23955 ✗ 0 data_received..................: 701 MB 10 MB/s data_sent......................: 9.5 MB 135 kB/s http_req_blocked...............: avg=2.25ms min=1.7µs med=3.42µs max=462.14ms p(90)=6.15µs p(95)=223.11µs http_req_connecting............: avg=2.18ms min=0s med=0s max=462.07ms p(90)=0s p(95)=149.55µs http_req_duration..............: avg=2.27s min=6.27ms med=2.07s max=9.33s p(90)=4.39s p(95)=5.42s { expected_response:true }...: avg=2.27s min=6.27ms med=2.07s max=9.33s p(90)=4.39s p(95)=5.42s http_req_failed................: 0.00% ✓ 0 ✗ 7985 http_req_receiving.............: avg=32.31ms min=39.02µs med=83.83µs max=1.75s p(90)=26.78ms p(95)=211.5ms http_req_sending...............: avg=3.22ms min=8.64µs med=16.36µs max=985.36ms p(90)=122.48µs p(95)=11.47ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.23s min=6.06ms med=2.01s max=9.33s p(90)=4.32s p(95)=5.39s http_reqs......................: 7985 114.053137/s iteration_duration.............: avg=2.35s min=13.24ms med=2.16s max=9.59s p(90)=4.54s p(95)=5.57s iterations.....................: 7985 114.053137/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14706 ✗ 0 data_received..................: 430 MB 6.1 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=273.32µs min=1.4µs med=3.67µs max=64.58ms p(90)=157.39µs p(95)=408.86µs http_req_connecting............: avg=259.47µs min=0s med=0s max=64.5ms p(90)=104.81µs p(95)=337.23µs http_req_duration..............: avg=3.88s min=13.26ms med=4.08s max=7.96s p(90)=6.07s p(95)=6.43s { expected_response:true }...: avg=3.88s min=13.26ms med=4.08s max=7.96s p(90)=6.07s p(95)=6.43s http_req_failed................: 0.00% ✓ 0 ✗ 4902 http_req_receiving.............: avg=1.79ms min=38.96µs med=99.25µs max=429.1ms p(90)=1.16ms p(95)=7.15ms http_req_sending...............: avg=226.02µs min=8.43µs med=18.84µs max=63.45ms p(90)=47.35µs p(95)=77.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.87s min=13.16ms med=4.08s max=7.96s p(90)=6.07s p(95)=6.43s http_reqs......................: 4902 69.968675/s iteration_duration.............: avg=3.9s min=22.59ms med=4.11s max=7.98s p(90)=6.08s p(95)=6.46s iterations.....................: 4902 69.968675/s vus............................: 2 min=2 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14979 ✗ 0 data_received..................: 439 MB 6.0 MB/s data_sent......................: 5.9 MB 81 kB/s http_req_blocked...............: avg=94.44µs min=1.41µs med=3.5µs max=26.08ms p(90)=164.61µs p(95)=314.29µs http_req_connecting............: avg=60.54µs min=0s med=0s max=26ms p(90)=41.97µs p(95)=188.87µs http_req_duration..............: avg=4.18s min=105.96ms med=2.25s max=45.21s p(90)=3.48s p(95)=24.01s { expected_response:true }...: avg=4.18s min=105.96ms med=2.25s max=45.21s p(90)=3.48s p(95)=24.01s http_req_failed................: 0.00% ✓ 0 ✗ 4993 http_req_receiving.............: avg=403.27µs min=45.91µs med=117.66µs max=327.78ms p(90)=179.51µs p(95)=207.16µs http_req_sending...............: avg=68.71µs min=8.66µs med=18.75µs max=35.15ms p(90)=42.33µs p(95)=63.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.18s min=105.81ms med=2.25s max=45.21s p(90)=3.48s p(95)=24.01s http_reqs......................: 4993 68.097991/s iteration_duration.............: avg=4.2s min=115.71ms med=2.26s max=45.22s p(90)=3.48s p(95)=24.03s iterations.....................: 4993 68.097991/s vus............................: 30 min=30 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview