search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @graphql-mesh/graphql to v0.97.4 #399

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/graphql (source) 0.97.3 -> 0.97.4 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/graphql) ### [`v0.97.4`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/graphql/CHANGELOG.md#0974) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/graphql@0.97.3...103621c913f20849d97184a1f87a5127a3d8a1ca) ##### Patch Changes - Updated dependencies \[[`e2fb7ed`](https://togithub.com/ardatan/graphql-mesh/commit/e2fb7edb8b02a53fa6f1b1f1fba629ea7c84488f), [`e2fb7ed`](https://togithub.com/ardatan/graphql-mesh/commit/e2fb7edb8b02a53fa6f1b1f1fba629ea7c84488f), [`ff33394`](https://togithub.com/ardatan/graphql-mesh/commit/ff3339451d8911f9b9265e158ad86844648ee12f)]: - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.4 - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.4 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.4

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4596 total, 0 failed avg: 609ms, p95: 804ms ✅
wundergraph 102 3154 total, 0 failed avg: 927ms, p95: 1194ms ✅
mesh-supergraph-bun 82 2542 total, 0 failed avg: 1172ms, p95: 1834ms ✅
cosmo 79 2493 total, 0 failed avg: 1192ms, p95: 1471ms ✅
apollo-server 46 1440 total, 0 failed avg: 2120ms, p95: 2539ms ✅
mesh-supergraph 30 956 total, 0 failed avg: 3232ms, p95: 5228ms ✅
mercurius 12 452 total, 0 failed avg: 7541ms, p95: 9127ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13788 ✗ 0 data_received..................: 403 MB 13 MB/s data_sent......................: 5.5 MB 179 kB/s http_req_blocked...............: avg=50.64µs min=1.13µs med=2.62µs max=88.06ms p(90)=4.12µs p(95)=5.13µs http_req_connecting............: avg=13.06µs min=0s med=0s max=3.01ms p(90)=0s p(95)=0s http_req_duration..............: avg=609.01ms min=330.88ms med=597.18ms max=1.15s p(90)=737.03ms p(95)=804.12ms { expected_response:true }...: avg=609.01ms min=330.88ms med=597.18ms max=1.15s p(90)=737.03ms p(95)=804.12ms http_req_failed................: 0.00% ✓ 0 ✗ 4596 http_req_receiving.............: avg=10.41ms min=34.4µs med=64.09µs max=429.74ms p(90)=20.14ms p(95)=66.89ms http_req_sending...............: avg=1.22ms min=7.11µs med=13.19µs max=330.03ms p(90)=37.92µs p(95)=258.3µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=597.37ms min=330.72ms med=590.66ms max=920.41ms p(90)=720.01ms p(95)=777.52ms http_reqs......................: 4596 150.457945/s iteration_duration.............: avg=658.59ms min=353.27ms med=642.87ms max=1.29s p(90)=826.5ms p(95)=893.92ms iterations.....................: 4596 150.457945/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9462 ✗ 0 data_received..................: 277 MB 9.0 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=97.78µs min=1.33µs med=2.59µs max=21.7ms p(90)=3.73µs p(95)=8.02µs http_req_connecting............: avg=81.17µs min=0s med=0s max=5.9ms p(90)=0s p(95)=0s http_req_duration..............: avg=926.69ms min=540.45ms med=906.58ms max=1.52s p(90)=1.11s p(95)=1.19s { expected_response:true }...: avg=926.69ms min=540.45ms med=906.58ms max=1.52s p(90)=1.11s p(95)=1.19s http_req_failed................: 0.00% ✓ 0 ✗ 3154 http_req_receiving.............: avg=8.85ms min=38.04µs med=76.44µs max=272.23ms p(90)=26.07ms p(95)=61.53ms http_req_sending...............: avg=1.25ms min=7.63µs med=12.97µs max=202.77ms p(90)=44.05µs p(95)=442.64µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=916.58ms min=539.69ms med=898.55ms max=1.41s p(90)=1.09s p(95)=1.17s http_reqs......................: 3154 102.075667/s iteration_duration.............: avg=962.68ms min=571.17ms med=942.56ms max=1.55s p(90)=1.16s p(95)=1.23s iterations.....................: 3154 102.075667/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7626 ✗ 0 data_received..................: 223 MB 7.3 MB/s data_sent......................: 3.0 MB 98 kB/s http_req_blocked...............: avg=131.63µs min=1.5µs med=3.03µs max=6.71ms p(90)=4.69µs p(95)=9.95µs http_req_connecting............: avg=125.21µs min=0s med=0s max=6.54ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=523.73ms med=1.1s max=2.33s p(90)=1.58s p(95)=1.83s { expected_response:true }...: avg=1.17s min=523.73ms med=1.1s max=2.33s p(90)=1.58s p(95)=1.83s http_req_failed................: 0.00% ✓ 0 ✗ 2542 http_req_receiving.............: avg=15.83ms min=39.66µs med=97.55µs max=753.36ms p(90)=3.66ms p(95)=64.08ms http_req_sending...............: avg=236.11µs min=7.95µs med=14.91µs max=97.48ms p(90)=44.37µs p(95)=138.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=523.46ms med=1.09s max=2.33s p(90)=1.56s p(95)=1.82s http_reqs......................: 2542 82.791193/s iteration_duration.............: avg=1.19s min=532.41ms med=1.13s max=2.42s p(90)=1.63s p(95)=1.86s iterations.....................: 2542 82.791193/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7479 ✗ 0 data_received..................: 219 MB 7.0 MB/s data_sent......................: 3.0 MB 95 kB/s http_req_blocked...............: avg=61.77µs min=1.31µs med=2.45µs max=4.97ms p(90)=3.79µs p(95)=9.07µs http_req_connecting............: avg=49.2µs min=0s med=0s max=3.74ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=723.65ms med=1.17s max=1.76s p(90)=1.4s p(95)=1.47s { expected_response:true }...: avg=1.19s min=723.65ms med=1.17s max=1.76s p(90)=1.4s p(95)=1.47s http_req_failed................: 0.00% ✓ 0 ✗ 2493 http_req_receiving.............: avg=11.29ms min=39.52µs med=76.07µs max=271.68ms p(90)=33.11ms p(95)=79.12ms http_req_sending...............: avg=1.59ms min=8.13µs med=12.66µs max=230.64ms p(90)=36.98µs p(95)=1.06ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.17s min=723.56ms med=1.17s max=1.61s p(90)=1.37s p(95)=1.41s http_reqs......................: 2493 79.730253/s iteration_duration.............: avg=1.22s min=738.77ms med=1.2s max=1.94s p(90)=1.45s p(95)=1.54s iterations.....................: 2493 79.730253/s vus............................: 20 min=20 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4320 ✗ 0 data_received..................: 127 MB 4.1 MB/s data_sent......................: 1.7 MB 55 kB/s http_req_blocked...............: avg=55.68µs min=1.68µs med=4.67µs max=5.43ms p(90)=6.62µs p(95)=175.94µs http_req_connecting............: avg=42.9µs min=0s med=0s max=2.83ms p(90)=0s p(95)=131.83µs http_req_duration..............: avg=2.11s min=957.38ms med=1.86s max=15.12s p(90)=2.34s p(95)=2.53s { expected_response:true }...: avg=2.11s min=957.38ms med=1.86s max=15.12s p(90)=2.34s p(95)=2.53s http_req_failed................: 0.00% ✓ 0 ✗ 1440 http_req_receiving.............: avg=252.41µs min=56.52µs med=129.4µs max=65.02ms p(90)=189.14µs p(95)=229.07µs http_req_sending...............: avg=37µs min=10.1µs med=26.84µs max=1.52ms p(90)=40.46µs p(95)=73.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.11s min=957.2ms med=1.86s max=15.12s p(90)=2.34s p(95)=2.53s http_reqs......................: 1440 46.094855/s iteration_duration.............: avg=2.13s min=965.02ms med=1.87s max=15.13s p(90)=2.36s p(95)=2.55s iterations.....................: 1440 46.094855/s vus............................: 17 min=17 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2868 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=287.11µs min=1.4µs med=3.6µs max=6.43ms p(90)=343.75µs p(95)=2.06ms http_req_connecting............: avg=278.64µs min=0s med=0s max=6.41ms p(90)=317.3µs p(95)=2.03ms http_req_duration..............: avg=3.23s min=1.28s med=3.06s max=6.89s p(90)=4.27s p(95)=5.22s { expected_response:true }...: avg=3.23s min=1.28s med=3.06s max=6.89s p(90)=4.27s p(95)=5.22s http_req_failed................: 0.00% ✓ 0 ✗ 956 http_req_receiving.............: avg=3.08ms min=40.43µs med=145.17µs max=82.48ms p(90)=1.74ms p(95)=11.03ms http_req_sending...............: avg=87.88µs min=8.53µs med=19.06µs max=21.44ms p(90)=106.37µs p(95)=311.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.22s min=1.21s med=3.06s max=6.89s p(90)=4.27s p(95)=5.22s http_reqs......................: 956 30.242153/s iteration_duration.............: avg=3.24s min=1.3s med=3.08s max=6.9s p(90)=4.28s p(95)=5.24s iterations.....................: 956 30.242153/s vus............................: 58 min=58 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1356 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 537 kB 14 kB/s http_req_blocked...............: avg=382.23µs min=1.4µs med=3.8µs max=4.34ms p(90)=1.81ms p(95)=3.05ms http_req_connecting............: avg=341.75µs min=0s med=0s max=4.2ms p(90)=1.5ms p(95)=2.82ms http_req_duration..............: avg=7.54s min=3.66s med=7.68s max=9.47s p(90)=8.86s p(95)=9.12s { expected_response:true }...: avg=7.54s min=3.66s med=7.68s max=9.47s p(90)=8.86s p(95)=9.12s http_req_failed................: 0.00% ✓ 0 ✗ 452 http_req_receiving.............: avg=138.61µs min=62.46µs med=123.56µs max=663.68µs p(90)=187.67µs p(95)=230.57µs http_req_sending...............: avg=148.28µs min=8.67µs med=20.74µs max=1.57ms p(90)=785.14µs p(95)=881.02µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.54s min=3.66s med=7.68s max=9.47s p(90)=8.86s p(95)=9.12s http_reqs......................: 452 12.00593/s iteration_duration.............: avg=7.54s min=3.67s med=7.69s max=9.48s p(90)=8.87s p(95)=9.13s iterations.....................: 452 12.00593/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 2315ms 168 11782 total, 0 failed avg: 819ms, p95: 2316ms, max: 6295ms, med: 532ms ✅
cosmo 2322ms 174 12184 total, 0 failed avg: 812ms, p95: 2323ms, max: 7237ms, med: 575ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
wundergraph 2946ms 164 11495 total, 0 failed avg: 848ms, p95: 2946ms, max: 8974ms, med: 487ms ✅
mesh-supergraph-bun 5560ms 117 8197 total, 0 failed avg: 2220ms, p95: 5561ms, max: 8424ms, med: 2144ms ✅
mesh-supergraph 6523ms 70 4920 total, 0 failed avg: 3858ms, p95: 6524ms, max: 8017ms, med: 4025ms ✅
apollo-server 24866ms 66 4863 total, 0 failed avg: 4304ms, p95: 24867ms, max: 45529ms, med: 2316ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35346 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 200 kB/s http_req_blocked...............: avg=14.61ms min=1.75µs med=3.3µs max=3.19s p(90)=5.52µs p(95)=13.64µs http_req_connecting............: avg=14.14ms min=0s med=0s max=3.19s p(90)=0s p(95)=0s http_req_duration..............: avg=818.76ms min=6.55ms med=532.48ms max=6.29s p(90)=1.91s p(95)=2.31s { expected_response:true }...: avg=818.76ms min=6.55ms med=532.48ms max=6.29s p(90)=1.91s p(95)=2.31s http_req_failed................: 0.00% ✓ 0 ✗ 11782 http_req_receiving.............: avg=274.34ms min=33.96µs med=85.78µs max=4.35s p(90)=1.1s p(95)=1.5s http_req_sending...............: avg=28.33ms min=8.51µs med=15.33µs max=4.37s p(90)=190.85µs p(95)=61.4ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=516.08ms min=6.47ms med=388.63ms max=2.77s p(90)=1.09s p(95)=1.39s http_reqs......................: 11782 168.305182/s iteration_duration.............: avg=1.55s min=12.72ms med=1.05s max=11.61s p(90)=3.68s p(95)=4.72s iterations.....................: 11782 168.305182/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12183 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 12183 / ✗ 1 checks.........................: 99.99% ✓ 36550 ✗ 2 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=19.26ms min=1.4µs med=2.89µs max=4.91s p(90)=4.53µs p(95)=11.3µs http_req_connecting............: avg=18.71ms min=0s med=0s max=4.91s p(90)=0s p(95)=0s http_req_duration..............: avg=812.49ms min=6.58ms med=575.46ms max=7.23s p(90)=1.79s p(95)=2.32s { expected_response:true }...: avg=812.49ms min=6.58ms med=575.46ms max=7.23s p(90)=1.79s p(95)=2.32s http_req_failed................: 0.00% ✓ 0 ✗ 12184 http_req_receiving.............: avg=314.74ms min=24.58µs med=80.52µs max=6.26s p(90)=1.16s p(95)=1.67s http_req_sending...............: avg=32.35ms min=8.17µs med=13.5µs max=4.62s p(90)=292.41µs p(95)=80.61ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=465.4ms min=6.49ms med=361.4ms max=2.51s p(90)=982.67ms p(95)=1.17s http_reqs......................: 12184 174.050289/s iteration_duration.............: avg=1.5s min=11.93ms med=1.04s max=12.53s p(90)=3.52s p(95)=4.63s iterations.....................: 12184 174.050289/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34485 ✗ 0 data_received..................: 1.0 GB 14 MB/s data_sent......................: 14 MB 195 kB/s http_req_blocked...............: avg=21.66ms min=1.48µs med=3.16µs max=4.36s p(90)=4.87µs p(95)=14.53µs http_req_connecting............: avg=19.65ms min=0s med=0s max=4.1s p(90)=0s p(95)=0s http_req_duration..............: avg=848.25ms min=6.05ms med=487.2ms max=8.97s p(90)=2.32s p(95)=2.94s { expected_response:true }...: avg=848.25ms min=6.05ms med=487.2ms max=8.97s p(90)=2.32s p(95)=2.94s http_req_failed................: 0.00% ✓ 0 ✗ 11495 http_req_receiving.............: avg=381.65ms min=35.04µs med=83.15µs max=8.78s p(90)=1.58s p(95)=2.31s http_req_sending...............: avg=42.59ms min=7.9µs med=14.69µs max=4.84s p(90)=1.34ms p(95)=80.84ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=424.01ms min=5.96ms med=311.74ms max=2.94s p(90)=923.44ms p(95)=1.11s http_reqs......................: 11495 164.194586/s iteration_duration.............: avg=1.6s min=11.91ms med=944.48ms max=15.12s p(90)=4.05s p(95)=5.29s iterations.....................: 11495 164.194586/s vus............................: 1 min=1 max=496 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24591 ✗ 0 data_received..................: 719 MB 10 MB/s data_sent......................: 9.7 MB 139 kB/s http_req_blocked...............: avg=2.09ms min=1.3µs med=3.04µs max=426.43ms p(90)=5.59µs p(95)=221.25µs http_req_connecting............: avg=1.99ms min=0s med=0s max=426.34ms p(90)=0s p(95)=146.84µs http_req_duration..............: avg=2.21s min=7.24ms med=2.14s max=8.42s p(90)=4.18s p(95)=5.56s { expected_response:true }...: avg=2.21s min=7.24ms med=2.14s max=8.42s p(90)=4.18s p(95)=5.56s http_req_failed................: 0.00% ✓ 0 ✗ 8197 http_req_receiving.............: avg=31.59ms min=34.41µs med=80.35µs max=1.92s p(90)=54.99ms p(95)=207.51ms http_req_sending...............: avg=3.17ms min=8.46µs med=14.24µs max=795.94ms p(90)=72.59µs p(95)=7.05ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.18s min=7.04ms med=2.13s max=8.42s p(90)=4.16s p(95)=5.45s http_reqs......................: 8197 117.091459/s iteration_duration.............: avg=2.29s min=12.81ms med=2.22s max=8.74s p(90)=4.31s p(95)=5.66s iterations.....................: 8197 117.091459/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14760 ✗ 0 data_received..................: 432 MB 6.2 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=684.14µs min=1.39µs med=3.48µs max=136.17ms p(90)=159.04µs p(95)=440.31µs http_req_connecting............: avg=631.79µs min=0s med=0s max=136.1ms p(90)=96.2µs p(95)=353.48µs http_req_duration..............: avg=3.85s min=10.33ms med=4.02s max=8.01s p(90)=6.06s p(95)=6.52s { expected_response:true }...: avg=3.85s min=10.33ms med=4.02s max=8.01s p(90)=6.06s p(95)=6.52s http_req_failed................: 0.00% ✓ 0 ✗ 4920 http_req_receiving.............: avg=1.52ms min=38.95µs med=93.9µs max=373.06ms p(90)=714.2µs p(95)=6.87ms http_req_sending...............: avg=576.55µs min=8.41µs med=17.54µs max=121.9ms p(90)=52.25µs p(95)=135.32µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.85s min=10.25ms med=4.02s max=8.01s p(90)=6.06s p(95)=6.51s http_reqs......................: 4920 70.270671/s iteration_duration.............: avg=3.89s min=16.35ms med=4.05s max=8.07s p(90)=6.09s p(95)=6.55s iterations.....................: 4920 70.270671/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14589 ✗ 0 data_received..................: 427 MB 5.8 MB/s data_sent......................: 5.8 MB 79 kB/s http_req_blocked...............: avg=106.12µs min=1.67µs med=4.26µs max=37.53ms p(90)=185.94µs p(95)=318.33µs http_req_connecting............: avg=92.55µs min=0s med=0s max=37.46ms p(90)=123.79µs p(95)=234.16µs http_req_duration..............: avg=4.3s min=87.12ms med=2.31s max=45.52s p(90)=3.69s p(95)=24.86s { expected_response:true }...: avg=4.3s min=87.12ms med=2.31s max=45.52s p(90)=3.69s p(95)=24.86s http_req_failed................: 0.00% ✓ 0 ✗ 4863 http_req_receiving.............: avg=436.11µs min=51.62µs med=128.3µs max=218.59ms p(90)=188.02µs p(95)=238.11µs http_req_sending...............: avg=85.34µs min=8.92µs med=24.28µs max=38.68ms p(90)=47.1µs p(95)=68.56µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.3s min=86.96ms med=2.31s max=45.52s p(90)=3.69s p(95)=24.86s http_reqs......................: 4863 66.242012/s iteration_duration.............: avg=4.31s min=97.64ms med=2.32s max=45.53s p(90)=3.7s p(95)=24.87s iterations.....................: 4863 66.242012/s vus............................: 37 min=37 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 176 5359 total, 0 failed avg: 500ms, p95: 680ms ✅
apollo-router 169 5154 total, 0 failed avg: 531ms, p95: 703ms ✅
wundergraph 156 4758 total, 0 failed avg: 538ms, p95: 989ms ✅
mesh-supergraph-bun 95 2949 total, 0 failed avg: 1013ms, p95: 1779ms ✅
apollo-server 47 1506 total, 0 failed avg: 2042ms, p95: 2691ms ✅
mercurius 30 935 total, 0 failed avg: 3245ms, p95: 4338ms ✅
mesh-supergraph 30 966 total, 0 failed avg: 3180ms, p95: 5578ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16077 ✗ 0 data_received..................: 470 MB 16 MB/s data_sent......................: 6.4 MB 209 kB/s http_req_blocked...............: avg=17.12µs min=1.35µs med=2.91µs max=9.08ms p(90)=4.57µs p(95)=5.76µs http_req_connecting............: avg=8.01µs min=0s med=0s max=2.1ms p(90)=0s p(95)=0s http_req_duration..............: avg=499.93ms min=18.79ms med=497.25ms max=1.41s p(90)=607.87ms p(95)=680.23ms { expected_response:true }...: avg=499.93ms min=18.79ms med=497.25ms max=1.41s p(90)=607.87ms p(95)=680.23ms http_req_failed................: 0.00% ✓ 0 ✗ 5359 http_req_receiving.............: avg=31.89ms min=39.08µs med=79.29µs max=749.5ms p(90)=94.18ms p(95)=255.67ms http_req_sending...............: avg=1.13ms min=8.05µs med=13.67µs max=484.29ms p(90)=37.39µs p(95)=136.47µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=466.89ms min=18.6ms med=483.3ms max=739.91ms p(90)=564.96ms p(95)=586.87ms http_reqs......................: 5359 176.156995/s iteration_duration.............: avg=564.65ms min=32.3ms med=535.19ms max=1.6s p(90)=770ms p(95)=935.91ms iterations.....................: 5359 176.156995/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15462 ✗ 0 data_received..................: 452 MB 15 MB/s data_sent......................: 6.1 MB 201 kB/s http_req_blocked...............: avg=39.14µs min=1.38µs med=2.71µs max=48.69ms p(90)=4.15µs p(95)=5.31µs http_req_connecting............: avg=24.72µs min=0s med=0s max=3.66ms p(90)=0s p(95)=0s http_req_duration..............: avg=530.9ms min=98.67ms med=533.42ms max=1.38s p(90)=660.86ms p(95)=703.03ms { expected_response:true }...: avg=530.9ms min=98.67ms med=533.42ms max=1.38s p(90)=660.86ms p(95)=703.03ms http_req_failed................: 0.00% ✓ 0 ✗ 5154 http_req_receiving.............: avg=15.98ms min=36.49µs med=67.55µs max=1.01s p(90)=19.55ms p(95)=73.76ms http_req_sending...............: avg=1.22ms min=8.19µs med=13.24µs max=489.09ms p(90)=38.62µs p(95)=490.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=513.7ms min=98.3ms med=523.84ms max=941.08ms p(90)=635.25ms p(95)=672.03ms http_reqs......................: 5154 169.269415/s iteration_duration.............: avg=587.12ms min=158.24ms med=572.84ms max=2.35s p(90)=736.51ms p(95)=807.65ms iterations.....................: 5154 169.269415/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14274 ✗ 0 data_received..................: 418 MB 14 MB/s data_sent......................: 5.6 MB 186 kB/s http_req_blocked...............: avg=55.75µs min=1.34µs med=2.69µs max=8.4ms p(90)=4.02µs p(95)=5.28µs http_req_connecting............: avg=50.05µs min=0s med=0s max=5.09ms p(90)=0s p(95)=0s http_req_duration..............: avg=537.73ms min=17.86ms med=517.92ms max=1.69s p(90)=838.02ms p(95)=988.8ms { expected_response:true }...: avg=537.73ms min=17.86ms med=517.92ms max=1.69s p(90)=838.02ms p(95)=988.8ms http_req_failed................: 0.00% ✓ 0 ✗ 4758 http_req_receiving.............: avg=50ms min=40.52µs med=86.47µs max=1.25s p(90)=164.04ms p(95)=352.6ms http_req_sending...............: avg=2.05ms min=7.81µs med=13.13µs max=529.84ms p(90)=42.23µs p(95)=344.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=485.67ms min=17.11ms med=484.25ms max=1.19s p(90)=751.63ms p(95)=858.85ms http_reqs......................: 4758 156.365338/s iteration_duration.............: avg=636ms min=29.11ms med=588ms max=2.35s p(90)=1.01s p(95)=1.21s iterations.....................: 4758 156.365338/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8847 ✗ 0 data_received..................: 259 MB 8.4 MB/s data_sent......................: 3.5 MB 113 kB/s http_req_blocked...............: avg=67.87µs min=1.37µs med=2.76µs max=40.21ms p(90)=4.45µs p(95)=8.31µs http_req_connecting............: avg=40.93µs min=0s med=0s max=8.39ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.01s min=374.7ms med=898.94ms max=2.43s p(90)=1.6s p(95)=1.77s { expected_response:true }...: avg=1.01s min=374.7ms med=898.94ms max=2.43s p(90)=1.6s p(95)=1.77s http_req_failed................: 0.00% ✓ 0 ✗ 2949 http_req_receiving.............: avg=9.68ms min=38.4µs med=93.09µs max=475.73ms p(90)=742.69µs p(95)=29.92ms http_req_sending...............: avg=340.48µs min=8.12µs med=13.74µs max=73.11ms p(90)=33.14µs p(95)=140.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1s min=374.16ms med=892.68ms max=2.43s p(90)=1.6s p(95)=1.77s http_reqs......................: 2949 95.508343/s iteration_duration.............: avg=1.03s min=384.11ms med=921.07ms max=2.45s p(90)=1.62s p(95)=1.79s iterations.....................: 2949 95.508343/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4518 ✗ 0 data_received..................: 132 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=71.13µs min=1.63µs med=4µs max=7.57ms p(90)=6.15µs p(95)=439.17µs http_req_connecting............: avg=59.28µs min=0s med=0s max=2.61ms p(90)=0s p(95)=364.39µs http_req_duration..............: avg=2.04s min=485.57ms med=1.66s max=22.29s p(90)=2.11s p(95)=2.69s { expected_response:true }...: avg=2.04s min=485.57ms med=1.66s max=22.29s p(90)=2.11s p(95)=2.69s http_req_failed................: 0.00% ✓ 0 ✗ 1506 http_req_receiving.............: avg=182.27µs min=51.26µs med=131.23µs max=25.13ms p(90)=183.29µs p(95)=208.29µs http_req_sending...............: avg=90.38µs min=9.09µs med=21.97µs max=7.15ms p(90)=38.18µs p(95)=345.51µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.04s min=484.28ms med=1.66s max=22.29s p(90)=2.11s p(95)=2.69s http_reqs......................: 1506 47.843256/s iteration_duration.............: avg=2.05s min=494.8ms med=1.67s max=22.3s p(90)=2.12s p(95)=2.7s iterations.....................: 1506 47.843256/s vus............................: 52 min=52 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2805 ✗ 0 data_received..................: 82 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=59.44µs min=1.64µs med=4.13µs max=1.85ms p(90)=101.06µs p(95)=388.59µs http_req_connecting............: avg=40.23µs min=0s med=0s max=1.52ms p(90)=68.51µs p(95)=297.56µs http_req_duration..............: avg=3.24s min=843.43ms med=3.04s max=6.5s p(90)=4.19s p(95)=4.33s { expected_response:true }...: avg=3.24s min=843.43ms med=3.04s max=6.5s p(90)=4.19s p(95)=4.33s http_req_failed................: 0.00% ✓ 0 ✗ 935 http_req_receiving.............: avg=330.28µs min=46.68µs med=120.29µs max=84.29ms p(90)=176.91µs p(95)=229.8µs http_req_sending...............: avg=48.44µs min=8.68µs med=23.1µs max=519.11µs p(90)=39.75µs p(95)=349.7µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.24s min=843.36ms med=3.04s max=6.5s p(90)=4.19s p(95)=4.33s http_reqs......................: 935 30.456436/s iteration_duration.............: avg=3.25s min=862.66ms med=3.05s max=6.51s p(90)=4.2s p(95)=4.34s iterations.....................: 935 30.456436/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2898 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=117.56µs min=1.57µs med=3.29µs max=10.63ms p(90)=116.55µs p(95)=858.12µs http_req_connecting............: avg=86.41µs min=0s med=0s max=2.23ms p(90)=77.47µs p(95)=741.69µs http_req_duration..............: avg=3.18s min=978.59ms med=3.07s max=8.06s p(90)=4.66s p(95)=5.57s { expected_response:true }...: avg=3.18s min=978.59ms med=3.07s max=8.06s p(90)=4.66s p(95)=5.57s http_req_failed................: 0.00% ✓ 0 ✗ 966 http_req_receiving.............: avg=3.79ms min=42.98µs med=136.67µs max=82.01ms p(90)=3.09ms p(95)=22.84ms http_req_sending...............: avg=69.25µs min=8.13µs med=17.27µs max=17.1ms p(90)=79.03µs p(95)=350.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.17s min=978.13ms med=3.07s max=8.06s p(90)=4.66s p(95)=5.56s http_reqs......................: 966 30.631277/s iteration_duration.............: avg=3.19s min=988.7ms med=3.09s max=8.07s p(90)=4.68s p(95)=5.59s iterations.....................: 966 30.631277/s vus............................: 41 min=41 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5045 total, 0 failed avg: 539ms, p95: 716ms ✅
wundergraph 104 3241 total, 0 failed avg: 905ms, p95: 1101ms ✅
mesh-supergraph-bun 98 3026 total, 0 failed avg: 957ms, p95: 1368ms ✅
cosmo 81 2542 total, 0 failed avg: 1163ms, p95: 1399ms ✅
apollo-server 65 2026 total, 0 failed avg: 1500ms, p95: 1729ms ✅
mesh-supergraph 58 1803 total, 0 failed avg: 1669ms, p95: 2608ms ✅
mercurius 12 476 total, 0 failed avg: 7100ms, p95: 8451ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15135 ✗ 0 data_received..................: 443 MB 15 MB/s data_sent......................: 6.0 MB 196 kB/s http_req_blocked...............: avg=50.96µs min=1.46µs med=2.87µs max=83.84ms p(90)=4.45µs p(95)=5.79µs http_req_connecting............: avg=20.14µs min=0s med=0s max=3.55ms p(90)=0s p(95)=0s http_req_duration..............: avg=538.6ms min=271.92ms med=528.67ms max=1.08s p(90)=669.15ms p(95)=716.38ms { expected_response:true }...: avg=538.6ms min=271.92ms med=528.67ms max=1.08s p(90)=669.15ms p(95)=716.38ms http_req_failed................: 0.00% ✓ 0 ✗ 5045 http_req_receiving.............: avg=14.72ms min=31.5µs med=74.22µs max=453.37ms p(90)=52.5ms p(95)=98.15ms http_req_sending...............: avg=1.68ms min=7.86µs med=13.5µs max=397.66ms p(90)=40.06µs p(95)=527.68µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=522.19ms min=271.83ms med=517.96ms max=905.33ms p(90)=636.36ms p(95)=672.38ms http_reqs......................: 5045 165.365896/s iteration_duration.............: avg=601.06ms min=300.43ms med=585.94ms max=1.31s p(90)=755.28ms p(95)=823.01ms iterations.....................: 5045 165.365896/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9723 ✗ 0 data_received..................: 284 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=89.7µs min=1.1µs med=2.55µs max=10.88ms p(90)=3.82µs p(95)=8.36µs http_req_connecting............: avg=78.3µs min=0s med=0s max=5.43ms p(90)=0s p(95)=0s http_req_duration..............: avg=905.39ms min=537.84ms med=901.11ms max=1.31s p(90)=1.04s p(95)=1.1s { expected_response:true }...: avg=905.39ms min=537.84ms med=901.11ms max=1.31s p(90)=1.04s p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 3241 http_req_receiving.............: avg=6.68ms min=39.59µs med=76.92µs max=329.71ms p(90)=14.94ms p(95)=48.4ms http_req_sending...............: avg=1.11ms min=8.26µs med=12.82µs max=137.23ms p(90)=49.08µs p(95)=459.74µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=897.59ms min=537.75ms med=893.28ms max=1.28s p(90)=1.04s p(95)=1.08s http_reqs......................: 3241 104.792092/s iteration_duration.............: avg=940.81ms min=558.7ms med=935.47ms max=1.36s p(90)=1.09s p(95)=1.16s iterations.....................: 3241 104.792092/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9078 ✗ 0 data_received..................: 266 MB 8.6 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=42.53µs min=1.73µs med=3.38µs max=3ms p(90)=5.4µs p(95)=9.83µs http_req_connecting............: avg=34.74µs min=0s med=0s max=2.97ms p(90)=0s p(95)=0s http_req_duration..............: avg=956.83ms min=379.63ms med=936.32ms max=1.8s p(90)=1.26s p(95)=1.36s { expected_response:true }...: avg=956.83ms min=379.63ms med=936.32ms max=1.8s p(90)=1.26s p(95)=1.36s http_req_failed................: 0.00% ✓ 0 ✗ 3026 http_req_receiving.............: avg=18.13ms min=38.04µs med=87.78µs max=631.76ms p(90)=30.36ms p(95)=136.46ms http_req_sending...............: avg=744.91µs min=9.12µs med=17.06µs max=159.35ms p(90)=52.53µs p(95)=242.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=937.95ms min=379.22ms med=916.89ms max=1.77s p(90)=1.24s p(95)=1.33s http_reqs......................: 3026 98.579816/s iteration_duration.............: avg=1s min=390.52ms med=978.54ms max=1.97s p(90)=1.32s p(95)=1.44s iterations.....................: 3026 98.579816/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7626 ✗ 0 data_received..................: 223 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=265.73µs min=1.49µs med=2.98µs max=9.66ms p(90)=5.04µs p(95)=11.39µs http_req_connecting............: avg=81µs min=0s med=0s max=5.26ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=709.32ms med=1.16s max=1.6s p(90)=1.34s p(95)=1.39s { expected_response:true }...: avg=1.16s min=709.32ms med=1.16s max=1.6s p(90)=1.34s p(95)=1.39s http_req_failed................: 0.00% ✓ 0 ✗ 2542 http_req_receiving.............: avg=12.43ms min=42.2µs med=87.24µs max=336.32ms p(90)=40.57ms p(95)=81.94ms http_req_sending...............: avg=2.01ms min=7.89µs med=14.16µs max=330.23ms p(90)=81.96µs p(95)=961.08µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=709.24ms med=1.15s max=1.58s p(90)=1.31s p(95)=1.37s http_reqs......................: 2542 81.617921/s iteration_duration.............: avg=1.19s min=718.87ms med=1.2s max=1.64s p(90)=1.39s p(95)=1.44s iterations.....................: 2542 81.617921/s vus............................: 30 min=30 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6078 ✗ 0 data_received..................: 178 MB 5.7 MB/s data_sent......................: 2.4 MB 78 kB/s http_req_blocked...............: avg=69.62µs min=1.41µs med=3.19µs max=5.08ms p(90)=4.88µs p(95)=80.08µs http_req_connecting............: avg=60.64µs min=0s med=0s max=4.91ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.49s min=773.18ms med=1.43s max=9.48s p(90)=1.65s p(95)=1.72s { expected_response:true }...: avg=1.49s min=773.18ms med=1.43s max=9.48s p(90)=1.65s p(95)=1.72s http_req_failed................: 0.00% ✓ 0 ✗ 2026 http_req_receiving.............: avg=153.99µs min=46.59µs med=112.81µs max=13.02ms p(90)=179.13µs p(95)=228.92µs http_req_sending...............: avg=87.51µs min=8.53µs med=16.58µs max=17.51ms p(90)=32.63µs p(95)=106.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.49s min=772.74ms med=1.43s max=9.48s p(90)=1.65s p(95)=1.72s http_reqs......................: 2026 65.28331/s iteration_duration.............: avg=1.51s min=783.97ms med=1.44s max=9.49s p(90)=1.67s p(95)=1.74s iterations.....................: 2026 65.28331/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5409 ✗ 0 data_received..................: 158 MB 5.1 MB/s data_sent......................: 2.1 MB 69 kB/s http_req_blocked...............: avg=101.77µs min=1.6µs med=4.45µs max=4.25ms p(90)=6.38µs p(95)=122.74µs http_req_connecting............: avg=91.33µs min=0s med=0s max=4.22ms p(90)=0s p(95)=92.04µs http_req_duration..............: avg=1.66s min=654.59ms med=1.58s max=4.12s p(90)=2.37s p(95)=2.6s { expected_response:true }...: avg=1.66s min=654.59ms med=1.58s max=4.12s p(90)=2.37s p(95)=2.6s http_req_failed................: 0.00% ✓ 0 ✗ 1803 http_req_receiving.............: avg=2.64ms min=47.04µs med=151.12µs max=235.84ms p(90)=1.88ms p(95)=9.17ms http_req_sending...............: avg=183.43µs min=9.48µs med=23.58µs max=147.01ms p(90)=44.15µs p(95)=127.7µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.66s min=654.47ms med=1.57s max=4.12s p(90)=2.36s p(95)=2.6s http_reqs......................: 1803 58.35389/s iteration_duration.............: avg=1.69s min=664.26ms med=1.6s max=4.13s p(90)=2.39s p(95)=2.62s iterations.....................: 1803 58.35389/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1428 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 565 kB 15 kB/s http_req_blocked...............: avg=509.64µs min=1.71µs med=4.12µs max=5.02ms p(90)=2.22ms p(95)=3.62ms http_req_connecting............: avg=494.18µs min=0s med=0s max=4.99ms p(90)=2.19ms p(95)=3.6ms http_req_duration..............: avg=7.09s min=3.22s med=7.33s max=8.87s p(90)=8.21s p(95)=8.45s { expected_response:true }...: avg=7.09s min=3.22s med=7.33s max=8.87s p(90)=8.21s p(95)=8.45s http_req_failed................: 0.00% ✓ 0 ✗ 476 http_req_receiving.............: avg=213.71µs min=60.98µs med=125µs max=33.08ms p(90)=194.73µs p(95)=230.71µs http_req_sending...............: avg=88.88µs min=10.34µs med=22.79µs max=748.6µs p(90)=335.41µs p(95)=516.59µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.09s min=3.22s med=7.33s max=8.87s p(90)=8.21s p(95)=8.45s http_reqs......................: 476 12.750155/s iteration_duration.............: avg=7.1s min=3.23s med=7.34s max=8.88s p(90)=8.22s p(95)=8.45s iterations.....................: 476 12.750155/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview