search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update dependency @graphql-mesh/cli to v0.89.6 #411

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/cli (source) 0.89.4 -> 0.89.6 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/cli) ### [`v0.89.6`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0896) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/8518c1ca6a88684b599a1e594a6741447f2ccdb0...@graphql-mesh/cli@0.89.6) ##### Patch Changes - Updated dependencies \[]: - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.6 ### [`v0.89.5`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0895) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/103621c913f20849d97184a1f87a5127a3d8a1ca...8518c1ca6a88684b599a1e594a6741447f2ccdb0) ##### Patch Changes - Updated dependencies \[[`18e0d49`](https://togithub.com/ardatan/graphql-mesh/commit/18e0d495053f0b67fd1ba488270318e5d11309f8)]: - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.5 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.5 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.5

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 177 5382 total, 0 failed avg: 495ms, p95: 667ms ✅
apollo-router 167 5116 total, 0 failed avg: 536ms, p95: 709ms ✅
wundergraph 158 4801 total, 0 failed avg: 528ms, p95: 995ms ✅
mesh-supergraph-bun 93 2894 total, 0 failed avg: 1031ms, p95: 1765ms ✅
apollo-server 51 1611 total, 0 failed avg: 1905ms, p95: 2598ms ✅
mercurius 30 938 total, 0 failed avg: 3226ms, p95: 4461ms ✅
mesh-supergraph 30 973 total, 0 failed avg: 3157ms, p95: 5066ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16146 ✗ 0 data_received..................: 472 MB 16 MB/s data_sent......................: 6.4 MB 210 kB/s http_req_blocked...............: avg=36.46µs min=1.26µs med=2.58µs max=44.08ms p(90)=3.92µs p(95)=4.87µs http_req_connecting............: avg=19.79µs min=0s med=0s max=4.24ms p(90)=0s p(95)=0s http_req_duration..............: avg=495.08ms min=114.09ms med=493.93ms max=1.35s p(90)=606.38ms p(95)=667.49ms { expected_response:true }...: avg=495.08ms min=114.09ms med=493.93ms max=1.35s p(90)=606.38ms p(95)=667.49ms http_req_failed................: 0.00% ✓ 0 ✗ 5382 http_req_receiving.............: avg=23.56ms min=37.8µs med=70.14µs max=825.72ms p(90)=55.7ms p(95)=153.87ms http_req_sending...............: avg=1.43ms min=8.1µs med=12.75µs max=704.02ms p(90)=31.48µs p(95)=141.56µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=470.08ms min=113.97ms med=484.77ms max=777.26ms p(90)=569.92ms p(95)=596.09ms http_reqs......................: 5382 177.15645/s iteration_duration.............: avg=561.58ms min=124.12ms med=533.68ms max=2.45s p(90)=741.85ms p(95)=908.22ms iterations.....................: 5382 177.15645/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15348 ✗ 0 data_received..................: 449 MB 15 MB/s data_sent......................: 6.1 MB 199 kB/s http_req_blocked...............: avg=73.39µs min=1.35µs med=2.82µs max=90.87ms p(90)=4.1µs p(95)=4.95µs http_req_connecting............: avg=48.74µs min=0s med=0s max=6.08ms p(90)=0s p(95)=0s http_req_duration..............: avg=535.99ms min=201.81ms med=532.81ms max=1.15s p(90)=659.89ms p(95)=708.92ms { expected_response:true }...: avg=535.99ms min=201.81ms med=532.81ms max=1.15s p(90)=659.89ms p(95)=708.92ms http_req_failed................: 0.00% ✓ 0 ✗ 5116 http_req_receiving.............: avg=10.9ms min=37.99µs med=67.38µs max=696.68ms p(90)=18.76ms p(95)=67.51ms http_req_sending...............: avg=1.22ms min=7.78µs med=13.04µs max=568.89ms p(90)=32.72µs p(95)=195.68µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=523.87ms min=201.74ms med=524.47ms max=944.87ms p(90)=641.77ms p(95)=681.55ms http_reqs......................: 5116 167.827825/s iteration_duration.............: avg=591.97ms min=212.03ms med=581.28ms max=1.42s p(90)=740.42ms p(95)=824.4ms iterations.....................: 5116 167.827825/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14403 ✗ 0 data_received..................: 421 MB 14 MB/s data_sent......................: 5.7 MB 188 kB/s http_req_blocked...............: avg=89.02µs min=1.29µs med=2.79µs max=152.83ms p(90)=4.31µs p(95)=5.45µs http_req_connecting............: avg=26.85µs min=0s med=0s max=3.74ms p(90)=0s p(95)=0s http_req_duration..............: avg=527.53ms min=13.74ms med=492.59ms max=1.81s p(90)=865.56ms p(95)=994.89ms { expected_response:true }...: avg=527.53ms min=13.74ms med=492.59ms max=1.81s p(90)=865.56ms p(95)=994.89ms http_req_failed................: 0.00% ✓ 0 ✗ 4801 http_req_receiving.............: avg=59.75ms min=40.74µs med=88.02µs max=1.36s p(90)=209.57ms p(95)=424.68ms http_req_sending...............: avg=2.44ms min=8.09µs med=13.36µs max=1.06s p(90)=34.92µs p(95)=525.59µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=465.33ms min=13.3ms med=445.08ms max=1.22s p(90)=757.44ms p(95)=875.53ms http_reqs......................: 4801 158.061532/s iteration_duration.............: avg=629.24ms min=25.28ms med=569.37ms max=2.76s p(90)=1.03s p(95)=1.26s iterations.....................: 4801 158.061532/s vus............................: 98 min=98 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8682 ✗ 0 data_received..................: 254 MB 8.2 MB/s data_sent......................: 3.4 MB 111 kB/s http_req_blocked...............: avg=30.63µs min=1.39µs med=3.21µs max=3.79ms p(90)=5.32µs p(95)=10.47µs http_req_connecting............: avg=20.76µs min=0s med=0s max=3.33ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.03s min=374.1ms med=897.41ms max=2.6s p(90)=1.68s p(95)=1.76s { expected_response:true }...: avg=1.03s min=374.1ms med=897.41ms max=2.6s p(90)=1.68s p(95)=1.76s http_req_failed................: 0.00% ✓ 0 ✗ 2894 http_req_receiving.............: avg=10.75ms min=33.41µs med=94.48µs max=700.94ms p(90)=556.21µs p(95)=31.23ms http_req_sending...............: avg=332.69µs min=7.37µs med=15.01µs max=137.07ms p(90)=34.3µs p(95)=123.9µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.01s min=372.97ms med=893.34ms max=2.6s p(90)=1.67s p(95)=1.75s http_reqs......................: 2894 93.441343/s iteration_duration.............: avg=1.05s min=381.64ms med=921.54ms max=2.61s p(90)=1.71s p(95)=1.79s iterations.....................: 2894 93.441343/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4833 ✗ 0 data_received..................: 142 MB 4.5 MB/s data_sent......................: 1.9 MB 61 kB/s http_req_blocked...............: avg=53.59µs min=1.35µs med=2.82µs max=3.87ms p(90)=4.71µs p(95)=165.33µs http_req_connecting............: avg=44.35µs min=0s med=0s max=3.67ms p(90)=0s p(95)=131.31µs http_req_duration..............: avg=1.9s min=453.63ms med=1.56s max=20.23s p(90)=2.08s p(95)=2.59s { expected_response:true }...: avg=1.9s min=453.63ms med=1.56s max=20.23s p(90)=2.08s p(95)=2.59s http_req_failed................: 0.00% ✓ 0 ✗ 1611 http_req_receiving.............: avg=178.31µs min=44.94µs med=117.19µs max=67.25ms p(90)=174.19µs p(95)=197.85µs http_req_sending...............: avg=45.72µs min=7.95µs med=14.91µs max=13.85ms p(90)=30.86µs p(95)=89.27µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.9s min=453.47ms med=1.56s max=20.23s p(90)=2.08s p(95)=2.59s http_reqs......................: 1611 51.356516/s iteration_duration.............: avg=1.91s min=459.93ms med=1.57s max=20.24s p(90)=2.09s p(95)=2.6s iterations.....................: 1611 51.356516/s vus............................: 38 min=38 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2814 ✗ 0 data_received..................: 82 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=241.67µs min=1.9µs med=4µs max=11.98ms p(90)=434.94µs p(95)=1.94ms http_req_connecting............: avg=228.08µs min=0s med=0s max=11.95ms p(90)=294.04µs p(95)=1.9ms http_req_duration..............: avg=3.22s min=653.36ms med=3.08s max=7.58s p(90)=4.16s p(95)=4.46s { expected_response:true }...: avg=3.22s min=653.36ms med=3.08s max=7.58s p(90)=4.16s p(95)=4.46s http_req_failed................: 0.00% ✓ 0 ✗ 938 http_req_receiving.............: avg=317µs min=46.61µs med=116.95µs max=75.86ms p(90)=187.51µs p(95)=248.16µs http_req_sending...............: avg=166.55µs min=9.77µs med=22.05µs max=8.19ms p(90)=114.33µs p(95)=770.3µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.22s min=652.61ms med=3.08s max=7.58s p(90)=4.16s p(95)=4.46s http_reqs......................: 938 30.549178/s iteration_duration.............: avg=3.23s min=668.48ms med=3.09s max=7.59s p(90)=4.18s p(95)=4.47s iterations.....................: 938 30.549178/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2919 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=543.01µs min=1.45µs med=3.33µs max=10.3ms p(90)=4.17ms p(95)=5.05ms http_req_connecting............: avg=79.66µs min=0s med=0s max=2.92ms p(90)=66.98µs p(95)=260.32µs http_req_duration..............: avg=3.15s min=1.36s med=2.98s max=6.67s p(90)=4.37s p(95)=5.06s { expected_response:true }...: avg=3.15s min=1.36s med=2.98s max=6.67s p(90)=4.37s p(95)=5.06s http_req_failed................: 0.00% ✓ 0 ✗ 973 http_req_receiving.............: avg=3.29ms min=40.24µs med=148.73µs max=83.81ms p(90)=1.76ms p(95)=13.83ms http_req_sending...............: avg=68.79µs min=8µs med=17.29µs max=4.01ms p(90)=62.45µs p(95)=185.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.15s min=1.36s med=2.98s max=6.67s p(90)=4.36s p(95)=5.06s http_reqs......................: 973 30.993947/s iteration_duration.............: avg=3.17s min=1.37s med=2.99s max=6.68s p(90)=4.38s p(95)=5.08s iterations.....................: 973 30.993947/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 149 4560 total, 0 failed avg: 615ms, p95: 816ms ✅
wundergraph 103 3189 total, 0 failed avg: 925ms, p95: 1148ms ✅
mesh-supergraph-bun 83 2583 total, 0 failed avg: 1147ms, p95: 1674ms ✅
cosmo 79 2453 total, 0 failed avg: 1216ms, p95: 1471ms ✅
apollo-server 48 1520 total, 0 failed avg: 2022ms, p95: 2350ms ✅
mesh-supergraph 29 933 total, 0 failed avg: 3338ms, p95: 5298ms ✅
mercurius 11 445 total, 0 failed avg: 7670ms, p95: 9094ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13680 ✗ 0 data_received..................: 400 MB 13 MB/s data_sent......................: 5.4 MB 177 kB/s http_req_blocked...............: avg=62.12µs min=1.4µs med=2.68µs max=6.44ms p(90)=4.01µs p(95)=5.21µs http_req_connecting............: avg=58.27µs min=0s med=0s max=6.32ms p(90)=0s p(95)=0s http_req_duration..............: avg=614.71ms min=308.73ms med=603.62ms max=1.2s p(90)=751.29ms p(95)=816.41ms { expected_response:true }...: avg=614.71ms min=308.73ms med=603.62ms max=1.2s p(90)=751.29ms p(95)=816.41ms http_req_failed................: 0.00% ✓ 0 ✗ 4560 http_req_receiving.............: avg=13.98ms min=34.95µs med=70.05µs max=416.63ms p(90)=51.31ms p(95)=97.67ms http_req_sending...............: avg=1.33ms min=7.81µs med=13.11µs max=401.07ms p(90)=28.06µs p(95)=196.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=599.39ms min=308.67ms med=593.22ms max=1.07s p(90)=734.69ms p(95)=783.45ms http_reqs......................: 4560 149.135348/s iteration_duration.............: avg=666.45ms min=322.65ms med=647.26ms max=1.32s p(90)=832.24ms p(95)=926.32ms iterations.....................: 4560 149.135348/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9567 ✗ 0 data_received..................: 280 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=30.62µs min=1.5µs med=2.84µs max=2.88ms p(90)=4.33µs p(95)=9.27µs http_req_connecting............: avg=24.38µs min=0s med=0s max=2.86ms p(90)=0s p(95)=0s http_req_duration..............: avg=924.53ms min=583.81ms med=916.53ms max=1.48s p(90)=1.08s p(95)=1.14s { expected_response:true }...: avg=924.53ms min=583.81ms med=916.53ms max=1.48s p(90)=1.08s p(95)=1.14s http_req_failed................: 0.00% ✓ 0 ✗ 3189 http_req_receiving.............: avg=8.21ms min=39.19µs med=81.34µs max=323.4ms p(90)=21.1ms p(95)=59.4ms http_req_sending...............: avg=1.35ms min=7.93µs med=14.01µs max=216.87ms p(90)=45.85µs p(95)=616.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=914.96ms min=577.61ms med=909.1ms max=1.32s p(90)=1.06s p(95)=1.13s http_reqs......................: 3189 103.104512/s iteration_duration.............: avg=961.42ms min=610.57ms med=954.24ms max=1.59s p(90)=1.12s p(95)=1.19s iterations.....................: 3189 103.104512/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7749 ✗ 0 data_received..................: 227 MB 7.4 MB/s data_sent......................: 3.1 MB 100 kB/s http_req_blocked...............: avg=61.3µs min=1.24µs med=2.84µs max=12.21ms p(90)=4.89µs p(95)=10.93µs http_req_connecting............: avg=41.62µs min=0s med=0s max=3.76ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=492.79ms med=1.1s max=2.62s p(90)=1.48s p(95)=1.67s { expected_response:true }...: avg=1.14s min=492.79ms med=1.1s max=2.62s p(90)=1.48s p(95)=1.67s http_req_failed................: 0.00% ✓ 0 ✗ 2583 http_req_receiving.............: avg=14.27ms min=38.76µs med=92.97µs max=768.45ms p(90)=1.8ms p(95)=56.52ms http_req_sending...............: avg=472.43µs min=7.89µs med=13.88µs max=105.44ms p(90)=45.42µs p(95)=370.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=492.48ms med=1.09s max=2.62s p(90)=1.45s p(95)=1.62s http_reqs......................: 2583 83.924084/s iteration_duration.............: avg=1.17s min=505.34ms med=1.14s max=2.64s p(90)=1.52s p(95)=1.7s iterations.....................: 2583 83.924084/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7359 ✗ 0 data_received..................: 215 MB 6.9 MB/s data_sent......................: 2.9 MB 94 kB/s http_req_blocked...............: avg=140.97µs min=1.36µs med=2.73µs max=8.37ms p(90)=4.51µs p(95)=10.25µs http_req_connecting............: avg=134.75µs min=0s med=0s max=8.3ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.21s min=820.83ms med=1.2s max=1.85s p(90)=1.38s p(95)=1.47s { expected_response:true }...: avg=1.21s min=820.83ms med=1.2s max=1.85s p(90)=1.38s p(95)=1.47s http_req_failed................: 0.00% ✓ 0 ✗ 2453 http_req_receiving.............: avg=15.14ms min=37.14µs med=81.81µs max=405.77ms p(90)=46.89ms p(95)=97.34ms http_req_sending...............: avg=1.1ms min=7.89µs med=13.38µs max=120.21ms p(90)=81.26µs p(95)=493.21µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.19s min=820.39ms med=1.19s max=1.6s p(90)=1.36s p(95)=1.42s http_reqs......................: 2453 79.071416/s iteration_duration.............: avg=1.24s min=835.91ms med=1.23s max=1.86s p(90)=1.43s p(95)=1.51s iterations.....................: 2453 79.071416/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4560 ✗ 0 data_received..................: 134 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=84.04µs min=1.42µs med=3.61µs max=9.76ms p(90)=5.46µs p(95)=196.08µs http_req_connecting............: avg=75.66µs min=0s med=0s max=8.82ms p(90)=0s p(95)=156.33µs http_req_duration..............: avg=2.02s min=979ms med=1.79s max=14.47s p(90)=2.19s p(95)=2.34s { expected_response:true }...: avg=2.02s min=979ms med=1.79s max=14.47s p(90)=2.19s p(95)=2.34s http_req_failed................: 0.00% ✓ 0 ✗ 1520 http_req_receiving.............: avg=236µs min=48.96µs med=122.88µs max=52.06ms p(90)=185.15µs p(95)=222.21µs http_req_sending...............: avg=44.83µs min=8.64µs med=18.64µs max=996.68µs p(90)=35.11µs p(95)=75.95µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.02s min=978.89ms med=1.79s max=14.47s p(90)=2.19s p(95)=2.34s http_reqs......................: 1520 48.237548/s iteration_duration.............: avg=2.03s min=989.76ms med=1.8s max=14.48s p(90)=2.21s p(95)=2.36s iterations.....................: 1520 48.237548/s vus............................: 51 min=51 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2799 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=73.37µs min=1.49µs med=3.94µs max=2.64ms p(90)=103µs p(95)=559.24µs http_req_connecting............: avg=57.42µs min=0s med=0s max=1.74ms p(90)=74.63µs p(95)=480.18µs http_req_duration..............: avg=3.33s min=1.59s med=3.2s max=6.56s p(90)=4.38s p(95)=5.29s { expected_response:true }...: avg=3.33s min=1.59s med=3.2s max=6.56s p(90)=4.38s p(95)=5.29s http_req_failed................: 0.00% ✓ 0 ✗ 933 http_req_receiving.............: avg=3.41ms min=44.02µs med=150.69µs max=576.61ms p(90)=2.13ms p(95)=9.07ms http_req_sending...............: avg=77.48µs min=8.01µs med=21.87µs max=11.35ms p(90)=63µs p(95)=389.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.33s min=1.59s med=3.2s max=6.55s p(90)=4.37s p(95)=5.29s http_reqs......................: 933 29.180329/s iteration_duration.............: avg=3.35s min=1.61s med=3.21s max=6.56s p(90)=4.4s p(95)=5.3s iterations.....................: 933 29.180329/s vus............................: 74 min=74 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1335 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 528 kB 14 kB/s http_req_blocked...............: avg=224.25µs min=1.53µs med=3.35µs max=3.86ms p(90)=825.02µs p(95)=1.42ms http_req_connecting............: avg=199.31µs min=0s med=0s max=3.3ms p(90)=703.99µs p(95)=1.22ms http_req_duration..............: avg=7.67s min=2.81s med=7.86s max=9.28s p(90)=9.01s p(95)=9.09s { expected_response:true }...: avg=7.67s min=2.81s med=7.86s max=9.28s p(90)=9.01s p(95)=9.09s http_req_failed................: 0.00% ✓ 0 ✗ 445 http_req_receiving.............: avg=137.4µs min=61.62µs med=123.42µs max=1.78ms p(90)=187.92µs p(95)=228.02µs http_req_sending...............: avg=139.87µs min=8.86µs med=19.26µs max=1.58ms p(90)=360.93µs p(95)=1.05ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.66s min=2.81s med=7.86s max=9.28s p(90)=9.01s p(95)=9.09s http_reqs......................: 445 11.781587/s iteration_duration.............: avg=7.67s min=2.81s med=7.87s max=9.29s p(90)=9.02s p(95)=9.1s iterations.....................: 445 11.781587/s vus............................: 14 min=14 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 2826ms 171 11998 total, 0 failed avg: 865ms, p95: 2826ms, max: 6531ms, med: 516ms ✅
cosmo 2862ms 175 12299 total, 0 failed avg: 816ms, p95: 2862ms, max: 7991ms, med: 528ms ❌ 2 unexpected GraphQL errors, non-compatible response structure (2)
wundergraph 2933ms 162 11365 total, 0 failed avg: 851ms, p95: 2934ms, max: 8421ms, med: 489ms ✅
mesh-supergraph-bun 5294ms 117 8219 total, 0 failed avg: 2219ms, p95: 5294ms, max: 8980ms, med: 2010ms ✅
mesh-supergraph 6505ms 70 4910 total, 0 failed avg: 3874ms, p95: 6506ms, max: 8605ms, med: 3959ms ✅
apollo-server 22640ms 70 5151 total, 0 failed avg: 4034ms, p95: 22640ms, max: 44346ms, med: 2133ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35994 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 203 kB/s http_req_blocked...............: avg=14.82ms min=1.7µs med=3.34µs max=4.3s p(90)=5.65µs p(95)=13.36µs http_req_connecting............: avg=14.37ms min=0s med=0s max=4.3s p(90)=0s p(95)=0s http_req_duration..............: avg=864.89ms min=6.63ms med=515.64ms max=6.53s p(90)=2.15s p(95)=2.82s { expected_response:true }...: avg=864.89ms min=6.63ms med=515.64ms max=6.53s p(90)=2.15s p(95)=2.82s http_req_failed................: 0.00% ✓ 0 ✗ 11998 http_req_receiving.............: avg=344ms min=29.42µs med=87.62µs max=5.76s p(90)=1.37s p(95)=2.01s http_req_sending...............: avg=51.18ms min=8.17µs med=16.02µs max=5.18s p(90)=2.06ms p(95)=92.63ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=469.7ms min=6.55ms med=372.67ms max=3.19s p(90)=950.74ms p(95)=1.18s http_reqs......................: 11998 171.36822/s iteration_duration.............: avg=1.54s min=13.64ms med=940.37ms max=13.67s p(90)=3.7s p(95)=4.7s iterations.....................: 11998 171.36822/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12297 / ✗ 2 ✗ valid response structure ↳ 99% — ✓ 12297 / ✗ 2 checks.........................: 99.98% ✓ 36893 ✗ 4 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 209 kB/s http_req_blocked...............: avg=17.2ms min=1.49µs med=2.82µs max=4.51s p(90)=4.5µs p(95)=11.12µs http_req_connecting............: avg=16.22ms min=0s med=0s max=4.51s p(90)=0s p(95)=0s http_req_duration..............: avg=816.24ms min=6.67ms med=528.01ms max=7.99s p(90)=2s p(95)=2.86s { expected_response:true }...: avg=816.24ms min=6.67ms med=528.01ms max=7.99s p(90)=2s p(95)=2.86s http_req_failed................: 0.00% ✓ 0 ✗ 12299 http_req_receiving.............: avg=352.32ms min=24.85µs med=78.37µs max=7.62s p(90)=1.39s p(95)=2.12s http_req_sending...............: avg=30.89ms min=7.71µs med=13.57µs max=5.45s p(90)=134.76µs p(95)=57.85ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=433.02ms min=6.59ms med=347.63ms max=2.18s p(90)=891.13ms p(95)=1.05s http_reqs......................: 12299 175.680071/s iteration_duration.............: avg=1.49s min=12.11ms med=952.11ms max=11.4s p(90)=3.63s p(95)=4.61s iterations.....................: 12299 175.680071/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34095 ✗ 0 data_received..................: 997 MB 14 MB/s data_sent......................: 14 MB 193 kB/s http_req_blocked...............: avg=19.15ms min=1.59µs med=3.39µs max=7.71s p(90)=5.54µs p(95)=15.36µs http_req_connecting............: avg=18.33ms min=0s med=0s max=7.71s p(90)=0s p(95)=0s http_req_duration..............: avg=851.49ms min=6.66ms med=489.23ms max=8.42s p(90)=2.1s p(95)=2.93s { expected_response:true }...: avg=851.49ms min=6.66ms med=489.23ms max=8.42s p(90)=2.1s p(95)=2.93s http_req_failed................: 0.00% ✓ 0 ✗ 11365 http_req_receiving.............: avg=360.32ms min=28.62µs med=90µs max=7.24s p(90)=1.39s p(95)=2.24s http_req_sending...............: avg=38.27ms min=7.83µs med=16.09µs max=4.54s p(90)=6.28ms p(95)=96.41ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=452.9ms min=6.56ms med=347.55ms max=2.8s p(90)=981.91ms p(95)=1.2s http_reqs......................: 11365 162.348748/s iteration_duration.............: avg=1.62s min=12.21ms med=1.01s max=11.68s p(90)=4.01s p(95)=4.97s iterations.....................: 11365 162.348748/s vus............................: 1 min=1 max=496 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24657 ✗ 0 data_received..................: 721 MB 10 MB/s data_sent......................: 9.8 MB 139 kB/s http_req_blocked...............: avg=2.28ms min=1.47µs med=2.91µs max=568.32ms p(90)=4.87µs p(95)=213.3µs http_req_connecting............: avg=2.23ms min=0s med=0s max=494.71ms p(90)=0s p(95)=142.06µs http_req_duration..............: avg=2.21s min=5.31ms med=2s max=8.98s p(90)=3.87s p(95)=5.29s { expected_response:true }...: avg=2.21s min=5.31ms med=2s max=8.98s p(90)=3.87s p(95)=5.29s http_req_failed................: 0.00% ✓ 0 ✗ 8219 http_req_receiving.............: avg=27.05ms min=34.58µs med=73.29µs max=1.59s p(90)=22.81ms p(95)=157.53ms http_req_sending...............: avg=3.03ms min=8.15µs med=13.53µs max=539.38ms p(90)=106.73µs p(95)=11.28ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.18s min=5.14ms med=1.97s max=8.98s p(90)=3.65s p(95)=5.27s http_reqs......................: 8219 117.40262/s iteration_duration.............: avg=2.29s min=11.52ms med=2.14s max=9.29s p(90)=4.15s p(95)=5.35s iterations.....................: 8219 117.40262/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14730 ✗ 0 data_received..................: 431 MB 6.2 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=570.75µs min=1.37µs med=3.41µs max=140.58ms p(90)=153.4µs p(95)=403.91µs http_req_connecting............: avg=547.5µs min=0s med=0s max=140.52ms p(90)=101.88µs p(95)=340.52µs http_req_duration..............: avg=3.87s min=12ms med=3.95s max=8.6s p(90)=6.1s p(95)=6.5s { expected_response:true }...: avg=3.87s min=12ms med=3.95s max=8.6s p(90)=6.1s p(95)=6.5s http_req_failed................: 0.00% ✓ 0 ✗ 4910 http_req_receiving.............: avg=2.9ms min=39.69µs med=92.85µs max=580.58ms p(90)=936.46µs p(95)=7.69ms http_req_sending...............: avg=532.87µs min=7.94µs med=17.44µs max=210.03ms p(90)=48.09µs p(95)=98.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.87s min=11.92ms med=3.95s max=8.6s p(90)=6.09s p(95)=6.5s http_reqs......................: 4910 70.126587/s iteration_duration.............: avg=3.91s min=17.58ms med=3.99s max=8.69s p(90)=6.15s p(95)=6.56s iterations.....................: 4910 70.126587/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15453 ✗ 0 data_received..................: 453 MB 6.2 MB/s data_sent......................: 6.1 MB 84 kB/s http_req_blocked...............: avg=92.84µs min=1.36µs med=2.86µs max=38.21ms p(90)=13.66µs p(95)=282.07µs http_req_connecting............: avg=83.4µs min=0s med=0s max=38.15ms p(90)=0s p(95)=214.93µs http_req_duration..............: avg=4.03s min=77.64ms med=2.13s max=44.34s p(90)=3.28s p(95)=22.64s { expected_response:true }...: avg=4.03s min=77.64ms med=2.13s max=44.34s p(90)=3.28s p(95)=22.64s http_req_failed................: 0.00% ✓ 0 ✗ 5151 http_req_receiving.............: avg=339.11µs min=43.23µs med=109.96µs max=204.7ms p(90)=174.7µs p(95)=211.62µs http_req_sending...............: avg=70.19µs min=8.24µs med=14.4µs max=64.23ms p(90)=38.2µs p(95)=59.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.03s min=77.49ms med=2.13s max=44.34s p(90)=3.28s p(95)=22.63s http_reqs......................: 5151 70.553821/s iteration_duration.............: avg=4.04s min=84.58ms med=2.14s max=44.35s p(90)=3.29s p(95)=22.68s iterations.....................: 5151 70.553821/s vus............................: 6 min=6 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5040 total, 0 failed avg: 537ms, p95: 709ms ✅
wundergraph 104 3233 total, 0 failed avg: 911ms, p95: 1114ms ✅
mesh-supergraph-bun 102 3165 total, 0 failed avg: 922ms, p95: 1304ms ✅
cosmo 80 2525 total, 0 failed avg: 1160ms, p95: 1489ms ✅
mesh-supergraph 63 1958 total, 0 failed avg: 1539ms, p95: 2106ms ✅
apollo-server 62 1945 total, 0 failed avg: 1577ms, p95: 1818ms ✅
mercurius 12 472 total, 0 failed avg: 7196ms, p95: 8472ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15120 ✗ 0 data_received..................: 442 MB 15 MB/s data_sent......................: 6.0 MB 197 kB/s http_req_blocked...............: avg=41.47µs min=1.35µs med=2.86µs max=39.96ms p(90)=4.33µs p(95)=5.43µs http_req_connecting............: avg=21.6µs min=0s med=0s max=7.83ms p(90)=0s p(95)=0s http_req_duration..............: avg=537.21ms min=251.89ms med=527.57ms max=1.17s p(90)=659.16ms p(95)=709.32ms { expected_response:true }...: avg=537.21ms min=251.89ms med=527.57ms max=1.17s p(90)=659.16ms p(95)=709.32ms http_req_failed................: 0.00% ✓ 0 ✗ 5040 http_req_receiving.............: avg=16.71ms min=35.92µs med=70.75µs max=523.37ms p(90)=57.36ms p(95)=107.88ms http_req_sending...............: avg=1.68ms min=7.89µs med=13.39µs max=380.39ms p(90)=50.16µs p(95)=777.08µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=518.81ms min=246.69ms med=515.32ms max=815.64ms p(90)=630.21ms p(95)=669.17ms http_reqs......................: 5040 165.768113/s iteration_duration.............: avg=599.71ms min=268.83ms med=581.77ms max=1.29s p(90)=755.76ms p(95)=831.93ms iterations.....................: 5040 165.768113/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9699 ✗ 0 data_received..................: 284 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=35.6µs min=1.26µs med=2.55µs max=27.56ms p(90)=3.88µs p(95)=7.81µs http_req_connecting............: avg=22.06µs min=0s med=0s max=3.34ms p(90)=0s p(95)=0s http_req_duration..............: avg=910.78ms min=538.24ms med=906.56ms max=1.34s p(90)=1.06s p(95)=1.11s { expected_response:true }...: avg=910.78ms min=538.24ms med=906.56ms max=1.34s p(90)=1.06s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3233 http_req_receiving.............: avg=10.78ms min=40.37µs med=86.52µs max=295.65ms p(90)=38.75ms p(95)=70.33ms http_req_sending...............: avg=1.26ms min=7.89µs med=12.63µs max=195.16ms p(90)=38.19µs p(95)=224.08µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=898.72ms min=520.77ms med=897.92ms max=1.21s p(90)=1.04s p(95)=1.07s http_reqs......................: 3233 104.667394/s iteration_duration.............: avg=945.54ms min=592.99ms med=936.03ms max=1.35s p(90)=1.11s p(95)=1.16s iterations.....................: 3233 104.667394/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9495 ✗ 0 data_received..................: 278 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=53.05µs min=1.41µs med=2.88µs max=9.42ms p(90)=4.51µs p(95)=8.55µs http_req_connecting............: avg=47.7µs min=0s med=0s max=9.35ms p(90)=0s p(95)=0s http_req_duration..............: avg=922.02ms min=312.55ms med=913.71ms max=2.05s p(90)=1.21s p(95)=1.3s { expected_response:true }...: avg=922.02ms min=312.55ms med=913.71ms max=2.05s p(90)=1.21s p(95)=1.3s http_req_failed................: 0.00% ✓ 0 ✗ 3165 http_req_receiving.............: avg=14.16ms min=37.72µs med=82.89µs max=1.01s p(90)=13.76ms p(95)=73.13ms http_req_sending...............: avg=546.72µs min=8.85µs med=13.93µs max=142.54ms p(90)=41.11µs p(95)=235.75µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=907.31ms min=312.35ms med=900.04ms max=1.73s p(90)=1.19s p(95)=1.28s http_reqs......................: 3165 102.510908/s iteration_duration.............: avg=961.11ms min=322.63ms med=950.36ms max=2.08s p(90)=1.27s p(95)=1.36s iterations.....................: 3165 102.510908/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7575 ✗ 0 data_received..................: 222 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=48.32µs min=1.01µs med=2.67µs max=8.47ms p(90)=4.09µs p(95)=9.46µs http_req_connecting............: avg=37.25µs min=0s med=0s max=8.44ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=794.94ms med=1.14s max=1.8s p(90)=1.35s p(95)=1.48s { expected_response:true }...: avg=1.16s min=794.94ms med=1.14s max=1.8s p(90)=1.35s p(95)=1.48s http_req_failed................: 0.00% ✓ 0 ✗ 2525 http_req_receiving.............: avg=14.22ms min=38.55µs med=83.42µs max=262ms p(90)=56.33ms p(95)=97.8ms http_req_sending...............: avg=1.21ms min=8.63µs med=13.27µs max=140.73ms p(90)=58.27µs p(95)=432.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=794.87ms med=1.13s max=1.61s p(90)=1.34s p(95)=1.47s http_reqs......................: 2525 80.570893/s iteration_duration.............: avg=1.19s min=804.94ms med=1.18s max=1.85s p(90)=1.41s p(95)=1.52s iterations.....................: 2525 80.570893/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5874 ✗ 0 data_received..................: 172 MB 5.5 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=165.13µs min=1.47µs med=3.75µs max=7.51ms p(90)=5.59µs p(95)=278.69µs http_req_connecting............: avg=155.57µs min=0s med=0s max=7.48ms p(90)=0s p(95)=249.01µs http_req_duration..............: avg=1.53s min=686.92ms med=1.48s max=3.74s p(90)=1.93s p(95)=2.1s { expected_response:true }...: avg=1.53s min=686.92ms med=1.48s max=3.74s p(90)=1.93s p(95)=2.1s http_req_failed................: 0.00% ✓ 0 ✗ 1958 http_req_receiving.............: avg=2.01ms min=40.89µs med=122.39µs max=181.32ms p(90)=2.13ms p(95)=10.3ms http_req_sending...............: avg=148.38µs min=9.07µs med=19.69µs max=120.04ms p(90)=42.22µs p(95)=152.42µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.53s min=686.65ms med=1.48s max=3.74s p(90)=1.93s p(95)=2.1s http_reqs......................: 1958 63.205363/s iteration_duration.............: avg=1.56s min=701.56ms med=1.51s max=3.76s p(90)=1.96s p(95)=2.13s iterations.....................: 1958 63.205363/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5835 ✗ 0 data_received..................: 171 MB 5.5 MB/s data_sent......................: 2.3 MB 74 kB/s http_req_blocked...............: avg=74.02µs min=1.77µs med=4.48µs max=4.44ms p(90)=6.34µs p(95)=99.78µs http_req_connecting............: avg=57.92µs min=0s med=0s max=4.38ms p(90)=0s p(95)=66.99µs http_req_duration..............: avg=1.57s min=693.52ms med=1.5s max=10s p(90)=1.73s p(95)=1.81s { expected_response:true }...: avg=1.57s min=693.52ms med=1.5s max=10s p(90)=1.73s p(95)=1.81s http_req_failed................: 0.00% ✓ 0 ✗ 1945 http_req_receiving.............: avg=164.28µs min=54.83µs med=130.5µs max=10.35ms p(90)=194.38µs p(95)=237.73µs http_req_sending...............: avg=47.9µs min=9.47µs med=24.31µs max=3.33ms p(90)=38.27µs p(95)=61.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.57s min=693.4ms med=1.5s max=10s p(90)=1.73s p(95)=1.81s http_reqs......................: 1945 62.150851/s iteration_duration.............: avg=1.59s min=703.03ms med=1.51s max=10.01s p(90)=1.75s p(95)=1.83s iterations.....................: 1945 62.150851/s vus............................: 48 min=48 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1416 ✗ 0 data_received..................: 41 MB 1.1 MB/s data_sent......................: 560 kB 15 kB/s http_req_blocked...............: avg=579.89µs min=1.69µs med=4.29µs max=6.5ms p(90)=2.15ms p(95)=4.3ms http_req_connecting............: avg=527.18µs min=0s med=0s max=6.45ms p(90)=2.09ms p(95)=3.76ms http_req_duration..............: avg=7.19s min=2.93s med=7.51s max=8.79s p(90)=8.31s p(95)=8.47s { expected_response:true }...: avg=7.19s min=2.93s med=7.51s max=8.79s p(90)=8.31s p(95)=8.47s http_req_failed................: 0.00% ✓ 0 ✗ 472 http_req_receiving.............: avg=140.33µs min=61.7µs med=124.92µs max=1.31ms p(90)=188.1µs p(95)=218.88µs http_req_sending...............: avg=118.59µs min=9.79µs med=22.32µs max=11.57ms p(90)=352.24µs p(95)=431.73µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.19s min=2.93s med=7.51s max=8.79s p(90)=8.31s p(95)=8.47s http_reqs......................: 472 12.595988/s iteration_duration.............: avg=7.2s min=2.94s med=7.52s max=8.8s p(90)=8.32s p(95)=8.47s iterations.....................: 472 12.595988/s vus............................: 11 min=11 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview