search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @graphql-mesh/cli to v0.89.3 #393

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/cli (source) 0.89.0 -> 0.89.3 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/cli) ### [`v0.89.3`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0893) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/cli@0.89.2...@graphql-mesh/cli@0.89.3) ##### Patch Changes - Updated dependencies \[[`57f4a60`](https://togithub.com/ardatan/graphql-mesh/commit/57f4a601c1f9819937c784ab9aae68f3368cbefd)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.3 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.3 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.3 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.3 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.3 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.3 ### [`v0.89.2`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0892) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/26db58954b3e3d10555b196622ab659e16b49e6a...@graphql-mesh/cli@0.89.2) ##### Patch Changes - Updated dependencies \[[`7a712ab`](https://togithub.com/ardatan/graphql-mesh/commit/7a712ab915ac3216765951080e689d510b5682a6)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.2 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.2 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.2 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.2 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.2 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.2 ### [`v0.89.1`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0891) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/cli@0.89.0...26db58954b3e3d10555b196622ab659e16b49e6a) ##### Patch Changes - Updated dependencies \[[`dbaf72c`](https://togithub.com/ardatan/graphql-mesh/commit/dbaf72c4520f64524dce14b798019639c4d57020)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.1 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.1 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.1 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.1 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.1 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.1

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 148 4544 total, 0 failed avg: 621ms, p95: 827ms ✅
wundergraph 104 3227 total, 0 failed avg: 913ms, p95: 1145ms ✅
mesh-supergraph-bun 84 2605 total, 0 failed avg: 1148ms, p95: 1770ms ✅
cosmo 76 2375 total, 0 failed avg: 1243ms, p95: 1494ms ✅
apollo-server 47 1494 total, 0 failed avg: 2043ms, p95: 2384ms ✅
mesh-supergraph 30 985 total, 0 failed avg: 3160ms, p95: 5604ms ✅
mercurius 11 445 total, 0 failed avg: 7621ms, p95: 9035ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13632 ✗ 0 data_received..................: 399 MB 13 MB/s data_sent......................: 5.4 MB 177 kB/s http_req_blocked...............: avg=40.11µs min=1.36µs med=2.78µs max=24.26ms p(90)=4.22µs p(95)=5.31µs http_req_connecting............: avg=25.91µs min=0s med=0s max=7.7ms p(90)=0s p(95)=0s http_req_duration..............: avg=620.82ms min=309.47ms med=607.29ms max=1.2s p(90)=768.74ms p(95)=827.34ms { expected_response:true }...: avg=620.82ms min=309.47ms med=607.29ms max=1.2s p(90)=768.74ms p(95)=827.34ms http_req_failed................: 0.00% ✓ 0 ✗ 4544 http_req_receiving.............: avg=11.85ms min=36.69µs med=71.37µs max=372.78ms p(90)=43.95ms p(95)=82.69ms http_req_sending...............: avg=1.04ms min=8.18µs med=13.5µs max=222.87ms p(90)=34.22µs p(95)=447.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=607.91ms min=309.41ms med=597.33ms max=1.02s p(90)=750.58ms p(95)=803.48ms http_reqs......................: 4544 148.710455/s iteration_duration.............: avg=667.29ms min=319.88ms med=649.97ms max=1.3s p(90)=835.48ms p(95)=912.47ms iterations.....................: 4544 148.710455/s vus............................: 93 min=93 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9681 ✗ 0 data_received..................: 283 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=39.22µs min=1.28µs med=2.6µs max=3.39ms p(90)=4.01µs p(95)=8.25µs http_req_connecting............: avg=33.5µs min=0s med=0s max=3.35ms p(90)=0s p(95)=0s http_req_duration..............: avg=913.23ms min=519.6ms med=904.55ms max=1.46s p(90)=1.08s p(95)=1.14s { expected_response:true }...: avg=913.23ms min=519.6ms med=904.55ms max=1.46s p(90)=1.08s p(95)=1.14s http_req_failed................: 0.00% ✓ 0 ✗ 3227 http_req_receiving.............: avg=9.87ms min=39.79µs med=79.23µs max=295.28ms p(90)=27.92ms p(95)=65.51ms http_req_sending...............: avg=1.03ms min=8.07µs med=13.23µs max=245.93ms p(90)=38.04µs p(95)=178.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=902.32ms min=513.7ms med=897.19ms max=1.28s p(90)=1.07s p(95)=1.12s http_reqs......................: 3227 104.429012/s iteration_duration.............: avg=946.25ms min=531.63ms med=934.13ms max=1.47s p(90)=1.11s p(95)=1.19s iterations.....................: 3227 104.429012/s vus............................: 77 min=77 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7815 ✗ 0 data_received..................: 229 MB 7.4 MB/s data_sent......................: 3.1 MB 100 kB/s http_req_blocked...............: avg=65.48µs min=1.41µs med=3.02µs max=20.27ms p(90)=5.22µs p(95)=10.7µs http_req_connecting............: avg=48.31µs min=0s med=0s max=7.8ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=496.52ms med=1.09s max=2.66s p(90)=1.52s p(95)=1.77s { expected_response:true }...: avg=1.14s min=496.52ms med=1.09s max=2.66s p(90)=1.52s p(95)=1.77s http_req_failed................: 0.00% ✓ 0 ✗ 2605 http_req_receiving.............: avg=14.72ms min=39.36µs med=88.28µs max=602.17ms p(90)=2.76ms p(95)=69.35ms http_req_sending...............: avg=574.52µs min=8.14µs med=14.35µs max=149.77ms p(90)=40.13µs p(95)=403.32µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=496.36ms med=1.08s max=2.66s p(90)=1.47s p(95)=1.74s http_reqs......................: 2605 84.10268/s iteration_duration.............: avg=1.17s min=507.43ms med=1.12s max=2.7s p(90)=1.58s p(95)=1.82s iterations.....................: 2605 84.10268/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7125 ✗ 0 data_received..................: 208 MB 6.7 MB/s data_sent......................: 2.8 MB 91 kB/s http_req_blocked...............: avg=53.35µs min=1.41µs med=3.11µs max=3.16ms p(90)=5.13µs p(95)=11.59µs http_req_connecting............: avg=43.7µs min=0s med=0s max=3.09ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.24s min=827.57ms med=1.24s max=1.86s p(90)=1.42s p(95)=1.49s { expected_response:true }...: avg=1.24s min=827.57ms med=1.24s max=1.86s p(90)=1.42s p(95)=1.49s http_req_failed................: 0.00% ✓ 0 ✗ 2375 http_req_receiving.............: avg=11.39ms min=37.21µs med=94.91µs max=366.95ms p(90)=33.82ms p(95)=74.98ms http_req_sending...............: avg=1.25ms min=8.65µs med=14.19µs max=348.24ms p(90)=54.56µs p(95)=960.72µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.23s min=827.48ms med=1.23s max=1.62s p(90)=1.4s p(95)=1.46s http_reqs......................: 2375 76.625901/s iteration_duration.............: avg=1.28s min=840.72ms med=1.27s max=1.87s p(90)=1.49s p(95)=1.6s iterations.....................: 2375 76.625901/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4482 ✗ 0 data_received..................: 131 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=62.99µs min=1.72µs med=3.8µs max=3.01ms p(90)=5.63µs p(95)=187.53µs http_req_connecting............: avg=53.94µs min=0s med=0s max=2.97ms p(90)=0s p(95)=141.5µs http_req_duration..............: avg=2.04s min=997.54ms med=1.82s max=14.47s p(90)=2.24s p(95)=2.38s { expected_response:true }...: avg=2.04s min=997.54ms med=1.82s max=14.47s p(90)=2.24s p(95)=2.38s http_req_failed................: 0.00% ✓ 0 ✗ 1494 http_req_receiving.............: avg=228.58µs min=55.52µs med=127.19µs max=30.52ms p(90)=186.06µs p(95)=232.19µs http_req_sending...............: avg=46µs min=8.86µs med=19.63µs max=1.35ms p(90)=36.93µs p(95)=156.49µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.04s min=997.39ms med=1.82s max=14.46s p(90)=2.24s p(95)=2.38s http_reqs......................: 1494 47.762925/s iteration_duration.............: avg=2.05s min=1s med=1.83s max=14.47s p(90)=2.25s p(95)=2.39s iterations.....................: 1494 47.762925/s vus............................: 37 min=37 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2955 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=329.12µs min=1.38µs med=3.42µs max=6.57ms p(90)=482.75µs p(95)=2.93ms http_req_connecting............: avg=318.3µs min=0s med=0s max=6.48ms p(90)=440.65µs p(95)=2.83ms http_req_duration..............: avg=3.16s min=1.16s med=2.57s max=7.61s p(90)=5.17s p(95)=5.6s { expected_response:true }...: avg=3.16s min=1.16s med=2.57s max=7.61s p(90)=5.17s p(95)=5.6s http_req_failed................: 0.00% ✓ 0 ✗ 985 http_req_receiving.............: avg=3.37ms min=42.58µs med=177.84µs max=88.05ms p(90)=1.76ms p(95)=10.52ms http_req_sending...............: avg=58.44µs min=8.22µs med=18.16µs max=13.63ms p(90)=99.44µs p(95)=195.76µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.15s min=1.16s med=2.57s max=7.61s p(90)=5.17s p(95)=5.6s http_reqs......................: 985 30.740795/s iteration_duration.............: avg=3.17s min=1.18s med=2.59s max=7.61s p(90)=5.19s p(95)=5.61s iterations.....................: 985 30.740795/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1335 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 528 kB 14 kB/s http_req_blocked...............: avg=324.36µs min=1.72µs med=4.28µs max=5.19ms p(90)=1.04ms p(95)=2.56ms http_req_connecting............: avg=268.34µs min=0s med=0s max=4.33ms p(90)=859.36µs p(95)=2.09ms http_req_duration..............: avg=7.62s min=3.09s med=7.8s max=9.48s p(90)=8.89s p(95)=9.03s { expected_response:true }...: avg=7.62s min=3.09s med=7.8s max=9.48s p(90)=8.89s p(95)=9.03s http_req_failed................: 0.00% ✓ 0 ✗ 445 http_req_receiving.............: avg=475.96µs min=66.76µs med=132.76µs max=72.14ms p(90)=211.86µs p(95)=244.78µs http_req_sending...............: avg=143.24µs min=9.48µs med=23.46µs max=3.49ms p(90)=647.13µs p(95)=940.42µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.62s min=3.09s med=7.8s max=9.48s p(90)=8.89s p(95)=9.03s http_reqs......................: 445 11.872373/s iteration_duration.............: avg=7.62s min=3.1s med=7.81s max=9.49s p(90)=8.89s p(95)=9.04s iterations.....................: 445 11.872373/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 164 5040 total, 0 failed avg: 536ms, p95: 723ms ✅
wundergraph 105 3288 total, 0 failed avg: 892ms, p95: 1104ms ✅
mesh-supergraph-bun 97 3038 total, 0 failed avg: 961ms, p95: 1406ms ✅
cosmo 79 2486 total, 0 failed avg: 1197ms, p95: 1462ms ✅
mesh-supergraph 64 2011 total, 0 failed avg: 1499ms, p95: 2055ms ✅
apollo-server 61 1933 total, 0 failed avg: 1585ms, p95: 1846ms ✅
mercurius 12 475 total, 0 failed avg: 7153ms, p95: 8474ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15120 ✗ 0 data_received..................: 442 MB 14 MB/s data_sent......................: 6.0 MB 195 kB/s http_req_blocked...............: avg=44.06µs min=1.7µs med=3.17µs max=8.89ms p(90)=5.05µs p(95)=6.9µs http_req_connecting............: avg=34.24µs min=0s med=0s max=5.35ms p(90)=0s p(95)=0s http_req_duration..............: avg=536.19ms min=242.34ms med=526.14ms max=1.15s p(90)=673.81ms p(95)=723.29ms { expected_response:true }...: avg=536.19ms min=242.34ms med=526.14ms max=1.15s p(90)=673.81ms p(95)=723.29ms http_req_failed................: 0.00% ✓ 0 ✗ 5040 http_req_receiving.............: avg=15.23ms min=39.46µs med=80.71µs max=403.7ms p(90)=55.87ms p(95)=100.7ms http_req_sending...............: avg=1.76ms min=8.22µs med=14.61µs max=452.7ms p(90)=50.29µs p(95)=951.18µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=519.2ms min=242.21ms med=511.75ms max=1.02s p(90)=645.56ms p(95)=694.02ms http_reqs......................: 5040 164.360778/s iteration_duration.............: avg=599.91ms min=277.96ms med=583.47ms max=1.22s p(90)=767.83ms p(95)=843.11ms iterations.....................: 5040 164.360778/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9864 ✗ 0 data_received..................: 289 MB 9.3 MB/s data_sent......................: 3.9 MB 126 kB/s http_req_blocked...............: avg=15.42µs min=1.37µs med=2.92µs max=1.8ms p(90)=4.39µs p(95)=8.04µs http_req_connecting............: avg=10.05µs min=0s med=0s max=1.43ms p(90)=0s p(95)=0s http_req_duration..............: avg=892.17ms min=507.21ms med=882.74ms max=1.61s p(90)=1.03s p(95)=1.1s { expected_response:true }...: avg=892.17ms min=507.21ms med=882.74ms max=1.61s p(90)=1.03s p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 3288 http_req_receiving.............: avg=12.68ms min=38.76µs med=90.3µs max=564ms p(90)=42.69ms p(95)=88.1ms http_req_sending...............: avg=1.35ms min=8.57µs med=13.85µs max=193.84ms p(90)=40.35µs p(95)=164.08µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=878.13ms min=506.61ms med=872.72ms max=1.21s p(90)=1.02s p(95)=1.07s http_reqs......................: 3288 105.949005/s iteration_duration.............: avg=931.17ms min=534.72ms med=918.24ms max=1.62s p(90)=1.08s p(95)=1.16s iterations.....................: 3288 105.949005/s vus............................: 19 min=19 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9114 ✗ 0 data_received..................: 267 MB 8.6 MB/s data_sent......................: 3.6 MB 116 kB/s http_req_blocked...............: avg=62.39µs min=1.69µs med=3.43µs max=88.07ms p(90)=5.61µs p(95)=10.96µs http_req_connecting............: avg=23.74µs min=0s med=0s max=2.19ms p(90)=0s p(95)=0s http_req_duration..............: avg=960.89ms min=401.62ms med=939.66ms max=1.93s p(90)=1.28s p(95)=1.4s { expected_response:true }...: avg=960.89ms min=401.62ms med=939.66ms max=1.93s p(90)=1.28s p(95)=1.4s http_req_failed................: 0.00% ✓ 0 ✗ 3038 http_req_receiving.............: avg=18.75ms min=37.26µs med=90.55µs max=875.83ms p(90)=17.45ms p(95)=124.4ms http_req_sending...............: avg=634.88µs min=9.09µs med=16.39µs max=178.07ms p(90)=53.02µs p(95)=321.76µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=941.5ms min=401.32ms med=923.28ms max=1.78s p(90)=1.24s p(95)=1.35s http_reqs......................: 3038 97.74933/s iteration_duration.............: avg=1s min=410.66ms med=984.33ms max=1.97s p(90)=1.35s p(95)=1.46s iterations.....................: 3038 97.74933/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7458 ✗ 0 data_received..................: 218 MB 7.0 MB/s data_sent......................: 3.0 MB 95 kB/s http_req_blocked...............: avg=67.85µs min=1.15µs med=2.71µs max=4.59ms p(90)=4.54µs p(95)=10.02µs http_req_connecting............: avg=62.59µs min=0s med=0s max=4.56ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=754.79ms med=1.18s max=1.78s p(90)=1.37s p(95)=1.46s { expected_response:true }...: avg=1.19s min=754.79ms med=1.18s max=1.78s p(90)=1.37s p(95)=1.46s http_req_failed................: 0.00% ✓ 0 ✗ 2486 http_req_receiving.............: avg=11.44ms min=36.1µs med=85.43µs max=407.57ms p(90)=38.51ms p(95)=76.78ms http_req_sending...............: avg=967.72µs min=8.44µs med=13.3µs max=260.5ms p(90)=42.23µs p(95)=508.56µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=754.64ms med=1.18s max=1.63s p(90)=1.35s p(95)=1.42s http_reqs......................: 2486 79.834976/s iteration_duration.............: avg=1.23s min=810.11ms med=1.21s max=1.91s p(90)=1.42s p(95)=1.53s iterations.....................: 2486 79.834976/s vus............................: 39 min=39 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6033 ✗ 0 data_received..................: 176 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=194.57µs min=1.6µs med=3.84µs max=44.21ms p(90)=5.83µs p(95)=186.22µs http_req_connecting............: avg=166.18µs min=0s med=0s max=7.18ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.49s min=800.83ms med=1.45s max=3.35s p(90)=1.77s p(95)=2.05s { expected_response:true }...: avg=1.49s min=800.83ms med=1.45s max=3.35s p(90)=1.77s p(95)=2.05s http_req_failed................: 0.00% ✓ 0 ✗ 2011 http_req_receiving.............: avg=1.13ms min=41.58µs med=112.58µs max=110.58ms p(90)=986.42µs p(95)=5.68ms http_req_sending...............: avg=135.02µs min=7.78µs med=20.09µs max=44.1ms p(90)=39.3µs p(95)=313.7µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.49s min=798.55ms med=1.45s max=3.35s p(90)=1.76s p(95)=2.05s http_reqs......................: 2011 64.89967/s iteration_duration.............: avg=1.52s min=813.33ms med=1.48s max=3.37s p(90)=1.79s p(95)=2.08s iterations.....................: 2011 64.89967/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5799 ✗ 0 data_received..................: 170 MB 5.4 MB/s data_sent......................: 2.3 MB 74 kB/s http_req_blocked...............: avg=101.21µs min=1.66µs med=4.58µs max=5.31ms p(90)=6.23µs p(95)=114.42µs http_req_connecting............: avg=92.21µs min=0s med=0s max=5.22ms p(90)=0s p(95)=75.64µs http_req_duration..............: avg=1.58s min=773.87ms med=1.51s max=9.87s p(90)=1.75s p(95)=1.84s { expected_response:true }...: avg=1.58s min=773.87ms med=1.51s max=9.87s p(90)=1.75s p(95)=1.84s http_req_failed................: 0.00% ✓ 0 ✗ 1933 http_req_receiving.............: avg=207.23µs min=52µs med=128.95µs max=24.98ms p(90)=195.1µs p(95)=270.68µs http_req_sending...............: avg=65.99µs min=9.59µs med=25.75µs max=13.92ms p(90)=40.43µs p(95)=75.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.58s min=773.71ms med=1.51s max=9.86s p(90)=1.75s p(95)=1.84s http_reqs......................: 1933 61.977923/s iteration_duration.............: avg=1.59s min=784.82ms med=1.52s max=9.88s p(90)=1.77s p(95)=1.86s iterations.....................: 1933 61.977923/s vus............................: 41 min=41 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1425 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 564 kB 15 kB/s http_req_blocked...............: avg=85.39µs min=1.5µs med=3.09µs max=1.56ms p(90)=314µs p(95)=538.75µs http_req_connecting............: avg=72.91µs min=0s med=0s max=1.53ms p(90)=251.6µs p(95)=491.48µs http_req_duration..............: avg=7.15s min=3.22s med=7.42s max=8.75s p(90)=8.34s p(95)=8.47s { expected_response:true }...: avg=7.15s min=3.22s med=7.42s max=8.75s p(90)=8.34s p(95)=8.47s http_req_failed................: 0.00% ✓ 0 ✗ 475 http_req_receiving.............: avg=124.47µs min=55.24µs med=113.52µs max=555.49µs p(90)=165.83µs p(95)=196.26µs http_req_sending...............: avg=56.82µs min=8.56µs med=18.41µs max=668.29µs p(90)=122.19µs p(95)=312.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.15s min=3.22s med=7.42s max=8.75s p(90)=8.34s p(95)=8.47s http_reqs......................: 475 12.66831/s iteration_duration.............: avg=7.15s min=3.23s med=7.43s max=8.75s p(90)=8.35s p(95)=8.48s iterations.....................: 475 12.66831/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5328 total, 0 failed avg: 492ms, p95: 733ms ✅
apollo-router 166 5068 total, 0 failed avg: 541ms, p95: 737ms ✅
wundergraph 158 4846 total, 0 failed avg: 525ms, p95: 926ms ✅
mesh-supergraph-bun 91 2839 total, 0 failed avg: 1055ms, p95: 1776ms ✅
apollo-server 47 1499 total, 0 failed avg: 2042ms, p95: 2953ms ✅
mesh-supergraph 30 958 total, 0 failed avg: 3207ms, p95: 5122ms ✅
mercurius 29 903 total, 0 failed avg: 3358ms, p95: 4473ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15984 ✗ 0 data_received..................: 467 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=30.9µs min=1.34µs med=2.65µs max=4.65ms p(90)=3.99µs p(95)=4.89µs http_req_connecting............: avg=26.88µs min=0s med=0s max=4.62ms p(90)=0s p(95)=0s http_req_duration..............: avg=491.84ms min=21.41ms med=489.85ms max=1.49s p(90)=621.03ms p(95)=733.21ms { expected_response:true }...: avg=491.84ms min=21.41ms med=489.85ms max=1.49s p(90)=621.03ms p(95)=733.21ms http_req_failed................: 0.00% ✓ 0 ✗ 5328 http_req_receiving.............: avg=35.04ms min=37.09µs med=74.99µs max=1.14s p(90)=100.8ms p(95)=276.5ms http_req_sending...............: avg=1.65ms min=8.21µs med=12.72µs max=727.28ms p(90)=32.73µs p(95)=203.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=455.13ms min=20.26ms med=475.18ms max=792.77ms p(90)=563.64ms p(95)=591.67ms http_reqs......................: 5328 175.276346/s iteration_duration.............: avg=567.35ms min=40.61ms med=529.1ms max=2.43s p(90)=798.87ms p(95)=975.77ms iterations.....................: 5328 175.276346/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15204 ✗ 0 data_received..................: 445 MB 15 MB/s data_sent......................: 6.0 MB 198 kB/s http_req_blocked...............: avg=56.13µs min=1.41µs med=3.11µs max=127.63ms p(90)=5.15µs p(95)=6.45µs http_req_connecting............: avg=13.91µs min=0s med=0s max=2.88ms p(90)=0s p(95)=0s http_req_duration..............: avg=540.83ms min=28.84ms med=538.48ms max=1.63s p(90)=682.44ms p(95)=737.21ms { expected_response:true }...: avg=540.83ms min=28.84ms med=538.48ms max=1.63s p(90)=682.44ms p(95)=737.21ms http_req_failed................: 0.00% ✓ 0 ✗ 5068 http_req_receiving.............: avg=17.48ms min=34.84µs med=71.94µs max=1.02s p(90)=31.6ms p(95)=89.74ms http_req_sending...............: avg=1.23ms min=8.3µs med=14.35µs max=610.53ms p(90)=45.52µs p(95)=294.75µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=522.11ms min=16.14ms med=526.8ms max=982ms p(90)=653.7ms p(95)=694.8ms http_reqs......................: 5068 166.561012/s iteration_duration.............: avg=596.5ms min=47.76ms med=580.4ms max=2.11s p(90)=768.25ms p(95)=855.22ms iterations.....................: 5068 166.561012/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14538 ✗ 0 data_received..................: 425 MB 14 MB/s data_sent......................: 5.8 MB 188 kB/s http_req_blocked...............: avg=89.91µs min=1.42µs med=2.95µs max=74.13ms p(90)=4.87µs p(95)=6.01µs http_req_connecting............: avg=58.78µs min=0s med=0s max=6.95ms p(90)=0s p(95)=0s http_req_duration..............: avg=525.46ms min=19.89ms med=504.39ms max=2.33s p(90)=817.42ms p(95)=926.33ms { expected_response:true }...: avg=525.46ms min=19.89ms med=504.39ms max=2.33s p(90)=817.42ms p(95)=926.33ms http_req_failed................: 0.00% ✓ 0 ✗ 4846 http_req_receiving.............: avg=41.72ms min=40.01µs med=85.86µs max=2.13s p(90)=109.78ms p(95)=233.74ms http_req_sending...............: avg=2.52ms min=7.71µs med=13.53µs max=1.34s p(90)=38.26µs p(95)=524.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=481.21ms min=19.82ms med=474.2ms max=1.43s p(90)=756.75ms p(95)=853.03ms http_reqs......................: 4846 158.579296/s iteration_duration.............: avg=626.16ms min=32.07ms med=575.41ms max=3.04s p(90)=984.89ms p(95)=1.17s iterations.....................: 4846 158.579296/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8517 ✗ 0 data_received..................: 249 MB 8.0 MB/s data_sent......................: 3.4 MB 108 kB/s http_req_blocked...............: avg=44.12µs min=1.71µs med=3.88µs max=10.13ms p(90)=5.81µs p(95)=12.01µs http_req_connecting............: avg=30.62µs min=0s med=0s max=2.94ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.05s min=617.51ms med=925.16ms max=2.24s p(90)=1.65s p(95)=1.77s { expected_response:true }...: avg=1.05s min=617.51ms med=925.16ms max=2.24s p(90)=1.65s p(95)=1.77s http_req_failed................: 0.00% ✓ 0 ✗ 2839 http_req_receiving.............: avg=10.93ms min=41.95µs med=101.48µs max=509.26ms p(90)=990.45µs p(95)=38.49ms http_req_sending...............: avg=355.03µs min=8.98µs med=19.75µs max=68.41ms p(90)=40.69µs p(95)=163.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.04s min=605.98ms med=919.18ms max=2.24s p(90)=1.64s p(95)=1.76s http_reqs......................: 2839 91.340327/s iteration_duration.............: avg=1.08s min=641.98ms med=951.43ms max=2.27s p(90)=1.67s p(95)=1.8s iterations.....................: 2839 91.340327/s vus............................: 18 min=18 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4497 ✗ 0 data_received..................: 132 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=41.67µs min=1.73µs med=4.11µs max=1.61ms p(90)=5.86µs p(95)=157.64µs http_req_connecting............: avg=32.78µs min=0s med=0s max=1.55ms p(90)=0s p(95)=126.04µs http_req_duration..............: avg=2.04s min=393ms med=1.66s max=22.22s p(90)=2.09s p(95)=2.95s { expected_response:true }...: avg=2.04s min=393ms med=1.66s max=22.22s p(90)=2.09s p(95)=2.95s http_req_failed................: 0.00% ✓ 0 ✗ 1499 http_req_receiving.............: avg=208.35µs min=46.98µs med=129.88µs max=54.37ms p(90)=185.99µs p(95)=216.22µs http_req_sending...............: avg=48.04µs min=10.53µs med=23.79µs max=2.17ms p(90)=38.39µs p(95)=84.67µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.04s min=392.85ms med=1.66s max=22.22s p(90)=2.09s p(95)=2.95s http_reqs......................: 1499 47.827416/s iteration_duration.............: avg=2.05s min=402.91ms med=1.67s max=22.22s p(90)=2.1s p(95)=2.96s iterations.....................: 1499 47.827416/s vus............................: 37 min=37 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2874 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=81.05µs min=1.39µs med=3.5µs max=3.08ms p(90)=92.45µs p(95)=556.56µs http_req_connecting............: avg=65.73µs min=0s med=0s max=2.18ms p(90)=61.79µs p(95)=453.56µs http_req_duration..............: avg=3.2s min=1.23s med=3.06s max=6.29s p(90)=4.26s p(95)=5.12s { expected_response:true }...: avg=3.2s min=1.23s med=3.06s max=6.29s p(90)=4.26s p(95)=5.12s http_req_failed................: 0.00% ✓ 0 ✗ 958 http_req_receiving.............: avg=3.6ms min=37.6µs med=143.91µs max=81.55ms p(90)=3.31ms p(95)=16.97ms http_req_sending...............: avg=66.18µs min=7.77µs med=19.36µs max=5.42ms p(90)=86.8µs p(95)=317.68µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.2s min=1.23s med=3.06s max=6.29s p(90)=4.26s p(95)=5.12s http_reqs......................: 958 30.310662/s iteration_duration.............: avg=3.22s min=1.25s med=3.07s max=6.3s p(90)=4.27s p(95)=5.13s iterations.....................: 958 30.310662/s vus............................: 46 min=46 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2709 ✗ 0 data_received..................: 79 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=156.05µs min=1.68µs med=4.3µs max=3.92ms p(90)=129.62µs p(95)=1.26ms http_req_connecting............: avg=132.99µs min=0s med=0s max=3.64ms p(90)=94.41µs p(95)=1.03ms http_req_duration..............: avg=3.35s min=742.49ms med=3.13s max=7.13s p(90)=4.29s p(95)=4.47s { expected_response:true }...: avg=3.35s min=742.49ms med=3.13s max=7.13s p(90)=4.29s p(95)=4.47s http_req_failed................: 0.00% ✓ 0 ✗ 903 http_req_receiving.............: avg=269.86µs min=43.79µs med=123.6µs max=56.71ms p(90)=191.15µs p(95)=254.7µs http_req_sending...............: avg=81.62µs min=9µs med=24.62µs max=1.04ms p(90)=62.99µs p(95)=723.6µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.35s min=742.41ms med=3.13s max=7.13s p(90)=4.29s p(95)=4.47s http_reqs......................: 903 29.441766/s iteration_duration.............: avg=3.36s min=749.62ms med=3.14s max=7.14s p(90)=4.3s p(95)=4.47s iterations.....................: 903 29.441766/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2345ms 171 12020 total, 0 failed avg: 778ms, p95: 2346ms, max: 5678ms, med: 530ms ❌ 4 unexpected GraphQL errors, non-compatible response structure (4)
wundergraph 2621ms 166 11634 total, 0 failed avg: 818ms, p95: 2622ms, max: 8514ms, med: 470ms ✅
apollo-router 2912ms 167 11724 total, 0 failed avg: 868ms, p95: 2913ms, max: 8181ms, med: 550ms ✅
mesh-supergraph-bun 5585ms 116 8136 total, 0 failed avg: 2251ms, p95: 5585ms, max: 9025ms, med: 2070ms ✅
mesh-supergraph 6969ms 66 4621 total, 0 failed avg: 4140ms, p95: 6970ms, max: 8475ms, med: 4208ms ✅
apollo-server 24956ms 66 4847 total, 0 failed avg: 4311ms, p95: 24956ms, max: 45583ms, med: 2257ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12016 / ✗ 4 ✗ valid response structure ↳ 99% — ✓ 12016 / ✗ 4 checks.........................: 99.97% ✓ 36052 ✗ 8 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 204 kB/s http_req_blocked...............: avg=16.71ms min=1.63µs med=3.34µs max=6.08s p(90)=5.62µs p(95)=13.73µs http_req_connecting............: avg=15.64ms min=0s med=0s max=6.08s p(90)=0s p(95)=0s http_req_duration..............: avg=777.88ms min=6.89ms med=530.23ms max=5.67s p(90)=1.84s p(95)=2.34s { expected_response:true }...: avg=777.88ms min=6.89ms med=530.23ms max=5.67s p(90)=1.84s p(95)=2.34s http_req_failed................: 0.00% ✓ 0 ✗ 12020 http_req_receiving.............: avg=316.22ms min=23.16µs med=91.9µs max=5.3s p(90)=1.28s p(95)=1.77s http_req_sending...............: avg=27.37ms min=8.31µs med=15.92µs max=3.58s p(90)=189.42µs p(95)=43.36ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=434.28ms min=6.81ms med=344.2ms max=2.39s p(90)=880.08ms p(95)=1.09s http_reqs......................: 12020 171.67084/s iteration_duration.............: avg=1.51s min=12.47ms med=991.9ms max=14.54s p(90)=3.66s p(95)=4.59s iterations.....................: 12020 171.67084/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34902 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 197 kB/s http_req_blocked...............: avg=13.83ms min=1.5µs med=3.02µs max=6.25s p(90)=4.6µs p(95)=14.83µs http_req_connecting............: avg=13.39ms min=0s med=0s max=5.01s p(90)=0s p(95)=0s http_req_duration..............: avg=817.68ms min=5.96ms med=469.65ms max=8.51s p(90)=1.99s p(95)=2.62s { expected_response:true }...: avg=817.68ms min=5.96ms med=469.65ms max=8.51s p(90)=1.99s p(95)=2.62s http_req_failed................: 0.00% ✓ 0 ✗ 11634 http_req_receiving.............: avg=385.16ms min=35.74µs med=86.73µs max=5.62s p(90)=1.32s p(95)=1.99s http_req_sending...............: avg=46.92ms min=8.15µs med=14.15µs max=5.63s p(90)=5.22ms p(95)=107.82ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=385.59ms min=5.88ms med=294.23ms max=2.77s p(90)=822.19ms p(95)=979.22ms http_reqs......................: 11634 166.180257/s iteration_duration.............: avg=1.57s min=11.3ms med=927.13ms max=15.11s p(90)=3.83s p(95)=5.23s iterations.....................: 11634 166.180257/s vus............................: 1 min=1 max=497 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35172 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 199 kB/s http_req_blocked...............: avg=13.64ms min=1.62µs med=3.67µs max=4.73s p(90)=6.06µs p(95)=14.82µs http_req_connecting............: avg=12.88ms min=0s med=0s max=4.29s p(90)=0s p(95)=0s http_req_duration..............: avg=868.11ms min=7.49ms med=549.91ms max=8.18s p(90)=2.05s p(95)=2.91s { expected_response:true }...: avg=868.11ms min=7.49ms med=549.91ms max=8.18s p(90)=2.05s p(95)=2.91s http_req_failed................: 0.00% ✓ 0 ✗ 11724 http_req_receiving.............: avg=362.61ms min=34.76µs med=97.77µs max=6.47s p(90)=1.34s p(95)=2.16s http_req_sending...............: avg=34.91ms min=8.75µs med=17.12µs max=5.33s p(90)=226.57µs p(95)=58ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=470.58ms min=7.39ms med=410.34ms max=2.2s p(90)=847.15ms p(95)=1.06s http_reqs......................: 11724 167.462825/s iteration_duration.............: avg=1.56s min=13.48ms med=926.71ms max=16.09s p(90)=3.83s p(95)=4.94s iterations.....................: 11724 167.462825/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24408 ✗ 0 data_received..................: 714 MB 10 MB/s data_sent......................: 9.7 MB 138 kB/s http_req_blocked...............: avg=2.19ms min=1.39µs med=2.95µs max=425.87ms p(90)=5.14µs p(95)=222.43µs http_req_connecting............: avg=2.16ms min=0s med=0s max=425.81ms p(90)=0s p(95)=148.98µs http_req_duration..............: avg=2.25s min=4.97ms med=2.06s max=9.02s p(90)=4.42s p(95)=5.58s { expected_response:true }...: avg=2.25s min=4.97ms med=2.06s max=9.02s p(90)=4.42s p(95)=5.58s http_req_failed................: 0.00% ✓ 0 ✗ 8136 http_req_receiving.............: avg=25.42ms min=36.66µs med=73.53µs max=1.78s p(90)=11.63ms p(95)=144.37ms http_req_sending...............: avg=2.74ms min=8.34µs med=14.08µs max=461.19ms p(90)=83.74µs p(95)=6.9ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.22s min=4.79ms med=2.04s max=8.76s p(90)=4.3s p(95)=5.57s http_reqs......................: 8136 116.222234/s iteration_duration.............: avg=2.32s min=11.17ms med=2.13s max=9.14s p(90)=4.47s p(95)=5.7s iterations.....................: 8136 116.222234/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13863 ✗ 0 data_received..................: 406 MB 5.8 MB/s data_sent......................: 5.5 MB 78 kB/s http_req_blocked...............: avg=422.53µs min=1.56µs med=4.36µs max=122.13ms p(90)=195.43µs p(95)=482.93µs http_req_connecting............: avg=390.98µs min=0s med=0s max=122.07ms p(90)=134.31µs p(95)=414.22µs http_req_duration..............: avg=4.14s min=11.25ms med=4.2s max=8.47s p(90)=6.6s p(95)=6.96s { expected_response:true }...: avg=4.14s min=11.25ms med=4.2s max=8.47s p(90)=6.6s p(95)=6.96s http_req_failed................: 0.00% ✓ 0 ✗ 4621 http_req_receiving.............: avg=4.05ms min=40.79µs med=116.19µs max=725.88ms p(90)=1.93ms p(95)=11.07ms http_req_sending...............: avg=388.93µs min=8.54µs med=24.21µs max=88.91ms p(90)=57.69µs p(95)=130.03µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.13s min=11.09ms med=4.2s max=8.47s p(90)=6.6s p(95)=6.96s http_reqs......................: 4621 66.01078/s iteration_duration.............: avg=4.17s min=17.09ms med=4.23s max=8.69s p(90)=6.66s p(95)=7s iterations.....................: 4621 66.01078/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14541 ✗ 0 data_received..................: 426 MB 5.8 MB/s data_sent......................: 5.8 MB 79 kB/s http_req_blocked...............: avg=77.26µs min=1.42µs med=3.76µs max=23.94ms p(90)=186.38µs p(95)=367.41µs http_req_connecting............: avg=65.27µs min=0s med=0s max=23.87ms p(90)=124.37µs p(95)=281.29µs http_req_duration..............: avg=4.31s min=93.12ms med=2.25s max=45.58s p(90)=3.48s p(95)=24.95s { expected_response:true }...: avg=4.31s min=93.12ms med=2.25s max=45.58s p(90)=3.48s p(95)=24.95s http_req_failed................: 0.00% ✓ 0 ✗ 4847 http_req_receiving.............: avg=441.87µs min=47.29µs med=124.42µs max=177.55ms p(90)=183.41µs p(95)=226.82µs http_req_sending...............: avg=51.88µs min=8.33µs med=20.13µs max=16.7ms p(90)=45.9µs p(95)=68.16µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.31s min=93.02ms med=2.25s max=45.58s p(90)=3.48s p(95)=24.95s http_reqs......................: 4847 66.118686/s iteration_duration.............: avg=4.32s min=100.96ms med=2.26s max=45.59s p(90)=3.49s p(95)=24.96s iterations.....................: 4847 66.118686/s vus............................: 25 min=25 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview