search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @graphql-mesh/supergraph to v0.2.3 #395

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/supergraph (source) 0.2.0 -> 0.2.3 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/supergraph) ### [`v0.2.3`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/supergraph/CHANGELOG.md#023) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/supergraph@0.2.2...@graphql-mesh/supergraph@0.2.3) ##### Patch Changes - Updated dependencies \[[`57f4a60`](https://togithub.com/ardatan/graphql-mesh/commit/57f4a601c1f9819937c784ab9aae68f3368cbefd)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.3 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.3 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.3 ### [`v0.2.2`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/supergraph/CHANGELOG.md#022) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/26db58954b3e3d10555b196622ab659e16b49e6a...@graphql-mesh/supergraph@0.2.2) ##### Patch Changes - Updated dependencies \[[`7a712ab`](https://togithub.com/ardatan/graphql-mesh/commit/7a712ab915ac3216765951080e689d510b5682a6)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.2 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.2 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.2 ### [`v0.2.1`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/supergraph/CHANGELOG.md#021) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/supergraph@0.2.0...26db58954b3e3d10555b196622ab659e16b49e6a) ##### Patch Changes - Updated dependencies \[[`dbaf72c`](https://togithub.com/ardatan/graphql-mesh/commit/dbaf72c4520f64524dce14b798019639c4d57020)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.1 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.1 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.1

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 171 5198 total, 0 failed avg: 509ms, p95: 679ms ✅
apollo-router 169 5158 total, 0 failed avg: 526ms, p95: 702ms ✅
wundergraph 158 4818 total, 0 failed avg: 534ms, p95: 951ms ✅
mesh-supergraph-bun 98 3045 total, 0 failed avg: 979ms, p95: 1643ms ✅
apollo-server 49 1539 total, 0 failed avg: 1987ms, p95: 2413ms ✅
mercurius 30 943 total, 0 failed avg: 3209ms, p95: 4795ms ✅
mesh-supergraph 30 972 total, 0 failed avg: 3192ms, p95: 5153ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15594 ✗ 0 data_received..................: 456 MB 15 MB/s data_sent......................: 6.2 MB 204 kB/s http_req_blocked...............: avg=29.17µs min=1.41µs med=3.07µs max=44.19ms p(90)=5.11µs p(95)=6.36µs http_req_connecting............: avg=14.46µs min=0s med=0s max=8.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=509.07ms min=48.14ms med=508.03ms max=1.84s p(90)=619.82ms p(95)=679.16ms { expected_response:true }...: avg=509.07ms min=48.14ms med=508.03ms max=1.84s p(90)=619.82ms p(95)=679.16ms http_req_failed................: 0.00% ✓ 0 ✗ 5198 http_req_receiving.............: avg=26.86ms min=38.28µs med=83.25µs max=1.59s p(90)=68.4ms p(95)=179.4ms http_req_sending...............: avg=1.49ms min=8.36µs med=14.09µs max=788.24ms p(90)=41.07µs p(95)=240.16µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=480.71ms min=16.23ms med=494.05ms max=786.87ms p(90)=579.29ms p(95)=607.8ms http_reqs......................: 5198 171.625197/s iteration_duration.............: avg=580.07ms min=62.45ms med=551.12ms max=2.21s p(90)=782.57ms p(95)=905.97ms iterations.....................: 5198 171.625197/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15474 ✗ 0 data_received..................: 453 MB 15 MB/s data_sent......................: 6.1 MB 201 kB/s http_req_blocked...............: avg=69.83µs min=1.26µs med=2.82µs max=109.67ms p(90)=4.39µs p(95)=5.58µs http_req_connecting............: avg=33.46µs min=0s med=0s max=8.36ms p(90)=0s p(95)=0s http_req_duration..............: avg=525.79ms min=92.12ms med=523.59ms max=2.23s p(90)=654.44ms p(95)=702.43ms { expected_response:true }...: avg=525.79ms min=92.12ms med=523.59ms max=2.23s p(90)=654.44ms p(95)=702.43ms http_req_failed................: 0.00% ✓ 0 ✗ 5158 http_req_receiving.............: avg=15.41ms min=35.69µs med=68.89µs max=1.68s p(90)=23.75ms p(95)=87.71ms http_req_sending...............: avg=1.59ms min=8.06µs med=13.72µs max=1.52s p(90)=33.05µs p(95)=222.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=508.78ms min=92.05ms med=514.78ms max=870.58ms p(90)=629.7ms p(95)=665.36ms http_reqs......................: 5158 169.170365/s iteration_duration.............: avg=586.17ms min=116.8ms med=566.51ms max=2.56s p(90)=734.53ms p(95)=817.84ms iterations.....................: 5158 169.170365/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14454 ✗ 0 data_received..................: 423 MB 14 MB/s data_sent......................: 5.7 MB 188 kB/s http_req_blocked...............: avg=78.36µs min=1.31µs med=2.72µs max=245.21ms p(90)=4.43µs p(95)=5.83µs http_req_connecting............: avg=65.11µs min=0s med=0s max=245.14ms p(90)=0s p(95)=0s http_req_duration..............: avg=533.87ms min=34.2ms med=499.84ms max=1.68s p(90)=843.33ms p(95)=950.87ms { expected_response:true }...: avg=533.87ms min=34.2ms med=499.84ms max=1.68s p(90)=843.33ms p(95)=950.87ms http_req_failed................: 0.00% ✓ 0 ✗ 4818 http_req_receiving.............: avg=37.45ms min=37.37µs med=86.04µs max=1.11s p(90)=118.22ms p(95)=261.98ms http_req_sending...............: avg=2.31ms min=7.46µs med=13.53µs max=554.23ms p(90)=37.74µs p(95)=1.06ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=494.1ms min=34.01ms med=469.9ms max=1.32s p(90)=783.08ms p(95)=869.34ms http_reqs......................: 4818 158.652809/s iteration_duration.............: avg=626.76ms min=45.11ms med=579.01ms max=2.09s p(90)=978.48ms p(95)=1.16s iterations.....................: 4818 158.652809/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9135 ✗ 0 data_received..................: 267 MB 8.6 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=30.92µs min=1.29µs med=2.92µs max=12.02ms p(90)=4.59µs p(95)=8.8µs http_req_connecting............: avg=20.58µs min=0s med=0s max=2.25ms p(90)=0s p(95)=0s http_req_duration..............: avg=979.11ms min=465.37ms med=857.08ms max=3.73s p(90)=1.52s p(95)=1.64s { expected_response:true }...: avg=979.11ms min=465.37ms med=857.08ms max=3.73s p(90)=1.52s p(95)=1.64s http_req_failed................: 0.00% ✓ 0 ✗ 3045 http_req_receiving.............: avg=9.7ms min=39.28µs med=90.41µs max=459.78ms p(90)=1.01ms p(95)=45.21ms http_req_sending...............: avg=324.58µs min=7.84µs med=13.92µs max=78.82ms p(90)=33.73µs p(95)=200.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=969.09ms min=465.11ms med=850.05ms max=3.73s p(90)=1.51s p(95)=1.63s http_reqs......................: 3045 98.501577/s iteration_duration.............: avg=1s min=474.21ms med=888.47ms max=3.82s p(90)=1.56s p(95)=1.67s iterations.....................: 3045 98.501577/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4617 ✗ 0 data_received..................: 135 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=175.49µs min=1.47µs med=3.32µs max=6.2ms p(90)=5.29µs p(95)=1.15ms http_req_connecting............: avg=165.18µs min=0s med=0s max=6.05ms p(90)=0s p(95)=1.01ms http_req_duration..............: avg=1.98s min=865ms med=1.68s max=20.83s p(90)=1.95s p(95)=2.41s { expected_response:true }...: avg=1.98s min=865ms med=1.68s max=20.83s p(90)=1.95s p(95)=2.41s http_req_failed................: 0.00% ✓ 0 ✗ 1539 http_req_receiving.............: avg=151.69µs min=49.38µs med=127.06µs max=5.13ms p(90)=187.86µs p(95)=213.22µs http_req_sending...............: avg=35.64µs min=8.3µs med=17.48µs max=3.41ms p(90)=34.22µs p(95)=141.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.98s min=864.88ms med=1.68s max=20.83s p(90)=1.95s p(95)=2.4s http_reqs......................: 1539 49.12097/s iteration_duration.............: avg=1.99s min=875.59ms med=1.69s max=20.84s p(90)=1.97s p(95)=2.42s iterations.....................: 1539 49.12097/s vus............................: 37 min=37 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2829 ✗ 0 data_received..................: 83 MB 2.7 MB/s data_sent......................: 1.1 MB 37 kB/s http_req_blocked...............: avg=31.19µs min=1.77µs med=3.78µs max=2.45ms p(90)=95.07µs p(95)=176.46µs http_req_connecting............: avg=21.18µs min=0s med=0s max=779.14µs p(90)=64.69µs p(95)=141.32µs http_req_duration..............: avg=3.2s min=399.52ms med=3.02s max=8.01s p(90)=4.18s p(95)=4.79s { expected_response:true }...: avg=3.2s min=399.52ms med=3.02s max=8.01s p(90)=4.18s p(95)=4.79s http_req_failed................: 0.00% ✓ 0 ✗ 943 http_req_receiving.............: avg=247.22µs min=45.19µs med=118.42µs max=67.22ms p(90)=189.23µs p(95)=258.26µs http_req_sending...............: avg=35.11µs min=9.25µs med=21.35µs max=2.65ms p(90)=38.5µs p(95)=86.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.2s min=399.1ms med=3.02s max=8.01s p(90)=4.18s p(95)=4.79s http_reqs......................: 943 30.782603/s iteration_duration.............: avg=3.22s min=407.82ms med=3.03s max=8.01s p(90)=4.19s p(95)=4.8s iterations.....................: 943 30.782603/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2916 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.2 MB 36 kB/s http_req_blocked...............: avg=92.2µs min=1.49µs med=3.56µs max=11.07ms p(90)=90.03µs p(95)=582.16µs http_req_connecting............: avg=77.3µs min=0s med=0s max=11.04ms p(90)=58.38µs p(95)=404.09µs http_req_duration..............: avg=3.19s min=1.48s med=2.96s max=6.87s p(90)=4.56s p(95)=5.15s { expected_response:true }...: avg=3.19s min=1.48s med=2.96s max=6.87s p(90)=4.56s p(95)=5.15s http_req_failed................: 0.00% ✓ 0 ✗ 972 http_req_receiving.............: avg=3.42ms min=40.08µs med=202.99µs max=504.81ms p(90)=2.23ms p(95)=10.15ms http_req_sending...............: avg=53.85µs min=8.35µs med=19.35µs max=7.31ms p(90)=56.86µs p(95)=197.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.18s min=1.48s med=2.96s max=6.87s p(90)=4.56s p(95)=5.15s http_reqs......................: 972 30.491298/s iteration_duration.............: avg=3.2s min=1.49s med=2.97s max=6.88s p(90)=4.57s p(95)=5.17s iterations.....................: 972 30.491298/s vus............................: 59 min=59 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4607 total, 0 failed avg: 613ms, p95: 805ms ✅
wundergraph 102 3177 total, 0 failed avg: 921ms, p95: 1139ms ✅
mesh-supergraph-bun 80 2488 total, 0 failed avg: 1200ms, p95: 1838ms ✅
cosmo 78 2440 total, 0 failed avg: 1218ms, p95: 1487ms ✅
apollo-server 48 1527 total, 0 failed avg: 2002ms, p95: 2343ms ✅
mesh-supergraph 29 954 total, 0 failed avg: 3233ms, p95: 4996ms ✅
mercurius 11 450 total, 0 failed avg: 7565ms, p95: 9096ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13821 ✗ 0 data_received..................: 404 MB 13 MB/s data_sent......................: 5.5 MB 178 kB/s http_req_blocked...............: avg=69.11µs min=1.35µs med=2.96µs max=58.88ms p(90)=4.63µs p(95)=5.97µs http_req_connecting............: avg=44.3µs min=0s med=0s max=8.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=612.92ms min=277.53ms med=602.82ms max=1.14s p(90)=746.67ms p(95)=805.45ms { expected_response:true }...: avg=612.92ms min=277.53ms med=602.82ms max=1.14s p(90)=746.67ms p(95)=805.45ms http_req_failed................: 0.00% ✓ 0 ✗ 4607 http_req_receiving.............: avg=12.12ms min=37.42µs med=75.86µs max=354.85ms p(90)=38.26ms p(95)=82.91ms http_req_sending...............: avg=923.43µs min=7.65µs med=13.65µs max=238.39ms p(90)=37.99µs p(95)=220.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=599.87ms min=277.41ms med=593.65ms max=1.02s p(90)=722.97ms p(95)=765.88ms http_reqs......................: 4607 150.280555/s iteration_duration.............: avg=659.05ms min=289.02ms med=644.69ms max=1.27s p(90)=815.76ms p(95)=890.17ms iterations.....................: 4607 150.280555/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9531 ✗ 0 data_received..................: 279 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=53.85µs min=1.42µs med=2.7µs max=18.56ms p(90)=4.2µs p(95)=9.18µs http_req_connecting............: avg=38.61µs min=0s med=0s max=4ms p(90)=0s p(95)=0s http_req_duration..............: avg=921.07ms min=581.77ms med=908.92ms max=1.55s p(90)=1.07s p(95)=1.13s { expected_response:true }...: avg=921.07ms min=581.77ms med=908.92ms max=1.55s p(90)=1.07s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3177 http_req_receiving.............: avg=5.61ms min=35.68µs med=74.44µs max=253.88ms p(90)=8.89ms p(95)=40.78ms http_req_sending...............: avg=1.24ms min=7.51µs med=12.68µs max=186.9ms p(90)=35.62µs p(95)=572.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=914.2ms min=581.67ms med=904.42ms max=1.43s p(90)=1.06s p(95)=1.13s http_reqs......................: 3177 102.829487/s iteration_duration.............: avg=956.92ms min=612.48ms med=943.63ms max=1.56s p(90)=1.11s p(95)=1.19s iterations.....................: 3177 102.829487/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7464 ✗ 0 data_received..................: 218 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=32.23µs min=1.37µs med=3.15µs max=2.21ms p(90)=4.81µs p(95)=11.59µs http_req_connecting............: avg=24.56µs min=0s med=0s max=2.18ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=507.87ms med=1.15s max=2.3s p(90)=1.55s p(95)=1.83s { expected_response:true }...: avg=1.19s min=507.87ms med=1.15s max=2.3s p(90)=1.55s p(95)=1.83s http_req_failed................: 0.00% ✓ 0 ✗ 2488 http_req_receiving.............: avg=15.5ms min=41.15µs med=102.84µs max=672.35ms p(90)=1.28ms p(95)=61.02ms http_req_sending...............: avg=282.38µs min=8.23µs med=15.19µs max=143.48ms p(90)=34.69µs p(95)=131.74µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=507.71ms med=1.14s max=2.3s p(90)=1.52s p(95)=1.83s http_reqs......................: 2488 80.886366/s iteration_duration.............: avg=1.22s min=516.25ms med=1.17s max=2.32s p(90)=1.59s p(95)=1.87s iterations.....................: 2488 80.886366/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7320 ✗ 0 data_received..................: 214 MB 6.9 MB/s data_sent......................: 2.9 MB 94 kB/s http_req_blocked...............: avg=72.6µs min=1.27µs med=2.42µs max=4.26ms p(90)=3.89µs p(95)=9.07µs http_req_connecting............: avg=63.72µs min=0s med=0s max=4.17ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.21s min=771.59ms med=1.2s max=1.75s p(90)=1.42s p(95)=1.48s { expected_response:true }...: avg=1.21s min=771.59ms med=1.2s max=1.75s p(90)=1.42s p(95)=1.48s http_req_failed................: 0.00% ✓ 0 ✗ 2440 http_req_receiving.............: avg=17.15ms min=36.55µs med=85.21µs max=362.73ms p(90)=61.04ms p(95)=116.5ms http_req_sending...............: avg=1.28ms min=8.29µs med=12.33µs max=144.49ms p(90)=49.04µs p(95)=892.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.19s min=771.51ms med=1.19s max=1.66s p(90)=1.39s p(95)=1.42s http_reqs......................: 2440 78.914594/s iteration_duration.............: avg=1.25s min=780.86ms med=1.24s max=1.85s p(90)=1.48s p(95)=1.56s iterations.....................: 2440 78.914594/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4581 ✗ 0 data_received..................: 134 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=177.84µs min=1.41µs med=3.02µs max=7.04ms p(90)=4.85µs p(95)=315.39µs http_req_connecting............: avg=53.54µs min=0s med=0s max=2.43ms p(90)=0s p(95)=225.28µs http_req_duration..............: avg=2s min=927.99ms med=1.79s max=14.11s p(90)=2.18s p(95)=2.34s { expected_response:true }...: avg=2s min=927.99ms med=1.79s max=14.11s p(90)=2.18s p(95)=2.34s http_req_failed................: 0.00% ✓ 0 ✗ 1527 http_req_receiving.............: avg=336.26µs min=48.57µs med=123.87µs max=69.14ms p(90)=188.37µs p(95)=250.71µs http_req_sending...............: avg=90.71µs min=8.54µs med=16µs max=10.44ms p(90)=33.92µs p(95)=194.38µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2s min=927.82ms med=1.79s max=14.11s p(90)=2.18s p(95)=2.34s http_reqs......................: 1527 48.774639/s iteration_duration.............: avg=2.01s min=938.71ms med=1.8s max=14.12s p(90)=2.19s p(95)=2.35s iterations.....................: 1527 48.774639/s vus............................: 33 min=33 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2862 ✗ 0 data_received..................: 84 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=618.44µs min=1.55µs med=3.64µs max=14.79ms p(90)=447.93µs p(95)=5.27ms http_req_connecting............: avg=605.25µs min=0s med=0s max=14.75ms p(90)=299.62µs p(95)=5.24ms http_req_duration..............: avg=3.23s min=1.32s med=3.09s max=6.37s p(90)=4.27s p(95)=4.99s { expected_response:true }...: avg=3.23s min=1.32s med=3.09s max=6.37s p(90)=4.27s p(95)=4.99s http_req_failed................: 0.00% ✓ 0 ✗ 954 http_req_receiving.............: avg=2.61ms min=41.31µs med=160.46µs max=89.12ms p(90)=1.76ms p(95)=7.86ms http_req_sending...............: avg=100.89µs min=8.45µs med=20.47µs max=23.53ms p(90)=69.45µs p(95)=243.11µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.23s min=1.3s med=3.09s max=6.37s p(90)=4.27s p(95)=4.99s http_reqs......................: 954 29.987709/s iteration_duration.............: avg=3.24s min=1.34s med=3.11s max=6.38s p(90)=4.28s p(95)=5.02s iterations.....................: 954 29.987709/s vus............................: 58 min=58 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1350 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 534 kB 14 kB/s http_req_blocked...............: avg=1.32ms min=1.85µs med=4.65µs max=8.94ms p(90)=6.29ms p(95)=7.5ms http_req_connecting............: avg=483.76µs min=0s med=0s max=4.16ms p(90)=2.39ms p(95)=3.23ms http_req_duration..............: avg=7.56s min=3.7s med=7.66s max=9.77s p(90)=8.88s p(95)=9.09s { expected_response:true }...: avg=7.56s min=3.7s med=7.66s max=9.77s p(90)=8.88s p(95)=9.09s http_req_failed................: 0.00% ✓ 0 ✗ 450 http_req_receiving.............: avg=141.29µs min=77.64µs med=127.97µs max=1.15ms p(90)=185.26µs p(95)=202.94µs http_req_sending...............: avg=80.34µs min=10.07µs med=24.35µs max=711.01µs p(90)=288.88µs p(95)=365.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.56s min=3.7s med=7.66s max=9.77s p(90)=8.88s p(95)=9.09s http_reqs......................: 450 11.991363/s iteration_duration.............: avg=7.57s min=3.71s med=7.67s max=9.79s p(90)=8.89s p(95)=9.1s iterations.....................: 450 11.991363/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2350ms 177 12406 total, 0 failed avg: 817ms, p95: 2351ms, max: 6547ms, med: 596ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
wundergraph 2417ms 165 11555 total, 0 failed avg: 799ms, p95: 2418ms, max: 6806ms, med: 562ms ✅
apollo-router 3273ms 170 11958 total, 0 failed avg: 909ms, p95: 3274ms, max: 11192ms, med: 557ms ✅
mesh-supergraph-bun 5521ms 116 8184 total, 0 failed avg: 2222ms, p95: 5522ms, max: 8460ms, med: 2061ms ✅
mesh-supergraph 6684ms 71 4984 total, 0 failed avg: 3827ms, p95: 6685ms, max: 8788ms, med: 3975ms ✅
apollo-server 23442ms 69 5070 total, 0 failed avg: 4111ms, p95: 23442ms, max: 44822ms, med: 2123ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12405 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 12405 / ✗ 1 checks.........................: 99.99% ✓ 37216 ✗ 2 data_received..................: 1.1 GB 16 MB/s data_sent......................: 15 MB 210 kB/s http_req_blocked...............: avg=18.63ms min=1.37µs med=2.8µs max=4.56s p(90)=4.5µs p(95)=10.68µs http_req_connecting............: avg=17.89ms min=0s med=0s max=4.56s p(90)=0s p(95)=0s http_req_duration..............: avg=817.48ms min=6.68ms med=596.26ms max=6.54s p(90)=1.84s p(95)=2.35s { expected_response:true }...: avg=817.48ms min=6.68ms med=596.26ms max=6.54s p(90)=1.84s p(95)=2.35s http_req_failed................: 0.00% ✓ 0 ✗ 12406 http_req_receiving.............: avg=271.92ms min=25.21µs med=77.82µs max=4.46s p(90)=1.03s p(95)=1.6s http_req_sending...............: avg=30.75ms min=7.74µs med=13.46µs max=3.76s p(90)=138.01µs p(95)=53.99ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=514.8ms min=6.57ms med=371.33ms max=2.95s p(90)=1.14s p(95)=1.39s http_reqs......................: 12406 177.216285/s iteration_duration.............: avg=1.48s min=12.02ms med=1.04s max=11.02s p(90)=3.45s p(95)=4.43s iterations.....................: 12406 177.216285/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34665 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 196 kB/s http_req_blocked...............: avg=22.09ms min=1.27µs med=3.01µs max=4.59s p(90)=4.64µs p(95)=12.44µs http_req_connecting............: avg=20.75ms min=0s med=0s max=3.31s p(90)=0s p(95)=0s http_req_duration..............: avg=798.97ms min=6.04ms med=561.94ms max=6.8s p(90)=1.9s p(95)=2.41s { expected_response:true }...: avg=798.97ms min=6.04ms med=561.94ms max=6.8s p(90)=1.9s p(95)=2.41s http_req_failed................: 0.00% ✓ 0 ✗ 11555 http_req_receiving.............: avg=270.86ms min=34.88µs med=79.53µs max=5.95s p(90)=1.13s p(95)=1.68s http_req_sending...............: avg=37.23ms min=8.26µs med=14µs max=4.06s p(90)=1.92ms p(95)=131.55ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=490.86ms min=5.95ms med=400.16ms max=2.79s p(90)=1.02s p(95)=1.22s http_reqs......................: 11555 165.042749/s iteration_duration.............: avg=1.58s min=11.7ms med=1.11s max=12.09s p(90)=3.71s p(95)=4.57s iterations.....................: 11555 165.042749/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35874 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 203 kB/s http_req_blocked...............: avg=18.67ms min=1.49µs med=3.08µs max=4.18s p(90)=4.91µs p(95)=12.54µs http_req_connecting............: avg=18.21ms min=0s med=0s max=4.18s p(90)=0s p(95)=0s http_req_duration..............: avg=908.73ms min=6.39ms med=557.44ms max=11.19s p(90)=2.24s p(95)=3.27s { expected_response:true }...: avg=908.73ms min=6.39ms med=557.44ms max=11.19s p(90)=2.24s p(95)=3.27s http_req_failed................: 0.00% ✓ 0 ✗ 11958 http_req_receiving.............: avg=395.03ms min=30.82µs med=78.16µs max=10.5s p(90)=1.54s p(95)=2.54s http_req_sending...............: avg=36.73ms min=8µs med=14.46µs max=7.58s p(90)=294.77µs p(95)=53.34ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=476.96ms min=6.32ms med=378.51ms max=2.43s p(90)=992.73ms p(95)=1.18s http_reqs......................: 11958 170.799153/s iteration_duration.............: avg=1.55s min=12.3ms med=950.74ms max=13.5s p(90)=3.84s p(95)=5.05s iterations.....................: 11958 170.799153/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24552 ✗ 0 data_received..................: 718 MB 10 MB/s data_sent......................: 9.7 MB 139 kB/s http_req_blocked...............: avg=2.04ms min=1.5µs med=2.97µs max=435.94ms p(90)=5.37µs p(95)=219.04µs http_req_connecting............: avg=1.98ms min=0s med=0s max=435.87ms p(90)=0s p(95)=149.01µs http_req_duration..............: avg=2.22s min=7.38ms med=2.06s max=8.45s p(90)=4.3s p(95)=5.52s { expected_response:true }...: avg=2.22s min=7.38ms med=2.06s max=8.45s p(90)=4.3s p(95)=5.52s http_req_failed................: 0.00% ✓ 0 ✗ 8184 http_req_receiving.............: avg=30.55ms min=31.7µs med=75.09µs max=1.45s p(90)=13.73ms p(95)=172.6ms http_req_sending...............: avg=3.39ms min=8.22µs med=14.11µs max=1.1s p(90)=92.1µs p(95)=11.27ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.18s min=6.87ms med=2.01s max=8.44s p(90)=4.28s p(95)=5.51s http_reqs......................: 8184 116.902541/s iteration_duration.............: avg=2.29s min=14.42ms med=2.15s max=8.82s p(90)=4.38s p(95)=5.62s iterations.....................: 8184 116.902541/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14952 ✗ 0 data_received..................: 437 MB 6.2 MB/s data_sent......................: 5.9 MB 85 kB/s http_req_blocked...............: avg=556.03µs min=1.51µs med=3.9µs max=265.57ms p(90)=98.43µs p(95)=412.23µs http_req_connecting............: avg=543.71µs min=0s med=0s max=265.4ms p(90)=59.58µs p(95)=351.18µs http_req_duration..............: avg=3.82s min=10.74ms med=3.97s max=8.78s p(90)=6.17s p(95)=6.68s { expected_response:true }...: avg=3.82s min=10.74ms med=3.97s max=8.78s p(90)=6.17s p(95)=6.68s http_req_failed................: 0.00% ✓ 0 ✗ 4984 http_req_receiving.............: avg=2.12ms min=40.04µs med=100.28µs max=357.72ms p(90)=960.48µs p(95)=7.53ms http_req_sending...............: avg=462.77µs min=8.21µs med=20.41µs max=135.42ms p(90)=52.36µs p(95)=120.67µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.82s min=10.64ms med=3.97s max=8.78s p(90)=6.17s p(95)=6.68s http_reqs......................: 4984 71.199133/s iteration_duration.............: avg=3.86s min=17.04ms med=4.01s max=8.8s p(90)=6.23s p(95)=6.74s iterations.....................: 4984 71.199133/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15210 ✗ 0 data_received..................: 446 MB 6.1 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=119.98µs min=1.41µs med=3.06µs max=45.73ms p(90)=28.15µs p(95)=302.38µs http_req_connecting............: avg=110.47µs min=0s med=0s max=45.66ms p(90)=0s p(95)=231.19µs http_req_duration..............: avg=4.11s min=74.86ms med=2.12s max=44.82s p(90)=3.22s p(95)=23.44s { expected_response:true }...: avg=4.11s min=74.86ms med=2.12s max=44.82s p(90)=3.22s p(95)=23.44s http_req_failed................: 0.00% ✓ 0 ✗ 5070 http_req_receiving.............: avg=356.21µs min=42.66µs med=115.29µs max=181.03ms p(90)=178.5µs p(95)=226.21µs http_req_sending...............: avg=61.95µs min=8.05µs med=15.42µs max=30.34ms p(90)=38.51µs p(95)=57.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.11s min=74.76ms med=2.12s max=44.82s p(90)=3.22s p(95)=23.44s http_reqs......................: 5070 69.363497/s iteration_duration.............: avg=4.12s min=85.33ms med=2.13s max=44.83s p(90)=3.23s p(95)=23.45s iterations.....................: 5070 69.363497/s vus............................: 14 min=14 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5051 total, 0 failed avg: 537ms, p95: 723ms ✅
wundergraph 104 3206 total, 0 failed avg: 912ms, p95: 1109ms ✅
mesh-supergraph-bun 99 3074 total, 0 failed avg: 953ms, p95: 1354ms ✅
cosmo 82 2560 total, 0 failed avg: 1153ms, p95: 1393ms ✅
apollo-server 64 2026 total, 0 failed avg: 1517ms, p95: 1739ms ✅
mesh-supergraph 63 1952 total, 0 failed avg: 1542ms, p95: 2251ms ✅
mercurius 12 473 total, 0 failed avg: 7184ms, p95: 8469ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15153 ✗ 0 data_received..................: 443 MB 15 MB/s data_sent......................: 6.0 MB 196 kB/s http_req_blocked...............: avg=41.67µs min=1.21µs med=2.85µs max=6.96ms p(90)=4.35µs p(95)=5.41µs http_req_connecting............: avg=31.06µs min=0s med=0s max=5.53ms p(90)=0s p(95)=0s http_req_duration..............: avg=537.45ms min=273.76ms med=524.5ms max=1.05s p(90)=668.72ms p(95)=723.02ms { expected_response:true }...: avg=537.45ms min=273.76ms med=524.5ms max=1.05s p(90)=668.72ms p(95)=723.02ms http_req_failed................: 0.00% ✓ 0 ✗ 5051 http_req_receiving.............: avg=17.29ms min=34.93µs med=72.86µs max=433.22ms p(90)=62.3ms p(95)=107.5ms http_req_sending...............: avg=1.46ms min=8µs med=13.44µs max=220.7ms p(90)=38.86µs p(95)=1.36ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=518.69ms min=266.56ms med=514ms max=836.6ms p(90)=634.92ms p(95)=660.35ms http_reqs......................: 5051 165.460868/s iteration_duration.............: avg=599.75ms min=304.25ms med=585.36ms max=1.27s p(90)=749.19ms p(95)=822.63ms iterations.....................: 5051 165.460868/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9618 ✗ 0 data_received..................: 281 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=26.8µs min=1.32µs med=2.62µs max=6.99ms p(90)=3.93µs p(95)=7µs http_req_connecting............: avg=18.54µs min=0s med=0s max=6.66ms p(90)=0s p(95)=0s http_req_duration..............: avg=911.62ms min=570.21ms med=905.38ms max=1.37s p(90)=1.05s p(95)=1.1s { expected_response:true }...: avg=911.62ms min=570.21ms med=905.38ms max=1.37s p(90)=1.05s p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 3206 http_req_receiving.............: avg=9.66ms min=32.51µs med=81.65µs max=277.35ms p(90)=30.25ms p(95)=69.49ms http_req_sending...............: avg=1.03ms min=7.52µs med=12.84µs max=178.83ms p(90)=40.36µs p(95)=236.38µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=900.93ms min=570.11ms med=897.64ms max=1.22s p(90)=1.04s p(95)=1.09s http_reqs......................: 3206 104.287054/s iteration_duration.............: avg=948.46ms min=620.05ms med=944.08ms max=1.38s p(90)=1.1s p(95)=1.15s iterations.....................: 3206 104.287054/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9222 ✗ 0 data_received..................: 270 MB 8.7 MB/s data_sent......................: 3.6 MB 118 kB/s http_req_blocked...............: avg=43.61µs min=1.51µs med=2.97µs max=3.66ms p(90)=4.57µs p(95)=9.47µs http_req_connecting............: avg=38.1µs min=0s med=0s max=3.6ms p(90)=0s p(95)=0s http_req_duration..............: avg=953.43ms min=326.31ms med=936.23ms max=1.88s p(90)=1.25s p(95)=1.35s { expected_response:true }...: avg=953.43ms min=326.31ms med=936.23ms max=1.88s p(90)=1.25s p(95)=1.35s http_req_failed................: 0.00% ✓ 0 ✗ 3074 http_req_receiving.............: avg=14.17ms min=37.4µs med=83.21µs max=736.12ms p(90)=4.83ms p(95)=86.84ms http_req_sending...............: avg=906.89µs min=8.56µs med=14.19µs max=309.64ms p(90)=51.52µs p(95)=662.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=938.35ms min=326.15ms med=924.26ms max=1.73s p(90)=1.22s p(95)=1.31s http_reqs......................: 3074 99.423297/s iteration_duration.............: avg=994.66ms min=337.73ms med=974.55ms max=1.92s p(90)=1.3s p(95)=1.41s iterations.....................: 3074 99.423297/s vus............................: 91 min=91 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7680 ✗ 0 data_received..................: 225 MB 7.2 MB/s data_sent......................: 3.0 MB 98 kB/s http_req_blocked...............: avg=161.74µs min=1.3µs med=2.59µs max=61.25ms p(90)=4.14µs p(95)=9.88µs http_req_connecting............: avg=100.58µs min=0s med=0s max=6.25ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=720.4ms med=1.14s max=1.65s p(90)=1.33s p(95)=1.39s { expected_response:true }...: avg=1.15s min=720.4ms med=1.14s max=1.65s p(90)=1.33s p(95)=1.39s http_req_failed................: 0.00% ✓ 0 ✗ 2560 http_req_receiving.............: avg=9.32ms min=39.53µs med=84.31µs max=338.06ms p(90)=37.34ms p(95)=59.92ms http_req_sending...............: avg=1.32ms min=8.37µs med=12.82µs max=227.23ms p(90)=57.33µs p(95)=349.81µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=720.31ms med=1.14s max=1.52s p(90)=1.32s p(95)=1.37s http_reqs......................: 2560 82.486793/s iteration_duration.............: avg=1.18s min=793.67ms med=1.18s max=1.66s p(90)=1.38s p(95)=1.42s iterations.....................: 2560 82.486793/s vus............................: 15 min=15 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6078 ✗ 0 data_received..................: 178 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=182.99µs min=1.46µs med=3.22µs max=13.36ms p(90)=5.1µs p(95)=81.41µs http_req_connecting............: avg=171.59µs min=0s med=0s max=13.29ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.51s min=773.38ms med=1.43s max=9.79s p(90)=1.66s p(95)=1.73s { expected_response:true }...: avg=1.51s min=773.38ms med=1.43s max=9.79s p(90)=1.66s p(95)=1.73s http_req_failed................: 0.00% ✓ 0 ✗ 2026 http_req_receiving.............: avg=173.85µs min=47.67µs med=115.2µs max=19.54ms p(90)=183.12µs p(95)=238.14µs http_req_sending...............: avg=217.42µs min=8.52µs med=16.89µs max=17.34ms p(90)=34.4µs p(95)=136.53µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.51s min=773.23ms med=1.43s max=9.79s p(90)=1.66s p(95)=1.73s http_reqs......................: 2026 64.560254/s iteration_duration.............: avg=1.52s min=780.08ms med=1.44s max=9.81s p(90)=1.67s p(95)=1.75s iterations.....................: 2026 64.560254/s vus............................: 60 min=60 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5856 ✗ 0 data_received..................: 171 MB 5.5 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=92.41µs min=1.54µs med=3.63µs max=5.38ms p(90)=5.37µs p(95)=95.95µs http_req_connecting............: avg=80.76µs min=0s med=0s max=5.32ms p(90)=0s p(95)=65.81µs http_req_duration..............: avg=1.54s min=617.85ms med=1.5s max=3.63s p(90)=1.95s p(95)=2.25s { expected_response:true }...: avg=1.54s min=617.85ms med=1.5s max=3.63s p(90)=1.95s p(95)=2.25s http_req_failed................: 0.00% ✓ 0 ✗ 1952 http_req_receiving.............: avg=1.54ms min=42.3µs med=115.92µs max=105.5ms p(90)=1.8ms p(95)=8.51ms http_req_sending...............: avg=132.2µs min=8.41µs med=18.68µs max=27.84ms p(90)=36.54µs p(95)=124.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.53s min=617.77ms med=1.5s max=3.63s p(90)=1.95s p(95)=2.25s http_reqs......................: 1952 63.168609/s iteration_duration.............: avg=1.56s min=643.01ms med=1.52s max=3.64s p(90)=1.97s p(95)=2.26s iterations.....................: 1952 63.168609/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1419 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 562 kB 15 kB/s http_req_blocked...............: avg=263.94µs min=1.54µs med=3.07µs max=5.51ms p(90)=745.23µs p(95)=1.96ms http_req_connecting............: avg=253.01µs min=0s med=0s max=5.48ms p(90)=681.11µs p(95)=1.93ms http_req_duration..............: avg=7.18s min=3.06s med=7.48s max=8.72s p(90)=8.27s p(95)=8.46s { expected_response:true }...: avg=7.18s min=3.06s med=7.48s max=8.72s p(90)=8.27s p(95)=8.46s http_req_failed................: 0.00% ✓ 0 ✗ 473 http_req_receiving.............: avg=173.38µs min=58.55µs med=116.42µs max=22.63ms p(90)=174.5µs p(95)=201µs http_req_sending...............: avg=146.49µs min=9.12µs med=18.31µs max=5.33ms p(90)=811.28µs p(95)=1.03ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.18s min=3.06s med=7.48s max=8.72s p(90)=8.27s p(95)=8.46s http_reqs......................: 473 12.623463/s iteration_duration.............: avg=7.19s min=3.07s med=7.49s max=8.73s p(90)=8.28s p(95)=8.47s iterations.....................: 473 12.623463/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview