search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @grafbase/sdk to ~0.27.0 #438

Closed renovate[bot] closed 4 days ago

renovate[bot] commented 6 months ago

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@grafbase/sdk (source) ~0.17.0 -> ~0.27.0 age adoption passing confidence

Release Notes

grafbase/grafbase (@​grafbase/sdk) ### [`v0.27.1`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0271---Mon-Jul-15-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/0b8b4b92f49decfec22ce3d327798fb7ade593d9...dfcab255eef4add243604cf07513f559fa1a00e9) [CHANGELOG](changelog/0.27.1.md) ### [`v0.27.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0270---Thu-Jul-11-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/aeaf200b8b3b44860af5d7b1ac7191e539ece9cf...0b8b4b92f49decfec22ce3d327798fb7ade593d9) [CHANGELOG](changelog/0.27.0.md) ### [`v0.26.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0260---Tue-Jul-02-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/1eebfe600a29e2ed15ac76d0cb2224224900789c...aeaf200b8b3b44860af5d7b1ac7191e539ece9cf) [CHANGELOG](changelog/0.26.0.md) ### [`v0.25.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0250---Wed-Jun-07-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/6e4cfe742a53c129cabd2a81695266e7ce29b73e...1eebfe600a29e2ed15ac76d0cb2224224900789c) [CHANGELOG](changelog/0.25.0.md) ### [`v0.24.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0240---Wed-May-08-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/fed2ddab11a4923ab1e9d543807b5d8f4e3f9a18...6e4cfe742a53c129cabd2a81695266e7ce29b73e) [CHANGELOG](changelog/0.24.0.md) ### [`v0.23.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0230---Fri-Apr-26-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/d0de472a266550e89fa4d20eba689c5682913030...fed2ddab11a4923ab1e9d543807b5d8f4e3f9a18) [CHANGELOG](changelog/0.23.0.md) ### [`v0.22.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0220---Wed-Apr-24-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/0.21.0...d0de472a266550e89fa4d20eba689c5682913030) [CHANGELOG](changelog/0.22.0.md) ### [`v0.21.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0210---Wed-Apr-17-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/0.20.0...0.21.0) [CHANGELOG](changelog/0.21.0.md) ### [`v0.20.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0200---Wed-Apr-10-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/0.19.2...0.20.0) [CHANGELOG](changelog/0.20.0.md) ### [`v0.19.2`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0192---Tue-Apr-2-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/0.19.1...0.19.2) [CHANGELOG](changelog/0.19.2.md) ### [`v0.19.1`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0191---Tue-Apr-2-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/0.19.0...0.19.1) [CHANGELOG](changelog/0.19.1.md) ### [`v0.19.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0190---Wed-Mar-20-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/0.18.0...0.19.0) [CHANGELOG](changelog/0.19.0.md) ### [`v0.18.0`](https://togithub.com/grafbase/grafbase/blob/HEAD/packages/grafbase-sdk/CHANGELOG.md#0180---Tue-Feb-13-2024) [Compare Source](https://togithub.com/grafbase/grafbase/compare/0.17.0...0.18.0) [CHANGELOG](changelog/0.18.0.md)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR was generated by Mend Renovate. View the repository job log.

github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 169 5166 total, 0 failed avg: 500ms, p95: 717ms ✅
apollo-router 168 5122 total, 0 failed avg: 511ms, p95: 724ms ✅
wundergraph 149 4527 total, 0 failed avg: 549ms, p95: 985ms ✅
mesh-supergraph-bun 81 2495 total, 0 failed avg: 1195ms, p95: 2062ms ✅
apollo-server 45 1430 total, 0 failed avg: 2153ms, p95: 3230ms ✅
mesh-supergraph 30 938 total, 0 failed avg: 3245ms, p95: 5198ms ✅
mercurius 22 713 total, 0 failed avg: 4320ms, p95: 5694ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15498 ✗ 0 data_received..................: 453 MB 15 MB/s data_sent......................: 6.1 MB 201 kB/s http_req_blocked...............: avg=66.53µs min=1.4µs med=3.08µs max=123.16ms p(90)=4.86µs p(95)=6.33µs http_req_connecting............: avg=33.34µs min=0s med=0s max=4.99ms p(90)=0s p(95)=0s http_req_duration..............: avg=499.86ms min=41.94ms med=502.92ms max=1.56s p(90)=630.94ms p(95)=717.07ms { expected_response:true }...: avg=499.86ms min=41.94ms med=502.92ms max=1.56s p(90)=630.94ms p(95)=717.07ms http_req_failed................: 0.00% ✓ 0 ✗ 5166 http_req_receiving.............: avg=34.84ms min=40.37µs med=89.29µs max=1.13s p(90)=101.43ms p(95)=265.98ms http_req_sending...............: avg=1.45ms min=8.66µs med=14.33µs max=695.4ms p(90)=42.48µs p(95)=260.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=463.55ms min=41.83ms med=485.89ms max=997.53ms p(90)=575ms p(95)=601.15ms http_reqs......................: 5166 169.70123/s iteration_duration.............: avg=586.05ms min=51.96ms med=550.82ms max=2.46s p(90)=815.27ms p(95)=953.73ms iterations.....................: 5166 169.70123/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15366 ✗ 0 data_received..................: 449 MB 15 MB/s data_sent......................: 6.1 MB 200 kB/s http_req_blocked...............: avg=136.78µs min=1.47µs med=2.79µs max=268.97ms p(90)=4.15µs p(95)=5.22µs http_req_connecting............: avg=65.22µs min=0s med=0s max=5.93ms p(90)=0s p(95)=0s http_req_duration..............: avg=510.57ms min=49.97ms med=510.2ms max=2.16s p(90)=652ms p(95)=724.02ms { expected_response:true }...: avg=510.57ms min=49.97ms med=510.2ms max=2.16s p(90)=652ms p(95)=724.02ms http_req_failed................: 0.00% ✓ 0 ✗ 5122 http_req_receiving.............: avg=24.58ms min=35.02µs med=68.44µs max=1.73s p(90)=42.21ms p(95)=131.94ms http_req_sending...............: avg=1.21ms min=8.98µs med=13.59µs max=443.13ms p(90)=40.69µs p(95)=154.82µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=484.77ms min=45.24ms med=499.45ms max=890.95ms p(90)=617.49ms p(95)=653.57ms http_reqs......................: 5122 168.107946/s iteration_duration.............: avg=590.41ms min=75.84ms med=557.77ms max=2.9s p(90)=768.22ms p(95)=924.12ms iterations.....................: 5122 168.107946/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13581 ✗ 0 data_received..................: 397 MB 13 MB/s data_sent......................: 5.4 MB 177 kB/s http_req_blocked...............: avg=49.22µs min=1.3µs med=3.14µs max=24.29ms p(90)=4.97µs p(95)=7.11µs http_req_connecting............: avg=38.49µs min=0s med=0s max=4.48ms p(90)=0s p(95)=0s http_req_duration..............: avg=548.83ms min=23.53ms med=522.94ms max=2.05s p(90)=873.1ms p(95)=985.32ms { expected_response:true }...: avg=548.83ms min=23.53ms med=522.94ms max=2.05s p(90)=873.1ms p(95)=985.32ms http_req_failed................: 0.00% ✓ 0 ✗ 4527 http_req_receiving.............: avg=35.56ms min=38.01µs med=87.81µs max=891.51ms p(90)=109.73ms p(95)=274.51ms http_req_sending...............: avg=2.1ms min=8.06µs med=15.21µs max=1.06s p(90)=43.77µs p(95)=201.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=511.16ms min=23.44ms med=485.55ms max=1.42s p(90)=831.73ms p(95)=958.7ms http_reqs......................: 4527 149.181447/s iteration_duration.............: avg=666.89ms min=34.19ms med=607.54ms max=2.57s p(90)=1.04s p(95)=1.24s iterations.....................: 4527 149.181447/s vus............................: 98 min=98 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7485 ✗ 0 data_received..................: 219 MB 7.1 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=110µs min=1.4µs med=2.71µs max=5.14ms p(90)=4.26µs p(95)=9.87µs http_req_connecting............: avg=101.68µs min=0s med=0s max=5.06ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=164.09ms med=1.03s max=3.05s p(90)=1.95s p(95)=2.06s { expected_response:true }...: avg=1.19s min=164.09ms med=1.03s max=3.05s p(90)=1.95s p(95)=2.06s http_req_failed................: 0.00% ✓ 0 ✗ 2495 http_req_receiving.............: avg=12.02ms min=39.63µs med=117.57µs max=528.1ms p(90)=1.15ms p(95)=26.22ms http_req_sending...............: avg=241.78µs min=8.3µs med=13.6µs max=60.26ms p(90)=34.59µs p(95)=161.46µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=163.69ms med=1.02s max=3.05s p(90)=1.94s p(95)=2.06s http_reqs......................: 2495 81.439338/s iteration_duration.............: avg=1.21s min=176.18ms med=1.05s max=3.06s p(90)=1.98s p(95)=2.09s iterations.....................: 2495 81.439338/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4290 ✗ 0 data_received..................: 126 MB 4.0 MB/s data_sent......................: 1.7 MB 54 kB/s http_req_blocked...............: avg=66.82µs min=2.21µs med=4.82µs max=4.39ms p(90)=6.7µs p(95)=205.6µs http_req_connecting............: avg=49.92µs min=0s med=0s max=3.71ms p(90)=0s p(95)=153.6µs http_req_duration..............: avg=2.15s min=520.03ms med=1.72s max=23.05s p(90)=2.25s p(95)=3.23s { expected_response:true }...: avg=2.15s min=520.03ms med=1.72s max=23.05s p(90)=2.25s p(95)=3.23s http_req_failed................: 0.00% ✓ 0 ✗ 1430 http_req_receiving.............: avg=216.84µs min=58.79µs med=132.8µs max=39.79ms p(90)=203.59µs p(95)=270.7µs http_req_sending...............: avg=44.89µs min=9.54µs med=27.33µs max=4.55ms p(90)=43.72µs p(95)=89.04µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.15s min=519.71ms med=1.72s max=23.05s p(90)=2.25s p(95)=3.22s http_reqs......................: 1430 45.324588/s iteration_duration.............: avg=2.16s min=528.48ms med=1.73s max=23.06s p(90)=2.26s p(95)=3.24s iterations.....................: 1430 45.324588/s vus............................: 50 min=50 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2814 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=271.62µs min=1.4µs med=3.6µs max=7.64ms p(90)=261.52µs p(95)=2.4ms http_req_connecting............: avg=230.06µs min=0s med=0s max=6.18ms p(90)=170.81µs p(95)=2.04ms http_req_duration..............: avg=3.24s min=1.1s med=3.08s max=6.47s p(90)=4.48s p(95)=5.19s { expected_response:true }...: avg=3.24s min=1.1s med=3.08s max=6.47s p(90)=4.48s p(95)=5.19s http_req_failed................: 0.00% ✓ 0 ✗ 938 http_req_receiving.............: avg=2.01ms min=40.99µs med=140.91µs max=74.12ms p(90)=2.73ms p(95)=4.78ms http_req_sending...............: avg=232.43µs min=8.67µs med=19.8µs max=11.98ms p(90)=262.68µs p(95)=1.91ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.24s min=1.1s med=3.08s max=6.47s p(90)=4.48s p(95)=5.19s http_reqs......................: 938 30.015498/s iteration_duration.............: avg=3.26s min=1.11s med=3.1s max=6.49s p(90)=4.5s p(95)=5.22s iterations.....................: 938 30.015498/s vus............................: 21 min=21 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2139 ✗ 0 data_received..................: 63 MB 2.0 MB/s data_sent......................: 846 kB 27 kB/s http_req_blocked...............: avg=303.71µs min=1.81µs med=4.88µs max=9.59ms p(90)=726.45µs p(95)=2.2ms http_req_connecting............: avg=271.56µs min=0s med=0s max=7.76ms p(90)=637.65µs p(95)=2.12ms http_req_duration..............: avg=4.32s min=1.24s med=4.32s max=8.21s p(90)=5.24s p(95)=5.69s { expected_response:true }...: avg=4.32s min=1.24s med=4.32s max=8.21s p(90)=5.24s p(95)=5.69s http_req_failed................: 0.00% ✓ 0 ✗ 713 http_req_receiving.............: avg=642.36µs min=41.93µs med=118.65µs max=52.25ms p(90)=282.6µs p(95)=684.16µs http_req_sending...............: avg=167.97µs min=9.41µs med=27.66µs max=7.57ms p(90)=132.57µs p(95)=289.25µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.31s min=1.24s med=4.32s max=8.21s p(90)=5.24s p(95)=5.69s http_reqs......................: 713 22.800151/s iteration_duration.............: avg=4.33s min=1.25s med=4.34s max=8.23s p(90)=5.25s p(95)=5.7s iterations.....................: 713 22.800151/s vus............................: 41 min=41 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 172 5239 total, 0 failed avg: 519ms, p95: 686ms ✅
cosmo 170 5201 total, 0 failed avg: 514ms, p95: 686ms ✅
wundergraph 153 4696 total, 0 failed avg: 516ms, p95: 938ms ✅
mesh-supergraph-bun 81 2499 total, 0 failed avg: 1188ms, p95: 2065ms ✅
apollo-server 46 1452 total, 0 failed avg: 2109ms, p95: 3142ms ✅
mesh-supergraph 28 908 total, 0 failed avg: 3385ms, p95: 5170ms ✅
mercurius 27 843 total, 0 failed avg: 3622ms, p95: 4992ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15717 ✗ 0 data_received..................: 460 MB 15 MB/s data_sent......................: 6.2 MB 205 kB/s http_req_blocked...............: avg=46.72µs min=1.44µs med=3.08µs max=51.83ms p(90)=4.78µs p(95)=5.7µs http_req_connecting............: avg=17µs min=0s med=0s max=5.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=519.16ms min=195.23ms med=515.58ms max=1.28s p(90)=634.63ms p(95)=685.76ms { expected_response:true }...: avg=519.16ms min=195.23ms med=515.58ms max=1.28s p(90)=634.63ms p(95)=685.76ms http_req_failed................: 0.00% ✓ 0 ✗ 5239 http_req_receiving.............: avg=16.15ms min=37.22µs med=79.43µs max=779.96ms p(90)=54.68ms p(95)=101.85ms http_req_sending...............: avg=1.33ms min=8.56µs med=14.16µs max=575.82ms p(90)=47.65µs p(95)=284.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=501.67ms min=195.15ms med=504.63ms max=796.16ms p(90)=607.79ms p(95)=638.57ms http_reqs......................: 5239 172.654765/s iteration_duration.............: avg=576.34ms min=214.37ms med=557.02ms max=1.34s p(90)=734.27ms p(95)=820.85ms iterations.....................: 5239 172.654765/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15603 ✗ 0 data_received..................: 456 MB 15 MB/s data_sent......................: 6.2 MB 202 kB/s http_req_blocked...............: avg=72.68µs min=1.47µs med=3.2µs max=183.27ms p(90)=5.06µs p(95)=6.6µs http_req_connecting............: avg=58.3µs min=0s med=0s max=183.17ms p(90)=0s p(95)=0s http_req_duration..............: avg=513.83ms min=32.67ms med=512.18ms max=1.52s p(90)=622.21ms p(95)=685.76ms { expected_response:true }...: avg=513.83ms min=32.67ms med=512.18ms max=1.52s p(90)=622.21ms p(95)=685.76ms http_req_failed................: 0.00% ✓ 0 ✗ 5201 http_req_receiving.............: avg=24.16ms min=37.65µs med=84.84µs max=884.19ms p(90)=54.13ms p(95)=158.96ms http_req_sending...............: avg=2.01ms min=7.53µs med=14.61µs max=644.14ms p(90)=48.43µs p(95)=309.38µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=487.65ms min=32.19ms med=502.3ms max=792.85ms p(90)=583.59ms p(95)=606ms http_reqs......................: 5201 170.495971/s iteration_duration.............: avg=582.58ms min=43.44ms med=555.39ms max=2.13s p(90)=750.5ms p(95)=914ms iterations.....................: 5201 170.495971/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14088 ✗ 0 data_received..................: 412 MB 14 MB/s data_sent......................: 5.6 MB 183 kB/s http_req_blocked...............: avg=199.81µs min=1.21µs med=2.87µs max=257.64ms p(90)=4.74µs p(95)=6.5µs http_req_connecting............: avg=14.59µs min=0s med=0s max=29.18ms p(90)=0s p(95)=0s http_req_duration..............: avg=516.46ms min=21.75ms med=491ms max=1.77s p(90)=830.48ms p(95)=938.11ms { expected_response:true }...: avg=516.46ms min=21.75ms med=491ms max=1.77s p(90)=830.48ms p(95)=938.11ms http_req_failed................: 0.00% ✓ 0 ✗ 4696 http_req_receiving.............: avg=46.73ms min=37.44µs med=90.87µs max=923.48ms p(90)=169.66ms p(95)=314.52ms http_req_sending...............: avg=2.01ms min=7.47µs med=13.59µs max=566.76ms p(90)=33.93µs p(95)=166.92µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=467.7ms min=21.36ms med=446.77ms max=1.21s p(90)=776.91ms p(95)=854.92ms http_reqs......................: 4696 153.852048/s iteration_duration.............: avg=645.73ms min=34.89ms med=594.12ms max=2.61s p(90)=1.05s p(95)=1.26s iterations.....................: 4696 153.852048/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7497 ✗ 0 data_received..................: 219 MB 7.1 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=43.58µs min=1.46µs med=3.04µs max=3.63ms p(90)=5.02µs p(95)=11.65µs http_req_connecting............: avg=37.48µs min=0s med=0s max=3.6ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.18s min=533.43ms med=1.01s max=2.95s p(90)=1.9s p(95)=2.06s { expected_response:true }...: avg=1.18s min=533.43ms med=1.01s max=2.95s p(90)=1.9s p(95)=2.06s http_req_failed................: 0.00% ✓ 0 ✗ 2499 http_req_receiving.............: avg=11.04ms min=34.19µs med=97.53µs max=642.92ms p(90)=1.54ms p(95)=39.22ms http_req_sending...............: avg=298.18µs min=8.63µs med=14.56µs max=71.41ms p(90)=35.05µs p(95)=129.56µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.17s min=533.05ms med=1s max=2.95s p(90)=1.89s p(95)=2.05s http_reqs......................: 2499 81.417475/s iteration_duration.............: avg=1.21s min=545.22ms med=1.04s max=2.99s p(90)=1.93s p(95)=2.09s iterations.....................: 2499 81.417475/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4356 ✗ 0 data_received..................: 128 MB 4.1 MB/s data_sent......................: 1.7 MB 55 kB/s http_req_blocked...............: avg=83.69µs min=1.69µs med=4.58µs max=3.39ms p(90)=7.01µs p(95)=268.65µs http_req_connecting............: avg=72.8µs min=0s med=0s max=3.26ms p(90)=0s p(95)=205.15µs http_req_duration..............: avg=2.1s min=436.99ms med=1.7s max=22.73s p(90)=2.18s p(95)=3.14s { expected_response:true }...: avg=2.1s min=436.99ms med=1.7s max=22.73s p(90)=2.18s p(95)=3.14s http_req_failed................: 0.00% ✓ 0 ✗ 1452 http_req_receiving.............: avg=176.25µs min=49.82µs med=126.26µs max=16.32ms p(90)=192.07µs p(95)=281.07µs http_req_sending...............: avg=46.92µs min=8.83µs med=25.6µs max=6.74ms p(90)=43.26µs p(95)=147.5µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.1s min=436.78ms med=1.7s max=22.73s p(90)=2.18s p(95)=3.14s http_reqs......................: 1452 46.368335/s iteration_duration.............: avg=2.12s min=447.23ms med=1.71s max=22.74s p(90)=2.19s p(95)=3.17s iterations.....................: 1452 46.368335/s vus............................: 38 min=38 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2724 ✗ 0 data_received..................: 80 MB 2.5 MB/s data_sent......................: 1.1 MB 34 kB/s http_req_blocked...............: avg=97.21µs min=1.57µs med=4.28µs max=3.31ms p(90)=122.6µs p(95)=430.64µs http_req_connecting............: avg=65.99µs min=0s med=0s max=3.28ms p(90)=81.8µs p(95)=315.39µs http_req_duration..............: avg=3.38s min=1.51s med=3.09s max=7.26s p(90)=4.84s p(95)=5.16s { expected_response:true }...: avg=3.38s min=1.51s med=3.09s max=7.26s p(90)=4.84s p(95)=5.16s http_req_failed................: 0.00% ✓ 0 ✗ 908 http_req_receiving.............: avg=1.81ms min=42.86µs med=138.35µs max=81.06ms p(90)=2.71ms p(95)=4.63ms http_req_sending...............: avg=51.32µs min=8.55µs med=24.5µs max=2.71ms p(90)=66.53µs p(95)=153.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.38s min=1.51s med=3.09s max=7.26s p(90)=4.84s p(95)=5.16s http_reqs......................: 908 28.759873/s iteration_duration.............: avg=3.4s min=1.52s med=3.1s max=7.27s p(90)=4.86s p(95)=5.18s iterations.....................: 908 28.759873/s vus............................: 41 min=41 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2529 ✗ 0 data_received..................: 74 MB 2.4 MB/s data_sent......................: 1.0 MB 32 kB/s http_req_blocked...............: avg=274.97µs min=1.47µs med=4.76µs max=5.95ms p(90)=201.54µs p(95)=2.48ms http_req_connecting............: avg=226.32µs min=0s med=0s max=5.46ms p(90)=153.91µs p(95)=1.91ms http_req_duration..............: avg=3.62s min=1.02s med=3.41s max=7.54s p(90)=4.73s p(95)=4.99s { expected_response:true }...: avg=3.62s min=1.02s med=3.41s max=7.54s p(90)=4.73s p(95)=4.99s http_req_failed................: 0.00% ✓ 0 ✗ 843 http_req_receiving.............: avg=184.15µs min=45.03µs med=121.87µs max=5.8ms p(90)=197.96µs p(95)=288.44µs http_req_sending...............: avg=110.58µs min=9.1µs med=25.9µs max=8.15ms p(90)=66.14µs p(95)=799.42µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.62s min=1.02s med=3.41s max=7.54s p(90)=4.73s p(95)=4.99s http_reqs......................: 843 27.27859/s iteration_duration.............: avg=3.63s min=1.04s med=3.42s max=7.55s p(90)=4.74s p(95)=4.99s iterations.....................: 843 27.27859/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 164 4983 total, 0 failed avg: 357ms, p95: 908ms ✅
apollo-router 159 4873 total, 0 failed avg: 356ms, p95: 962ms ✅
wundergraph 155 4721 total, 0 failed avg: 351ms, p95: 960ms ✅
mesh-supergraph-bun 93 2916 total, 0 failed avg: 1013ms, p95: 1678ms ✅
apollo-server 66 2051 total, 0 failed avg: 1479ms, p95: 1726ms ✅
mesh-supergraph 58 1808 total, 0 failed avg: 1666ms, p95: 2640ms ✅
mercurius 45 1401 total, 0 failed avg: 2154ms, p95: 2842ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14949 ✗ 0 data_received..................: 437 MB 14 MB/s data_sent......................: 5.9 MB 195 kB/s http_req_blocked...............: avg=76.95µs min=1.77µs med=3.3µs max=141.09ms p(90)=5.3µs p(95)=6.73µs http_req_connecting............: avg=36.23µs min=0s med=0s max=4.8ms p(90)=0s p(95)=0s http_req_duration..............: avg=356.84ms min=15.04ms med=285.71ms max=2.22s p(90)=714.08ms p(95)=907.8ms { expected_response:true }...: avg=356.84ms min=15.04ms med=285.71ms max=2.22s p(90)=714.08ms p(95)=907.8ms http_req_failed................: 0.00% ✓ 0 ✗ 4983 http_req_receiving.............: avg=133.7ms min=34.95µs med=105.53µs max=1.54s p(90)=501.06ms p(95)=676.43ms http_req_sending...............: avg=4.69ms min=9.04µs med=16.02µs max=1.04s p(90)=76.34µs p(95)=2.39ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=218.44ms min=13.97ms med=214.66ms max=1.05s p(90)=357.45ms p(95)=398.03ms http_reqs......................: 4983 164.141683/s iteration_duration.............: avg=605.73ms min=27.79ms med=517.13ms max=4.14s p(90)=1.17s p(95)=1.44s iterations.....................: 4983 164.141683/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14619 ✗ 0 data_received..................: 428 MB 14 MB/s data_sent......................: 5.8 MB 190 kB/s http_req_blocked...............: avg=384.23µs min=1.63µs med=3.54µs max=509.84ms p(90)=5.29µs p(95)=6.54µs http_req_connecting............: avg=231.27µs min=0s med=0s max=509.77ms p(90)=0s p(95)=0s http_req_duration..............: avg=355.93ms min=14.04ms med=261.86ms max=2.62s p(90)=785.06ms p(95)=961.86ms { expected_response:true }...: avg=355.93ms min=14.04ms med=261.86ms max=2.62s p(90)=785.06ms p(95)=961.86ms http_req_failed................: 0.00% ✓ 0 ✗ 4873 http_req_receiving.............: avg=135.51ms min=36.06µs med=93.13µs max=2.51s p(90)=570.6ms p(95)=737.55ms http_req_sending...............: avg=6.09ms min=8.95µs med=17.36µs max=1.14s p(90)=132.06µs p(95)=8.22ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=214.31ms min=11.98ms med=204.89ms max=679.51ms p(90)=356.4ms p(95)=412.22ms http_reqs......................: 4873 159.964842/s iteration_duration.............: avg=621.05ms min=27.5ms med=490.69ms max=3.52s p(90)=1.26s p(95)=1.57s iterations.....................: 4873 159.964842/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14163 ✗ 0 data_received..................: 414 MB 14 MB/s data_sent......................: 5.6 MB 185 kB/s http_req_blocked...............: avg=307.06µs min=1.54µs med=3.15µs max=676.98ms p(90)=4.51µs p(95)=6.33µs http_req_connecting............: avg=230.67µs min=0s med=0s max=676.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=351.21ms min=15.03ms med=257.46ms max=2.29s p(90)=791.22ms p(95)=960.35ms { expected_response:true }...: avg=351.21ms min=15.03ms med=257.46ms max=2.29s p(90)=791.22ms p(95)=960.35ms http_req_failed................: 0.00% ✓ 0 ✗ 4721 http_req_receiving.............: avg=141.59ms min=36.04µs med=92.63µs max=2.05s p(90)=578.39ms p(95)=747.77ms http_req_sending...............: avg=7.71ms min=7.93µs med=14.65µs max=1.67s p(90)=119.04µs p(95)=9.59ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=201.9ms min=13.7ms med=197.06ms max=798.56ms p(90)=331.51ms p(95)=396.6ms http_reqs......................: 4721 155.578955/s iteration_duration.............: avg=639.55ms min=29.47ms med=524.08ms max=3.53s p(90)=1.32s p(95)=1.56s iterations.....................: 4721 155.578955/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8748 ✗ 0 data_received..................: 256 MB 8.2 MB/s data_sent......................: 3.5 MB 111 kB/s http_req_blocked...............: avg=61.34µs min=2.02µs med=3.92µs max=34.78ms p(90)=6.4µs p(95)=13.17µs http_req_connecting............: avg=36.84µs min=0s med=0s max=2.96ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.01s min=419.67ms med=862.63ms max=2.23s p(90)=1.56s p(95)=1.67s { expected_response:true }...: avg=1.01s min=419.67ms med=862.63ms max=2.23s p(90)=1.56s p(95)=1.67s http_req_failed................: 0.00% ✓ 0 ✗ 2916 http_req_receiving.............: avg=15.04ms min=40.9µs med=111.62µs max=572.61ms p(90)=28.29ms p(95)=109.79ms http_req_sending...............: avg=686.19µs min=9.14µs med=18.56µs max=182.68ms p(90)=114.55µs p(95)=676.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=997.49ms min=419.16ms med=850.05ms max=2.23s p(90)=1.54s p(95)=1.65s http_reqs......................: 2916 93.886472/s iteration_duration.............: avg=1.05s min=432.14ms med=905.07ms max=2.3s p(90)=1.61s p(95)=1.72s iterations.....................: 2916 93.886472/s vus............................: 25 min=25 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6153 ✗ 0 data_received..................: 180 MB 5.8 MB/s data_sent......................: 2.4 MB 79 kB/s http_req_blocked...............: avg=34.35µs min=1.81µs med=4.21µs max=3.23ms p(90)=5.87µs p(95)=23.3µs http_req_connecting............: avg=26.29µs min=0s med=0s max=3.17ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.47s min=298.55ms med=1.33s max=16.14s p(90)=1.58s p(95)=1.72s { expected_response:true }...: avg=1.47s min=298.55ms med=1.33s max=16.14s p(90)=1.58s p(95)=1.72s http_req_failed................: 0.00% ✓ 0 ✗ 2051 http_req_receiving.............: avg=165.02µs min=52.65µs med=124.1µs max=6.8ms p(90)=190.99µs p(95)=258.88µs http_req_sending...............: avg=39.88µs min=9.45µs med=22.07µs max=1.45ms p(90)=38.12µs p(95)=73.99µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.47s min=298.4ms med=1.33s max=16.14s p(90)=1.58s p(95)=1.72s http_reqs......................: 2051 66.16612/s iteration_duration.............: avg=1.49s min=309.16ms med=1.35s max=16.19s p(90)=1.6s p(95)=1.74s iterations.....................: 2051 66.16612/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5424 ✗ 0 data_received..................: 159 MB 5.1 MB/s data_sent......................: 2.1 MB 69 kB/s http_req_blocked...............: avg=96.95µs min=1.53µs med=4.56µs max=9.04ms p(90)=6.37µs p(95)=171.42µs http_req_connecting............: avg=72.86µs min=0s med=0s max=7.18ms p(90)=0s p(95)=113.72µs http_req_duration..............: avg=1.66s min=726.85ms med=1.59s max=3.72s p(90)=2.08s p(95)=2.63s { expected_response:true }...: avg=1.66s min=726.85ms med=1.59s max=3.72s p(90)=2.08s p(95)=2.63s http_req_failed................: 0.00% ✓ 0 ✗ 1808 http_req_receiving.............: avg=1.17ms min=37.73µs med=146.27µs max=86.14ms p(90)=2.43ms p(95)=4.35ms http_req_sending...............: avg=136.3µs min=8.98µs med=25.23µs max=44.71ms p(90)=48.22µs p(95)=176.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.66s min=726.57ms med=1.59s max=3.72s p(90)=2.08s p(95)=2.63s http_reqs......................: 1808 58.457976/s iteration_duration.............: avg=1.69s min=742.98ms med=1.61s max=3.74s p(90)=2.1s p(95)=2.66s iterations.....................: 1808 58.457976/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4203 ✗ 0 data_received..................: 123 MB 4.0 MB/s data_sent......................: 1.7 MB 54 kB/s http_req_blocked...............: avg=224.79µs min=1.59µs med=3.85µs max=6.91ms p(90)=5.7µs p(95)=1.74ms http_req_connecting............: avg=209.59µs min=0s med=0s max=6.83ms p(90)=0s p(95)=1.67ms http_req_duration..............: avg=2.15s min=581.59ms med=2.1s max=4.29s p(90)=2.66s p(95)=2.84s { expected_response:true }...: avg=2.15s min=581.59ms med=2.1s max=4.29s p(90)=2.66s p(95)=2.84s http_req_failed................: 0.00% ✓ 0 ✗ 1401 http_req_receiving.............: avg=272.58µs min=42.37µs med=115.48µs max=46.07ms p(90)=232.26µs p(95)=391.77µs http_req_sending...............: avg=37.44µs min=8.99µs med=21.27µs max=1.11ms p(90)=39.15µs p(95)=119.04µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.15s min=581.5ms med=2.1s max=4.29s p(90)=2.66s p(95)=2.84s http_reqs......................: 1401 45.77073/s iteration_duration.............: avg=2.16s min=596.73ms med=2.11s max=4.3s p(90)=2.67s p(95)=2.85s iterations.....................: 1401 45.77073/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2409ms 171 11981 total, 0 failed avg: 819ms, p95: 2410ms, max: 7310ms, med: 538ms ✅
apollo-router 2591ms 167 11705 total, 0 failed avg: 832ms, p95: 2592ms, max: 6878ms, med: 505ms ✅
wundergraph 2592ms 157 11015 total, 0 failed avg: 896ms, p95: 2593ms, max: 9167ms, med: 678ms ✅
mesh-supergraph-bun 6580ms 99 6950 total, 0 failed avg: 2675ms, p95: 6581ms, max: 10475ms, med: 2338ms ✅
mesh-supergraph 6951ms 66 4683 total, 0 failed avg: 4100ms, p95: 6951ms, max: 9469ms, med: 4096ms ✅
apollo-server 24103ms 67 4953 total, 0 failed avg: 4217ms, p95: 24103ms, max: 45245ms, med: 2268ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35943 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 203 kB/s http_req_blocked...............: avg=20.7ms min=1.35µs med=2.92µs max=5.19s p(90)=4.54µs p(95)=12.84µs http_req_connecting............: avg=16.72ms min=0s med=0s max=4.21s p(90)=0s p(95)=0s http_req_duration..............: avg=818.81ms min=6.85ms med=538.2ms max=7.3s p(90)=1.85s p(95)=2.4s { expected_response:true }...: avg=818.81ms min=6.85ms med=538.2ms max=7.3s p(90)=1.85s p(95)=2.4s http_req_failed................: 0.00% ✓ 0 ✗ 11981 http_req_receiving.............: avg=282.33ms min=32.98µs med=77.7µs max=5.85s p(90)=1.05s p(95)=1.56s http_req_sending...............: avg=36.2ms min=8.2µs med=13.63µs max=5.2s p(90)=165.27µs p(95)=68.34ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=500.28ms min=6.76ms med=386.9ms max=4.81s p(90)=1.08s p(95)=1.33s http_reqs......................: 11981 171.132937/s iteration_duration.............: avg=1.55s min=12.34ms med=1.08s max=12.51s p(90)=3.56s p(95)=4.5s iterations.....................: 11981 171.132937/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35115 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 199 kB/s http_req_blocked...............: avg=21.39ms min=1.43µs med=3.23µs max=4.14s p(90)=5.49µs p(95)=22.08µs http_req_connecting............: avg=20.05ms min=0s med=0s max=4.05s p(90)=0s p(95)=0s http_req_duration..............: avg=831.99ms min=6.26ms med=505.09ms max=6.87s p(90)=1.97s p(95)=2.59s { expected_response:true }...: avg=831.99ms min=6.26ms med=505.09ms max=6.87s p(90)=1.97s p(95)=2.59s http_req_failed................: 0.00% ✓ 0 ✗ 11705 http_req_receiving.............: avg=346.59ms min=33.61µs med=84.01µs max=6.55s p(90)=1.31s p(95)=1.95s http_req_sending...............: avg=31.84ms min=8.03µs med=14.66µs max=3.99s p(90)=347.42µs p(95)=56.31ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=453.55ms min=6.2ms med=338.23ms max=3.29s p(90)=978.26ms p(95)=1.23s http_reqs......................: 11705 167.198493/s iteration_duration.............: avg=1.58s min=11.8ms med=1.03s max=15.18s p(90)=3.78s p(95)=4.87s iterations.....................: 11705 167.198493/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 33045 ✗ 0 data_received..................: 967 MB 14 MB/s data_sent......................: 13 MB 187 kB/s http_req_blocked...............: avg=26.82ms min=1.56µs med=3.17µs max=4.57s p(90)=5.23µs p(95)=32.56µs http_req_connecting............: avg=25.89ms min=0s med=0s max=4.33s p(90)=0s p(95)=0s http_req_duration..............: avg=896ms min=6.55ms med=678.13ms max=9.16s p(90)=1.93s p(95)=2.59s { expected_response:true }...: avg=896ms min=6.55ms med=678.13ms max=9.16s p(90)=1.93s p(95)=2.59s http_req_failed................: 0.00% ✓ 0 ✗ 11015 http_req_receiving.............: avg=257.99ms min=33.9µs med=83.87µs max=8.6s p(90)=972.25ms p(95)=1.66s http_req_sending...............: avg=38.21ms min=7.95µs med=15.16µs max=4.91s p(90)=2.02ms p(95)=125.68ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=599.79ms min=6.44ms med=465.42ms max=4.31s p(90)=1.25s p(95)=1.59s http_reqs......................: 11015 157.337248/s iteration_duration.............: avg=1.68s min=12.64ms med=1.25s max=13.92s p(90)=3.71s p(95)=4.77s iterations.....................: 11015 157.337248/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 20850 ✗ 0 data_received..................: 610 MB 8.7 MB/s data_sent......................: 8.2 MB 118 kB/s http_req_blocked...............: avg=2.43ms min=1.49µs med=3.16µs max=1.14s p(90)=6.56µs p(95)=241.67µs http_req_connecting............: avg=2.23ms min=0s med=0s max=538.8ms p(90)=0s p(95)=159.56µs http_req_duration..............: avg=2.67s min=6.89ms med=2.33s max=10.47s p(90)=5.36s p(95)=6.58s { expected_response:true }...: avg=2.67s min=6.89ms med=2.33s max=10.47s p(90)=5.36s p(95)=6.58s http_req_failed................: 0.00% ✓ 0 ✗ 6950 http_req_receiving.............: avg=29.72ms min=34.49µs med=81.35µs max=1.69s p(90)=10.22ms p(95)=191.36ms http_req_sending...............: avg=3.44ms min=8.64µs med=14.57µs max=1.09s p(90)=107.12µs p(95)=7.86ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.64s min=6.74ms med=2.23s max=10.25s p(90)=5.35s p(95)=6.56s http_reqs......................: 6950 99.271835/s iteration_duration.............: avg=2.75s min=12.58ms med=2.48s max=10.57s p(90)=5.44s p(95)=6.73s iterations.....................: 6950 99.271835/s vus............................: 1 min=1 max=497 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14049 ✗ 0 data_received..................: 411 MB 5.9 MB/s data_sent......................: 5.6 MB 79 kB/s http_req_blocked...............: avg=496.58µs min=1.47µs med=4.28µs max=121.07ms p(90)=184.72µs p(95)=414.85µs http_req_connecting............: avg=474.5µs min=0s med=0s max=121ms p(90)=124.12µs p(95)=341.08µs http_req_duration..............: avg=4.1s min=16.12ms med=4.09s max=9.46s p(90)=6.54s p(95)=6.95s { expected_response:true }...: avg=4.1s min=16.12ms med=4.09s max=9.46s p(90)=6.54s p(95)=6.95s http_req_failed................: 0.00% ✓ 0 ✗ 4683 http_req_receiving.............: avg=1.57ms min=38.83µs med=120.46µs max=215.59ms p(90)=2.39ms p(95)=4.96ms http_req_sending...............: avg=452.67µs min=8.51µs med=24.28µs max=114.23ms p(90)=55.36µs p(95)=145.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.09s min=15.96ms med=4.09s max=9.46s p(90)=6.54s p(95)=6.93s http_reqs......................: 4683 66.891828/s iteration_duration.............: avg=4.13s min=21.94ms med=4.15s max=9.73s p(90)=6.58s p(95)=6.98s iterations.....................: 4683 66.891828/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14859 ✗ 0 data_received..................: 435 MB 5.9 MB/s data_sent......................: 5.9 MB 80 kB/s http_req_blocked...............: avg=82.71µs min=1.41µs med=3.31µs max=32.67ms p(90)=165.71µs p(95)=235.02µs http_req_connecting............: avg=71.37µs min=0s med=0s max=32.57ms p(90)=110.82µs p(95)=163.94µs http_req_duration..............: avg=4.21s min=83.04ms med=2.26s max=45.24s p(90)=3.42s p(95)=24.1s { expected_response:true }...: avg=4.21s min=83.04ms med=2.26s max=45.24s p(90)=3.42s p(95)=24.1s http_req_failed................: 0.00% ✓ 0 ✗ 4953 http_req_receiving.............: avg=397.3µs min=48.65µs med=114.72µs max=175.6ms p(90)=193.12µs p(95)=284.36µs http_req_sending...............: avg=60.36µs min=8.86µs med=17.43µs max=16.24ms p(90)=41.89µs p(95)=58.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.21s min=82.93ms med=2.26s max=45.24s p(90)=3.41s p(95)=24.1s http_reqs......................: 4953 67.629423/s iteration_duration.............: avg=4.22s min=90.1ms med=2.28s max=45.25s p(90)=3.43s p(95)=24.11s iterations.....................: 4953 67.629423/s vus............................: 23 min=23 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview