search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update dependency typescript to v5.4.3 #413

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
typescript (source) 5.4.2 -> 5.4.3 age adoption passing confidence

Release Notes

Microsoft/TypeScript (typescript) ### [`v5.4.3`](https://togithub.com/microsoft/TypeScript/releases/tag/v5.4.3): TypeScript 5.4.3 [Compare Source](https://togithub.com/Microsoft/TypeScript/compare/v5.4.2...v5.4.3) For release notes, check out the [release announcement](https://devblogs.microsoft.com/typescript/announcing-typescript-5-4/). For the complete list of fixed issues, check out the - [fixed issues query for Typescript 5.4.0 (Beta)](https://togithub.com/Microsoft/TypeScript/issues?utf8=%E2%9C%93\&q=milestone%3A%22TypeScript+5.4.0%22+is%3Aclosed+). - [fixed issues query for Typescript 5.4.1 (RC)](https://togithub.com/Microsoft/TypeScript/issues?utf8=%E2%9C%93\&q=milestone%3A%22TypeScript+5.4.1%22+is%3Aclosed+). - [fixed issues query for Typescript 5.4.2 (Stable)](https://togithub.com/Microsoft/TypeScript/issues?utf8=%E2%9C%93\&q=milestone%3A%22TypeScript+5.4.2%22+is%3Aclosed+). - [fixed issues query for Typescript 5.4.3 (Stable)](https://togithub.com/Microsoft/TypeScript/issues?utf8=%E2%9C%93\&q=milestone%3A%22TypeScript+5.4.3%22+is%3Aclosed+). Downloads are available on: - [NuGet package](https://www.nuget.org/packages/Microsoft.TypeScript.MSBuild)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4595 total, 0 failed avg: 611ms, p95: 805ms ✅
wundergraph 103 3184 total, 0 failed avg: 919ms, p95: 1167ms ✅
mesh-supergraph-bun 83 2558 total, 0 failed avg: 1164ms, p95: 1813ms ✅
cosmo 78 2453 total, 0 failed avg: 1204ms, p95: 1437ms ✅
apollo-server 49 1555 total, 0 failed avg: 1972ms, p95: 2364ms ✅
mesh-supergraph 30 961 total, 0 failed avg: 3180ms, p95: 5043ms ✅
mercurius 11 445 total, 0 failed avg: 7723ms, p95: 9181ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13785 ✗ 0 data_received..................: 403 MB 13 MB/s data_sent......................: 5.5 MB 179 kB/s http_req_blocked...............: avg=49.26µs min=1.46µs med=2.81µs max=52.83ms p(90)=4.31µs p(95)=5.87µs http_req_connecting............: avg=30.59µs min=0s med=0s max=6.99ms p(90)=0s p(95)=0s http_req_duration..............: avg=610.81ms min=287.65ms med=604.09ms max=1.12s p(90)=752.57ms p(95)=805.14ms { expected_response:true }...: avg=610.81ms min=287.65ms med=604.09ms max=1.12s p(90)=752.57ms p(95)=805.14ms http_req_failed................: 0.00% ✓ 0 ✗ 4595 http_req_receiving.............: avg=11ms min=36.6µs med=68.9µs max=364.73ms p(90)=28.31ms p(95)=78.83ms http_req_sending...............: avg=1.13ms min=8.41µs med=13.48µs max=320.19ms p(90)=38.71µs p(95)=486.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=598.67ms min=287.59ms med=596.59ms max=982.05ms p(90)=728.45ms p(95)=770.18ms http_reqs......................: 4595 150.962201/s iteration_duration.............: avg=658.14ms min=316.42ms med=643.51ms max=1.37s p(90)=821.17ms p(95)=886.29ms iterations.....................: 4595 150.962201/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9552 ✗ 0 data_received..................: 279 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=57.69µs min=1.09µs med=2.43µs max=92.42ms p(90)=3.72µs p(95)=5.88µs http_req_connecting............: avg=13.63µs min=0s med=0s max=1.74ms p(90)=0s p(95)=0s http_req_duration..............: avg=919.17ms min=543.17ms med=904.05ms max=1.73s p(90)=1.06s p(95)=1.16s { expected_response:true }...: avg=919.17ms min=543.17ms med=904.05ms max=1.73s p(90)=1.06s p(95)=1.16s http_req_failed................: 0.00% ✓ 0 ✗ 3184 http_req_receiving.............: avg=10.97ms min=40.47µs med=76.61µs max=378.42ms p(90)=29.32ms p(95)=70.38ms http_req_sending...............: avg=1.05ms min=7.51µs med=12.41µs max=173.24ms p(90)=29.2µs p(95)=134.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=907.14ms min=543.11ms med=898.49ms max=1.37s p(90)=1.05s p(95)=1.11s http_reqs......................: 3184 103.345344/s iteration_duration.............: avg=955.5ms min=553.45ms med=938.57ms max=1.73s p(90)=1.12s p(95)=1.24s iterations.....................: 3184 103.345344/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7674 ✗ 0 data_received..................: 224 MB 7.3 MB/s data_sent......................: 3.0 MB 99 kB/s http_req_blocked...............: avg=57.64µs min=1.45µs med=3.19µs max=5.98ms p(90)=5.26µs p(95)=11.08µs http_req_connecting............: avg=51.46µs min=0s med=0s max=5.95ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=478.82ms med=1.11s max=2.24s p(90)=1.54s p(95)=1.81s { expected_response:true }...: avg=1.16s min=478.82ms med=1.11s max=2.24s p(90)=1.54s p(95)=1.81s http_req_failed................: 0.00% ✓ 0 ✗ 2558 http_req_receiving.............: avg=13.69ms min=37.95µs med=96.1µs max=672.45ms p(90)=2.26ms p(95)=58.01ms http_req_sending...............: avg=315.14µs min=8.25µs med=15.48µs max=68.58ms p(90)=45.85µs p(95)=171µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=478.71ms med=1.1s max=2.24s p(90)=1.52s p(95)=1.79s http_reqs......................: 2558 83.241683/s iteration_duration.............: avg=1.18s min=489ms med=1.14s max=2.27s p(90)=1.57s p(95)=1.82s iterations.....................: 2558 83.241683/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7359 ✗ 0 data_received..................: 215 MB 6.9 MB/s data_sent......................: 2.9 MB 93 kB/s http_req_blocked...............: avg=40.53µs min=1.62µs med=2.89µs max=3.84ms p(90)=4.65µs p(95)=10.72µs http_req_connecting............: avg=34µs min=0s med=0s max=3.65ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=586.2ms med=1.19s max=1.67s p(90)=1.38s p(95)=1.43s { expected_response:true }...: avg=1.2s min=586.2ms med=1.19s max=1.67s p(90)=1.38s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2453 http_req_receiving.............: avg=18.28ms min=42.44µs med=102.54µs max=287.57ms p(90)=70.35ms p(95)=134.39ms http_req_sending...............: avg=1.48ms min=8.48µs med=13.94µs max=284.38ms p(90)=70.39µs p(95)=386.88µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=586.13ms med=1.18s max=1.59s p(90)=1.34s p(95)=1.38s http_reqs......................: 2453 78.490423/s iteration_duration.............: avg=1.24s min=612.81ms med=1.24s max=1.71s p(90)=1.43s p(95)=1.49s iterations.....................: 2453 78.490423/s vus............................: 22 min=22 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4665 ✗ 0 data_received..................: 137 MB 4.4 MB/s data_sent......................: 1.8 MB 59 kB/s http_req_blocked...............: avg=221.51µs min=1.41µs med=2.95µs max=10.53ms p(90)=4.59µs p(95)=575.87µs http_req_connecting............: avg=212.85µs min=0s med=0s max=10.5ms p(90)=0s p(95)=551.14µs http_req_duration..............: avg=1.97s min=991.16ms med=1.76s max=13.61s p(90)=2.13s p(95)=2.36s { expected_response:true }...: avg=1.97s min=991.16ms med=1.76s max=13.61s p(90)=2.13s p(95)=2.36s http_req_failed................: 0.00% ✓ 0 ✗ 1555 http_req_receiving.............: avg=217.91µs min=48.47µs med=116µs max=42.32ms p(90)=181.37µs p(95)=231.85µs http_req_sending...............: avg=175.3µs min=8.36µs med=15.7µs max=5.89ms p(90)=31.84µs p(95)=468.04µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.97s min=991.05ms med=1.76s max=13.61s p(90)=2.13s p(95)=2.36s http_reqs......................: 1555 49.608472/s iteration_duration.............: avg=1.98s min=997.24ms med=1.77s max=13.62s p(90)=2.13s p(95)=2.37s iterations.....................: 1555 49.608472/s vus............................: 36 min=36 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2883 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=90.67µs min=1.35µs med=3.42µs max=2.42ms p(90)=103.92µs p(95)=686.29µs http_req_connecting............: avg=79.65µs min=0s med=0s max=2.39ms p(90)=71.71µs p(95)=592.43µs http_req_duration..............: avg=3.18s min=1.23s med=3.03s max=7.15s p(90)=4.15s p(95)=5.04s { expected_response:true }...: avg=3.18s min=1.23s med=3.03s max=7.15s p(90)=4.15s p(95)=5.04s http_req_failed................: 0.00% ✓ 0 ✗ 961 http_req_receiving.............: avg=3.26ms min=41.8µs med=154.58µs max=91.37ms p(90)=2.2ms p(95)=10.45ms http_req_sending...............: avg=107.81µs min=8.21µs med=18.78µs max=26.79ms p(90)=106.98µs p(95)=529.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.17s min=1.23s med=3.02s max=7.15s p(90)=4.15s p(95)=5.04s http_reqs......................: 961 30.588364/s iteration_duration.............: avg=3.19s min=1.24s med=3.04s max=7.16s p(90)=4.17s p(95)=5.05s iterations.....................: 961 30.588364/s vus............................: 29 min=29 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1335 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 528 kB 14 kB/s http_req_blocked...............: avg=307.91µs min=1.72µs med=4.22µs max=8.18ms p(90)=678.35µs p(95)=2.03ms http_req_connecting............: avg=222.91µs min=0s med=0s max=8.13ms p(90)=497.52µs p(95)=1.52ms http_req_duration..............: avg=7.72s min=2.68s med=7.94s max=9.68s p(90)=9.05s p(95)=9.18s { expected_response:true }...: avg=7.72s min=2.68s med=7.94s max=9.68s p(90)=9.05s p(95)=9.18s http_req_failed................: 0.00% ✓ 0 ✗ 445 http_req_receiving.............: avg=143.79µs min=63.13µs med=128.61µs max=1.11ms p(90)=194.63µs p(95)=227.91µs http_req_sending...............: avg=71.64µs min=8.7µs med=23.05µs max=687.67µs p(90)=229.33µs p(95)=420.03µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.72s min=2.68s med=7.94s max=9.68s p(90)=9.05s p(95)=9.18s http_reqs......................: 445 11.737399/s iteration_duration.............: avg=7.73s min=2.69s med=7.95s max=9.69s p(90)=9.06s p(95)=9.18s iterations.....................: 445 11.737399/s vus............................: 18 min=18 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 163 4988 total, 0 failed avg: 558ms, p95: 721ms ✅
wundergraph 159 4828 total, 0 failed avg: 519ms, p95: 935ms ✅
cosmo 137 4218 total, 0 failed avg: 615ms, p95: 857ms ✅
mesh-supergraph-bun 100 3082 total, 0 failed avg: 957ms, p95: 1630ms ✅
apollo-server 49 1553 total, 0 failed avg: 1974ms, p95: 2816ms ✅
mesh-supergraph 31 998 total, 0 failed avg: 3095ms, p95: 5078ms ✅
mercurius 30 948 total, 0 failed avg: 3235ms, p95: 4214ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14964 ✗ 0 data_received..................: 438 MB 14 MB/s data_sent......................: 5.9 MB 194 kB/s http_req_blocked...............: avg=67.75µs min=1.64µs med=3.09µs max=70.32ms p(90)=4.84µs p(95)=5.75µs http_req_connecting............: avg=31.96µs min=0s med=0s max=4.09ms p(90)=0s p(95)=0s http_req_duration..............: avg=558.34ms min=184.04ms med=556.23ms max=1.53s p(90)=678.36ms p(95)=720.7ms { expected_response:true }...: avg=558.34ms min=184.04ms med=556.23ms max=1.53s p(90)=678.36ms p(95)=720.7ms http_req_failed................: 0.00% ✓ 0 ✗ 4988 http_req_receiving.............: avg=10.02ms min=37.87µs med=74.25µs max=991.75ms p(90)=10.85ms p(95)=60.21ms http_req_sending...............: avg=1.21ms min=8.42µs med=15.02µs max=474.27ms p(90)=35.94µs p(95)=163.59µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=547.1ms min=183.97ms med=548.03ms max=917.1ms p(90)=662.08ms p(95)=700.7ms http_reqs......................: 4988 163.337087/s iteration_duration.............: avg=607.07ms min=193.51ms med=593.7ms max=1.78s p(90)=744.44ms p(95)=806.07ms iterations.....................: 4988 163.337087/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14484 ✗ 0 data_received..................: 424 MB 14 MB/s data_sent......................: 5.7 MB 189 kB/s http_req_blocked...............: avg=180.15µs min=1.21µs med=2.57µs max=402.76ms p(90)=3.99µs p(95)=5.1µs http_req_connecting............: avg=39.96µs min=0s med=0s max=5.63ms p(90)=0s p(95)=0s http_req_duration..............: avg=519.14ms min=19.17ms med=491.29ms max=1.71s p(90)=807.13ms p(95)=934.64ms { expected_response:true }...: avg=519.14ms min=19.17ms med=491.29ms max=1.71s p(90)=807.13ms p(95)=934.64ms http_req_failed................: 0.00% ✓ 0 ✗ 4828 http_req_receiving.............: avg=40.66ms min=37.33µs med=77.31µs max=1s p(90)=111.96ms p(95)=282.27ms http_req_sending...............: avg=2.53ms min=7.63µs med=12.69µs max=945.99ms p(90)=29.61µs p(95)=810.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=475.93ms min=19.07ms med=458.5ms max=1.37s p(90)=740.69ms p(95)=853.52ms http_reqs......................: 4828 159.151389/s iteration_duration.............: avg=625.51ms min=29.44ms med=565.65ms max=2.96s p(90)=981.35ms p(95)=1.19s iterations.....................: 4828 159.151389/s vus............................: 96 min=96 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 12654 ✗ 0 data_received..................: 370 MB 12 MB/s data_sent......................: 5.0 MB 164 kB/s http_req_blocked...............: avg=65.14µs min=1.71µs med=4.66µs max=20.29ms p(90)=8.21µs p(95)=11.25µs http_req_connecting............: avg=48.85µs min=0s med=0s max=7.16ms p(90)=0s p(95)=0s http_req_duration..............: avg=614.5ms min=18.5ms med=621.44ms max=2.38s p(90)=771.13ms p(95)=857.48ms { expected_response:true }...: avg=614.5ms min=18.5ms med=621.44ms max=2.38s p(90)=771.13ms p(95)=857.48ms http_req_failed................: 0.00% ✓ 0 ✗ 4218 http_req_receiving.............: avg=46.78ms min=47.48µs med=148.81µs max=1.64s p(90)=158.96ms p(95)=346.69ms http_req_sending...............: avg=1.96ms min=10.24µs med=19.95µs max=958.75ms p(90)=123.63µs p(95)=286.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=565.74ms min=18.33ms med=600.07ms max=948.81ms p(90)=716.55ms p(95)=746.61ms http_reqs......................: 4218 137.745307/s iteration_duration.............: avg=719.37ms min=30.33ms med=685.01ms max=2.75s p(90)=1.03s p(95)=1.22s iterations.....................: 4218 137.745307/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9246 ✗ 0 data_received..................: 270 MB 8.8 MB/s data_sent......................: 3.7 MB 119 kB/s http_req_blocked...............: avg=231.49µs min=1.3µs med=2.61µs max=17.05ms p(90)=4.02µs p(95)=8.59µs http_req_connecting............: avg=142.97µs min=0s med=0s max=17.02ms p(90)=0s p(95)=0s http_req_duration..............: avg=957.03ms min=485.09ms med=821.69ms max=2.81s p(90)=1.51s p(95)=1.62s { expected_response:true }...: avg=957.03ms min=485.09ms med=821.69ms max=2.81s p(90)=1.51s p(95)=1.62s http_req_failed................: 0.00% ✓ 0 ✗ 3082 http_req_receiving.............: avg=9.87ms min=37.69µs med=82.44µs max=546.38ms p(90)=1.44ms p(95)=43.95ms http_req_sending...............: avg=449.91µs min=7.34µs med=13.23µs max=190.68ms p(90)=35.41µs p(95)=125.77µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=946.7ms min=484.6ms med=817.19ms max=2.81s p(90)=1.51s p(95)=1.62s http_reqs......................: 3082 100.592031/s iteration_duration.............: avg=984.48ms min=501.76ms med=849.56ms max=2.87s p(90)=1.55s p(95)=1.65s iterations.....................: 3082 100.592031/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4659 ✗ 0 data_received..................: 137 MB 4.3 MB/s data_sent......................: 1.8 MB 59 kB/s http_req_blocked...............: avg=123.06µs min=1.65µs med=3.35µs max=6.59ms p(90)=5.37µs p(95)=465.57µs http_req_connecting............: avg=110.95µs min=0s med=0s max=6.56ms p(90)=0s p(95)=301.69µs http_req_duration..............: avg=1.97s min=378.1ms med=1.61s max=21.21s p(90)=2.03s p(95)=2.81s { expected_response:true }...: avg=1.97s min=378.1ms med=1.61s max=21.21s p(90)=2.03s p(95)=2.81s http_req_failed................: 0.00% ✓ 0 ✗ 1553 http_req_receiving.............: avg=251.4µs min=50.53µs med=124.12µs max=65.56ms p(90)=180.14µs p(95)=207.82µs http_req_sending...............: avg=86.82µs min=8.58µs med=18.32µs max=12.93ms p(90)=35.83µs p(95)=397.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.97s min=377.95ms med=1.61s max=21.21s p(90)=2.03s p(95)=2.81s http_reqs......................: 1553 49.452501/s iteration_duration.............: avg=1.98s min=388.92ms med=1.62s max=21.21s p(90)=2.04s p(95)=2.83s iterations.....................: 1553 49.452501/s vus............................: 42 min=42 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2994 ✗ 0 data_received..................: 88 MB 2.8 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=44.27µs min=1.36µs med=3.34µs max=1.57ms p(90)=84.08µs p(95)=196.07µs http_req_connecting............: avg=32.71µs min=0s med=0s max=1.49ms p(90)=17.39µs p(95)=157.25µs http_req_duration..............: avg=3.09s min=1s med=2.96s max=6.8s p(90)=4.29s p(95)=5.07s { expected_response:true }...: avg=3.09s min=1s med=2.96s max=6.8s p(90)=4.29s p(95)=5.07s http_req_failed................: 0.00% ✓ 0 ✗ 998 http_req_receiving.............: avg=2.91ms min=38.86µs med=131.99µs max=81.31ms p(90)=1.26ms p(95)=9.83ms http_req_sending...............: avg=48.06µs min=8.38µs med=18.35µs max=3.01ms p(90)=39.57µs p(95)=142.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.09s min=1s med=2.96s max=6.8s p(90)=4.29s p(95)=5.07s http_reqs......................: 998 31.544884/s iteration_duration.............: avg=3.1s min=1.03s med=2.97s max=6.81s p(90)=4.31s p(95)=5.1s iterations.....................: 998 31.544884/s vus............................: 59 min=59 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2844 ✗ 0 data_received..................: 83 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=306.55µs min=1.63µs med=3.75µs max=6.44ms p(90)=331.4µs p(95)=2.44ms http_req_connecting............: avg=291.43µs min=0s med=0s max=6.37ms p(90)=274.97µs p(95)=2.41ms http_req_duration..............: avg=3.23s min=1.05s med=3.05s max=6.87s p(90)=4.07s p(95)=4.21s { expected_response:true }...: avg=3.23s min=1.05s med=3.05s max=6.87s p(90)=4.07s p(95)=4.21s http_req_failed................: 0.00% ✓ 0 ✗ 948 http_req_receiving.............: avg=201.61µs min=41.27µs med=117.61µs max=31.67ms p(90)=181.36µs p(95)=233.18µs http_req_sending...............: avg=44.89µs min=9.1µs med=20.18µs max=2.07ms p(90)=52.32µs p(95)=190.32µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.23s min=1.05s med=3.05s max=6.87s p(90)=4.07s p(95)=4.21s http_reqs......................: 948 30.517019/s iteration_duration.............: avg=3.24s min=1.07s med=3.06s max=6.9s p(90)=4.08s p(95)=4.22s iterations.....................: 948 30.517019/s vus............................: 15 min=15 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 164 5013 total, 0 failed avg: 543ms, p95: 735ms ✅
wundergraph 102 3160 total, 0 failed avg: 925ms, p95: 1125ms ✅
mesh-supergraph-bun 101 3137 total, 0 failed avg: 929ms, p95: 1358ms ✅
cosmo 82 2556 total, 0 failed avg: 1166ms, p95: 1387ms ✅
apollo-server 64 2021 total, 0 failed avg: 1505ms, p95: 1873ms ✅
mesh-supergraph 61 1896 total, 0 failed avg: 1586ms, p95: 2380ms ✅
mercurius 12 473 total, 0 failed avg: 7212ms, p95: 8487ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15039 ✗ 0 data_received..................: 440 MB 14 MB/s data_sent......................: 6.0 MB 195 kB/s http_req_blocked...............: avg=88.25µs min=1.4µs med=2.89µs max=51.76ms p(90)=4.59µs p(95)=6.05µs http_req_connecting............: avg=58.85µs min=0s med=0s max=7.94ms p(90)=0s p(95)=0s http_req_duration..............: avg=543.32ms min=267.68ms med=530.57ms max=1.17s p(90)=675.11ms p(95)=734.92ms { expected_response:true }...: avg=543.32ms min=267.68ms med=530.57ms max=1.17s p(90)=675.11ms p(95)=734.92ms http_req_failed................: 0.00% ✓ 0 ✗ 5013 http_req_receiving.............: avg=16.75ms min=33.83µs med=73.82µs max=410.15ms p(90)=58.27ms p(95)=108.41ms http_req_sending...............: avg=1.6ms min=7.83µs med=13.69µs max=416.66ms p(90)=36.31µs p(95)=225.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=524.96ms min=267.61ms med=519.25ms max=869.12ms p(90)=647.43ms p(95)=686.91ms http_reqs......................: 5013 164.288789/s iteration_duration.............: avg=605.63ms min=277.42ms med=583.81ms max=1.22s p(90)=768.64ms p(95)=851.77ms iterations.....................: 5013 164.288789/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9480 ✗ 0 data_received..................: 277 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=35.45µs min=1.27µs med=2.63µs max=11.95ms p(90)=4.01µs p(95)=8.5µs http_req_connecting............: avg=24.33µs min=0s med=0s max=11.82ms p(90)=0s p(95)=0s http_req_duration..............: avg=924.67ms min=552.43ms med=919.63ms max=1.36s p(90)=1.07s p(95)=1.12s { expected_response:true }...: avg=924.67ms min=552.43ms med=919.63ms max=1.36s p(90)=1.07s p(95)=1.12s http_req_failed................: 0.00% ✓ 0 ✗ 3160 http_req_receiving.............: avg=12.43ms min=38.88µs med=80.7µs max=324.76ms p(90)=40.71ms p(95)=86.66ms http_req_sending...............: avg=1.9ms min=7.91µs med=12.85µs max=306.43ms p(90)=61.13µs p(95)=522.23µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=910.33ms min=552.36ms med=909.77ms max=1.23s p(90)=1.03s p(95)=1.08s http_reqs......................: 3160 102.656507/s iteration_duration.............: avg=961.78ms min=593.01ms med=951.45ms max=1.36s p(90)=1.12s p(95)=1.17s iterations.....................: 3160 102.656507/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9411 ✗ 0 data_received..................: 275 MB 8.9 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=91.61µs min=1.52µs med=2.96µs max=17.07ms p(90)=4.73µs p(95)=9.61µs http_req_connecting............: avg=78.68µs min=0s med=0s max=5.9ms p(90)=0s p(95)=0s http_req_duration..............: avg=928.62ms min=334.95ms med=909.85ms max=1.81s p(90)=1.23s p(95)=1.35s { expected_response:true }...: avg=928.62ms min=334.95ms med=909.85ms max=1.81s p(90)=1.23s p(95)=1.35s http_req_failed................: 0.00% ✓ 0 ✗ 3137 http_req_receiving.............: avg=18.83ms min=36.87µs med=86.27µs max=704.31ms p(90)=22.15ms p(95)=130.55ms http_req_sending...............: avg=764.7µs min=8.49µs med=14.06µs max=329.26ms p(90)=40.16µs p(95)=261.23µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=909.02ms min=334.83ms med=894.12ms max=1.7s p(90)=1.18s p(95)=1.29s http_reqs......................: 3137 101.841298/s iteration_duration.............: avg=968.3ms min=346.05ms med=942.45ms max=1.84s p(90)=1.29s p(95)=1.4s iterations.....................: 3137 101.841298/s vus............................: 96 min=96 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7668 ✗ 0 data_received..................: 224 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=24.84µs min=1.32µs med=2.45µs max=2.61ms p(90)=3.81µs p(95)=9.07µs http_req_connecting............: avg=17.9µs min=0s med=0s max=1.83ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=728.24ms med=1.17s max=1.61s p(90)=1.33s p(95)=1.38s { expected_response:true }...: avg=1.16s min=728.24ms med=1.17s max=1.61s p(90)=1.33s p(95)=1.38s http_req_failed................: 0.00% ✓ 0 ✗ 2556 http_req_receiving.............: avg=11.99ms min=38.05µs med=85.05µs max=386.84ms p(90)=46.44ms p(95)=86.42ms http_req_sending...............: avg=1.26ms min=7.84µs med=12.64µs max=235.81ms p(90)=33.34µs p(95)=202.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=725.92ms med=1.15s max=1.6s p(90)=1.31s p(95)=1.35s http_reqs......................: 2556 82.063036/s iteration_duration.............: avg=1.2s min=743.11ms med=1.2s max=1.74s p(90)=1.38s p(95)=1.44s iterations.....................: 2556 82.063036/s vus............................: 26 min=26 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6063 ✗ 0 data_received..................: 178 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=44.66µs min=1.54µs med=3.04µs max=7.72ms p(90)=4.82µs p(95)=40.6µs http_req_connecting............: avg=35.2µs min=0s med=0s max=7.69ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.5s min=758.08ms med=1.43s max=9.51s p(90)=1.71s p(95)=1.87s { expected_response:true }...: avg=1.5s min=758.08ms med=1.43s max=9.51s p(90)=1.71s p(95)=1.87s http_req_failed................: 0.00% ✓ 0 ✗ 2021 http_req_receiving.............: avg=174.93µs min=46.88µs med=114.53µs max=32.79ms p(90)=183.39µs p(95)=248.08µs http_req_sending...............: avg=34.56µs min=8.6µs med=16.04µs max=1.37ms p(90)=31.32µs p(95)=73.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.5s min=757.91ms med=1.43s max=9.51s p(90)=1.71s p(95)=1.87s http_reqs......................: 2021 64.965138/s iteration_duration.............: avg=1.51s min=768.28ms med=1.44s max=9.52s p(90)=1.72s p(95)=1.88s iterations.....................: 2021 64.965138/s vus............................: 15 min=15 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5688 ✗ 0 data_received..................: 166 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=86.04µs min=1.89µs med=4.29µs max=12.66ms p(90)=6.03µs p(95)=113.99µs http_req_connecting............: avg=57.47µs min=0s med=0s max=12.63ms p(90)=0s p(95)=76.85µs http_req_duration..............: avg=1.58s min=621.14ms med=1.52s max=3.92s p(90)=2.18s p(95)=2.38s { expected_response:true }...: avg=1.58s min=621.14ms med=1.52s max=3.92s p(90)=2.18s p(95)=2.38s http_req_failed................: 0.00% ✓ 0 ✗ 1896 http_req_receiving.............: avg=1.94ms min=47.46µs med=123.23µs max=116.01ms p(90)=1.72ms p(95)=10.24ms http_req_sending...............: avg=186.98µs min=9.47µs med=22.68µs max=44.76ms p(90)=41.15µs p(95)=125.24µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.58s min=621.06ms med=1.52s max=3.92s p(90)=2.18s p(95)=2.37s http_reqs......................: 1896 61.161162/s iteration_duration.............: avg=1.61s min=629.66ms med=1.55s max=3.95s p(90)=2.2s p(95)=2.42s iterations.....................: 1896 61.161162/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1419 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 562 kB 15 kB/s http_req_blocked...............: avg=480.51µs min=1.61µs med=3.24µs max=5.18ms p(90)=2.26ms p(95)=3.84ms http_req_connecting............: avg=461.68µs min=0s med=0s max=5.14ms p(90)=2.23ms p(95)=3.62ms http_req_duration..............: avg=7.21s min=2.85s med=7.51s max=8.7s p(90)=8.36s p(95)=8.48s { expected_response:true }...: avg=7.21s min=2.85s med=7.51s max=8.7s p(90)=8.36s p(95)=8.48s http_req_failed................: 0.00% ✓ 0 ✗ 473 http_req_receiving.............: avg=135.18µs min=61.59µs med=112.83µs max=2.39ms p(90)=166.78µs p(95)=215.95µs http_req_sending...............: avg=88.58µs min=9.09µs med=18.61µs max=830.65µs p(90)=399µs p(95)=572.59µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.21s min=2.85s med=7.51s max=8.7s p(90)=8.36s p(95)=8.48s http_reqs......................: 473 12.552114/s iteration_duration.............: avg=7.22s min=2.85s med=7.52s max=8.7s p(90)=8.36s p(95)=8.49s iterations.....................: 473 12.552114/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2509ms 171 12000 total, 0 failed avg: 808ms, p95: 2509ms, max: 6863ms, med: 490ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
wundergraph 2826ms 165 11593 total, 0 failed avg: 834ms, p95: 2826ms, max: 8329ms, med: 486ms ✅
apollo-router 3291ms 174 12203 total, 0 failed avg: 877ms, p95: 3292ms, max: 8194ms, med: 467ms ✅
mesh-supergraph-bun 5468ms 115 8106 total, 0 failed avg: 2267ms, p95: 5468ms, max: 9153ms, med: 2040ms ✅
mesh-supergraph 6575ms 69 4848 total, 0 failed avg: 3941ms, p95: 6576ms, max: 8361ms, med: 4090ms ✅
apollo-server 22633ms 70 5170 total, 0 failed avg: 4023ms, p95: 22634ms, max: 44416ms, med: 2180ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 11999 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 11999 / ✗ 1 checks.........................: 99.99% ✓ 35998 ✗ 2 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 204 kB/s http_req_blocked...............: avg=15.76ms min=1.67µs med=3.23µs max=3.58s p(90)=5.4µs p(95)=13.51µs http_req_connecting............: avg=14.74ms min=0s med=0s max=3.58s p(90)=0s p(95)=0s http_req_duration..............: avg=807.92ms min=6.92ms med=490.33ms max=6.86s p(90)=1.91s p(95)=2.5s { expected_response:true }...: avg=807.92ms min=6.92ms med=490.33ms max=6.86s p(90)=1.91s p(95)=2.5s http_req_failed................: 0.00% ✓ 0 ✗ 12000 http_req_receiving.............: avg=317.28ms min=32.02µs med=87.19µs max=5.67s p(90)=1.27s p(95)=1.86s http_req_sending...............: avg=38.37ms min=8.22µs med=15.42µs max=4.78s p(90)=196.24µs p(95)=58.31ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=452.25ms min=6.81ms med=341.4ms max=3.05s p(90)=978.28ms p(95)=1.32s http_reqs......................: 12000 171.4136/s iteration_duration.............: avg=1.53s min=12.38ms med=969.43ms max=12.75s p(90)=3.69s p(95)=4.7s iterations.....................: 12000 171.4136/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34779 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 197 kB/s http_req_blocked...............: avg=21.53ms min=1.53µs med=3.14µs max=5.52s p(90)=5.09µs p(95)=13.7µs http_req_connecting............: avg=20.04ms min=0s med=0s max=4.71s p(90)=0s p(95)=0s http_req_duration..............: avg=833.96ms min=6.01ms med=486.38ms max=8.32s p(90)=2.12s p(95)=2.82s { expected_response:true }...: avg=833.96ms min=6.01ms med=486.38ms max=8.32s p(90)=2.12s p(95)=2.82s http_req_failed................: 0.00% ✓ 0 ✗ 11593 http_req_receiving.............: avg=378.87ms min=31.75µs med=85.02µs max=7.91s p(90)=1.49s p(95)=2.13s http_req_sending...............: avg=39.91ms min=7.2µs med=14.6µs max=5.02s p(90)=624.53µs p(95)=82.25ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=415.16ms min=5.93ms med=327.75ms max=4.2s p(90)=878.43ms p(95)=1.03s http_reqs......................: 11593 165.599497/s iteration_duration.............: avg=1.58s min=11.93ms med=944.71ms max=20.01s p(90)=3.94s p(95)=5.1s iterations.....................: 11593 165.599497/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36609 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=15.91ms min=1.48µs med=3.01µs max=7.41s p(90)=4.92µs p(95)=12.2µs http_req_connecting............: avg=14.58ms min=0s med=0s max=7.41s p(90)=0s p(95)=0s http_req_duration..............: avg=877.17ms min=6.66ms med=467.33ms max=8.19s p(90)=2.33s p(95)=3.29s { expected_response:true }...: avg=877.17ms min=6.66ms med=467.33ms max=8.19s p(90)=2.33s p(95)=3.29s http_req_failed................: 0.00% ✓ 0 ✗ 12203 http_req_receiving.............: avg=419.43ms min=31.47µs med=80.65µs max=7.17s p(90)=1.73s p(95)=2.65s http_req_sending...............: avg=36.92ms min=7.71µs med=14.24µs max=5.27s p(90)=142.53µs p(95)=48.18ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=420.82ms min=6.58ms med=365.39ms max=2.81s p(90)=773.82ms p(95)=924.24ms http_reqs......................: 12203 174.327222/s iteration_duration.............: avg=1.53s min=12.2ms med=809.78ms max=16.04s p(90)=3.97s p(95)=5.21s iterations.....................: 12203 174.327222/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24318 ✗ 0 data_received..................: 711 MB 10 MB/s data_sent......................: 9.6 MB 137 kB/s http_req_blocked...............: avg=1.89ms min=1.26µs med=3.1µs max=744.03ms p(90)=5.7µs p(95)=222.8µs http_req_connecting............: avg=1.78ms min=0s med=0s max=337.77ms p(90)=0s p(95)=143.16µs http_req_duration..............: avg=2.26s min=5.76ms med=2.04s max=9.15s p(90)=4.25s p(95)=5.46s { expected_response:true }...: avg=2.26s min=5.76ms med=2.04s max=9.15s p(90)=4.25s p(95)=5.46s http_req_failed................: 0.00% ✓ 0 ✗ 8106 http_req_receiving.............: avg=29.39ms min=36.59µs med=79.71µs max=1.88s p(90)=40.48ms p(95)=199.4ms http_req_sending...............: avg=3.1ms min=8.25µs med=14.24µs max=1s p(90)=91.04µs p(95)=9.34ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.23s min=5.57ms med=2s max=9.15s p(90)=4.19s p(95)=5.42s http_reqs......................: 8106 115.791439/s iteration_duration.............: avg=2.33s min=11.5ms med=2.11s max=9.77s p(90)=4.33s p(95)=5.6s iterations.....................: 8106 115.791439/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14544 ✗ 0 data_received..................: 425 MB 6.1 MB/s data_sent......................: 5.8 MB 82 kB/s http_req_blocked...............: avg=512.73µs min=1.38µs med=3.78µs max=133.81ms p(90)=171.22µs p(95)=441.48µs http_req_connecting............: avg=485.32µs min=0s med=0s max=133.74ms p(90)=108.91µs p(95)=367.9µs http_req_duration..............: avg=3.94s min=10.77ms med=4.09s max=8.36s p(90)=6.23s p(95)=6.57s { expected_response:true }...: avg=3.94s min=10.77ms med=4.09s max=8.36s p(90)=6.23s p(95)=6.57s http_req_failed................: 0.00% ✓ 0 ✗ 4848 http_req_receiving.............: avg=2.78ms min=37.19µs med=102.47µs max=323.23ms p(90)=1.32ms p(95)=8.62ms http_req_sending...............: avg=486.48µs min=8.44µs med=20.44µs max=154.64ms p(90)=52.44µs p(95)=124.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.93s min=10.68ms med=4.08s max=8.36s p(90)=6.23s p(95)=6.57s http_reqs......................: 4848 69.241082/s iteration_duration.............: avg=3.96s min=17.3ms med=4.11s max=8.37s p(90)=6.26s p(95)=6.64s iterations.....................: 4848 69.241082/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15510 ✗ 0 data_received..................: 454 MB 6.2 MB/s data_sent......................: 6.1 MB 84 kB/s http_req_blocked...............: avg=141.91µs min=1.23µs med=2.83µs max=60.05ms p(90)=18.32µs p(95)=282.24µs http_req_connecting............: avg=128.78µs min=0s med=0s max=59.89ms p(90)=0s p(95)=220.08µs http_req_duration..............: avg=4.02s min=69.33ms med=2.17s max=44.41s p(90)=3.33s p(95)=22.63s { expected_response:true }...: avg=4.02s min=69.33ms med=2.17s max=44.41s p(90)=3.33s p(95)=22.63s http_req_failed................: 0.00% ✓ 0 ✗ 5170 http_req_receiving.............: avg=347.88µs min=41.54µs med=111.33µs max=199.17ms p(90)=175.21µs p(95)=213.48µs http_req_sending...............: avg=69.34µs min=8.3µs med=14.26µs max=36.54ms p(90)=37.26µs p(95)=58.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.02s min=69.22ms med=2.17s max=44.41s p(90)=3.33s p(95)=22.63s http_reqs......................: 5170 70.866797/s iteration_duration.............: avg=4.03s min=85.11ms med=2.19s max=44.42s p(90)=3.35s p(95)=22.64s iterations.....................: 5170 70.866797/s vus............................: 77 min=57 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview