search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency typescript to v5.4.2 #383

Closed renovate[bot] closed 7 months ago

renovate[bot] commented 7 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
typescript (source) 5.3.3 -> 5.4.2 age adoption passing confidence

Release Notes

Microsoft/TypeScript (typescript) ### [`v5.4.2`](https://togithub.com/microsoft/TypeScript/releases/tag/v5.4.2): TypeScript 5.4 [Compare Source](https://togithub.com/Microsoft/TypeScript/compare/v5.3.3...v5.4.2) For release notes, check out the [release announcement](https://devblogs.microsoft.com/typescript/announcing-typescript-5-4/). For the complete list of fixed issues, check out the - [fixed issues query for Typescript 5.4.0 (Beta)](https://togithub.com/Microsoft/TypeScript/issues?utf8=%E2%9C%93\&q=milestone%3A%22TypeScript+5.4.0%22+is%3Aclosed+). - [fixed issues query for Typescript 5.4.1 (RC)](https://togithub.com/Microsoft/TypeScript/issues?utf8=%E2%9C%93\&q=milestone%3A%22TypeScript+5.4.1%22+is%3Aclosed+). - [fixed issues query for Typescript 5.4.2 (Stable)](https://togithub.com/Microsoft/TypeScript/issues?utf8=%E2%9C%93\&q=milestone%3A%22TypeScript+5.4.2%22+is%3Aclosed+). Downloads are available on: - [NuGet package](https://www.nuget.org/packages/Microsoft.TypeScript.MSBuild)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 7 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 151 4630 total, 0 failed avg: 607ms, p95: 799ms ✅
wundergraph 99 3088 total, 0 failed avg: 949ms, p95: 1231ms ✅
mesh-supergraph-bun 84 2623 total, 0 failed avg: 1139ms, p95: 1622ms ✅
cosmo 79 2441 total, 0 failed avg: 1195ms, p95: 1467ms ✅
apollo-server 47 1498 total, 0 failed avg: 2052ms, p95: 2448ms ✅
mesh-supergraph 31 993 total, 0 failed avg: 3105ms, p95: 5166ms ✅
mercurius 11 452 total, 0 failed avg: 7557ms, p95: 9097ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13890 ✗ 0 data_received..................: 406 MB 13 MB/s data_sent......................: 5.5 MB 180 kB/s http_req_blocked...............: avg=34.94µs min=1.11µs med=2.8µs max=8.44ms p(90)=4.32µs p(95)=5.74µs http_req_connecting............: avg=27.3µs min=0s med=0s max=3.6ms p(90)=0s p(95)=0s http_req_duration..............: avg=607.32ms min=296.57ms med=597.85ms max=1.34s p(90)=743.06ms p(95)=799.22ms { expected_response:true }...: avg=607.32ms min=296.57ms med=597.85ms max=1.34s p(90)=743.06ms p(95)=799.22ms http_req_failed................: 0.00% ✓ 0 ✗ 4630 http_req_receiving.............: avg=10.41ms min=37.58µs med=69.94µs max=417.6ms p(90)=29.33ms p(95)=77.01ms http_req_sending...............: avg=1.22ms min=8.13µs med=13.45µs max=325.79ms p(90)=36.47µs p(95)=270.45µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=595.68ms min=296.41ms med=590.33ms max=1.03s p(90)=723.62ms p(95)=773.23ms http_reqs......................: 4630 151.727283/s iteration_duration.............: avg=653.97ms min=306.72ms med=638.61ms max=1.44s p(90)=822.2ms p(95)=884.44ms iterations.....................: 4630 151.727283/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9264 ✗ 0 data_received..................: 271 MB 8.7 MB/s data_sent......................: 3.7 MB 118 kB/s http_req_blocked...............: avg=27.44µs min=1.59µs med=3.01µs max=6.1ms p(90)=4.8µs p(95)=9.72µs http_req_connecting............: avg=20.56µs min=0s med=0s max=3.02ms p(90)=0s p(95)=0s http_req_duration..............: avg=949.32ms min=608.35ms med=926.74ms max=1.58s p(90)=1.13s p(95)=1.23s { expected_response:true }...: avg=949.32ms min=608.35ms med=926.74ms max=1.58s p(90)=1.13s p(95)=1.23s http_req_failed................: 0.00% ✓ 0 ✗ 3088 http_req_receiving.............: avg=16.49ms min=35.58µs med=100.86µs max=351.06ms p(90)=63.7ms p(95)=111.11ms http_req_sending...............: avg=1.15ms min=8.35µs med=14.64µs max=260.18ms p(90)=40.25µs p(95)=251.09µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=931.68ms min=607.7ms med=916.14ms max=1.38s p(90)=1.1s p(95)=1.19s http_reqs......................: 3088 99.149755/s iteration_duration.............: avg=987.98ms min=618.95ms med=960.25ms max=1.6s p(90)=1.19s p(95)=1.29s iterations.....................: 3088 99.149755/s vus............................: 1 min=1 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7869 ✗ 0 data_received..................: 230 MB 7.4 MB/s data_sent......................: 3.1 MB 101 kB/s http_req_blocked...............: avg=51.3µs min=1.44µs med=3.01µs max=3.85ms p(90)=4.73µs p(95)=10.29µs http_req_connecting............: avg=42.31µs min=0s med=0s max=3.82ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.13s min=505.03ms med=1.1s max=2.43s p(90)=1.46s p(95)=1.62s { expected_response:true }...: avg=1.13s min=505.03ms med=1.1s max=2.43s p(90)=1.46s p(95)=1.62s http_req_failed................: 0.00% ✓ 0 ✗ 2623 http_req_receiving.............: avg=15.15ms min=39.52µs med=92.11µs max=680.24ms p(90)=3.43ms p(95)=67.22ms http_req_sending...............: avg=507.71µs min=7.96µs med=14.23µs max=80.25ms p(90)=45.83µs p(95)=239.75µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.12s min=504.76ms med=1.09s max=2.43s p(90)=1.43s p(95)=1.58s http_reqs......................: 2623 84.751403/s iteration_duration.............: avg=1.16s min=511.7ms med=1.13s max=2.52s p(90)=1.5s p(95)=1.65s iterations.....................: 2623 84.751403/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7323 ✗ 0 data_received..................: 214 MB 7.0 MB/s data_sent......................: 2.9 MB 95 kB/s http_req_blocked...............: avg=32.31µs min=1.42µs med=2.64µs max=7.04ms p(90)=4.2µs p(95)=10.12µs http_req_connecting............: avg=25.62µs min=0s med=0s max=3.81ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=749.39ms med=1.18s max=1.76s p(90)=1.39s p(95)=1.46s { expected_response:true }...: avg=1.19s min=749.39ms med=1.18s max=1.76s p(90)=1.39s p(95)=1.46s http_req_failed................: 0.00% ✓ 0 ✗ 2441 http_req_receiving.............: avg=18.8ms min=35.05µs med=83.49µs max=439.66ms p(90)=64.81ms p(95)=119.86ms http_req_sending...............: avg=1.06ms min=7.86µs med=13.15µs max=373.22ms p(90)=39.45µs p(95)=355.48µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.17s min=749.2ms med=1.17s max=1.52s p(90)=1.37s p(95)=1.4s http_reqs......................: 2441 79.97762/s iteration_duration.............: avg=1.23s min=759.58ms med=1.22s max=1.97s p(90)=1.44s p(95)=1.55s iterations.....................: 2441 79.97762/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4494 ✗ 0 data_received..................: 132 MB 4.2 MB/s data_sent......................: 1.8 MB 56 kB/s http_req_blocked...............: avg=49.19µs min=1.46µs med=3.22µs max=3.35ms p(90)=5.25µs p(95)=203.2µs http_req_connecting............: avg=41.28µs min=0s med=0s max=3.31ms p(90)=0s p(95)=161.86µs http_req_duration..............: avg=2.05s min=899.73ms med=1.83s max=14.28s p(90)=2.24s p(95)=2.44s { expected_response:true }...: avg=2.05s min=899.73ms med=1.83s max=14.28s p(90)=2.24s p(95)=2.44s http_req_failed................: 0.00% ✓ 0 ✗ 1498 http_req_receiving.............: avg=288.71µs min=45.02µs med=115.62µs max=47.07ms p(90)=182.91µs p(95)=245.84µs http_req_sending...............: avg=54.17µs min=8.1µs med=16.56µs max=13.11ms p(90)=33.14µs p(95)=112.14µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.05s min=899.59ms med=1.83s max=14.28s p(90)=2.24s p(95)=2.44s http_reqs......................: 1498 47.476845/s iteration_duration.............: avg=2.06s min=907.1ms med=1.84s max=14.31s p(90)=2.26s p(95)=2.45s iterations.....................: 1498 47.476845/s vus............................: 60 min=60 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2979 ✗ 0 data_received..................: 87 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=238.51µs min=1.45µs med=3.33µs max=6.19ms p(90)=249µs p(95)=1.88ms http_req_connecting............: avg=227.64µs min=0s med=0s max=6.04ms p(90)=61.05µs p(95)=1.81ms http_req_duration..............: avg=3.1s min=1.3s med=2.97s max=6.05s p(90)=3.99s p(95)=5.16s { expected_response:true }...: avg=3.1s min=1.3s med=2.97s max=6.05s p(90)=3.99s p(95)=5.16s http_req_failed................: 0.00% ✓ 0 ✗ 993 http_req_receiving.............: avg=2.94ms min=40.05µs med=138.87µs max=104.8ms p(90)=1.29ms p(95)=8.23ms http_req_sending...............: avg=80.26µs min=8.08µs med=18.4µs max=21.49ms p(90)=113.26µs p(95)=175.48µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.1s min=1.3s med=2.97s max=6.05s p(90)=3.99s p(95)=5.15s http_reqs......................: 993 31.164579/s iteration_duration.............: avg=3.11s min=1.31s med=2.98s max=6.06s p(90)=4.01s p(95)=5.18s iterations.....................: 993 31.164579/s vus............................: 48 min=48 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1356 ✗ 0 data_received..................: 40 MB 1.0 MB/s data_sent......................: 537 kB 14 kB/s http_req_blocked...............: avg=217.75µs min=1.57µs med=3.76µs max=2.59ms p(90)=917.28µs p(95)=1.51ms http_req_connecting............: avg=194.78µs min=0s med=0s max=2.56ms p(90)=838.81µs p(95)=1.33ms http_req_duration..............: avg=7.55s min=2.94s med=7.77s max=9.39s p(90)=8.93s p(95)=9.09s { expected_response:true }...: avg=7.55s min=2.94s med=7.77s max=9.39s p(90)=8.93s p(95)=9.09s http_req_failed................: 0.00% ✓ 0 ✗ 452 http_req_receiving.............: avg=150.41µs min=60.15µs med=125.04µs max=7.42ms p(90)=175.88µs p(95)=202.08µs http_req_sending...............: avg=159.46µs min=9.38µs med=20.95µs max=3.36ms p(90)=356.61µs p(95)=1.23ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.55s min=2.94s med=7.77s max=9.39s p(90)=8.93s p(95)=9.09s http_reqs......................: 452 11.950842/s iteration_duration.............: avg=7.56s min=2.94s med=7.78s max=9.4s p(90)=8.94s p(95)=9.1s iterations.....................: 452 11.950842/s vus............................: 15 min=15 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 7 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 174 5295 total, 0 failed avg: 500ms, p95: 675ms ✅
apollo-router 169 5162 total, 0 failed avg: 523ms, p95: 712ms ✅
wundergraph 158 4816 total, 0 failed avg: 524ms, p95: 1011ms ✅
mesh-supergraph-bun 91 2793 total, 0 failed avg: 1058ms, p95: 1819ms ✅
apollo-server 49 1554 total, 0 failed avg: 1975ms, p95: 2730ms ✅
mercurius 31 958 total, 0 failed avg: 3163ms, p95: 4519ms ✅
mesh-supergraph 31 971 total, 0 failed avg: 3141ms, p95: 5327ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15885 ✗ 0 data_received..................: 465 MB 15 MB/s data_sent......................: 6.3 MB 207 kB/s http_req_blocked...............: avg=32.59µs min=1.43µs med=2.77µs max=9.58ms p(90)=3.91µs p(95)=4.85µs http_req_connecting............: avg=22.75µs min=0s med=0s max=4.68ms p(90)=0s p(95)=0s http_req_duration..............: avg=499.69ms min=40.31ms med=499.45ms max=1.51s p(90)=613.98ms p(95)=674.83ms { expected_response:true }...: avg=499.69ms min=40.31ms med=499.45ms max=1.51s p(90)=613.98ms p(95)=674.83ms http_req_failed................: 0.00% ✓ 0 ✗ 5295 http_req_receiving.............: avg=25.77ms min=40.09µs med=74.17µs max=768.33ms p(90)=53.91ms p(95)=200.12ms http_req_sending...............: avg=1.12ms min=7.98µs med=13.12µs max=410.56ms p(90)=29.57µs p(95)=189.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=472.79ms min=40.23ms med=486.54ms max=1s p(90)=582.53ms p(95)=610.05ms http_reqs......................: 5295 174.328054/s iteration_duration.............: avg=570.54ms min=51.8ms med=539.87ms max=1.68s p(90)=768.67ms p(95)=925.73ms iterations.....................: 5295 174.328054/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15486 ✗ 0 data_received..................: 453 MB 15 MB/s data_sent......................: 6.1 MB 201 kB/s http_req_blocked...............: avg=60.94µs min=1.34µs med=2.73µs max=55.52ms p(90)=4.32µs p(95)=5.22µs http_req_connecting............: avg=55.84µs min=0s med=0s max=55.46ms p(90)=0s p(95)=0s http_req_duration..............: avg=522.86ms min=18.45ms med=521.27ms max=1.33s p(90)=653.01ms p(95)=712.49ms { expected_response:true }...: avg=522.86ms min=18.45ms med=521.27ms max=1.33s p(90)=653.01ms p(95)=712.49ms http_req_failed................: 0.00% ✓ 0 ✗ 5162 http_req_receiving.............: avg=18.31ms min=34.68µs med=69.91µs max=1.1s p(90)=41ms p(95)=109.36ms http_req_sending...............: avg=1.63ms min=8.26µs med=13.33µs max=829.37ms p(90)=36.11µs p(95)=211.6µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=502.91ms min=18.38ms med=512.85ms max=844.98ms p(90)=631.4ms p(95)=667.56ms http_reqs......................: 5162 169.023862/s iteration_duration.............: avg=586.32ms min=31.63ms med=563.05ms max=2.14s p(90)=748.52ms p(95)=878.55ms iterations.....................: 5162 169.023862/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14448 ✗ 0 data_received..................: 423 MB 14 MB/s data_sent......................: 5.7 MB 188 kB/s http_req_blocked...............: avg=57µs min=1.21µs med=2.76µs max=86.96ms p(90)=4.48µs p(95)=5.76µs http_req_connecting............: avg=51.14µs min=0s med=0s max=86.88ms p(90)=0s p(95)=0s http_req_duration..............: avg=523.57ms min=15.59ms med=479.12ms max=2.76s p(90)=883.74ms p(95)=1.01s { expected_response:true }...: avg=523.57ms min=15.59ms med=479.12ms max=2.76s p(90)=883.74ms p(95)=1.01s http_req_failed................: 0.00% ✓ 0 ✗ 4816 http_req_receiving.............: avg=60.94ms min=38.44µs med=93.1µs max=2.54s p(90)=202.89ms p(95)=417.62ms http_req_sending...............: avg=3.11ms min=7.69µs med=13.11µs max=1.22s p(90)=32.4µs p(95)=176.73µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=459.51ms min=15.53ms med=436.45ms max=1.25s p(90)=762.22ms p(95)=879.5ms http_reqs......................: 4816 158.49702/s iteration_duration.............: avg=627.33ms min=37.98ms med=546.17ms max=2.79s p(90)=1.04s p(95)=1.26s iterations.....................: 4816 158.49702/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8379 ✗ 0 data_received..................: 245 MB 8.0 MB/s data_sent......................: 3.3 MB 108 kB/s http_req_blocked...............: avg=57.51µs min=1.68µs med=3.77µs max=4.09ms p(90)=5.78µs p(95)=11.33µs http_req_connecting............: avg=43.15µs min=0s med=0s max=3.72ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.05s min=218.69ms med=927ms max=2.96s p(90)=1.67s p(95)=1.81s { expected_response:true }...: avg=1.05s min=218.69ms med=927ms max=2.96s p(90)=1.67s p(95)=1.81s http_req_failed................: 0.00% ✓ 0 ✗ 2793 http_req_receiving.............: avg=11.63ms min=39.21µs med=103.11µs max=576.2ms p(90)=1.66ms p(95)=54.06ms http_req_sending...............: avg=574.46µs min=8.88µs med=19.59µs max=291.91ms p(90)=40.45µs p(95)=370.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.04s min=218.21ms med=921.54ms max=2.96s p(90)=1.65s p(95)=1.8s http_reqs......................: 2793 91.100296/s iteration_duration.............: avg=1.08s min=226.12ms med=948.98ms max=3s p(90)=1.69s p(95)=1.84s iterations.....................: 2793 91.100296/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4662 ✗ 0 data_received..................: 137 MB 4.3 MB/s data_sent......................: 1.8 MB 59 kB/s http_req_blocked...............: avg=27.33µs min=1.45µs med=3.37µs max=3.47ms p(90)=5.75µs p(95)=121µs http_req_connecting............: avg=12.92µs min=0s med=0s max=1.7ms p(90)=0s p(95)=79.8µs http_req_duration..............: avg=1.97s min=336.04ms med=1.64s max=21.33s p(90)=2.06s p(95)=2.73s { expected_response:true }...: avg=1.97s min=336.04ms med=1.64s max=21.33s p(90)=2.06s p(95)=2.73s http_req_failed................: 0.00% ✓ 0 ✗ 1554 http_req_receiving.............: avg=214.09µs min=46.24µs med=123.08µs max=63.68ms p(90)=182.01µs p(95)=208.36µs http_req_sending...............: avg=58.01µs min=8.39µs med=18.01µs max=24.12ms p(90)=36.31µs p(95)=77.38µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.97s min=335.92ms med=1.64s max=21.33s p(90)=2.06s p(95)=2.73s http_reqs......................: 1554 49.4256/s iteration_duration.............: avg=1.98s min=343.16ms med=1.65s max=21.34s p(90)=2.07s p(95)=2.73s iterations.....................: 1554 49.4256/s vus............................: 43 min=43 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2874 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 37 kB/s http_req_blocked...............: avg=61.73µs min=1.52µs med=3.49µs max=3.97ms p(90)=101.04µs p(95)=478.81µs http_req_connecting............: avg=48.5µs min=0s med=0s max=1.36ms p(90)=70.8µs p(95)=397.56µs http_req_duration..............: avg=3.16s min=609.24ms med=2.97s max=7.92s p(90)=4.13s p(95)=4.51s { expected_response:true }...: avg=3.16s min=609.24ms med=2.97s max=7.92s p(90)=4.13s p(95)=4.51s http_req_failed................: 0.00% ✓ 0 ✗ 958 http_req_receiving.............: avg=400.2µs min=43.89µs med=113.43µs max=71.73ms p(90)=188.72µs p(95)=292.26µs http_req_sending...............: avg=56.37µs min=8.7µs med=19.79µs max=1.78ms p(90)=53.36µs p(95)=394.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.16s min=608.55ms med=2.97s max=7.92s p(90)=4.13s p(95)=4.51s http_reqs......................: 958 31.216302/s iteration_duration.............: avg=3.17s min=621.25ms med=2.98s max=7.93s p(90)=4.13s p(95)=4.52s iterations.....................: 958 31.216302/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2913 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=277.41µs min=1.48µs med=3.48µs max=11.92ms p(90)=109.65µs p(95)=1.63ms http_req_connecting............: avg=254.74µs min=0s med=0s max=11.88ms p(90)=71.05µs p(95)=1.5ms http_req_duration..............: avg=3.14s min=890.06ms med=2.99s max=6.62s p(90)=4.32s p(95)=5.32s { expected_response:true }...: avg=3.14s min=890.06ms med=2.99s max=6.62s p(90)=4.32s p(95)=5.32s http_req_failed................: 0.00% ✓ 0 ✗ 971 http_req_receiving.............: avg=3.14ms min=41.96µs med=158.5µs max=84.26ms p(90)=904.32µs p(95)=11.08ms http_req_sending...............: avg=150.63µs min=8.25µs med=19.01µs max=10.88ms p(90)=81.92µs p(95)=718.56µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.13s min=889.96ms med=2.98s max=6.62s p(90)=4.32s p(95)=5.32s http_reqs......................: 971 31.075553/s iteration_duration.............: avg=3.15s min=899.72ms med=3s max=6.63s p(90)=4.33s p(95)=5.34s iterations.....................: 971 31.075553/s vus............................: 25 min=25 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 7 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 161 4940 total, 0 failed avg: 552ms, p95: 739ms ✅
wundergraph 104 3235 total, 0 failed avg: 901ms, p95: 1150ms ✅
mesh-supergraph-bun 98 3025 total, 0 failed avg: 979ms, p95: 1375ms ✅
cosmo 82 2538 total, 0 failed avg: 1163ms, p95: 1427ms ✅
mesh-supergraph 64 1995 total, 0 failed avg: 1508ms, p95: 2098ms ✅
apollo-server 61 1909 total, 0 failed avg: 1586ms, p95: 1821ms ✅
mercurius 12 473 total, 0 failed avg: 7105ms, p95: 8502ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14820 ✗ 0 data_received..................: 433 MB 14 MB/s data_sent......................: 5.9 MB 192 kB/s http_req_blocked...............: avg=26.76µs min=1.66µs med=3.36µs max=5.04ms p(90)=5.42µs p(95)=6.8µs http_req_connecting............: avg=18.89µs min=0s med=0s max=3.37ms p(90)=0s p(95)=0s http_req_duration..............: avg=551.77ms min=245.94ms med=542.18ms max=1.24s p(90)=681.08ms p(95)=739.13ms { expected_response:true }...: avg=551.77ms min=245.94ms med=542.18ms max=1.24s p(90)=681.08ms p(95)=739.13ms http_req_failed................: 0.00% ✓ 0 ✗ 4940 http_req_receiving.............: avg=17.18ms min=37.21µs med=84.76µs max=487.27ms p(90)=61.91ms p(95)=107.15ms http_req_sending...............: avg=1.76ms min=8.57µs med=15.24µs max=338.12ms p(90)=44.03µs p(95)=288.03µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=532.82ms min=245.87ms med=529.57ms max=907.39ms p(90)=650.03ms p(95)=692.75ms http_reqs......................: 4940 161.946925/s iteration_duration.............: avg=612.81ms min=265.88ms med=596.29ms max=1.27s p(90)=783.31ms p(95)=858.24ms iterations.....................: 4940 161.946925/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9705 ✗ 0 data_received..................: 284 MB 9.2 MB/s data_sent......................: 3.8 MB 125 kB/s http_req_blocked...............: avg=115.66µs min=1.33µs med=2.78µs max=7.87ms p(90)=4.38µs p(95)=7.96µs http_req_connecting............: avg=109.65µs min=0s med=0s max=7.73ms p(90)=0s p(95)=0s http_req_duration..............: avg=900.55ms min=548.75ms med=890.43ms max=1.41s p(90)=1.07s p(95)=1.14s { expected_response:true }...: avg=900.55ms min=548.75ms med=890.43ms max=1.41s p(90)=1.07s p(95)=1.14s http_req_failed................: 0.00% ✓ 0 ✗ 3235 http_req_receiving.............: avg=10.44ms min=41.58µs med=83.59µs max=279.91ms p(90)=32.22ms p(95)=69.9ms http_req_sending...............: avg=1.53ms min=8.12µs med=13.45µs max=169.14ms p(90)=69.45µs p(95)=896.49µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=888.57ms min=541.53ms med=882.87ms max=1.38s p(90)=1.04s p(95)=1.11s http_reqs......................: 3235 104.912473/s iteration_duration.............: avg=937.61ms min=564.09ms med=920.82ms max=1.49s p(90)=1.11s p(95)=1.21s iterations.....................: 3235 104.912473/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9075 ✗ 0 data_received..................: 265 MB 8.6 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=87.75µs min=1.81µs med=3.86µs max=5.22ms p(90)=5.8µs p(95)=12.26µs http_req_connecting............: avg=78.42µs min=0s med=0s max=5.16ms p(90)=0s p(95)=0s http_req_duration..............: avg=979.48ms min=385.18ms med=964.06ms max=1.96s p(90)=1.27s p(95)=1.37s { expected_response:true }...: avg=979.48ms min=385.18ms med=964.06ms max=1.96s p(90)=1.27s p(95)=1.37s http_req_failed................: 0.00% ✓ 0 ✗ 3025 http_req_receiving.............: avg=14.27ms min=42.43µs med=96.31µs max=599.64ms p(90)=2.78ms p(95)=47.86ms http_req_sending...............: avg=419.94µs min=9.37µs med=19.68µs max=109.12ms p(90)=50.17µs p(95)=188.78µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=964.78ms min=384.89ms med=949.81ms max=1.96s p(90)=1.24s p(95)=1.33s http_reqs......................: 3025 98.142552/s iteration_duration.............: avg=1.01s min=395.43ms med=991.99ms max=2.1s p(90)=1.31s p(95)=1.41s iterations.....................: 3025 98.142552/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7614 ✗ 0 data_received..................: 223 MB 7.2 MB/s data_sent......................: 3.0 MB 98 kB/s http_req_blocked...............: avg=35.72µs min=1.25µs med=2.5µs max=8.35ms p(90)=3.87µs p(95)=8.58µs http_req_connecting............: avg=29.92µs min=0s med=0s max=8.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=664.25ms med=1.15s max=1.74s p(90)=1.35s p(95)=1.42s { expected_response:true }...: avg=1.16s min=664.25ms med=1.15s max=1.74s p(90)=1.35s p(95)=1.42s http_req_failed................: 0.00% ✓ 0 ✗ 2538 http_req_receiving.............: avg=12.55ms min=40.15µs med=90.76µs max=387.83ms p(90)=46.65ms p(95)=79.49ms http_req_sending...............: avg=1.06ms min=7.37µs med=12.7µs max=197.87ms p(90)=50.74µs p(95)=354.31µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=664.15ms med=1.14s max=1.74s p(90)=1.34s p(95)=1.39s http_reqs......................: 2538 82.309562/s iteration_duration.............: avg=1.2s min=738.21ms med=1.19s max=1.75s p(90)=1.41s p(95)=1.48s iterations.....................: 2538 82.309562/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5985 ✗ 0 data_received..................: 175 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=98.05µs min=1.48µs med=3.52µs max=6.44ms p(90)=5.36µs p(95)=94.7µs http_req_connecting............: avg=91.47µs min=0s med=0s max=6.21ms p(90)=0s p(95)=18.57µs http_req_duration..............: avg=1.5s min=642.18ms med=1.51s max=3.42s p(90)=1.92s p(95)=2.09s { expected_response:true }...: avg=1.5s min=642.18ms med=1.51s max=3.42s p(90)=1.92s p(95)=2.09s http_req_failed................: 0.00% ✓ 0 ✗ 1995 http_req_receiving.............: avg=1.53ms min=42.48µs med=107.53µs max=89.09ms p(90)=1.71ms p(95)=8.86ms http_req_sending...............: avg=151.59µs min=8.77µs med=18.04µs max=37.78ms p(90)=35.93µs p(95)=112.53µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.5s min=639.3ms med=1.5s max=3.42s p(90)=1.91s p(95)=2.09s http_reqs......................: 1995 64.457168/s iteration_duration.............: avg=1.53s min=668.66ms med=1.53s max=3.44s p(90)=1.94s p(95)=2.12s iterations.....................: 1995 64.457168/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5727 ✗ 0 data_received..................: 168 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=100.01µs min=1.77µs med=4.37µs max=5.79ms p(90)=6.18µs p(95)=119.47µs http_req_connecting............: avg=91.74µs min=0s med=0s max=5.37ms p(90)=0s p(95)=86.51µs http_req_duration..............: avg=1.58s min=757.06ms med=1.47s max=10.91s p(90)=1.74s p(95)=1.82s { expected_response:true }...: avg=1.58s min=757.06ms med=1.47s max=10.91s p(90)=1.74s p(95)=1.82s http_req_failed................: 0.00% ✓ 0 ✗ 1909 http_req_receiving.............: avg=153.64µs min=57.36µs med=128.61µs max=14.22ms p(90)=185.5µs p(95)=223.52µs http_req_sending...............: avg=75.4µs min=10.02µs med=24.59µs max=20.24ms p(90)=38.89µs p(95)=102.61µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.58s min=756.14ms med=1.47s max=10.91s p(90)=1.74s p(95)=1.82s http_reqs......................: 1909 61.656957/s iteration_duration.............: avg=1.59s min=767.83ms med=1.48s max=10.95s p(90)=1.75s p(95)=1.83s iterations.....................: 1909 61.656957/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1419 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 562 kB 15 kB/s http_req_blocked...............: avg=148.46µs min=1.8µs med=4.23µs max=3.67ms p(90)=672.24µs p(95)=1.04ms http_req_connecting............: avg=122.82µs min=0s med=0s max=1.54ms p(90)=545.68µs p(95)=966.09µs http_req_duration..............: avg=7.1s min=3.11s med=7.34s max=8.85s p(90)=8.29s p(95)=8.5s { expected_response:true }...: avg=7.1s min=3.11s med=7.34s max=8.85s p(90)=8.29s p(95)=8.5s http_req_failed................: 0.00% ✓ 0 ✗ 473 http_req_receiving.............: avg=159.1µs min=67.5µs med=123.68µs max=2.43ms p(90)=196.57µs p(95)=248.99µs http_req_sending...............: avg=99.76µs min=9.86µs med=21.91µs max=702.95µs p(90)=468.08µs p(95)=530.81µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.1s min=3.11s med=7.34s max=8.85s p(90)=8.28s p(95)=8.5s http_reqs......................: 473 12.764241/s iteration_duration.............: avg=7.11s min=3.11s med=7.34s max=8.85s p(90)=8.3s p(95)=8.5s iterations.....................: 473 12.764241/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 7 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2057ms 172 12106 total, 0 failed avg: 783ms, p95: 2058ms, max: 6845ms, med: 550ms ❌ 3 unexpected GraphQL errors, non-compatible response structure (3)
wundergraph 2311ms 165 11567 total, 0 failed avg: 785ms, p95: 2312ms, max: 6876ms, med: 538ms ✅
apollo-router 2800ms 175 12307 total, 0 failed avg: 875ms, p95: 2800ms, max: 7817ms, med: 612ms ✅
mesh-supergraph-bun 5556ms 114 8036 total, 0 failed avg: 2290ms, p95: 5556ms, max: 9064ms, med: 2085ms ✅
mesh-supergraph 6382ms 71 5020 total, 0 failed avg: 3773ms, p95: 6382ms, max: 8328ms, med: 3956ms ✅
apollo-server 24018ms 67 4964 total, 0 failed avg: 4203ms, p95: 24019ms, max: 45148ms, med: 2204ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12103 / ✗ 3 ✗ valid response structure ↳ 99% — ✓ 12103 / ✗ 3 checks.........................: 99.98% ✓ 36312 ✗ 6 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 205 kB/s http_req_blocked...............: avg=19.01ms min=1.37µs med=3.06µs max=3.58s p(90)=5.33µs p(95)=13.74µs http_req_connecting............: avg=17.85ms min=0s med=0s max=3.57s p(90)=0s p(95)=0s http_req_duration..............: avg=782.55ms min=6.97ms med=550.34ms max=6.84s p(90)=1.69s p(95)=2.05s { expected_response:true }...: avg=782.55ms min=6.97ms med=550.34ms max=6.84s p(90)=1.69s p(95)=2.05s http_req_failed................: 0.00% ✓ 0 ✗ 12106 http_req_receiving.............: avg=247.59ms min=30.42µs med=80.04µs max=6.6s p(90)=1.07s p(95)=1.28s http_req_sending...............: avg=32.94ms min=7.7µs med=14.71µs max=4.53s p(90)=448.33µs p(95)=99.23ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=502.01ms min=6.87ms med=383.23ms max=2.79s p(90)=1.08s p(95)=1.29s http_reqs......................: 12106 172.911198/s iteration_duration.............: avg=1.51s min=13.76ms med=1.09s max=9.5s p(90)=3.49s p(95)=4.43s iterations.....................: 12106 172.911198/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34701 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 196 kB/s http_req_blocked...............: avg=19.81ms min=1.51µs med=3.14µs max=3.25s p(90)=5.21µs p(95)=21.41µs http_req_connecting............: avg=19.32ms min=0s med=0s max=3.25s p(90)=0s p(95)=0s http_req_duration..............: avg=784.56ms min=6.67ms med=537.91ms max=6.87s p(90)=1.8s p(95)=2.31s { expected_response:true }...: avg=784.56ms min=6.67ms med=537.91ms max=6.87s p(90)=1.8s p(95)=2.31s http_req_failed................: 0.00% ✓ 0 ✗ 11567 http_req_receiving.............: avg=285.74ms min=34.65µs med=85.83µs max=6.78s p(90)=1.13s p(95)=1.55s http_req_sending...............: avg=41.57ms min=8.31µs med=14.46µs max=4.28s p(90)=3.84ms p(95)=122.36ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=457.23ms min=6.57ms med=340.2ms max=2.46s p(90)=993.07ms p(95)=1.22s http_reqs......................: 11567 165.233066/s iteration_duration.............: avg=1.6s min=12.51ms med=1.09s max=12.78s p(90)=3.76s p(95)=4.81s iterations.....................: 11567 165.233066/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36921 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 209 kB/s http_req_blocked...............: avg=19.85ms min=1.19µs med=3.1µs max=4.21s p(90)=5.19µs p(95)=12.42µs http_req_connecting............: avg=18.37ms min=0s med=0s max=4.09s p(90)=0s p(95)=0s http_req_duration..............: avg=874.86ms min=6.11ms med=612ms max=7.81s p(90)=2.04s p(95)=2.8s { expected_response:true }...: avg=874.86ms min=6.11ms med=612ms max=7.81s p(90)=2.04s p(95)=2.8s http_req_failed................: 0.00% ✓ 0 ✗ 12307 http_req_receiving.............: avg=299.77ms min=30.92µs med=76.48µs max=7.58s p(90)=1.21s p(95)=2.11s http_req_sending...............: avg=30.05ms min=8.17µs med=14.37µs max=4.74s p(90)=481µs p(95)=61.83ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=545.04ms min=6.02ms med=471.62ms max=3.39s p(90)=1.03s p(95)=1.28s http_reqs......................: 12307 175.750935/s iteration_duration.............: avg=1.56s min=11.63ms med=968.44ms max=14.21s p(90)=3.73s p(95)=4.87s iterations.....................: 12307 175.750935/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24108 ✗ 0 data_received..................: 705 MB 10 MB/s data_sent......................: 9.5 MB 136 kB/s http_req_blocked...............: avg=2.17ms min=1.7µs med=3.58µs max=398.78ms p(90)=6.6µs p(95)=235.41µs http_req_connecting............: avg=2.05ms min=0s med=0s max=398.67ms p(90)=0s p(95)=158.08µs http_req_duration..............: avg=2.29s min=6.91ms med=2.08s max=9.06s p(90)=4.62s p(95)=5.55s { expected_response:true }...: avg=2.29s min=6.91ms med=2.08s max=9.06s p(90)=4.62s p(95)=5.55s http_req_failed................: 0.00% ✓ 0 ✗ 8036 http_req_receiving.............: avg=20.54ms min=37.75µs med=85.11µs max=1.74s p(90)=15.71ms p(95)=124.39ms http_req_sending...............: avg=3.13ms min=9.19µs med=16.47µs max=399.63ms p(90)=111µs p(95)=10.43ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.26s min=6.74ms med=2.02s max=8.97s p(90)=4.61s p(95)=5.54s http_reqs......................: 8036 114.795648/s iteration_duration.............: avg=2.36s min=12.54ms med=2.17s max=9.47s p(90)=4.64s p(95)=5.68s iterations.....................: 8036 114.795648/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15060 ✗ 0 data_received..................: 441 MB 6.3 MB/s data_sent......................: 6.0 MB 85 kB/s http_req_blocked...............: avg=466.27µs min=1.33µs med=3.48µs max=141.44ms p(90)=115.43µs p(95)=432.06µs http_req_connecting............: avg=450.1µs min=0s med=0s max=141.37ms p(90)=0s p(95)=362.38µs http_req_duration..............: avg=3.77s min=10.34ms med=3.95s max=8.32s p(90)=6.01s p(95)=6.38s { expected_response:true }...: avg=3.77s min=10.34ms med=3.95s max=8.32s p(90)=6.01s p(95)=6.38s http_req_failed................: 0.00% ✓ 0 ✗ 5020 http_req_receiving.............: avg=1.78ms min=37.47µs med=91.26µs max=292ms p(90)=812.45µs p(95)=7.76ms http_req_sending...............: avg=480.19µs min=7.55µs med=17.44µs max=96.84ms p(90)=47.93µs p(95)=131.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.77s min=10.21ms med=3.95s max=8.3s p(90)=6.01s p(95)=6.38s http_reqs......................: 5020 71.702814/s iteration_duration.............: avg=3.8s min=15.85ms med=3.97s max=8.37s p(90)=6.06s p(95)=6.43s iterations.....................: 5020 71.702814/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14892 ✗ 0 data_received..................: 436 MB 6.0 MB/s data_sent......................: 5.9 MB 81 kB/s http_req_blocked...............: avg=78µs min=1.49µs med=3.52µs max=37.19ms p(90)=107.12µs p(95)=264.6µs http_req_connecting............: avg=66.91µs min=0s med=0s max=37.09ms p(90)=72.6µs p(95)=187.2µs http_req_duration..............: avg=4.2s min=89.68ms med=2.2s max=45.14s p(90)=3.4s p(95)=24.01s { expected_response:true }...: avg=4.2s min=89.68ms med=2.2s max=45.14s p(90)=3.4s p(95)=24.01s http_req_failed................: 0.00% ✓ 0 ✗ 4964 http_req_receiving.............: avg=345.73µs min=44.41µs med=116.92µs max=169.69ms p(90)=180.16µs p(95)=224.89µs http_req_sending...............: avg=53.81µs min=8.59µs med=18.5µs max=52.06ms p(90)=41.54µs p(95)=58.31µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.2s min=89.6ms med=2.2s max=45.14s p(90)=3.4s p(95)=24.01s http_reqs......................: 4964 67.786186/s iteration_duration.............: avg=4.21s min=96.65ms med=2.21s max=45.16s p(90)=3.41s p(95)=24.03s iterations.....................: 4964 67.786186/s vus............................: 18 min=18 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview