search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency fastify to v4.26.2 #374

Closed renovate[bot] closed 7 months ago

renovate[bot] commented 7 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
fastify (source) 4.26.1 -> 4.26.2 age adoption passing confidence

Release Notes

fastify/fastify (fastify) ### [`v4.26.2`](https://togithub.com/fastify/fastify/releases/tag/v4.26.2) [Compare Source](https://togithub.com/fastify/fastify/compare/v4.26.1...v4.26.2) #### What's Changed - fix: typo in module exports by [@​lirantal](https://togithub.com/lirantal) in [https://github.com/fastify/fastify/pull/5316](https://togithub.com/fastify/fastify/pull/5316) - docs(ts): Fix links by [@​rozzilla](https://togithub.com/rozzilla) in [https://github.com/fastify/fastify/pull/5308](https://togithub.com/fastify/fastify/pull/5308) - fix: cb is not a function at fallbackErrorHandler by [@​Uzlopak](https://togithub.com/Uzlopak) in [https://github.com/fastify/fastify/pull/5317](https://togithub.com/fastify/fastify/pull/5317) - feat: add a Firebase Functions step by step guide by [@​lirantal](https://togithub.com/lirantal) in [https://github.com/fastify/fastify/pull/5318](https://togithub.com/fastify/fastify/pull/5318) - types: fix test failure by [@​gurgunday](https://togithub.com/gurgunday) in [https://github.com/fastify/fastify/pull/5330](https://togithub.com/fastify/fastify/pull/5330) - perf: use FifoMap to check contentType by [@​gurgunday](https://togithub.com/gurgunday) in [https://github.com/fastify/fastify/pull/5331](https://togithub.com/fastify/fastify/pull/5331) - docs(ecosystem): adds fastify-override to plugins list by [@​matthyk](https://togithub.com/matthyk) in [https://github.com/fastify/fastify/pull/5336](https://togithub.com/fastify/fastify/pull/5336) - types: Export preClose hook types by [@​matthyk](https://togithub.com/matthyk) in [https://github.com/fastify/fastify/pull/5335](https://togithub.com/fastify/fastify/pull/5335) - fix: database migration doc missing db connection code by [@​nuhman](https://togithub.com/nuhman) in [https://github.com/fastify/fastify/pull/5339](https://togithub.com/fastify/fastify/pull/5339) - chore: Bump pnpm/action-setup from 2 to 3 by [@​dependabot](https://togithub.com/dependabot) in [https://github.com/fastify/fastify/pull/5341](https://togithub.com/fastify/fastify/pull/5341) - chore: Bump xt0rted/markdownlint-problem-matcher from 2.0.0 to 3.0.0 by [@​dependabot](https://togithub.com/dependabot) in [https://github.com/fastify/fastify/pull/5342](https://togithub.com/fastify/fastify/pull/5342) #### New Contributors - [@​nuhman](https://togithub.com/nuhman) made their first contribution in [https://github.com/fastify/fastify/pull/5339](https://togithub.com/fastify/fastify/pull/5339) **Full Changelog**: https://github.com/fastify/fastify/compare/v4.26.1...v4.26.2

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 7 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 163 5010 total, 0 failed avg: 540ms, p95: 739ms ✅
wundergraph 104 3229 total, 0 failed avg: 912ms, p95: 1119ms ✅
mesh-supergraph-bun 101 3140 total, 0 failed avg: 933ms, p95: 1322ms ✅
cosmo 83 2605 total, 0 failed avg: 1145ms, p95: 1404ms ✅
apollo-server 64 2003 total, 0 failed avg: 1507ms, p95: 1870ms ✅
mesh-supergraph 64 1983 total, 0 failed avg: 1517ms, p95: 2166ms ✅
mercurius 12 475 total, 0 failed avg: 7157ms, p95: 8377ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15030 ✗ 0 data_received..................: 440 MB 14 MB/s data_sent......................: 5.9 MB 195 kB/s http_req_blocked...............: avg=63.34µs min=1.53µs med=2.96µs max=165.99ms p(90)=4.66µs p(95)=5.66µs http_req_connecting............: avg=12.12µs min=0s med=0s max=2.47ms p(90)=0s p(95)=0s http_req_duration..............: avg=539.99ms min=271.66ms med=529.09ms max=1.09s p(90)=675.47ms p(95)=739.46ms { expected_response:true }...: avg=539.99ms min=271.66ms med=529.09ms max=1.09s p(90)=675.47ms p(95)=739.46ms http_req_failed................: 0.00% ✓ 0 ✗ 5010 http_req_receiving.............: avg=20.54ms min=37.29µs med=79.08µs max=400.81ms p(90)=78.68ms p(95)=121.45ms http_req_sending...............: avg=1.65ms min=8.41µs med=13.93µs max=349.42ms p(90)=36.08µs p(95)=189.88µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=517.78ms min=271.6ms med=512.38ms max=903.29ms p(90)=641.86ms p(95)=690.32ms http_reqs......................: 5010 163.934905/s iteration_duration.............: avg=605.08ms min=308.8ms med=586.81ms max=1.16s p(90)=774.44ms p(95)=870.12ms iterations.....................: 5010 163.934905/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9687 ✗ 0 data_received..................: 283 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=41.24µs min=1.32µs med=2.72µs max=15.71ms p(90)=4.14µs p(95)=7.05µs http_req_connecting............: avg=29.41µs min=0s med=0s max=2.58ms p(90)=0s p(95)=0s http_req_duration..............: avg=911.76ms min=556.85ms med=903.88ms max=1.35s p(90)=1.06s p(95)=1.11s { expected_response:true }...: avg=911.76ms min=556.85ms med=903.88ms max=1.35s p(90)=1.06s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3229 http_req_receiving.............: avg=9.55ms min=40.92µs med=88.04µs max=289.26ms p(90)=36.32ms p(95)=68.63ms http_req_sending...............: avg=1.14ms min=7.79µs med=13µs max=259.87ms p(90)=35.87µs p(95)=201.64µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=901.07ms min=556.4ms med=895.35ms max=1.31s p(90)=1.04s p(95)=1.09s http_reqs......................: 3229 104.733594/s iteration_duration.............: avg=948ms min=624.28ms med=938.89ms max=1.46s p(90)=1.11s p(95)=1.17s iterations.....................: 3229 104.733594/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9420 ✗ 0 data_received..................: 276 MB 8.9 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=42.29µs min=1.68µs med=3.11µs max=34.84ms p(90)=4.75µs p(95)=10.37µs http_req_connecting............: avg=24.03µs min=0s med=0s max=4.59ms p(90)=0s p(95)=0s http_req_duration..............: avg=932.74ms min=381.18ms med=916.04ms max=2.02s p(90)=1.22s p(95)=1.32s { expected_response:true }...: avg=932.74ms min=381.18ms med=916.04ms max=2.02s p(90)=1.22s p(95)=1.32s http_req_failed................: 0.00% ✓ 0 ✗ 3140 http_req_receiving.............: avg=13.49ms min=37.72µs med=88.07µs max=1.02s p(90)=1.56ms p(95)=40.37ms http_req_sending...............: avg=617.47µs min=8.86µs med=14.75µs max=115.67ms p(90)=43.93µs p(95)=310.57µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=918.63ms min=380.92ms med=906.54ms max=1.79s p(90)=1.19s p(95)=1.29s http_reqs......................: 3140 101.800915/s iteration_duration.............: avg=967.43ms min=390.13ms med=948.17ms max=2.03s p(90)=1.27s p(95)=1.37s iterations.....................: 3140 101.800915/s vus............................: 98 min=98 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7815 ✗ 0 data_received..................: 229 MB 7.3 MB/s data_sent......................: 3.1 MB 99 kB/s http_req_blocked...............: avg=47.9µs min=1.52µs med=2.74µs max=3.79ms p(90)=4.21µs p(95)=9.39µs http_req_connecting............: avg=42.42µs min=0s med=0s max=3.6ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=675.24ms med=1.13s max=1.73s p(90)=1.33s p(95)=1.4s { expected_response:true }...: avg=1.14s min=675.24ms med=1.13s max=1.73s p(90)=1.33s p(95)=1.4s http_req_failed................: 0.00% ✓ 0 ✗ 2605 http_req_receiving.............: avg=15.12ms min=38.72µs med=88.53µs max=324.74ms p(90)=57.15ms p(95)=105.97ms http_req_sending...............: avg=1.23ms min=8.63µs med=13.22µs max=212.23ms p(90)=32.19µs p(95)=233.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.12s min=675.11ms med=1.12s max=1.65s p(90)=1.29s p(95)=1.36s http_reqs......................: 2605 83.284512/s iteration_duration.............: avg=1.18s min=743.53ms med=1.17s max=1.88s p(90)=1.37s p(95)=1.45s iterations.....................: 2605 83.284512/s vus............................: 51 min=51 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6009 ✗ 0 data_received..................: 176 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=34.79µs min=1.4µs med=3.21µs max=9.19ms p(90)=4.96µs p(95)=87.95µs http_req_connecting............: avg=22.35µs min=0s med=0s max=2.99ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.5s min=740.73ms med=1.43s max=9.35s p(90)=1.7s p(95)=1.86s { expected_response:true }...: avg=1.5s min=740.73ms med=1.43s max=9.35s p(90)=1.7s p(95)=1.86s http_req_failed................: 0.00% ✓ 0 ✗ 2003 http_req_receiving.............: avg=155.18µs min=45.44µs med=108.28µs max=22.21ms p(90)=173.37µs p(95)=227.77µs http_req_sending...............: avg=62.33µs min=8.62µs med=16.82µs max=30.08ms p(90)=32.38µs p(95)=65.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.5s min=740.26ms med=1.43s max=9.35s p(90)=1.7s p(95)=1.86s http_reqs......................: 2003 64.83873/s iteration_duration.............: avg=1.52s min=748.68ms med=1.44s max=9.35s p(90)=1.72s p(95)=1.89s iterations.....................: 2003 64.83873/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5949 ✗ 0 data_received..................: 174 MB 5.6 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=147.18µs min=1.7µs med=3.88µs max=7.09ms p(90)=5.7µs p(95)=78.06µs http_req_connecting............: avg=140.95µs min=0s med=0s max=6.96ms p(90)=0s p(95)=48.94µs http_req_duration..............: avg=1.51s min=785.97ms med=1.46s max=3.23s p(90)=1.91s p(95)=2.16s { expected_response:true }...: avg=1.51s min=785.97ms med=1.46s max=3.23s p(90)=1.91s p(95)=2.16s http_req_failed................: 0.00% ✓ 0 ✗ 1983 http_req_receiving.............: avg=1.66ms min=41.17µs med=117.72µs max=135.72ms p(90)=1.84ms p(95)=10.97ms http_req_sending...............: avg=189.45µs min=8.89µs med=21.05µs max=54.76ms p(90)=39.96µs p(95)=125.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.51s min=756.76ms med=1.46s max=3.23s p(90)=1.91s p(95)=2.16s http_reqs......................: 1983 64.083125/s iteration_duration.............: avg=1.54s min=834.73ms med=1.48s max=3.24s p(90)=1.93s p(95)=2.19s iterations.....................: 1983 64.083125/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1425 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 564 kB 15 kB/s http_req_blocked...............: avg=136.53µs min=1.97µs med=4.19µs max=3.47ms p(90)=474.17µs p(95)=832.38µs http_req_connecting............: avg=120.08µs min=0s med=0s max=3.41ms p(90)=427.89µs p(95)=779.08µs http_req_duration..............: avg=7.15s min=2.78s med=7.41s max=8.62s p(90)=8.28s p(95)=8.37s { expected_response:true }...: avg=7.15s min=2.78s med=7.41s max=8.62s p(90)=8.28s p(95)=8.37s http_req_failed................: 0.00% ✓ 0 ✗ 475 http_req_receiving.............: avg=167.67µs min=66.18µs med=120.54µs max=11.73ms p(90)=186.75µs p(95)=271.18µs http_req_sending...............: avg=74.01µs min=10.09µs med=22.85µs max=3.09ms p(90)=240.26µs p(95)=408.57µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.15s min=2.78s med=7.41s max=8.62s p(90)=8.28s p(95)=8.37s http_reqs......................: 475 12.688751/s iteration_duration.............: avg=7.16s min=2.79s med=7.42s max=8.64s p(90)=8.29s p(95)=8.38s iterations.....................: 475 12.688751/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 7 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 174 5307 total, 0 failed avg: 499ms, p95: 692ms ✅
apollo-router 167 5111 total, 0 failed avg: 523ms, p95: 711ms ✅
wundergraph 160 4868 total, 0 failed avg: 514ms, p95: 921ms ✅
mesh-supergraph-bun 95 2939 total, 0 failed avg: 1009ms, p95: 1747ms ✅
apollo-server 49 1572 total, 0 failed avg: 1958ms, p95: 2452ms ✅
mesh-supergraph 31 1018 total, 0 failed avg: 3062ms, p95: 5011ms ✅
mercurius 29 907 total, 0 failed avg: 3360ms, p95: 4551ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15921 ✗ 0 data_received..................: 466 MB 15 MB/s data_sent......................: 6.3 MB 207 kB/s http_req_blocked...............: avg=73.04µs min=1.36µs med=2.69µs max=191.04ms p(90)=3.93µs p(95)=5.09µs http_req_connecting............: avg=60.9µs min=0s med=0s max=190.97ms p(90)=0s p(95)=0s http_req_duration..............: avg=499.27ms min=53.28ms med=498.31ms max=2.02s p(90)=609.26ms p(95)=691.84ms { expected_response:true }...: avg=499.27ms min=53.28ms med=498.31ms max=2.02s p(90)=609.26ms p(95)=691.84ms http_req_failed................: 0.00% ✓ 0 ✗ 5307 http_req_receiving.............: avg=28.91ms min=37.85µs med=73.05µs max=1.51s p(90)=52.4ms p(95)=166.63ms http_req_sending...............: avg=1.38ms min=7.83µs med=13.03µs max=562.9ms p(90)=33.26µs p(95)=138.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=468.97ms min=53.19ms med=488.45ms max=861.49ms p(90)=572.47ms p(95)=601.16ms http_reqs......................: 5307 174.661111/s iteration_duration.............: avg=569.7ms min=63.6ms med=536.92ms max=2.17s p(90)=759.86ms p(95)=907.12ms iterations.....................: 5307 174.661111/s vus............................: 98 min=98 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15333 ✗ 0 data_received..................: 448 MB 15 MB/s data_sent......................: 6.1 MB 199 kB/s http_req_blocked...............: avg=18.51µs min=1.26µs med=2.81µs max=9.55ms p(90)=4.3µs p(95)=5.23µs http_req_connecting............: avg=10.66µs min=0s med=0s max=9.46ms p(90)=0s p(95)=0s http_req_duration..............: avg=523.43ms min=29.04ms med=525.5ms max=1.39s p(90)=656.11ms p(95)=711.36ms { expected_response:true }...: avg=523.43ms min=29.04ms med=525.5ms max=1.39s p(90)=656.11ms p(95)=711.36ms http_req_failed................: 0.00% ✓ 0 ✗ 5111 http_req_receiving.............: avg=19.09ms min=35.93µs med=67.79µs max=951.23ms p(90)=33.23ms p(95)=102.1ms http_req_sending...............: avg=1.44ms min=8.11µs med=13.24µs max=984.8ms p(90)=35.06µs p(95)=149.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=502.89ms min=28.84ms med=512.42ms max=839.49ms p(90)=633.7ms p(95)=667.52ms http_reqs......................: 5111 167.860259/s iteration_duration.............: avg=591.79ms min=49.65ms med=575.02ms max=2s p(90)=755.58ms p(95)=861.84ms iterations.....................: 5111 167.860259/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14604 ✗ 0 data_received..................: 427 MB 14 MB/s data_sent......................: 5.8 MB 190 kB/s http_req_blocked...............: avg=29.09µs min=1.15µs med=2.74µs max=48.47ms p(90)=4.41µs p(95)=5.6µs http_req_connecting............: avg=12.29µs min=0s med=0s max=2.46ms p(90)=0s p(95)=0s http_req_duration..............: avg=513.57ms min=13.82ms med=491.66ms max=2.42s p(90)=814.53ms p(95)=921.49ms { expected_response:true }...: avg=513.57ms min=13.82ms med=491.66ms max=2.42s p(90)=814.53ms p(95)=921.49ms http_req_failed................: 0.00% ✓ 0 ✗ 4868 http_req_receiving.............: avg=54.04ms min=30.53µs med=87.74µs max=1.6s p(90)=166.02ms p(95)=357.41ms http_req_sending...............: avg=2.34ms min=7.67µs med=13.33µs max=676.14ms p(90)=35.95µs p(95)=392.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=457.18ms min=13.74ms med=444.71ms max=1.21s p(90)=736.67ms p(95)=830.31ms http_reqs......................: 4868 160.358891/s iteration_duration.............: avg=619.9ms min=24.81ms med=574.13ms max=3.08s p(90)=989.82ms p(95)=1.18s iterations.....................: 4868 160.358891/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8817 ✗ 0 data_received..................: 258 MB 8.4 MB/s data_sent......................: 3.5 MB 114 kB/s http_req_blocked...............: avg=46.65µs min=1.42µs med=2.95µs max=4.86ms p(90)=4.53µs p(95)=9.14µs http_req_connecting............: avg=38.67µs min=0s med=0s max=3.62ms p(90)=0s p(95)=0s http_req_duration..............: avg=1s min=410.43ms med=888.35ms max=2.62s p(90)=1.62s p(95)=1.74s { expected_response:true }...: avg=1s min=410.43ms med=888.35ms max=2.62s p(90)=1.62s p(95)=1.74s http_req_failed................: 0.00% ✓ 0 ✗ 2939 http_req_receiving.............: avg=11.13ms min=38.05µs med=90.68µs max=482.39ms p(90)=1.14ms p(95)=44.97ms http_req_sending...............: avg=276.87µs min=8.06µs med=14.06µs max=110.71ms p(90)=34.43µs p(95)=130.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=997.26ms min=409.88ms med=880.55ms max=2.62s p(90)=1.62s p(95)=1.73s http_reqs......................: 2939 95.652636/s iteration_duration.............: avg=1.03s min=422.25ms med=911.52ms max=2.64s p(90)=1.65s p(95)=1.78s iterations.....................: 2939 95.652636/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4716 ✗ 0 data_received..................: 138 MB 4.4 MB/s data_sent......................: 1.9 MB 59 kB/s http_req_blocked...............: avg=195.14µs min=1.54µs med=3.29µs max=7.35ms p(90)=5.21µs p(95)=1.16ms http_req_connecting............: avg=175.44µs min=0s med=0s max=7.15ms p(90)=0s p(95)=1.08ms http_req_duration..............: avg=1.95s min=835.63ms med=1.62s max=20.34s p(90)=2.06s p(95)=2.45s { expected_response:true }...: avg=1.95s min=835.63ms med=1.62s max=20.34s p(90)=2.06s p(95)=2.45s http_req_failed................: 0.00% ✓ 0 ✗ 1572 http_req_receiving.............: avg=217.92µs min=47.75µs med=121.57µs max=55.18ms p(90)=183.31µs p(95)=214.31µs http_req_sending...............: avg=59.75µs min=8.37µs med=16.79µs max=32.25ms p(90)=33.35µs p(95)=144.7µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.95s min=835.45ms med=1.62s max=20.34s p(90)=2.06s p(95)=2.45s http_reqs......................: 1572 49.843467/s iteration_duration.............: avg=1.96s min=844.2ms med=1.63s max=20.36s p(90)=2.06s p(95)=2.46s iterations.....................: 1572 49.843467/s vus............................: 53 min=53 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 3054 ✗ 0 data_received..................: 89 MB 2.8 MB/s data_sent......................: 1.2 MB 38 kB/s http_req_blocked...............: avg=241.92µs min=1.34µs med=3.41µs max=12.2ms p(90)=16.6µs p(95)=1.84ms http_req_connecting............: avg=216.23µs min=0s med=0s max=9.83ms p(90)=0s p(95)=1.67ms http_req_duration..............: avg=3.06s min=1.3s med=2.78s max=6.99s p(90)=4.31s p(95)=5.01s { expected_response:true }...: avg=3.06s min=1.3s med=2.78s max=6.99s p(90)=4.31s p(95)=5.01s http_req_failed................: 0.00% ✓ 0 ✗ 1018 http_req_receiving.............: avg=2.74ms min=42.12µs med=130.29µs max=86.66ms p(90)=852.12µs p(95)=9.23ms http_req_sending...............: avg=102.78µs min=7.96µs med=17.77µs max=2.34ms p(90)=57.67µs p(95)=1.1ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.05s min=1.3s med=2.78s max=6.99s p(90)=4.31s p(95)=5.01s http_reqs......................: 1018 31.775525/s iteration_duration.............: avg=3.07s min=1.31s med=2.79s max=7.02s p(90)=4.33s p(95)=5.02s iterations.....................: 1018 31.775525/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2721 ✗ 0 data_received..................: 80 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=162.51µs min=1.77µs med=3.73µs max=4.71ms p(90)=108.99µs p(95)=1.1ms http_req_connecting............: avg=149.86µs min=0s med=0s max=4.31ms p(90)=78.39µs p(95)=1.03ms http_req_duration..............: avg=3.36s min=1s med=3.12s max=7.06s p(90)=4.29s p(95)=4.55s { expected_response:true }...: avg=3.36s min=1s med=3.12s max=7.06s p(90)=4.29s p(95)=4.55s http_req_failed................: 0.00% ✓ 0 ✗ 907 http_req_receiving.............: avg=733.95µs min=43.65µs med=119.89µs max=74.91ms p(90)=196.43µs p(95)=302.85µs http_req_sending...............: avg=51.65µs min=9.48µs med=20.67µs max=1.17ms p(90)=41.68µs p(95)=178.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.35s min=997.4ms med=3.12s max=7.06s p(90)=4.29s p(95)=4.55s http_reqs......................: 907 29.224627/s iteration_duration.............: avg=3.37s min=1.04s med=3.13s max=7.07s p(90)=4.31s p(95)=4.55s iterations.....................: 907 29.224627/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 7 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 153 4702 total, 0 failed avg: 602ms, p95: 769ms ✅
wundergraph 104 3202 total, 0 failed avg: 916ms, p95: 1138ms ✅
mesh-supergraph-bun 86 2667 total, 0 failed avg: 1106ms, p95: 1566ms ✅
cosmo 79 2489 total, 0 failed avg: 1197ms, p95: 1438ms ✅
apollo-server 47 1476 total, 0 failed avg: 2068ms, p95: 2522ms ✅
mesh-supergraph 31 1024 total, 0 failed avg: 3036ms, p95: 4928ms ✅
mercurius 11 446 total, 0 failed avg: 7663ms, p95: 9093ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14106 ✗ 0 data_received..................: 413 MB 14 MB/s data_sent......................: 5.6 MB 183 kB/s http_req_blocked...............: avg=27.12µs min=1.45µs med=2.78µs max=5.75ms p(90)=4.25µs p(95)=5.22µs http_req_connecting............: avg=22.19µs min=0s med=0s max=5.72ms p(90)=0s p(95)=0s http_req_duration..............: avg=601.6ms min=275.19ms med=595.26ms max=1.31s p(90)=724.11ms p(95)=769.49ms { expected_response:true }...: avg=601.6ms min=275.19ms med=595.26ms max=1.31s p(90)=724.11ms p(95)=769.49ms http_req_failed................: 0.00% ✓ 0 ✗ 4702 http_req_receiving.............: avg=11.3ms min=36.21µs med=70.44µs max=621.22ms p(90)=28.58ms p(95)=83.81ms http_req_sending...............: avg=1.04ms min=7.76µs med=13.45µs max=377.33ms p(90)=32.33µs p(95)=236.74µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=589.25ms min=275.12ms med=588.26ms max=980.16ms p(90)=699.92ms p(95)=740.99ms http_reqs......................: 4702 153.796368/s iteration_duration.............: avg=644.49ms min=284.54ms med=631.69ms max=1.4s p(90)=787.03ms p(95)=849.39ms iterations.....................: 4702 153.796368/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9606 ✗ 0 data_received..................: 281 MB 9.1 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=22.41µs min=1.15µs med=2.61µs max=2.32ms p(90)=3.74µs p(95)=7.53µs http_req_connecting............: avg=17.21µs min=0s med=0s max=1.58ms p(90)=0s p(95)=0s http_req_duration..............: avg=916.39ms min=573.59ms med=904.06ms max=1.6s p(90)=1.07s p(95)=1.13s { expected_response:true }...: avg=916.39ms min=573.59ms med=904.06ms max=1.6s p(90)=1.07s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3202 http_req_receiving.............: avg=13.24ms min=36.7µs med=83.95µs max=354.88ms p(90)=43.71ms p(95)=82.8ms http_req_sending...............: avg=1.4ms min=7.8µs med=12.74µs max=330.5ms p(90)=51.48µs p(95)=592.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=901.73ms min=573.52ms med=894.32ms max=1.27s p(90)=1.05s p(95)=1.11s http_reqs......................: 3202 104.207518/s iteration_duration.............: avg=950.08ms min=590.48ms med=932.89ms max=1.61s p(90)=1.11s p(95)=1.19s iterations.....................: 3202 104.207518/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8001 ✗ 0 data_received..................: 234 MB 7.6 MB/s data_sent......................: 3.2 MB 103 kB/s http_req_blocked...............: avg=98.61µs min=1.41µs med=2.87µs max=7.82ms p(90)=4.44µs p(95)=9.81µs http_req_connecting............: avg=88.72µs min=0s med=0s max=7.51ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.1s min=511.93ms med=1.07s max=2.33s p(90)=1.42s p(95)=1.56s { expected_response:true }...: avg=1.1s min=511.93ms med=1.07s max=2.33s p(90)=1.42s p(95)=1.56s http_req_failed................: 0.00% ✓ 0 ✗ 2667 http_req_receiving.............: avg=14.25ms min=35.09µs med=84.17µs max=634.98ms p(90)=1.15ms p(95)=59.67ms http_req_sending...............: avg=715.53µs min=8.27µs med=13.64µs max=183.37ms p(90)=43.33µs p(95)=1.02ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.09s min=511.63ms med=1.06s max=2.22s p(90)=1.39s p(95)=1.54s http_reqs......................: 2667 86.673983/s iteration_duration.............: avg=1.13s min=519.66ms med=1.1s max=2.34s p(90)=1.47s p(95)=1.63s iterations.....................: 2667 86.673983/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7467 ✗ 0 data_received..................: 218 MB 7.0 MB/s data_sent......................: 3.0 MB 95 kB/s http_req_blocked...............: avg=129.8µs min=1.23µs med=2.6µs max=34.55ms p(90)=4.21µs p(95)=9.49µs http_req_connecting............: avg=110.68µs min=0s med=0s max=5.84ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=816.37ms med=1.18s max=1.82s p(90)=1.35s p(95)=1.43s { expected_response:true }...: avg=1.19s min=816.37ms med=1.18s max=1.82s p(90)=1.35s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2489 http_req_receiving.............: avg=8.7ms min=37.77µs med=73.98µs max=387.94ms p(90)=14.77ms p(95)=57.83ms http_req_sending...............: avg=1.08ms min=7.58µs med=12.79µs max=143.2ms p(90)=71.21µs p(95)=544.35µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=816.18ms med=1.18s max=1.58s p(90)=1.34s p(95)=1.41s http_reqs......................: 2489 79.690652/s iteration_duration.............: avg=1.23s min=826.17ms med=1.22s max=1.84s p(90)=1.41s p(95)=1.51s iterations.....................: 2489 79.690652/s vus............................: 20 min=20 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4428 ✗ 0 data_received..................: 130 MB 4.1 MB/s data_sent......................: 1.8 MB 56 kB/s http_req_blocked...............: avg=58.65µs min=1.6µs med=3.36µs max=4.59ms p(90)=5.34µs p(95)=313.22µs http_req_connecting............: avg=48.5µs min=0s med=0s max=4.56ms p(90)=0s p(95)=175.63µs http_req_duration..............: avg=2.06s min=990.7ms med=1.83s max=14.78s p(90)=2.27s p(95)=2.52s { expected_response:true }...: avg=2.06s min=990.7ms med=1.83s max=14.78s p(90)=2.27s p(95)=2.52s http_req_failed................: 0.00% ✓ 0 ✗ 1476 http_req_receiving.............: avg=239.87µs min=48.02µs med=121.04µs max=44.22ms p(90)=177.91µs p(95)=216.08µs http_req_sending...............: avg=40.2µs min=8.44µs med=17.48µs max=933.49µs p(90)=36.91µs p(95)=161.02µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.06s min=990.43ms med=1.83s max=14.78s p(90)=2.27s p(95)=2.52s http_reqs......................: 1476 47.148577/s iteration_duration.............: avg=2.07s min=1s med=1.85s max=14.79s p(90)=2.28s p(95)=2.53s iterations.....................: 1476 47.148577/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 3072 ✗ 0 data_received..................: 90 MB 2.8 MB/s data_sent......................: 1.2 MB 38 kB/s http_req_blocked...............: avg=166.31µs min=1.48µs med=3.63µs max=4.06ms p(90)=14.36µs p(95)=1.24ms http_req_connecting............: avg=158.08µs min=0s med=0s max=4.03ms p(90)=0s p(95)=1.11ms http_req_duration..............: avg=3.03s min=1.46s med=2.8s max=7.42s p(90)=4.21s p(95)=4.92s { expected_response:true }...: avg=3.03s min=1.46s med=2.8s max=7.42s p(90)=4.21s p(95)=4.92s http_req_failed................: 0.00% ✓ 0 ✗ 1024 http_req_receiving.............: avg=3.04ms min=43.47µs med=162.61µs max=210.52ms p(90)=1.38ms p(95)=8.74ms http_req_sending...............: avg=125.53µs min=7.83µs med=19.42µs max=6.92ms p(90)=99.38µs p(95)=652.69µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.03s min=1.46s med=2.8s max=7.42s p(90)=4.19s p(95)=4.92s http_reqs......................: 1024 31.895392/s iteration_duration.............: avg=3.05s min=1.48s med=2.82s max=7.44s p(90)=4.22s p(95)=4.93s iterations.....................: 1024 31.895392/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1338 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 529 kB 14 kB/s http_req_blocked...............: avg=1.45ms min=1.67µs med=4.12µs max=10ms p(90)=6.69ms p(95)=8.21ms http_req_connecting............: avg=177.74µs min=0s med=0s max=3.55ms p(90)=714.31µs p(95)=1.14ms http_req_duration..............: avg=7.66s min=3.13s med=7.9s max=9.39s p(90)=8.99s p(95)=9.09s { expected_response:true }...: avg=7.66s min=3.13s med=7.9s max=9.39s p(90)=8.99s p(95)=9.09s http_req_failed................: 0.00% ✓ 0 ✗ 446 http_req_receiving.............: avg=313.8µs min=60.28µs med=125.07µs max=69.41ms p(90)=187.99µs p(95)=223.29µs http_req_sending...............: avg=130.69µs min=9.74µs med=22.69µs max=1.06ms p(90)=388.73µs p(95)=888.6µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.66s min=3.13s med=7.9s max=9.39s p(90)=8.99s p(95)=9.09s http_reqs......................: 446 11.827817/s iteration_duration.............: avg=7.67s min=3.13s med=7.91s max=9.4s p(90)=9s p(95)=9.09s iterations.....................: 446 11.827817/s vus............................: 15 min=15 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 7 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2422ms 172 12069 total, 0 failed avg: 768ms, p95: 2423ms, max: 7528ms, med: 449ms ✅
apollo-router 2611ms 170 11961 total, 0 failed avg: 826ms, p95: 2612ms, max: 6766ms, med: 508ms ✅
wundergraph 2663ms 167 11694 total, 0 failed avg: 829ms, p95: 2664ms, max: 7870ms, med: 492ms ✅
mesh-supergraph-bun 5472ms 119 8335 total, 0 failed avg: 2199ms, p95: 5473ms, max: 9436ms, med: 1992ms ✅
mesh-supergraph 6769ms 69 4849 total, 0 failed avg: 3919ms, p95: 6770ms, max: 8374ms, med: 4034ms ✅
apollo-server 24130ms 68 4995 total, 0 failed avg: 4180ms, p95: 24131ms, max: 45183ms, med: 2149ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36207 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 205 kB/s http_req_blocked...............: avg=16.99ms min=1.6µs med=3.11µs max=4.52s p(90)=5.21µs p(95)=12.54µs http_req_connecting............: avg=14.85ms min=0s med=0s max=3.53s p(90)=0s p(95)=0s http_req_duration..............: avg=767.76ms min=6.97ms med=448.54ms max=7.52s p(90)=1.92s p(95)=2.42s { expected_response:true }...: avg=767.76ms min=6.97ms med=448.54ms max=7.52s p(90)=1.92s p(95)=2.42s http_req_failed................: 0.00% ✓ 0 ✗ 12069 http_req_receiving.............: avg=318.38ms min=29.6µs med=87.03µs max=5.48s p(90)=1.17s p(95)=1.86s http_req_sending...............: avg=33.86ms min=7.43µs med=14.57µs max=4.75s p(90)=230.9µs p(95)=60.63ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=415.5ms min=6.87ms med=315.3ms max=2.43s p(90)=886.06ms p(95)=1.12s http_reqs......................: 12069 172.399356/s iteration_duration.............: avg=1.51s min=12.46ms med=901.54ms max=11.56s p(90)=3.69s p(95)=4.71s iterations.....................: 12069 172.399356/s vus............................: 1 min=1 max=496 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35883 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 203 kB/s http_req_blocked...............: avg=17.92ms min=1.51µs med=3.38µs max=6.42s p(90)=5.78µs p(95)=13.77µs http_req_connecting............: avg=16.23ms min=0s med=0s max=4.46s p(90)=0s p(95)=0s http_req_duration..............: avg=826.13ms min=6.52ms med=508.19ms max=6.76s p(90)=1.92s p(95)=2.61s { expected_response:true }...: avg=826.13ms min=6.52ms med=508.19ms max=6.76s p(90)=1.92s p(95)=2.61s http_req_failed................: 0.00% ✓ 0 ✗ 11961 http_req_receiving.............: avg=322.99ms min=27.29µs med=83.92µs max=5.2s p(90)=1.19s p(95)=1.95s http_req_sending...............: avg=34.93ms min=7.86µs med=15.51µs max=5.96s p(90)=183.58µs p(95)=48.27ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=468.2ms min=6.44ms med=333.12ms max=2.92s p(90)=1.07s p(95)=1.34s http_reqs......................: 11961 170.857014/s iteration_duration.............: avg=1.55s min=12.07ms med=1s max=14.26s p(90)=3.78s p(95)=4.82s iterations.....................: 11961 170.857014/s vus............................: 1 min=1 max=490 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35082 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 198 kB/s http_req_blocked...............: avg=17.75ms min=1.21µs med=2.96µs max=4.04s p(90)=4.74µs p(95)=11.86µs http_req_connecting............: avg=16.51ms min=0s med=0s max=3.95s p(90)=0s p(95)=0s http_req_duration..............: avg=829.47ms min=6.27ms med=492.42ms max=7.86s p(90)=2.05s p(95)=2.66s { expected_response:true }...: avg=829.47ms min=6.27ms med=492.42ms max=7.86s p(90)=2.05s p(95)=2.66s http_req_failed................: 0.00% ✓ 0 ✗ 11694 http_req_receiving.............: avg=351.49ms min=32.35µs med=82.78µs max=7.04s p(90)=1.27s p(95)=2.14s http_req_sending...............: avg=34.83ms min=7.13µs med=14.14µs max=5.24s p(90)=3.36ms p(95)=102.93ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=443.14ms min=6.15ms med=353.35ms max=2.37s p(90)=934.87ms p(95)=1.17s http_reqs......................: 11694 167.035035/s iteration_duration.............: avg=1.56s min=11.68ms med=924.09ms max=11.59s p(90)=3.86s p(95)=5.06s iterations.....................: 11694 167.035035/s vus............................: 1 min=1 max=495 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 25005 ✗ 0 data_received..................: 731 MB 10 MB/s data_sent......................: 9.9 MB 141 kB/s http_req_blocked...............: avg=1.95ms min=1.29µs med=2.94µs max=661.7ms p(90)=5.15µs p(95)=211.55µs http_req_connecting............: avg=1.86ms min=0s med=0s max=437.71ms p(90)=0s p(95)=141.76µs http_req_duration..............: avg=2.19s min=5.2ms med=1.99s max=9.43s p(90)=4.13s p(95)=5.47s { expected_response:true }...: avg=2.19s min=5.2ms med=1.99s max=9.43s p(90)=4.13s p(95)=5.47s http_req_failed................: 0.00% ✓ 0 ✗ 8335 http_req_receiving.............: avg=28.28ms min=35µs med=76.6µs max=2.01s p(90)=27.09ms p(95)=162.32ms http_req_sending...............: avg=2.74ms min=8.15µs med=13.77µs max=529.67ms p(90)=84.11µs p(95)=10.49ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.16s min=5.02ms med=1.95s max=8.84s p(90)=4.05s p(95)=5.45s http_reqs......................: 8335 119.056742/s iteration_duration.............: avg=2.26s min=10.78ms med=2.06s max=9.87s p(90)=4.2s p(95)=5.57s iterations.....................: 8335 119.056742/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14547 ✗ 0 data_received..................: 426 MB 6.1 MB/s data_sent......................: 5.8 MB 82 kB/s http_req_blocked...............: avg=768.71µs min=1.63µs med=4.27µs max=366.02ms p(90)=175.1µs p(95)=404.21µs http_req_connecting............: avg=733.74µs min=0s med=0s max=365.94ms p(90)=113.99µs p(95)=318.02µs http_req_duration..............: avg=3.91s min=10.75ms med=4.03s max=8.37s p(90)=6.32s p(95)=6.76s { expected_response:true }...: avg=3.91s min=10.75ms med=4.03s max=8.37s p(90)=6.32s p(95)=6.76s http_req_failed................: 0.00% ✓ 0 ✗ 4849 http_req_receiving.............: avg=4.96ms min=39.75µs med=109.57µs max=468.94ms p(90)=3.13ms p(95)=15.42ms http_req_sending...............: avg=739.74µs min=8.42µs med=23.02µs max=322.32ms p(90)=54.17µs p(95)=129.3µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.91s min=10.65ms med=4.03s max=8.33s p(90)=6.3s p(95)=6.74s http_reqs......................: 4849 69.265782/s iteration_duration.............: avg=3.95s min=17.36ms med=4.09s max=8.4s p(90)=6.37s p(95)=6.83s iterations.....................: 4849 69.265782/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14985 ✗ 0 data_received..................: 439 MB 6.0 MB/s data_sent......................: 5.9 MB 81 kB/s http_req_blocked...............: avg=126.37µs min=1.45µs med=3.1µs max=42.07ms p(90)=105.29µs p(95)=260.84µs http_req_connecting............: avg=113.8µs min=0s med=0s max=42.01ms p(90)=37.79µs p(95)=188.19µs http_req_duration..............: avg=4.17s min=97.26ms med=2.14s max=45.18s p(90)=3.74s p(95)=24.13s { expected_response:true }...: avg=4.17s min=97.26ms med=2.14s max=45.18s p(90)=3.74s p(95)=24.13s http_req_failed................: 0.00% ✓ 0 ✗ 4995 http_req_receiving.............: avg=282.4µs min=44.39µs med=111.25µs max=122.92ms p(90)=174.93µs p(95)=217.67µs http_req_sending...............: avg=71.59µs min=8.31µs med=15.2µs max=20.83ms p(90)=40.55µs p(95)=63.9µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.17s min=97.15ms med=2.14s max=45.18s p(90)=3.74s p(95)=24.13s http_reqs......................: 4995 68.236542/s iteration_duration.............: avg=4.19s min=109.87ms med=2.16s max=45.19s p(90)=3.75s p(95)=24.14s iterations.....................: 4995 68.236542/s vus............................: 19 min=19 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview