search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update dependency @graphql-mesh/graphql to v0.97.3 #394

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/graphql (source) 0.97.0 -> 0.97.3 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/graphql) ### [`v0.97.3`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/graphql/CHANGELOG.md#0973) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/graphql@0.97.2...@graphql-mesh/graphql@0.97.3) ##### Patch Changes - Updated dependencies \[[`57f4a60`](https://togithub.com/ardatan/graphql-mesh/commit/57f4a601c1f9819937c784ab9aae68f3368cbefd)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.3 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.3 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.3 ### [`v0.97.2`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/graphql/CHANGELOG.md#0972) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/26db58954b3e3d10555b196622ab659e16b49e6a...@graphql-mesh/graphql@0.97.2) ##### Patch Changes - Updated dependencies \[[`7a712ab`](https://togithub.com/ardatan/graphql-mesh/commit/7a712ab915ac3216765951080e689d510b5682a6)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.2 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.2 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.2 ### [`v0.97.1`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/graphql/CHANGELOG.md#0971) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/graphql@0.97.0...26db58954b3e3d10555b196622ab659e16b49e6a) ##### Patch Changes - Updated dependencies \[[`dbaf72c`](https://togithub.com/ardatan/graphql-mesh/commit/dbaf72c4520f64524dce14b798019639c4d57020)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.1 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.1 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.1

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 172 5227 total, 0 failed avg: 501ms, p95: 738ms ✅
apollo-router 167 5110 total, 0 failed avg: 540ms, p95: 710ms ✅
wundergraph 154 4687 total, 0 failed avg: 542ms, p95: 1103ms ✅
mesh-supergraph-bun 95 2953 total, 0 failed avg: 1002ms, p95: 1696ms ✅
apollo-server 50 1582 total, 0 failed avg: 1926ms, p95: 2412ms ✅
mercurius 30 935 total, 0 failed avg: 3284ms, p95: 4895ms ✅
mesh-supergraph 30 981 total, 0 failed avg: 3147ms, p95: 5252ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15681 ✗ 0 data_received..................: 459 MB 15 MB/s data_sent......................: 6.2 MB 204 kB/s http_req_blocked...............: avg=16.24µs min=1.42µs med=2.87µs max=12.1ms p(90)=4.66µs p(95)=5.82µs http_req_connecting............: avg=7.16µs min=0s med=0s max=1.49ms p(90)=0s p(95)=0s http_req_duration..............: avg=501.44ms min=15.87ms med=502.16ms max=2.05s p(90)=640.49ms p(95)=738.15ms { expected_response:true }...: avg=501.44ms min=15.87ms med=502.16ms max=2.05s p(90)=640.49ms p(95)=738.15ms http_req_failed................: 0.00% ✓ 0 ✗ 5227 http_req_receiving.............: avg=42.88ms min=39.56µs med=79.51µs max=1.53s p(90)=131.97ms p(95)=349.37ms http_req_sending...............: avg=1.71ms min=7.08µs med=13.99µs max=1.06s p(90)=34.63µs p(95)=145.02µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=456.83ms min=15.6ms med=484.75ms max=828.63ms p(90)=577.87ms p(95)=606.55ms http_reqs......................: 5227 172.179825/s iteration_duration.............: avg=577.59ms min=36.77ms med=546.16ms max=2.77s p(90)=801.32ms p(95)=965.92ms iterations.....................: 5227 172.179825/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15330 ✗ 0 data_received..................: 448 MB 15 MB/s data_sent......................: 6.1 MB 199 kB/s http_req_blocked...............: avg=62.38µs min=1.25µs med=2.78µs max=6.54ms p(90)=4.39µs p(95)=5.53µs http_req_connecting............: avg=57.3µs min=0s med=0s max=6.42ms p(90)=0s p(95)=0s http_req_duration..............: avg=539.9ms min=229.2ms med=533.47ms max=1.78s p(90)=660.95ms p(95)=709.94ms { expected_response:true }...: avg=539.9ms min=229.2ms med=533.47ms max=1.78s p(90)=660.95ms p(95)=709.94ms http_req_failed................: 0.00% ✓ 0 ✗ 5110 http_req_receiving.............: avg=14.38ms min=36.42µs med=70.37µs max=1.11s p(90)=33.54ms p(95)=91.79ms http_req_sending...............: avg=1.1ms min=7.29µs med=13.35µs max=266.15ms p(90)=45.7µs p(95)=305.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=524.42ms min=229.12ms med=523.83ms max=871.04ms p(90)=636.52ms p(95)=672.73ms http_reqs......................: 5110 167.650425/s iteration_duration.............: avg=592.48ms min=257.62ms med=575.46ms max=1.79s p(90)=744.67ms p(95)=821.56ms iterations.....................: 5110 167.650425/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14061 ✗ 0 data_received..................: 411 MB 14 MB/s data_sent......................: 5.6 MB 183 kB/s http_req_blocked...............: avg=84.25µs min=1.28µs med=3.03µs max=269.33ms p(90)=4.98µs p(95)=6.25µs http_req_connecting............: avg=71.58µs min=0s med=0s max=269.27ms p(90)=0s p(95)=0s http_req_duration..............: avg=542.02ms min=17.44ms med=496.13ms max=2.27s p(90)=919.97ms p(95)=1.1s { expected_response:true }...: avg=542.02ms min=17.44ms med=496.13ms max=2.27s p(90)=919.97ms p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 4687 http_req_receiving.............: avg=61.53ms min=39.76µs med=96.78µs max=1.66s p(90)=198.23ms p(95)=415.18ms http_req_sending...............: avg=2.94ms min=7.77µs med=14.36µs max=790.8ms p(90)=39.27µs p(95)=397.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=477.54ms min=11.84ms med=445.45ms max=1.34s p(90)=811.34ms p(95)=950.81ms http_reqs......................: 4687 154.29387/s iteration_duration.............: avg=644.16ms min=31.61ms med=575.1ms max=3.23s p(90)=1.1s p(95)=1.28s iterations.....................: 4687 154.29387/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8859 ✗ 0 data_received..................: 259 MB 8.4 MB/s data_sent......................: 3.5 MB 114 kB/s http_req_blocked...............: avg=85.91µs min=1.33µs med=2.88µs max=7.64ms p(90)=4.59µs p(95)=9.38µs http_req_connecting............: avg=74.72µs min=0s med=0s max=5.49ms p(90)=0s p(95)=0s http_req_duration..............: avg=1s min=315.81ms med=855.52ms max=2.64s p(90)=1.55s p(95)=1.69s { expected_response:true }...: avg=1s min=315.81ms med=855.52ms max=2.64s p(90)=1.55s p(95)=1.69s http_req_failed................: 0.00% ✓ 0 ✗ 2953 http_req_receiving.............: avg=12.37ms min=38.66µs med=85.41µs max=600.17ms p(90)=3.25ms p(95)=53.51ms http_req_sending...............: avg=485.43µs min=8.12µs med=13.72µs max=94.44ms p(90)=39.19µs p(95)=160.48µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=989.18ms min=315.37ms med=845.46ms max=2.64s p(90)=1.54s p(95)=1.66s http_reqs......................: 2953 95.594182/s iteration_duration.............: avg=1.03s min=332.43ms med=889.12ms max=2.65s p(90)=1.59s p(95)=1.74s iterations.....................: 2953 95.594182/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4746 ✗ 0 data_received..................: 139 MB 4.5 MB/s data_sent......................: 1.9 MB 60 kB/s http_req_blocked...............: avg=139.31µs min=1.35µs med=2.89µs max=5.87ms p(90)=4.69µs p(95)=572.85µs http_req_connecting............: avg=121.2µs min=0s med=0s max=5.42ms p(90)=0s p(95)=330.37µs http_req_duration..............: avg=1.92s min=779.3ms med=1.59s max=20.09s p(90)=2.04s p(95)=2.41s { expected_response:true }...: avg=1.92s min=779.3ms med=1.59s max=20.09s p(90)=2.04s p(95)=2.41s http_req_failed................: 0.00% ✓ 0 ✗ 1582 http_req_receiving.............: avg=237.04µs min=49.08µs med=116.65µs max=67.57ms p(90)=179.76µs p(95)=208.95µs http_req_sending...............: avg=34.12µs min=8.44µs med=14.69µs max=906.99µs p(90)=30.44µs p(95)=97.31µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.92s min=778.98ms med=1.59s max=20.09s p(90)=2.04s p(95)=2.41s http_reqs......................: 1582 50.628024/s iteration_duration.............: avg=1.93s min=812.86ms med=1.61s max=20.1s p(90)=2.05s p(95)=2.42s iterations.....................: 1582 50.628024/s vus............................: 33 min=33 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2805 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=78.28µs min=1.69µs med=4.18µs max=2.1ms p(90)=108.64µs p(95)=497.04µs http_req_connecting............: avg=63.72µs min=0s med=0s max=2.05ms p(90)=75.81µs p(95)=407.18µs http_req_duration..............: avg=3.28s min=446.71ms med=3.08s max=8.05s p(90)=4.17s p(95)=4.89s { expected_response:true }...: avg=3.28s min=446.71ms med=3.08s max=8.05s p(90)=4.17s p(95)=4.89s http_req_failed................: 0.00% ✓ 0 ✗ 935 http_req_receiving.............: avg=346.28µs min=42.5µs med=125.44µs max=71ms p(90)=191.1µs p(95)=252.18µs http_req_sending...............: avg=78.03µs min=8.75µs med=23.54µs max=9.24ms p(90)=58.34µs p(95)=517.36µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.28s min=446.07ms med=3.08s max=8.05s p(90)=4.16s p(95)=4.89s http_reqs......................: 935 30.095251/s iteration_duration.............: avg=3.29s min=455.78ms med=3.09s max=8.09s p(90)=4.17s p(95)=4.9s iterations.....................: 935 30.095251/s vus............................: 17 min=17 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2943 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=81.54µs min=1.45µs med=3.5µs max=6.94ms p(90)=100.01µs p(95)=368.94µs http_req_connecting............: avg=61.7µs min=0s med=0s max=3.82ms p(90)=68.86µs p(95)=297.11µs http_req_duration..............: avg=3.14s min=1.07s med=3.11s max=6.96s p(90)=4.34s p(95)=5.25s { expected_response:true }...: avg=3.14s min=1.07s med=3.11s max=6.96s p(90)=4.34s p(95)=5.25s http_req_failed................: 0.00% ✓ 0 ✗ 981 http_req_receiving.............: avg=3.13ms min=44.31µs med=129.52µs max=92.53ms p(90)=1.23ms p(95)=11.28ms http_req_sending...............: avg=71.68µs min=7.83µs med=19.06µs max=14.94ms p(90)=57.55µs p(95)=170.47µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.14s min=1.04s med=3.11s max=6.96s p(90)=4.34s p(95)=5.25s http_reqs......................: 981 30.948417/s iteration_duration.............: avg=3.16s min=1.08s med=3.12s max=6.99s p(90)=4.35s p(95)=5.26s iterations.....................: 981 30.948417/s vus............................: 51 min=51 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 163 5002 total, 0 failed avg: 543ms, p95: 735ms ✅
wundergraph 104 3235 total, 0 failed avg: 905ms, p95: 1113ms ✅
mesh-supergraph-bun 101 3144 total, 0 failed avg: 936ms, p95: 1338ms ✅
cosmo 82 2572 total, 0 failed avg: 1152ms, p95: 1400ms ✅
apollo-server 64 2025 total, 0 failed avg: 1508ms, p95: 1751ms ✅
mesh-supergraph 61 1917 total, 0 failed avg: 1571ms, p95: 2298ms ✅
mercurius 12 473 total, 0 failed avg: 7174ms, p95: 8470ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15006 ✗ 0 data_received..................: 439 MB 14 MB/s data_sent......................: 5.9 MB 194 kB/s http_req_blocked...............: avg=110.46µs min=1.18µs med=2.97µs max=78.06ms p(90)=4.75µs p(95)=5.91µs http_req_connecting............: avg=82.9µs min=0s med=0s max=14.95ms p(90)=0s p(95)=0s http_req_duration..............: avg=543.43ms min=266.21ms med=530.07ms max=1.08s p(90)=677.97ms p(95)=734.99ms { expected_response:true }...: avg=543.43ms min=266.21ms med=530.07ms max=1.08s p(90)=677.97ms p(95)=734.99ms http_req_failed................: 0.00% ✓ 0 ✗ 5002 http_req_receiving.............: avg=14.5ms min=38.39µs med=77.01µs max=512.44ms p(90)=50.8ms p(95)=100.99ms http_req_sending...............: avg=1.91ms min=8.05µs med=14µs max=399.17ms p(90)=59.48µs p(95)=1.2ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=527ms min=266.11ms med=519.57ms max=852.42ms p(90)=646.53ms p(95)=690.42ms http_reqs......................: 5002 163.616788/s iteration_duration.............: avg=604.97ms min=276.63ms med=586.37ms max=1.56s p(90)=768.03ms p(95)=839.03ms iterations.....................: 5002 163.616788/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9705 ✗ 0 data_received..................: 284 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=43.38µs min=1.03µs med=2.59µs max=106.53ms p(90)=3.95µs p(95)=8.49µs http_req_connecting............: avg=5.41µs min=0s med=0s max=723.14µs p(90)=0s p(95)=0s http_req_duration..............: avg=904.97ms min=548.09ms med=894.15ms max=1.59s p(90)=1.05s p(95)=1.11s { expected_response:true }...: avg=904.97ms min=548.09ms med=894.15ms max=1.59s p(90)=1.05s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3235 http_req_receiving.............: avg=7.39ms min=40.31µs med=80.14µs max=306.82ms p(90)=22.13ms p(95)=54.14ms http_req_sending...............: avg=1.08ms min=7.05µs med=12.73µs max=274.83ms p(90)=37.95µs p(95)=134.96µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=896.49ms min=547.99ms med=888.12ms max=1.4s p(90)=1.03s p(95)=1.1s http_reqs......................: 3235 104.560468/s iteration_duration.............: avg=942.31ms min=576.04ms med=931.14ms max=1.61s p(90)=1.09s p(95)=1.15s iterations.....................: 3235 104.560468/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9432 ✗ 0 data_received..................: 276 MB 8.9 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=78.74µs min=1.55µs med=3.05µs max=78.83ms p(90)=4.73µs p(95)=8.93µs http_req_connecting............: avg=34.37µs min=0s med=0s max=10.34ms p(90)=0s p(95)=0s http_req_duration..............: avg=936.05ms min=362.68ms med=912.51ms max=1.82s p(90)=1.21s p(95)=1.33s { expected_response:true }...: avg=936.05ms min=362.68ms med=912.51ms max=1.82s p(90)=1.21s p(95)=1.33s http_req_failed................: 0.00% ✓ 0 ✗ 3144 http_req_receiving.............: avg=13.35ms min=37.71µs med=90.61µs max=553.05ms p(90)=1.18ms p(95)=45.63ms http_req_sending...............: avg=650.51µs min=8.95µs med=14.66µs max=205.29ms p(90)=41.88µs p(95)=176.24µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=922.05ms min=362.45ms med=902.53ms max=1.82s p(90)=1.18s p(95)=1.29s http_reqs......................: 3144 101.834353/s iteration_duration.............: avg=973.03ms min=373.58ms med=945.51ms max=1.94s p(90)=1.27s p(95)=1.39s iterations.....................: 3144 101.834353/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7716 ✗ 0 data_received..................: 226 MB 7.2 MB/s data_sent......................: 3.1 MB 98 kB/s http_req_blocked...............: avg=48.67µs min=1.58µs med=2.8µs max=4.48ms p(90)=4.83µs p(95)=10.56µs http_req_connecting............: avg=43.72µs min=0s med=0s max=4.44ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=708.11ms med=1.14s max=1.75s p(90)=1.33s p(95)=1.4s { expected_response:true }...: avg=1.15s min=708.11ms med=1.14s max=1.75s p(90)=1.33s p(95)=1.4s http_req_failed................: 0.00% ✓ 0 ✗ 2572 http_req_receiving.............: avg=14.77ms min=40.12µs med=86.08µs max=313.4ms p(90)=51.79ms p(95)=100.56ms http_req_sending...............: avg=1.72ms min=8.15µs med=13.35µs max=286.49ms p(90)=41.97µs p(95)=381.07µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=708.03ms med=1.14s max=1.49s p(90)=1.3s p(95)=1.35s http_reqs......................: 2572 82.461748/s iteration_duration.............: avg=1.19s min=717.41ms med=1.18s max=1.84s p(90)=1.4s p(95)=1.45s iterations.....................: 2572 82.461748/s vus............................: 37 min=37 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6075 ✗ 0 data_received..................: 178 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=71.12µs min=1.57µs med=3.2µs max=8.76ms p(90)=5.3µs p(95)=51.57µs http_req_connecting............: avg=61.37µs min=0s med=0s max=8.7ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.5s min=772.58ms med=1.43s max=9.35s p(90)=1.67s p(95)=1.75s { expected_response:true }...: avg=1.5s min=772.58ms med=1.43s max=9.35s p(90)=1.67s p(95)=1.75s http_req_failed................: 0.00% ✓ 0 ✗ 2025 http_req_receiving.............: avg=340.85µs min=45.73µs med=110.82µs max=105.67ms p(90)=184.41µs p(95)=272.33µs http_req_sending...............: avg=115.4µs min=9.03µs med=16.37µs max=53.08ms p(90)=33.53µs p(95)=92.63µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.5s min=771.9ms med=1.43s max=9.35s p(90)=1.67s p(95)=1.75s http_reqs......................: 2025 64.89967/s iteration_duration.............: avg=1.52s min=780.95ms med=1.45s max=9.36s p(90)=1.68s p(95)=1.76s iterations.....................: 2025 64.89967/s vus............................: 29 min=29 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5751 ✗ 0 data_received..................: 168 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=89.48µs min=1.47µs med=3.75µs max=4.13ms p(90)=5.43µs p(95)=115.4µs http_req_connecting............: avg=78.78µs min=0s med=0s max=4.1ms p(90)=0s p(95)=72.54µs http_req_duration..............: avg=1.57s min=681.25ms med=1.51s max=3.61s p(90)=2s p(95)=2.29s { expected_response:true }...: avg=1.57s min=681.25ms med=1.51s max=3.61s p(90)=2s p(95)=2.29s http_req_failed................: 0.00% ✓ 0 ✗ 1917 http_req_receiving.............: avg=1.81ms min=42.97µs med=116.06µs max=253.41ms p(90)=2.04ms p(95)=9.11ms http_req_sending...............: avg=238.25µs min=8.33µs med=20.12µs max=138.54ms p(90)=42.6µs p(95)=208.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.56s min=681.12ms med=1.51s max=3.6s p(90)=2s p(95)=2.29s http_reqs......................: 1917 61.762846/s iteration_duration.............: avg=1.59s min=700.59ms med=1.53s max=3.62s p(90)=2.03s p(95)=2.32s iterations.....................: 1917 61.762846/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1419 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 562 kB 15 kB/s http_req_blocked...............: avg=229.81µs min=1.45µs med=3.84µs max=2.8ms p(90)=1.01ms p(95)=1.66ms http_req_connecting............: avg=207.73µs min=0s med=0s max=2.77ms p(90)=904.05µs p(95)=1.54ms http_req_duration..............: avg=7.17s min=2.65s med=7.47s max=8.93s p(90)=8.27s p(95)=8.46s { expected_response:true }...: avg=7.17s min=2.65s med=7.47s max=8.93s p(90)=8.27s p(95)=8.46s http_req_failed................: 0.00% ✓ 0 ✗ 473 http_req_receiving.............: avg=141.74µs min=62.73µs med=122.39µs max=1.23ms p(90)=187.86µs p(95)=280.9µs http_req_sending...............: avg=195.95µs min=8.86µs med=21.43µs max=6.13ms p(90)=604.8µs p(95)=765.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.17s min=2.65s med=7.47s max=8.93s p(90)=8.27s p(95)=8.46s http_reqs......................: 473 12.615038/s iteration_duration.............: avg=7.18s min=2.66s med=7.48s max=8.94s p(90)=8.28s p(95)=8.47s iterations.....................: 473 12.615038/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 148 4565 total, 0 failed avg: 620ms, p95: 807ms ✅
wundergraph 102 3168 total, 0 failed avg: 926ms, p95: 1137ms ✅
mesh-supergraph-bun 85 2649 total, 0 failed avg: 1133ms, p95: 1611ms ✅
cosmo 76 2375 total, 0 failed avg: 1245ms, p95: 1483ms ✅
apollo-server 47 1469 total, 0 failed avg: 2072ms, p95: 2442ms ✅
mesh-supergraph 30 971 total, 0 failed avg: 3164ms, p95: 5093ms ✅
mercurius 12 451 total, 0 failed avg: 7538ms, p95: 8979ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13695 ✗ 0 data_received..................: 401 MB 13 MB/s data_sent......................: 5.4 MB 177 kB/s http_req_blocked...............: avg=28.36µs min=1.38µs med=2.68µs max=37.83ms p(90)=3.87µs p(95)=4.88µs http_req_connecting............: avg=8.71µs min=0s med=0s max=1.28ms p(90)=0s p(95)=0s http_req_duration..............: avg=620.43ms min=262.8ms med=612.05ms max=1.3s p(90)=752.81ms p(95)=806.83ms { expected_response:true }...: avg=620.43ms min=262.8ms med=612.05ms max=1.3s p(90)=752.81ms p(95)=806.83ms http_req_failed................: 0.00% ✓ 0 ✗ 4565 http_req_receiving.............: avg=12.29ms min=35.34µs med=68.07µs max=405.84ms p(90)=39.52ms p(95)=83.76ms http_req_sending...............: avg=1.17ms min=8.07µs med=13.15µs max=239.24ms p(90)=37.63µs p(95)=225.69µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=606.96ms min=262.64ms med=604.63ms max=1.02s p(90)=734.12ms p(95)=774.87ms http_reqs......................: 4565 148.981069/s iteration_duration.............: avg=665.08ms min=274.28ms med=651.87ms max=1.35s p(90)=821.63ms p(95)=893.15ms iterations.....................: 4565 148.981069/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9504 ✗ 0 data_received..................: 278 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=42.49µs min=1.33µs med=2.59µs max=7.46ms p(90)=3.99µs p(95)=8.59µs http_req_connecting............: avg=33.73µs min=0s med=0s max=5.8ms p(90)=0s p(95)=0s http_req_duration..............: avg=925.58ms min=593.31ms med=915.05ms max=1.54s p(90)=1.07s p(95)=1.13s { expected_response:true }...: avg=925.58ms min=593.31ms med=915.05ms max=1.54s p(90)=1.07s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3168 http_req_receiving.............: avg=6.41ms min=31.9µs med=74.8µs max=212.82ms p(90)=18.54ms p(95)=48.26ms http_req_sending...............: avg=1.55ms min=7.63µs med=12.87µs max=164.07ms p(90)=73.18µs p(95)=1.03ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=917.62ms min=592.38ms med=908.81ms max=1.41s p(90)=1.06s p(95)=1.12s http_reqs......................: 3168 102.542474/s iteration_duration.............: avg=960.62ms min=604.85ms med=946.29ms max=1.65s p(90)=1.12s p(95)=1.19s iterations.....................: 3168 102.542474/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7947 ✗ 0 data_received..................: 232 MB 7.5 MB/s data_sent......................: 3.1 MB 101 kB/s http_req_blocked...............: avg=25.62µs min=1.44µs med=2.86µs max=4.32ms p(90)=4.66µs p(95)=9.85µs http_req_connecting............: avg=15.77µs min=0s med=0s max=1.61ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.13s min=500.79ms med=1.08s max=4.08s p(90)=1.42s p(95)=1.61s { expected_response:true }...: avg=1.13s min=500.79ms med=1.08s max=4.08s p(90)=1.42s p(95)=1.61s http_req_failed................: 0.00% ✓ 0 ✗ 2649 http_req_receiving.............: avg=14.35ms min=37.52µs med=93.33µs max=665.79ms p(90)=5.95ms p(95)=59.66ms http_req_sending...............: avg=350.64µs min=7.66µs med=13.98µs max=115.25ms p(90)=36.45µs p(95)=128.74µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.11s min=500.54ms med=1.07s max=4.08s p(90)=1.38s p(95)=1.57s http_reqs......................: 2649 85.364742/s iteration_duration.............: avg=1.16s min=510.51ms med=1.11s max=4.26s p(90)=1.45s p(95)=1.64s iterations.....................: 2649 85.364742/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7125 ✗ 0 data_received..................: 208 MB 6.7 MB/s data_sent......................: 2.8 MB 91 kB/s http_req_blocked...............: avg=255.62µs min=1.32µs med=2.49µs max=112.17ms p(90)=3.72µs p(95)=9.26µs http_req_connecting............: avg=21.15µs min=0s med=0s max=3.91ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.24s min=844.89ms med=1.24s max=1.75s p(90)=1.42s p(95)=1.48s { expected_response:true }...: avg=1.24s min=844.89ms med=1.24s max=1.75s p(90)=1.42s p(95)=1.48s http_req_failed................: 0.00% ✓ 0 ✗ 2375 http_req_receiving.............: avg=12.18ms min=39.81µs med=76.37µs max=355.78ms p(90)=35.59ms p(95)=88ms http_req_sending...............: avg=1.44ms min=7.68µs med=12.43µs max=196.73ms p(90)=39.04µs p(95)=643.61µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.23s min=844.78ms med=1.23s max=1.75s p(90)=1.38s p(95)=1.43s http_reqs......................: 2375 76.502957/s iteration_duration.............: avg=1.28s min=854.1ms med=1.27s max=1.78s p(90)=1.48s p(95)=1.55s iterations.....................: 2375 76.502957/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4407 ✗ 0 data_received..................: 129 MB 4.1 MB/s data_sent......................: 1.7 MB 56 kB/s http_req_blocked...............: avg=90.66µs min=1.6µs med=4.25µs max=4.58ms p(90)=6.13µs p(95)=237.87µs http_req_connecting............: avg=79.49µs min=0s med=0s max=4.55ms p(90)=0s p(95)=158.82µs http_req_duration..............: avg=2.07s min=868.97ms med=1.81s max=14.85s p(90)=2.24s p(95)=2.44s { expected_response:true }...: avg=2.07s min=868.97ms med=1.81s max=14.85s p(90)=2.24s p(95)=2.44s http_req_failed................: 0.00% ✓ 0 ✗ 1469 http_req_receiving.............: avg=212.23µs min=56.39µs med=127.9µs max=69.14ms p(90)=183.84µs p(95)=215.58µs http_req_sending...............: avg=56.89µs min=9.91µs med=21.98µs max=4.56ms p(90)=35.87µs p(95)=113.09µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.07s min=868.78ms med=1.81s max=14.85s p(90)=2.24s p(95)=2.44s http_reqs......................: 1469 47.105026/s iteration_duration.............: avg=2.08s min=876.24ms med=1.83s max=14.89s p(90)=2.26s p(95)=2.45s iterations.....................: 1469 47.105026/s vus............................: 21 min=21 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2913 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=199.6µs min=1.41µs med=3.43µs max=28.73ms p(90)=115.39µs p(95)=948.8µs http_req_connecting............: avg=168.08µs min=0s med=0s max=16.51ms p(90)=73.28µs p(95)=841.5µs http_req_duration..............: avg=3.16s min=980.73ms med=3.08s max=7.19s p(90)=4.21s p(95)=5.09s { expected_response:true }...: avg=3.16s min=980.73ms med=3.08s max=7.19s p(90)=4.21s p(95)=5.09s http_req_failed................: 0.00% ✓ 0 ✗ 971 http_req_receiving.............: avg=2.92ms min=40.73µs med=132.4µs max=107.89ms p(90)=1.54ms p(95)=8.65ms http_req_sending...............: avg=98.19µs min=8.2µs med=18.94µs max=7.95ms p(90)=76.45µs p(95)=843.36µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.16s min=980.59ms med=3.08s max=7.18s p(90)=4.21s p(95)=5.09s http_reqs......................: 971 30.864601/s iteration_duration.............: avg=3.17s min=1s med=3.09s max=7.21s p(90)=4.22s p(95)=5.11s iterations.....................: 971 30.864601/s vus............................: 45 min=45 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1353 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 535 kB 14 kB/s http_req_blocked...............: avg=262.18µs min=1.51µs med=4.09µs max=3.49ms p(90)=834.8µs p(95)=2.18ms http_req_connecting............: avg=241.15µs min=0s med=0s max=3.46ms p(90)=783.12µs p(95)=2.08ms http_req_duration..............: avg=7.53s min=2.98s med=7.75s max=9.31s p(90)=8.81s p(95)=8.97s { expected_response:true }...: avg=7.53s min=2.98s med=7.75s max=9.31s p(90)=8.81s p(95)=8.97s http_req_failed................: 0.00% ✓ 0 ✗ 451 http_req_receiving.............: avg=274.62µs min=58.62µs med=124.04µs max=62.27ms p(90)=180.98µs p(95)=212.87µs http_req_sending...............: avg=119.01µs min=8.95µs med=21.5µs max=1.17ms p(90)=515.43µs p(95)=588.96µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.53s min=2.98s med=7.75s max=9.31s p(90)=8.81s p(95)=8.96s http_reqs......................: 451 12.013473/s iteration_duration.............: avg=7.54s min=2.99s med=7.76s max=9.32s p(90)=8.82s p(95)=8.98s iterations.....................: 451 12.013473/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2673ms 174 12236 total, 0 failed avg: 810ms, p95: 2674ms, max: 8081ms, med: 510ms ✅
apollo-router 2852ms 169 11892 total, 0 failed avg: 877ms, p95: 2853ms, max: 7449ms, med: 563ms ✅
wundergraph 2964ms 160 11233 total, 0 failed avg: 842ms, p95: 2965ms, max: 8729ms, med: 480ms ✅
mesh-supergraph-bun 5471ms 119 8354 total, 0 failed avg: 2202ms, p95: 5471ms, max: 9254ms, med: 2006ms ✅
mesh-supergraph 6687ms 69 4899 total, 0 failed avg: 3871ms, p95: 6688ms, max: 8100ms, med: 4021ms ✅
apollo-server 24460ms 67 4925 total, 0 failed avg: 4250ms, p95: 24460ms, max: 45343ms, med: 2161ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36708 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=18.08ms min=1.4µs med=3.1µs max=4.76s p(90)=5.1µs p(95)=12.86µs http_req_connecting............: avg=17.62ms min=0s med=0s max=4.76s p(90)=0s p(95)=0s http_req_duration..............: avg=810.4ms min=6.8ms med=509.68ms max=8.08s p(90)=1.97s p(95)=2.67s { expected_response:true }...: avg=810.4ms min=6.8ms med=509.68ms max=8.08s p(90)=1.97s p(95)=2.67s http_req_failed................: 0.00% ✓ 0 ✗ 12236 http_req_receiving.............: avg=332.47ms min=31.67µs med=82.04µs max=7.49s p(90)=1.27s p(95)=2s http_req_sending...............: avg=32.24ms min=8.24µs med=14.37µs max=4.8s p(90)=158.16µs p(95)=42.54ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=445.68ms min=6.71ms med=347.18ms max=3.37s p(90)=925.44ms p(95)=1.09s http_reqs......................: 12236 174.774208/s iteration_duration.............: avg=1.5s min=12.91ms med=965.59ms max=12.89s p(90)=3.67s p(95)=4.67s iterations.....................: 12236 174.774208/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35676 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 202 kB/s http_req_blocked...............: avg=15.46ms min=1.61µs med=3.64µs max=5.1s p(90)=6.13µs p(95)=14.52µs http_req_connecting............: avg=14.89ms min=0s med=0s max=5.1s p(90)=0s p(95)=0s http_req_duration..............: avg=876.64ms min=6.72ms med=563.27ms max=7.44s p(90)=2.18s p(95)=2.85s { expected_response:true }...: avg=876.64ms min=6.72ms med=563.27ms max=7.44s p(90)=2.18s p(95)=2.85s http_req_failed................: 0.00% ✓ 0 ✗ 11892 http_req_receiving.............: avg=382.96ms min=32.28µs med=99.68µs max=6.19s p(90)=1.39s p(95)=2.15s http_req_sending...............: avg=38.66ms min=8.3µs med=17.99µs max=4.52s p(90)=311.94µs p(95)=57.47ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=455.01ms min=6.64ms med=382.88ms max=2.77s p(90)=853.94ms p(95)=1.08s http_reqs......................: 11892 169.867334/s iteration_duration.............: avg=1.56s min=12.17ms med=945.63ms max=18.41s p(90)=3.85s p(95)=4.85s iterations.....................: 11892 169.867334/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 33699 ✗ 0 data_received..................: 986 MB 14 MB/s data_sent......................: 13 MB 191 kB/s http_req_blocked...............: avg=16.13ms min=1.68µs med=4.06µs max=4.61s p(90)=6.48µs p(95)=23.81µs http_req_connecting............: avg=14.91ms min=0s med=0s max=4.59s p(90)=0s p(95)=0s http_req_duration..............: avg=842.32ms min=6.64ms med=480.33ms max=8.72s p(90)=2.07s p(95)=2.96s { expected_response:true }...: avg=842.32ms min=6.64ms med=480.33ms max=8.72s p(90)=2.07s p(95)=2.96s http_req_failed................: 0.00% ✓ 0 ✗ 11233 http_req_receiving.............: avg=419.3ms min=34.79µs med=126.08µs max=8.08s p(90)=1.48s p(95)=2.3s http_req_sending...............: avg=37.35ms min=8.26µs med=20.2µs max=5.21s p(90)=228.99µs p(95)=49.81ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=385.66ms min=6.51ms med=292.99ms max=1.87s p(90)=833.25ms p(95)=962.81ms http_reqs......................: 11233 160.452351/s iteration_duration.............: avg=1.63s min=12.23ms med=1.02s max=13.87s p(90)=4.02s p(95)=5.26s iterations.....................: 11233 160.452351/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 25062 ✗ 0 data_received..................: 733 MB 11 MB/s data_sent......................: 9.9 MB 142 kB/s http_req_blocked...............: avg=2.2ms min=1.51µs med=2.94µs max=426.86ms p(90)=4.83µs p(95)=221.12µs http_req_connecting............: avg=2.11ms min=0s med=0s max=426.77ms p(90)=0s p(95)=144.5µs http_req_duration..............: avg=2.2s min=7.32ms med=2s max=9.25s p(90)=4.36s p(95)=5.47s { expected_response:true }...: avg=2.2s min=7.32ms med=2s max=9.25s p(90)=4.36s p(95)=5.47s http_req_failed................: 0.00% ✓ 0 ✗ 8354 http_req_receiving.............: avg=26.37ms min=34.75µs med=74.9µs max=1.61s p(90)=31.16ms p(95)=172.77ms http_req_sending...............: avg=2.47ms min=8.42µs med=13.81µs max=471.18ms p(90)=85.91µs p(95)=9.87ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.17s min=7.24ms med=1.99s max=8.58s p(90)=4.26s p(95)=5.45s http_reqs......................: 8354 119.316394/s iteration_duration.............: avg=2.27s min=14.77ms med=2.05s max=9.39s p(90)=4.39s p(95)=5.59s iterations.....................: 8354 119.316394/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14697 ✗ 0 data_received..................: 430 MB 6.1 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=474.6µs min=1.48µs med=3.76µs max=116.25ms p(90)=164.96µs p(95)=422.09µs http_req_connecting............: avg=452.32µs min=0s med=0s max=116.17ms p(90)=104.05µs p(95)=358.42µs http_req_duration..............: avg=3.87s min=10.76ms med=4.02s max=8.1s p(90)=6.24s p(95)=6.68s { expected_response:true }...: avg=3.87s min=10.76ms med=4.02s max=8.1s p(90)=6.24s p(95)=6.68s http_req_failed................: 0.00% ✓ 0 ✗ 4899 http_req_receiving.............: avg=4.39ms min=36.45µs med=97.07µs max=485.54ms p(90)=1.06ms p(95)=10.21ms http_req_sending...............: avg=350.11µs min=8.36µs med=19.74µs max=164.31ms p(90)=48.78µs p(95)=104.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.86s min=10.65ms med=4.02s max=8.09s p(90)=6.23s p(95)=6.68s http_reqs......................: 4899 69.969301/s iteration_duration.............: avg=3.9s min=16.47ms med=4.05s max=8.13s p(90)=6.34s p(95)=6.72s iterations.....................: 4899 69.969301/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14775 ✗ 0 data_received..................: 433 MB 5.9 MB/s data_sent......................: 5.8 MB 80 kB/s http_req_blocked...............: avg=77.32µs min=1.62µs med=4.06µs max=52.31ms p(90)=114.45µs p(95)=267.04µs http_req_connecting............: avg=55.76µs min=0s med=0s max=26.68ms p(90)=70.01µs p(95)=184.96µs http_req_duration..............: avg=4.24s min=75.47ms med=2.16s max=45.34s p(90)=3.75s p(95)=24.46s { expected_response:true }...: avg=4.24s min=75.47ms med=2.16s max=45.34s p(90)=3.75s p(95)=24.46s http_req_failed................: 0.00% ✓ 0 ✗ 4925 http_req_receiving.............: avg=282.2µs min=48.94µs med=123.91µs max=185.28ms p(90)=180.8µs p(95)=211.52µs http_req_sending...............: avg=49.66µs min=8.78µs med=20.73µs max=23.36ms p(90)=41.24µs p(95)=61.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.24s min=75.33ms med=2.16s max=45.34s p(90)=3.75s p(95)=24.45s http_reqs......................: 4925 67.111423/s iteration_duration.............: avg=4.26s min=87.36ms med=2.17s max=45.35s p(90)=3.76s p(95)=24.47s iterations.....................: 4925 67.111423/s vus............................: 33 min=33 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview