search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @graphql-mesh/cli to v0.89.3 #392

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/cli (source) 0.89.0 -> 0.89.3 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/cli) ### [`v0.89.3`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0893) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/cli@0.89.2...@graphql-mesh/cli@0.89.3) ##### Patch Changes - Updated dependencies \[[`57f4a60`](https://togithub.com/ardatan/graphql-mesh/commit/57f4a601c1f9819937c784ab9aae68f3368cbefd)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.3 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.3 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.3 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.3 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.3 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.3 ### [`v0.89.2`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0892) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/26db58954b3e3d10555b196622ab659e16b49e6a...@graphql-mesh/cli@0.89.2) ##### Patch Changes - Updated dependencies \[[`7a712ab`](https://togithub.com/ardatan/graphql-mesh/commit/7a712ab915ac3216765951080e689d510b5682a6)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.2 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.2 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.2 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.2 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.2 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.2 ### [`v0.89.1`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0891) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/cli@0.89.0...26db58954b3e3d10555b196622ab659e16b49e6a) ##### Patch Changes - Updated dependencies \[[`dbaf72c`](https://togithub.com/ardatan/graphql-mesh/commit/dbaf72c4520f64524dce14b798019639c4d57020)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.1 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.1 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.1 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.1 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.1 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.1

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 164 4999 total, 0 failed avg: 539ms, p95: 728ms ✅
wundergraph 105 3244 total, 0 failed avg: 905ms, p95: 1107ms ✅
mesh-supergraph-bun 103 3198 total, 0 failed avg: 911ms, p95: 1255ms ✅
cosmo 83 2586 total, 0 failed avg: 1148ms, p95: 1458ms ✅
apollo-server 63 1981 total, 0 failed avg: 1549ms, p95: 1781ms ✅
mesh-supergraph 62 1929 total, 0 failed avg: 1559ms, p95: 2341ms ✅
mercurius 12 473 total, 0 failed avg: 7159ms, p95: 8500ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14997 ✗ 0 data_received..................: 439 MB 14 MB/s data_sent......................: 5.9 MB 195 kB/s http_req_blocked...............: avg=88.54µs min=1.24µs med=2.82µs max=98.28ms p(90)=4.27µs p(95)=5.42µs http_req_connecting............: avg=58.29µs min=0s med=0s max=6.44ms p(90)=0s p(95)=0s http_req_duration..............: avg=539.3ms min=265.43ms med=527.76ms max=1.17s p(90)=665.88ms p(95)=728.1ms { expected_response:true }...: avg=539.3ms min=265.43ms med=527.76ms max=1.17s p(90)=665.88ms p(95)=728.1ms http_req_failed................: 0.00% ✓ 0 ✗ 4999 http_req_receiving.............: avg=16.31ms min=34.01µs med=74.55µs max=533.73ms p(90)=58.37ms p(95)=102.28ms http_req_sending...............: avg=1.69ms min=7.57µs med=13.38µs max=250.43ms p(90)=44.23µs p(95)=362.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=521.29ms min=265.34ms med=514.85ms max=961.24ms p(90)=633.25ms p(95)=679.86ms http_reqs......................: 4999 164.158878/s iteration_duration.............: avg=604.09ms min=302.37ms med=583.75ms max=1.32s p(90)=766.18ms p(95)=858.83ms iterations.....................: 4999 164.158878/s vus............................: 86 min=86 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9732 ✗ 0 data_received..................: 285 MB 9.2 MB/s data_sent......................: 3.9 MB 125 kB/s http_req_blocked...............: avg=40.96µs min=1.3µs med=2.5µs max=8.37ms p(90)=3.83µs p(95)=8.25µs http_req_connecting............: avg=30.89µs min=0s med=0s max=2.98ms p(90)=0s p(95)=0s http_req_duration..............: avg=905.15ms min=603.66ms med=898.59ms max=1.41s p(90)=1.04s p(95)=1.1s { expected_response:true }...: avg=905.15ms min=603.66ms med=898.59ms max=1.41s p(90)=1.04s p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 3244 http_req_receiving.............: avg=8.75ms min=34.28µs med=75.22µs max=257.71ms p(90)=29.72ms p(95)=61.84ms http_req_sending...............: avg=1.49ms min=7.76µs med=12.54µs max=159.11ms p(90)=43.02µs p(95)=703.27µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=894.9ms min=599.65ms med=890.8ms max=1.28s p(90)=1.03s p(95)=1.09s http_reqs......................: 3244 105.264496/s iteration_duration.............: avg=940.84ms min=623.31ms med=930.68ms max=1.43s p(90)=1.09s p(95)=1.15s iterations.....................: 3244 105.264496/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9594 ✗ 0 data_received..................: 281 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=108.49µs min=1.59µs med=3.23µs max=75.53ms p(90)=5.27µs p(95)=10.25µs http_req_connecting............: avg=76.01µs min=0s med=0s max=5.29ms p(90)=0s p(95)=0s http_req_duration..............: avg=911.45ms min=373.83ms med=903.3ms max=1.6s p(90)=1.17s p(95)=1.25s { expected_response:true }...: avg=911.45ms min=373.83ms med=903.3ms max=1.6s p(90)=1.17s p(95)=1.25s http_req_failed................: 0.00% ✓ 0 ✗ 3198 http_req_receiving.............: avg=14.06ms min=39.09µs med=89.4µs max=609.55ms p(90)=11.58ms p(95)=80.83ms http_req_sending...............: avg=633.14µs min=8.81µs med=15.57µs max=188.59ms p(90)=42.11µs p(95)=437.24µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=896.75ms min=373.72ms med=893.32ms max=1.54s p(90)=1.14s p(95)=1.21s http_reqs......................: 3198 103.681248/s iteration_duration.............: avg=948.1ms min=382.86ms med=938.15ms max=1.68s p(90)=1.22s p(95)=1.31s iterations.....................: 3198 103.681248/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7758 ✗ 0 data_received..................: 227 MB 7.3 MB/s data_sent......................: 3.1 MB 99 kB/s http_req_blocked...............: avg=65.26µs min=1.17µs med=2.51µs max=83.85ms p(90)=3.74µs p(95)=9.02µs http_req_connecting............: avg=24.17µs min=0s med=0s max=2.98ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=707ms med=1.13s max=1.7s p(90)=1.38s p(95)=1.45s { expected_response:true }...: avg=1.14s min=707ms med=1.13s max=1.7s p(90)=1.38s p(95)=1.45s http_req_failed................: 0.00% ✓ 0 ✗ 2586 http_req_receiving.............: avg=15.63ms min=40.51µs med=90.64µs max=447.03ms p(90)=55.44ms p(95)=98.4ms http_req_sending...............: avg=1.26ms min=8.51µs med=12.54µs max=254.81ms p(90)=38.82µs p(95)=182.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=647.74ms med=1.12s max=1.61s p(90)=1.33s p(95)=1.41s http_reqs......................: 2586 83.15097/s iteration_duration.............: avg=1.18s min=716.44ms med=1.16s max=1.75s p(90)=1.45s p(95)=1.5s iterations.....................: 2586 83.15097/s vus............................: 29 min=29 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5943 ✗ 0 data_received..................: 174 MB 5.5 MB/s data_sent......................: 2.4 MB 75 kB/s http_req_blocked...............: avg=40.71µs min=1.65µs med=3.69µs max=3.32ms p(90)=5.55µs p(95)=102.78µs http_req_connecting............: avg=28.18µs min=0s med=0s max=2.84ms p(90)=0s p(95)=64.52µs http_req_duration..............: avg=1.54s min=782ms med=1.48s max=10.07s p(90)=1.69s p(95)=1.78s { expected_response:true }...: avg=1.54s min=782ms med=1.48s max=10.07s p(90)=1.69s p(95)=1.78s http_req_failed................: 0.00% ✓ 0 ✗ 1981 http_req_receiving.............: avg=160.72µs min=50.35µs med=121.02µs max=18.9ms p(90)=179.42µs p(95)=214.64µs http_req_sending...............: avg=51.87µs min=9.13µs med=20.02µs max=10.03ms p(90)=36.41µs p(95)=80.76µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.54s min=781.77ms med=1.48s max=10.07s p(90)=1.69s p(95)=1.78s http_reqs......................: 1981 63.095488/s iteration_duration.............: avg=1.56s min=789.56ms med=1.49s max=10.08s p(90)=1.7s p(95)=1.79s iterations.....................: 1981 63.095488/s vus............................: 46 min=46 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5787 ✗ 0 data_received..................: 169 MB 5.5 MB/s data_sent......................: 2.3 MB 74 kB/s http_req_blocked...............: avg=144.99µs min=1.7µs med=4.06µs max=5.62ms p(90)=5.82µs p(95)=218.83µs http_req_connecting............: avg=131.62µs min=0s med=0s max=5.58ms p(90)=0s p(95)=93.67µs http_req_duration..............: avg=1.55s min=765.08ms med=1.44s max=3.94s p(90)=2.12s p(95)=2.34s { expected_response:true }...: avg=1.55s min=765.08ms med=1.44s max=3.94s p(90)=2.12s p(95)=2.34s http_req_failed................: 0.00% ✓ 0 ✗ 1929 http_req_receiving.............: avg=1.42ms min=40.73µs med=120.7µs max=136.24ms p(90)=1.44ms p(95)=6.53ms http_req_sending...............: avg=162.15µs min=8.34µs med=20.88µs max=62.45ms p(90)=39.08µs p(95)=309.99µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.55s min=764.86ms med=1.44s max=3.94s p(90)=2.12s p(95)=2.33s http_reqs......................: 1929 62.282888/s iteration_duration.............: avg=1.58s min=774.83ms med=1.47s max=3.97s p(90)=2.14s p(95)=2.39s iterations.....................: 1929 62.282888/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1419 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 562 kB 15 kB/s http_req_blocked...............: avg=269.82µs min=1.67µs med=4.23µs max=7.74ms p(90)=764.57µs p(95)=1.65ms http_req_connecting............: avg=251.25µs min=0s med=0s max=7.71ms p(90)=710.5µs p(95)=1.58ms http_req_duration..............: avg=7.15s min=2.98s med=7.42s max=8.8s p(90)=8.33s p(95)=8.49s { expected_response:true }...: avg=7.15s min=2.98s med=7.42s max=8.8s p(90)=8.33s p(95)=8.49s http_req_failed................: 0.00% ✓ 0 ✗ 473 http_req_receiving.............: avg=192.99µs min=59.49µs med=127.96µs max=23.4ms p(90)=197.02µs p(95)=235.91µs http_req_sending...............: avg=55.85µs min=9.19µs med=22.82µs max=621.06µs p(90)=166.66µs p(95)=281.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.15s min=2.98s med=7.42s max=8.8s p(90)=8.33s p(95)=8.49s http_reqs......................: 473 12.665186/s iteration_duration.............: avg=7.16s min=2.98s med=7.42s max=8.81s p(90)=8.34s p(95)=8.5s iterations.....................: 473 12.665186/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 170 5192 total, 0 failed avg: 506ms, p95: 743ms ✅
apollo-router 167 5092 total, 0 failed avg: 534ms, p95: 722ms ✅
wundergraph 157 4786 total, 0 failed avg: 533ms, p95: 979ms ✅
mesh-supergraph-bun 97 2983 total, 0 failed avg: 985ms, p95: 1685ms ✅
apollo-server 50 1570 total, 0 failed avg: 1951ms, p95: 2461ms ✅
mesh-supergraph 30 975 total, 0 failed avg: 3156ms, p95: 5071ms ✅
mercurius 29 908 total, 0 failed avg: 3387ms, p95: 4561ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15576 ✗ 0 data_received..................: 456 MB 15 MB/s data_sent......................: 6.2 MB 202 kB/s http_req_blocked...............: avg=103.67µs min=1.45µs med=3.07µs max=69.58ms p(90)=4.92µs p(95)=6.3µs http_req_connecting............: avg=5.03µs min=0s med=0s max=4.13ms p(90)=0s p(95)=0s http_req_duration..............: avg=505.78ms min=48.47ms med=500.31ms max=1.34s p(90)=639.63ms p(95)=743.33ms { expected_response:true }...: avg=505.78ms min=48.47ms med=500.31ms max=1.34s p(90)=639.63ms p(95)=743.33ms http_req_failed................: 0.00% ✓ 0 ✗ 5192 http_req_receiving.............: avg=33.11ms min=39.28µs med=84.84µs max=767.83ms p(90)=94.55ms p(95)=265.37ms http_req_sending...............: avg=1.55ms min=7.64µs med=14.18µs max=435.24ms p(90)=37.34µs p(95)=156.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=471.11ms min=45.19ms med=483.58ms max=806.21ms p(90)=584.36ms p(95)=614.8ms http_reqs......................: 5192 170.161719/s iteration_duration.............: avg=584.15ms min=65.95ms med=541.96ms max=1.86s p(90)=831.7ms p(95)=975.63ms iterations.....................: 5192 170.161719/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15276 ✗ 0 data_received..................: 447 MB 15 MB/s data_sent......................: 6.0 MB 198 kB/s http_req_blocked...............: avg=25.35µs min=1.44µs med=2.73µs max=8.09ms p(90)=4.17µs p(95)=5.28µs http_req_connecting............: avg=19.88µs min=0s med=0s max=4.52ms p(90)=0s p(95)=0s http_req_duration..............: avg=533.82ms min=66.33ms med=533.65ms max=1.68s p(90)=671.13ms p(95)=722.12ms { expected_response:true }...: avg=533.82ms min=66.33ms med=533.65ms max=1.68s p(90)=671.13ms p(95)=722.12ms http_req_failed................: 0.00% ✓ 0 ✗ 5092 http_req_receiving.............: avg=19.18ms min=34.66µs med=70.44µs max=1s p(90)=39.49ms p(95)=110.05ms http_req_sending...............: avg=1.5ms min=7.88µs med=13.27µs max=1.16s p(90)=37.38µs p(95)=144.24µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=513.13ms min=66.26ms med=522.21ms max=984.14ms p(90)=643.43ms p(95)=680.16ms http_reqs......................: 5092 167.141729/s iteration_duration.............: avg=594.31ms min=76.04ms med=576.07ms max=2.69s p(90)=757.38ms p(95)=843.68ms iterations.....................: 5092 167.141729/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14358 ✗ 0 data_received..................: 420 MB 14 MB/s data_sent......................: 5.7 MB 187 kB/s http_req_blocked...............: avg=72.69µs min=1.35µs med=2.78µs max=38.82ms p(90)=4.42µs p(95)=5.54µs http_req_connecting............: avg=48.94µs min=0s med=0s max=8.22ms p(90)=0s p(95)=0s http_req_duration..............: avg=533.27ms min=25.31ms med=503.28ms max=2.46s p(90)=845.49ms p(95)=978.85ms { expected_response:true }...: avg=533.27ms min=25.31ms med=503.28ms max=2.46s p(90)=845.49ms p(95)=978.85ms http_req_failed................: 0.00% ✓ 0 ✗ 4786 http_req_receiving.............: avg=48.14ms min=36.06µs med=88.22µs max=2.15s p(90)=134.02ms p(95)=315.92ms http_req_sending...............: avg=3.76ms min=7.45µs med=13.59µs max=2.15s p(90)=56.87µs p(95)=1.79ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=481.36ms min=10.57ms med=467.17ms max=1.31s p(90)=767.77ms p(95)=859.89ms http_reqs......................: 4786 157.754157/s iteration_duration.............: avg=630.17ms min=42.83ms med=577.69ms max=2.87s p(90)=1.01s p(95)=1.21s iterations.....................: 4786 157.754157/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8949 ✗ 0 data_received..................: 262 MB 8.6 MB/s data_sent......................: 3.5 MB 116 kB/s http_req_blocked...............: avg=66.88µs min=1.33µs med=2.78µs max=16.74ms p(90)=4.5µs p(95)=8.89µs http_req_connecting............: avg=56.48µs min=0s med=0s max=4.75ms p(90)=0s p(95)=0s http_req_duration..............: avg=985.24ms min=436.9ms med=850.33ms max=2.41s p(90)=1.57s p(95)=1.68s { expected_response:true }...: avg=985.24ms min=436.9ms med=850.33ms max=2.41s p(90)=1.57s p(95)=1.68s http_req_failed................: 0.00% ✓ 0 ✗ 2983 http_req_receiving.............: avg=9.45ms min=36.6µs med=82.86µs max=630.21ms p(90)=1.06ms p(95)=34.85ms http_req_sending...............: avg=564.79µs min=7.97µs med=13.44µs max=171.43ms p(90)=39.98µs p(95)=184.74µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=975.22ms min=436.47ms med=843.55ms max=2.41s p(90)=1.56s p(95)=1.68s http_reqs......................: 2983 97.494827/s iteration_duration.............: avg=1.01s min=449.84ms med=881.8ms max=2.42s p(90)=1.62s p(95)=1.71s iterations.....................: 2983 97.494827/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4710 ✗ 0 data_received..................: 138 MB 4.4 MB/s data_sent......................: 1.9 MB 59 kB/s http_req_blocked...............: avg=87.93µs min=1.34µs med=3.18µs max=8.91ms p(90)=4.99µs p(95)=284.01µs http_req_connecting............: avg=59.13µs min=0s med=0s max=8.13ms p(90)=0s p(95)=214.3µs http_req_duration..............: avg=1.95s min=692.47ms med=1.65s max=20.33s p(90)=2.03s p(95)=2.46s { expected_response:true }...: avg=1.95s min=692.47ms med=1.65s max=20.33s p(90)=2.03s p(95)=2.46s http_req_failed................: 0.00% ✓ 0 ✗ 1570 http_req_receiving.............: avg=163.15µs min=51.48µs med=119.05µs max=17.2ms p(90)=181.26µs p(95)=208.79µs http_req_sending...............: avg=79.6µs min=8.48µs med=16.22µs max=15.01ms p(90)=32.5µs p(95)=263.95µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.95s min=692.32ms med=1.65s max=20.33s p(90)=2.03s p(95)=2.46s http_reqs......................: 1570 50.000611/s iteration_duration.............: avg=1.96s min=702.02ms med=1.66s max=20.34s p(90)=2.04s p(95)=2.46s iterations.....................: 1570 50.000611/s vus............................: 39 min=39 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2925 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=208.41µs min=1.53µs med=3.35µs max=9.1ms p(90)=96.52µs p(95)=977.35µs http_req_connecting............: avg=196.39µs min=0s med=0s max=9.05ms p(90)=65.03µs p(95)=812.99µs http_req_duration..............: avg=3.15s min=901.77ms med=3.05s max=6.55s p(90)=4.18s p(95)=5.07s { expected_response:true }...: avg=3.15s min=901.77ms med=3.05s max=6.55s p(90)=4.18s p(95)=5.07s http_req_failed................: 0.00% ✓ 0 ✗ 975 http_req_receiving.............: avg=2.7ms min=40.91µs med=139.8µs max=531.34ms p(90)=1.03ms p(95)=5.95ms http_req_sending...............: avg=91.68µs min=7.84µs med=18.55µs max=7.12ms p(90)=79.56µs p(95)=374.76µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.15s min=901.71ms med=3.05s max=6.55s p(90)=4.16s p(95)=5.07s http_reqs......................: 975 30.862275/s iteration_duration.............: avg=3.17s min=907.49ms med=3.07s max=6.56s p(90)=4.19s p(95)=5.09s iterations.....................: 975 30.862275/s vus............................: 46 min=46 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2724 ✗ 0 data_received..................: 80 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=108.94µs min=1.86µs med=3.97µs max=8.31ms p(90)=114.99µs p(95)=711.1µs http_req_connecting............: avg=96.4µs min=0s med=0s max=8.25ms p(90)=81.14µs p(95)=624.83µs http_req_duration..............: avg=3.38s min=1.06s med=3.2s max=7.43s p(90)=4.33s p(95)=4.56s { expected_response:true }...: avg=3.38s min=1.06s med=3.2s max=7.43s p(90)=4.33s p(95)=4.56s http_req_failed................: 0.00% ✓ 0 ✗ 908 http_req_receiving.............: avg=274.63µs min=40.46µs med=121.16µs max=65.15ms p(90)=182.69µs p(95)=224.07µs http_req_sending...............: avg=54.9µs min=8.66µs med=21.98µs max=3.31ms p(90)=46.36µs p(95)=390.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.38s min=1.06s med=3.2s max=7.43s p(90)=4.33s p(95)=4.56s http_reqs......................: 908 29.174666/s iteration_duration.............: avg=3.39s min=1.08s med=3.21s max=7.44s p(90)=4.34s p(95)=4.57s iterations.....................: 908 29.174666/s vus............................: 30 min=30 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2389ms 174 12211 total, 0 failed avg: 794ms, p95: 2389ms, max: 6926ms, med: 574ms ❌ 2 unexpected GraphQL errors, non-compatible response structure (2)
wundergraph 2485ms 166 11644 total, 0 failed avg: 803ms, p95: 2486ms, max: 7739ms, med: 555ms ✅
apollo-router 2701ms 169 11896 total, 0 failed avg: 861ms, p95: 2702ms, max: 7319ms, med: 519ms ✅
mesh-supergraph-bun 5528ms 116 8162 total, 0 failed avg: 2251ms, p95: 5529ms, max: 9122ms, med: 1959ms ✅
mesh-supergraph 6752ms 69 4889 total, 0 failed avg: 3891ms, p95: 6752ms, max: 8621ms, med: 3965ms ✅
apollo-server 23411ms 69 5078 total, 0 failed avg: 4104ms, p95: 23412ms, max: 44851ms, med: 2214ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12209 / ✗ 2 ✗ valid response structure ↳ 99% — ✓ 12209 / ✗ 2 checks.........................: 99.98% ✓ 36629 ✗ 4 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=19.31ms min=1.33µs med=2.87µs max=4.01s p(90)=4.56µs p(95)=12.21µs http_req_connecting............: avg=18.54ms min=0s med=0s max=4.01s p(90)=0s p(95)=0s http_req_duration..............: avg=793.81ms min=7.83ms med=574.02ms max=6.92s p(90)=1.83s p(95)=2.38s { expected_response:true }...: avg=793.81ms min=7.83ms med=574.02ms max=6.92s p(90)=1.83s p(95)=2.38s http_req_failed................: 0.00% ✓ 0 ✗ 12211 http_req_receiving.............: avg=285.83ms min=32.3µs med=79.04µs max=5.39s p(90)=1.11s p(95)=1.66s http_req_sending...............: avg=38.1ms min=7.51µs med=13.64µs max=3.98s p(90)=158.36µs p(95)=57.03ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=469.87ms min=7.74ms med=377.47ms max=2.74s p(90)=962.18ms p(95)=1.15s http_reqs......................: 12211 174.401641/s iteration_duration.............: avg=1.49s min=13.98ms med=1s max=13.05s p(90)=3.58s p(95)=4.47s iterations.....................: 12211 174.401641/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34932 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 197 kB/s http_req_blocked...............: avg=19.54ms min=1.49µs med=2.99µs max=5.14s p(90)=4.82µs p(95)=13.35µs http_req_connecting............: avg=17.75ms min=0s med=0s max=5.14s p(90)=0s p(95)=0s http_req_duration..............: avg=803.02ms min=6.65ms med=555.05ms max=7.73s p(90)=1.85s p(95)=2.48s { expected_response:true }...: avg=803.02ms min=6.65ms med=555.05ms max=7.73s p(90)=1.85s p(95)=2.48s http_req_failed................: 0.00% ✓ 0 ✗ 11644 http_req_receiving.............: avg=296.9ms min=31.69µs med=82.77µs max=5.77s p(90)=1.19s p(95)=1.69s http_req_sending...............: avg=44.82ms min=8.62µs med=13.99µs max=6.75s p(90)=415.61µs p(95)=105.6ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=461.29ms min=6.56ms med=346.12ms max=2.4s p(90)=1s p(95)=1.21s http_reqs......................: 11644 166.320817/s iteration_duration.............: avg=1.59s min=12.24ms med=1.03s max=14.71s p(90)=3.86s p(95)=5.01s iterations.....................: 11644 166.320817/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35688 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 202 kB/s http_req_blocked...............: avg=16.83ms min=1.75µs med=3.47µs max=4.8s p(90)=5.7µs p(95)=13.63µs http_req_connecting............: avg=15.96ms min=0s med=0s max=4.1s p(90)=0s p(95)=0s http_req_duration..............: avg=860.9ms min=7.1ms med=519.24ms max=7.31s p(90)=1.95s p(95)=2.7s { expected_response:true }...: avg=860.9ms min=7.1ms med=519.24ms max=7.31s p(90)=1.95s p(95)=2.7s http_req_failed................: 0.00% ✓ 0 ✗ 11896 http_req_receiving.............: avg=363.28ms min=30.97µs med=86.62µs max=5.29s p(90)=1.25s p(95)=1.99s http_req_sending...............: avg=34.52ms min=7.9µs med=17.41µs max=4.76s p(90)=226.67µs p(95)=56.64ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=463.09ms min=6.99ms med=397.38ms max=4.19s p(90)=909.15ms p(95)=1.09s http_reqs......................: 11896 169.940391/s iteration_duration.............: avg=1.56s min=12.83ms med=935.59ms max=12s p(90)=3.86s p(95)=5.07s iterations.....................: 11896 169.940391/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24486 ✗ 0 data_received..................: 716 MB 10 MB/s data_sent......................: 9.7 MB 138 kB/s http_req_blocked...............: avg=1.73ms min=1.56µs med=3.23µs max=364.41ms p(90)=5.82µs p(95)=223.11µs http_req_connecting............: avg=1.7ms min=0s med=0s max=364.34ms p(90)=0s p(95)=151.82µs http_req_duration..............: avg=2.25s min=6.87ms med=1.95s max=9.12s p(90)=4.16s p(95)=5.52s { expected_response:true }...: avg=2.25s min=6.87ms med=1.95s max=9.12s p(90)=4.16s p(95)=5.52s http_req_failed................: 0.00% ✓ 0 ✗ 8162 http_req_receiving.............: avg=27.17ms min=37.36µs med=80.9µs max=2.09s p(90)=44.4ms p(95)=178.83ms http_req_sending...............: avg=2.89ms min=8.16µs med=14.84µs max=745.94ms p(90)=76.46µs p(95)=3.32ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.22s min=6.71ms med=1.93s max=9.08s p(90)=4.14s p(95)=5.47s http_reqs......................: 8162 116.573158/s iteration_duration.............: avg=2.31s min=12.85ms med=2.04s max=9.55s p(90)=4.2s p(95)=5.72s iterations.....................: 8162 116.573158/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14667 ✗ 0 data_received..................: 429 MB 6.1 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=462.87µs min=1.35µs med=3.84µs max=108.86ms p(90)=161.49µs p(95)=444.49µs http_req_connecting............: avg=439.65µs min=0s med=0s max=108.77ms p(90)=104.93µs p(95)=370.35µs http_req_duration..............: avg=3.89s min=10.95ms med=3.96s max=8.62s p(90)=6.39s p(95)=6.75s { expected_response:true }...: avg=3.89s min=10.95ms med=3.96s max=8.62s p(90)=6.39s p(95)=6.75s http_req_failed................: 0.00% ✓ 0 ✗ 4889 http_req_receiving.............: avg=1.65ms min=39.64µs med=98µs max=208.16ms p(90)=830.21µs p(95)=6.89ms http_req_sending...............: avg=575.23µs min=8.09µs med=20.59µs max=212.28ms p(90)=52.59µs p(95)=126.88µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.88s min=10.88ms med=3.96s max=8.59s p(90)=6.39s p(95)=6.74s http_reqs......................: 4889 69.827996/s iteration_duration.............: avg=3.92s min=16.49ms med=3.98s max=8.66s p(90)=6.42s p(95)=6.77s iterations.....................: 4889 69.827996/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15234 ✗ 0 data_received..................: 446 MB 6.1 MB/s data_sent......................: 6.0 MB 83 kB/s http_req_blocked...............: avg=81.74µs min=1.43µs med=2.86µs max=20.29ms p(90)=23.67µs p(95)=311.97µs http_req_connecting............: avg=70.79µs min=0s med=0s max=20.21ms p(90)=0s p(95)=232.17µs http_req_duration..............: avg=4.1s min=74.07ms med=2.21s max=44.85s p(90)=3.3s p(95)=23.41s { expected_response:true }...: avg=4.1s min=74.07ms med=2.21s max=44.85s p(90)=3.3s p(95)=23.41s http_req_failed................: 0.00% ✓ 0 ✗ 5078 http_req_receiving.............: avg=307.99µs min=46.22µs med=112.8µs max=174.39ms p(90)=177.98µs p(95)=208.01µs http_req_sending...............: avg=47.89µs min=8.42µs med=14.7µs max=17.04ms p(90)=39.18µs p(95)=63.03µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.1s min=73.95ms med=2.21s max=44.85s p(90)=3.3s p(95)=23.41s http_reqs......................: 5078 69.479355/s iteration_duration.............: avg=4.11s min=81.67ms med=2.22s max=44.86s p(90)=3.32s p(95)=23.42s iterations.....................: 5078 69.479355/s vus............................: 13 min=13 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 152 4657 total, 0 failed avg: 601ms, p95: 792ms ✅
wundergraph 104 3242 total, 0 failed avg: 908ms, p95: 1133ms ✅
mesh-supergraph-bun 83 2563 total, 0 failed avg: 1163ms, p95: 1646ms ✅
cosmo 78 2448 total, 0 failed avg: 1209ms, p95: 1501ms ✅
apollo-server 44 1425 total, 0 failed avg: 2188ms, p95: 2582ms ✅
mesh-supergraph 29 948 total, 0 failed avg: 3274ms, p95: 5390ms ✅
mercurius 11 446 total, 0 failed avg: 7590ms, p95: 9078ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13971 ✗ 0 data_received..................: 409 MB 13 MB/s data_sent......................: 5.5 MB 181 kB/s http_req_blocked...............: avg=38.39µs min=1.38µs med=2.73µs max=5.71ms p(90)=4.14µs p(95)=5.15µs http_req_connecting............: avg=32.66µs min=0s med=0s max=5.68ms p(90)=0s p(95)=0s http_req_duration..............: avg=600.59ms min=328.9ms med=592.91ms max=1.05s p(90)=730.65ms p(95)=791.77ms { expected_response:true }...: avg=600.59ms min=328.9ms med=592.91ms max=1.05s p(90)=730.65ms p(95)=791.77ms http_req_failed................: 0.00% ✓ 0 ✗ 4657 http_req_receiving.............: avg=9.19ms min=35.46µs med=67.15µs max=347.89ms p(90)=23.15ms p(95)=69.41ms http_req_sending...............: avg=1.26ms min=8.2µs med=13.36µs max=307.33ms p(90)=32.02µs p(95)=736.49µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=590.13ms min=328.77ms med=585.21ms max=957.44ms p(90)=707.62ms p(95)=752.46ms http_reqs......................: 4657 152.189764/s iteration_duration.............: avg=650.37ms min=339.37ms med=636.75ms max=1.17s p(90)=809.01ms p(95)=881.43ms iterations.....................: 4657 152.189764/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9726 ✗ 0 data_received..................: 285 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=64.06µs min=1.33µs med=2.62µs max=5.78ms p(90)=4.02µs p(95)=8.01µs http_req_connecting............: avg=55.44µs min=0s med=0s max=5.34ms p(90)=0s p(95)=0s http_req_duration..............: avg=907.8ms min=564.36ms med=892.16ms max=1.69s p(90)=1.05s p(95)=1.13s { expected_response:true }...: avg=907.8ms min=564.36ms med=892.16ms max=1.69s p(90)=1.05s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3242 http_req_receiving.............: avg=8.91ms min=40.05µs med=80.48µs max=321.05ms p(90)=26.08ms p(95)=61.8ms http_req_sending...............: avg=1.48ms min=7.92µs med=12.84µs max=215.72ms p(90)=49.01µs p(95)=261.51µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=897.4ms min=564.28ms med=884.22ms max=1.48s p(90)=1.04s p(95)=1.11s http_reqs......................: 3242 104.503988/s iteration_duration.............: avg=943.61ms min=574.11ms med=930.47ms max=1.79s p(90)=1.1s p(95)=1.19s iterations.....................: 3242 104.503988/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7689 ✗ 0 data_received..................: 225 MB 7.3 MB/s data_sent......................: 3.0 MB 99 kB/s http_req_blocked...............: avg=33.05µs min=1.37µs med=3.15µs max=7.77ms p(90)=5.09µs p(95)=10.68µs http_req_connecting............: avg=15.32µs min=0s med=0s max=7.72ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=519.25ms med=1.11s max=4.07s p(90)=1.46s p(95)=1.64s { expected_response:true }...: avg=1.16s min=519.25ms med=1.11s max=4.07s p(90)=1.46s p(95)=1.64s http_req_failed................: 0.00% ✓ 0 ✗ 2563 http_req_receiving.............: avg=16.12ms min=38.1µs med=96.03µs max=619.3ms p(90)=9.33ms p(95)=91.78ms http_req_sending...............: avg=420.7µs min=8.16µs med=14.29µs max=180.33ms p(90)=39.14µs p(95)=142.14µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=519.02ms med=1.1s max=4.07s p(90)=1.43s p(95)=1.61s http_reqs......................: 2563 83.202935/s iteration_duration.............: avg=1.19s min=526.84ms med=1.14s max=4.18s p(90)=1.5s p(95)=1.67s iterations.....................: 2563 83.202935/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7344 ✗ 0 data_received..................: 215 MB 6.9 MB/s data_sent......................: 2.9 MB 94 kB/s http_req_blocked...............: avg=214.4µs min=1.59µs med=3.41µs max=44.34ms p(90)=5.51µs p(95)=12.03µs http_req_connecting............: avg=167.45µs min=0s med=0s max=7.46ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=789.39ms med=1.2s max=2.11s p(90)=1.4s p(95)=1.5s { expected_response:true }...: avg=1.2s min=789.39ms med=1.2s max=2.11s p(90)=1.4s p(95)=1.5s http_req_failed................: 0.00% ✓ 0 ✗ 2448 http_req_receiving.............: avg=9.5ms min=41.62µs med=86.38µs max=634.76ms p(90)=17.82ms p(95)=57.86ms http_req_sending...............: avg=1.27ms min=8.91µs med=15.59µs max=401.64ms p(90)=53.48µs p(95)=416.45µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.19s min=789.18ms med=1.19s max=1.78s p(90)=1.38s p(95)=1.47s http_reqs......................: 2448 78.753702/s iteration_duration.............: avg=1.24s min=799.14ms med=1.24s max=2.12s p(90)=1.46s p(95)=1.56s iterations.....................: 2448 78.753702/s vus............................: 6 min=6 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4275 ✗ 0 data_received..................: 125 MB 3.9 MB/s data_sent......................: 1.7 MB 53 kB/s http_req_blocked...............: avg=69.24µs min=1.86µs med=4.29µs max=3.71ms p(90)=6.27µs p(95)=346.72µs http_req_connecting............: avg=52.41µs min=0s med=0s max=2.41ms p(90)=0s p(95)=267.6µs http_req_duration..............: avg=2.18s min=865.55ms med=1.95s max=15.2s p(90)=2.38s p(95)=2.58s { expected_response:true }...: avg=2.18s min=865.55ms med=1.95s max=15.2s p(90)=2.38s p(95)=2.58s http_req_failed................: 0.00% ✓ 0 ✗ 1425 http_req_receiving.............: avg=238.48µs min=59.69µs med=132.54µs max=69.07ms p(90)=197.03µs p(95)=240.68µs http_req_sending...............: avg=74.3µs min=9.99µs med=24.2µs max=35.19ms p(90)=41.4µs p(95)=170.69µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.18s min=865.31ms med=1.95s max=15.2s p(90)=2.38s p(95)=2.58s http_reqs......................: 1425 44.864136/s iteration_duration.............: avg=2.19s min=887.71ms med=1.96s max=15.22s p(90)=2.39s p(95)=2.59s iterations.....................: 1425 44.864136/s vus............................: 87 min=87 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2844 ✗ 0 data_received..................: 83 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=127.33µs min=1.48µs med=3.77µs max=10.49ms p(90)=131.89µs p(95)=608.29µs http_req_connecting............: avg=70.32µs min=0s med=0s max=3.69ms p(90)=75.91µs p(95)=504.9µs http_req_duration..............: avg=3.27s min=1.18s med=2.88s max=8.24s p(90)=4.69s p(95)=5.38s { expected_response:true }...: avg=3.27s min=1.18s med=2.88s max=8.24s p(90)=4.69s p(95)=5.38s http_req_failed................: 0.00% ✓ 0 ✗ 948 http_req_receiving.............: avg=3.22ms min=42.73µs med=173.13µs max=140.7ms p(90)=2.02ms p(95)=10.1ms http_req_sending...............: avg=73.3µs min=8.2µs med=20.66µs max=11.37ms p(90)=90.79µs p(95)=299.24µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.27s min=1.18s med=2.88s max=8.24s p(90)=4.69s p(95)=5.38s http_reqs......................: 948 29.726306/s iteration_duration.............: avg=3.28s min=1.2s med=2.89s max=8.26s p(90)=4.71s p(95)=5.41s iterations.....................: 948 29.726306/s vus............................: 67 min=67 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1338 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 529 kB 14 kB/s http_req_blocked...............: avg=240.69µs min=1.54µs med=4.14µs max=9.02ms p(90)=870.39µs p(95)=1.57ms http_req_connecting............: avg=200.71µs min=0s med=0s max=8.23ms p(90)=790.04µs p(95)=1.44ms http_req_duration..............: avg=7.59s min=3.27s med=7.78s max=9.5s p(90)=8.87s p(95)=9.07s { expected_response:true }...: avg=7.59s min=3.27s med=7.78s max=9.5s p(90)=8.87s p(95)=9.07s http_req_failed................: 0.00% ✓ 0 ✗ 446 http_req_receiving.............: avg=233.12µs min=60.66µs med=129.14µs max=39.97ms p(90)=198.59µs p(95)=243.88µs http_req_sending...............: avg=93.15µs min=8.73µs med=23.17µs max=749.83µs p(90)=417.23µs p(95)=532.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.59s min=3.27s med=7.78s max=9.5s p(90)=8.87s p(95)=9.07s http_reqs......................: 446 11.900167/s iteration_duration.............: avg=7.59s min=3.28s med=7.79s max=9.5s p(90)=8.88s p(95)=9.08s iterations.....................: 446 11.900167/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview