search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update dependency @graphql-mesh/cli to v0.89.7 #419

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/cli (source) 0.89.6 -> 0.89.7 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/cli) ### [`v0.89.7`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0897) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/cli@0.89.6...@graphql-mesh/cli@0.89.7) ##### Patch Changes - Updated dependencies \[[`52f74e7`](https://togithub.com/ardatan/graphql-mesh/commit/52f74e75219a32d30dea693a571c64c9c7519eb6)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.5 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.7 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.6 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.6 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.5 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.5

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 171 5243 total, 0 failed avg: 519ms, p95: 704ms ✅
mesh-supergraph-bun 102 3152 total, 0 failed avg: 935ms, p95: 1292ms ✅
wundergraph 102 3169 total, 0 failed avg: 927ms, p95: 1140ms ✅
cosmo 82 2534 total, 0 failed avg: 1159ms, p95: 1465ms ✅
mesh-supergraph 63 1957 total, 0 failed avg: 1533ms, p95: 2298ms ✅
apollo-server 61 1919 total, 0 failed avg: 1574ms, p95: 1852ms ✅
mercurius 12 472 total, 0 failed avg: 7207ms, p95: 8480ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15729 ✗ 0 data_received..................: 460 MB 15 MB/s data_sent......................: 6.2 MB 204 kB/s http_req_blocked...............: avg=150.49µs min=1.52µs med=2.86µs max=198.85ms p(90)=4.18µs p(95)=5.26µs http_req_connecting............: avg=12.35µs min=0s med=0s max=5.42ms p(90)=0s p(95)=0s http_req_duration..............: avg=519.11ms min=228.62ms med=505.63ms max=1.39s p(90)=647.6ms p(95)=703.83ms { expected_response:true }...: avg=519.11ms min=228.62ms med=505.63ms max=1.39s p(90)=647.6ms p(95)=703.83ms http_req_failed................: 0.00% ✓ 0 ✗ 5243 http_req_receiving.............: avg=19.43ms min=36.33µs med=76.11µs max=646.22ms p(90)=70.5ms p(95)=115.96ms http_req_sending...............: avg=1.18ms min=7.62µs med=13.46µs max=271.16ms p(90)=35.49µs p(95)=147.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=498.48ms min=228.56ms med=491.22ms max=843.45ms p(90)=616.09ms p(95)=660ms http_reqs......................: 5243 171.797624/s iteration_duration.............: avg=578.45ms min=272.37ms med=554.14ms max=1.49s p(90)=728.66ms p(95)=808.91ms iterations.....................: 5243 171.797624/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9456 ✗ 0 data_received..................: 277 MB 9.0 MB/s data_sent......................: 3.7 MB 122 kB/s http_req_blocked...............: avg=61.01µs min=1.54µs med=3.23µs max=6.13ms p(90)=5.32µs p(95)=10.85µs http_req_connecting............: avg=43.59µs min=0s med=0s max=4.44ms p(90)=0s p(95)=0s http_req_duration..............: avg=935.32ms min=369.42ms med=916.98ms max=1.96s p(90)=1.19s p(95)=1.29s { expected_response:true }...: avg=935.32ms min=369.42ms med=916.98ms max=1.96s p(90)=1.19s p(95)=1.29s http_req_failed................: 0.00% ✓ 0 ✗ 3152 http_req_receiving.............: avg=13.42ms min=38.66µs med=97.88µs max=662.28ms p(90)=1.93ms p(95)=56.11ms http_req_sending...............: avg=496.27µs min=8.72µs med=15.59µs max=313.8ms p(90)=38.4µs p(95)=154.94µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=921.4ms min=368.94ms med=908.53ms max=1.96s p(90)=1.16s p(95)=1.24s http_reqs......................: 3152 102.678334/s iteration_duration.............: avg=966.23ms min=380.59ms med=945.95ms max=1.97s p(90)=1.24s p(95)=1.34s iterations.....................: 3152 102.678334/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9507 ✗ 0 data_received..................: 278 MB 9.0 MB/s data_sent......................: 3.8 MB 121 kB/s http_req_blocked...............: avg=91.08µs min=1.3µs med=2.55µs max=105.83ms p(90)=3.86µs p(95)=8.65µs http_req_connecting............: avg=42.49µs min=0s med=0s max=4.66ms p(90)=0s p(95)=0s http_req_duration..............: avg=926.81ms min=604.97ms med=919.43ms max=1.48s p(90)=1.07s p(95)=1.14s { expected_response:true }...: avg=926.81ms min=604.97ms med=919.43ms max=1.48s p(90)=1.07s p(95)=1.14s http_req_failed................: 0.00% ✓ 0 ✗ 3169 http_req_receiving.............: avg=10.67ms min=38.96µs med=81.72µs max=255.9ms p(90)=35.92ms p(95)=75.7ms http_req_sending...............: avg=1.32ms min=7.8µs med=12.86µs max=288.38ms p(90)=35.77µs p(95)=921.41µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=914.81ms min=604.49ms med=910.39ms max=1.33s p(90)=1.06s p(95)=1.11s http_reqs......................: 3169 102.167934/s iteration_duration.............: avg=963.52ms min=617.24ms med=953.7ms max=1.51s p(90)=1.12s p(95)=1.19s iterations.....................: 3169 102.167934/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7602 ✗ 0 data_received..................: 222 MB 7.2 MB/s data_sent......................: 3.0 MB 98 kB/s http_req_blocked...............: avg=34.47µs min=1.89µs med=4.06µs max=16.85ms p(90)=6.13µs p(95)=12.79µs http_req_connecting............: avg=21.44µs min=0s med=0s max=2.21ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=719.82ms med=1.13s max=1.91s p(90)=1.34s p(95)=1.46s { expected_response:true }...: avg=1.15s min=719.82ms med=1.13s max=1.91s p(90)=1.34s p(95)=1.46s http_req_failed................: 0.00% ✓ 0 ✗ 2534 http_req_receiving.............: avg=17.87ms min=39.34µs med=116.09µs max=382.76ms p(90)=60.37ms p(95)=114.29ms http_req_sending...............: avg=1.24ms min=9.08µs med=21.02µs max=227.07ms p(90)=70.43µs p(95)=313.61µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=719.67ms med=1.12s max=1.58s p(90)=1.32s p(95)=1.42s http_reqs......................: 2534 82.139114/s iteration_duration.............: avg=1.2s min=733.74ms med=1.17s max=1.92s p(90)=1.4s p(95)=1.51s iterations.....................: 2534 82.139114/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5871 ✗ 0 data_received..................: 172 MB 5.6 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=58.12µs min=1.47µs med=3.79µs max=4.53ms p(90)=5.69µs p(95)=91.88µs http_req_connecting............: avg=47.73µs min=0s med=0s max=4.5ms p(90)=0s p(95)=65.5µs http_req_duration..............: avg=1.53s min=535.57ms med=1.5s max=3.45s p(90)=2.03s p(95)=2.29s { expected_response:true }...: avg=1.53s min=535.57ms med=1.5s max=3.45s p(90)=2.03s p(95)=2.29s http_req_failed................: 0.00% ✓ 0 ✗ 1957 http_req_receiving.............: avg=2.31ms min=39.92µs med=117.65µs max=245.03ms p(90)=2.54ms p(95)=10.17ms http_req_sending...............: avg=169.72µs min=8.19µs med=19.98µs max=68.56ms p(90)=37.99µs p(95)=142.24µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.53s min=535.47ms med=1.49s max=3.45s p(90)=2.03s p(95)=2.29s http_reqs......................: 1957 63.405488/s iteration_duration.............: avg=1.56s min=561.8ms med=1.52s max=3.46s p(90)=2.06s p(95)=2.32s iterations.....................: 1957 63.405488/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5757 ✗ 0 data_received..................: 169 MB 5.4 MB/s data_sent......................: 2.3 MB 74 kB/s http_req_blocked...............: avg=72.05µs min=1.81µs med=3.9µs max=11.67ms p(90)=5.99µs p(95)=134.23µs http_req_connecting............: avg=60.54µs min=0s med=0s max=11.64ms p(90)=0s p(95)=84.08µs http_req_duration..............: avg=1.57s min=762.04ms med=1.48s max=10.23s p(90)=1.75s p(95)=1.85s { expected_response:true }...: avg=1.57s min=762.04ms med=1.48s max=10.23s p(90)=1.75s p(95)=1.85s http_req_failed................: 0.00% ✓ 0 ✗ 1919 http_req_receiving.............: avg=224.69µs min=51.04µs med=123.53µs max=27.11ms p(90)=195.78µs p(95)=268.6µs http_req_sending...............: avg=51.78µs min=9.31µs med=19.61µs max=8.15ms p(90)=36.79µs p(95)=99.78µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.57s min=761.16ms med=1.48s max=10.23s p(90)=1.75s p(95)=1.85s http_reqs......................: 1919 61.947882/s iteration_duration.............: avg=1.58s min=772.18ms med=1.49s max=10.24s p(90)=1.77s p(95)=1.86s iterations.....................: 1919 61.947882/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1416 ✗ 0 data_received..................: 41 MB 1.1 MB/s data_sent......................: 560 kB 15 kB/s http_req_blocked...............: avg=657.39µs min=1.86µs med=4.31µs max=7ms p(90)=2.66ms p(95)=5.04ms http_req_connecting............: avg=633.81µs min=0s med=0s max=6.9ms p(90)=2.52ms p(95)=4.91ms http_req_duration..............: avg=7.2s min=2.8s med=7.5s max=8.8s p(90)=8.31s p(95)=8.47s { expected_response:true }...: avg=7.2s min=2.8s med=7.5s max=8.8s p(90)=8.31s p(95)=8.47s http_req_failed................: 0.00% ✓ 0 ✗ 472 http_req_receiving.............: avg=185.51µs min=62.83µs med=128.69µs max=9.77ms p(90)=201.11µs p(95)=245.52µs http_req_sending...............: avg=70.36µs min=11.33µs med=23.74µs max=446.16µs p(90)=267.63µs p(95)=339.45µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.2s min=2.8s med=7.5s max=8.8s p(90)=8.31s p(95)=8.47s http_reqs......................: 472 12.563964/s iteration_duration.............: avg=7.21s min=2.81s med=7.51s max=8.81s p(90)=8.32s p(95)=8.48s iterations.....................: 472 12.563964/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 174 5315 total, 0 failed avg: 497ms, p95: 676ms ✅
apollo-router 170 5190 total, 0 failed avg: 531ms, p95: 703ms ✅
wundergraph 160 4844 total, 0 failed avg: 518ms, p95: 917ms ✅
mesh-supergraph-bun 93 2853 total, 0 failed avg: 1031ms, p95: 1784ms ✅
apollo-server 48 1524 total, 0 failed avg: 2007ms, p95: 2708ms ✅
mesh-supergraph 30 960 total, 0 failed avg: 3216ms, p95: 5046ms ✅
mercurius 28 882 total, 0 failed avg: 3481ms, p95: 5496ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15945 ✗ 0 data_received..................: 466 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=47µs min=1.52µs med=2.89µs max=9.29ms p(90)=4.49µs p(95)=5.5µs http_req_connecting............: avg=35.32µs min=0s med=0s max=5.56ms p(90)=0s p(95)=0s http_req_duration..............: avg=497.4ms min=38.19ms med=496.66ms max=1.56s p(90)=608.29ms p(95)=675.73ms { expected_response:true }...: avg=497.4ms min=38.19ms med=496.66ms max=1.56s p(90)=608.29ms p(95)=675.73ms http_req_failed................: 0.00% ✓ 0 ✗ 5315 http_req_receiving.............: avg=29.79ms min=35.18µs med=78.06µs max=1.07s p(90)=71.26ms p(95)=259.34ms http_req_sending...............: avg=1.17ms min=8.18µs med=13.63µs max=389.95ms p(90)=34.61µs p(95)=378.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=466.43ms min=28.24ms med=482.7ms max=813.01ms p(90)=574.82ms p(95)=601.57ms http_reqs......................: 5315 174.939135/s iteration_duration.............: avg=568.76ms min=48.9ms med=540.82ms max=2.09s p(90)=768.75ms p(95)=923.27ms iterations.....................: 5315 174.939135/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15570 ✗ 0 data_received..................: 455 MB 15 MB/s data_sent......................: 6.2 MB 203 kB/s http_req_blocked...............: avg=23.44µs min=1.54µs med=2.87µs max=4.5ms p(90)=4.41µs p(95)=5.58µs http_req_connecting............: avg=18.23µs min=0s med=0s max=3.97ms p(90)=0s p(95)=0s http_req_duration..............: avg=531.28ms min=12.75ms med=528.71ms max=1.36s p(90)=657.73ms p(95)=703.33ms { expected_response:true }...: avg=531.28ms min=12.75ms med=528.71ms max=1.36s p(90)=657.73ms p(95)=703.33ms http_req_failed................: 0.00% ✓ 0 ✗ 5190 http_req_receiving.............: avg=17.81ms min=37.57µs med=69.69µs max=1.04s p(90)=12.97ms p(95)=73.92ms http_req_sending...............: avg=738.33µs min=8.12µs med=13.74µs max=255.41ms p(90)=36.68µs p(95)=146.09µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=512.73ms min=12.63ms med=520.53ms max=869.3ms p(90)=638.19ms p(95)=672.36ms http_reqs......................: 5190 170.571549/s iteration_duration.............: avg=582.25ms min=30.36ms med=569.13ms max=2.28s p(90)=724ms p(95)=804.4ms iterations.....................: 5190 170.571549/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14532 ✗ 0 data_received..................: 425 MB 14 MB/s data_sent......................: 5.7 MB 190 kB/s http_req_blocked...............: avg=198.61µs min=1.25µs med=2.64µs max=413.78ms p(90)=3.97µs p(95)=5µs http_req_connecting............: avg=62.99µs min=0s med=0s max=6.59ms p(90)=0s p(95)=0s http_req_duration..............: avg=517.55ms min=14.73ms med=499.67ms max=2.05s p(90)=799.48ms p(95)=917.36ms { expected_response:true }...: avg=517.55ms min=14.73ms med=499.67ms max=2.05s p(90)=799.48ms p(95)=917.36ms http_req_failed................: 0.00% ✓ 0 ✗ 4844 http_req_receiving.............: avg=49.79ms min=30.62µs med=79.49µs max=1.74s p(90)=170.39ms p(95)=370.25ms http_req_sending...............: avg=2.62ms min=6.71µs med=12.94µs max=653.88ms p(90)=28.73µs p(95)=343.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=465.13ms min=14.67ms med=460.22ms max=1.09s p(90)=727.57ms p(95)=834.58ms http_reqs......................: 4844 160.044443/s iteration_duration.............: avg=622.34ms min=24.79ms med=573.32ms max=2.69s p(90)=983.02ms p(95)=1.16s iterations.....................: 4844 160.044443/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8559 ✗ 0 data_received..................: 250 MB 8.2 MB/s data_sent......................: 3.4 MB 111 kB/s http_req_blocked...............: avg=123.72µs min=1.5µs med=3.54µs max=87.55ms p(90)=5.69µs p(95)=10.17µs http_req_connecting............: avg=84.63µs min=0s med=0s max=6.27ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.03s min=453.91ms med=878.48ms max=2.73s p(90)=1.64s p(95)=1.78s { expected_response:true }...: avg=1.03s min=453.91ms med=878.48ms max=2.73s p(90)=1.64s p(95)=1.78s http_req_failed................: 0.00% ✓ 0 ✗ 2853 http_req_receiving.............: avg=12.91ms min=39.3µs med=105.3µs max=556.25ms p(90)=9.63ms p(95)=80.18ms http_req_sending...............: avg=330.7µs min=8.79µs med=17.91µs max=47.89ms p(90)=73.36µs p(95)=220.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.01s min=453.42ms med=870.99ms max=2.73s p(90)=1.63s p(95)=1.76s http_reqs......................: 2853 93.223092/s iteration_duration.............: avg=1.06s min=469.04ms med=907.63ms max=2.78s p(90)=1.66s p(95)=1.8s iterations.....................: 2853 93.223092/s vus............................: 97 min=97 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4572 ✗ 0 data_received..................: 134 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=56.87µs min=1.62µs med=3.49µs max=3.57ms p(90)=5.38µs p(95)=215.65µs http_req_connecting............: avg=47.04µs min=0s med=0s max=2.83ms p(90)=0s p(95)=185.83µs http_req_duration..............: avg=2s min=390.52ms med=1.64s max=21.79s p(90)=2.04s p(95)=2.7s { expected_response:true }...: avg=2s min=390.52ms med=1.64s max=21.79s p(90)=2.04s p(95)=2.7s http_req_failed................: 0.00% ✓ 0 ✗ 1524 http_req_receiving.............: avg=160.84µs min=45.59µs med=123.28µs max=14.27ms p(90)=189.23µs p(95)=235.49µs http_req_sending...............: avg=68.83µs min=9.3µs med=18.05µs max=12.08ms p(90)=36.59µs p(95)=172.04µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2s min=390.4ms med=1.64s max=21.79s p(90)=2.04s p(95)=2.7s http_reqs......................: 1524 48.70672/s iteration_duration.............: avg=2.01s min=396.27ms med=1.65s max=21.8s p(90)=2.06s p(95)=2.72s iterations.....................: 1524 48.70672/s vus............................: 45 min=45 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2880 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=265.97µs min=1.52µs med=3.54µs max=5.73ms p(90)=184.56µs p(95)=2.2ms http_req_connecting............: avg=245.56µs min=0s med=0s max=5.71ms p(90)=141.14µs p(95)=2.14ms http_req_duration..............: avg=3.21s min=1.17s med=3.09s max=7.14s p(90)=4.4s p(95)=5.04s { expected_response:true }...: avg=3.21s min=1.17s med=3.09s max=7.14s p(90)=4.4s p(95)=5.04s http_req_failed................: 0.00% ✓ 0 ✗ 960 http_req_receiving.............: avg=3.43ms min=42.52µs med=158.39µs max=601.44ms p(90)=1.46ms p(95)=11.44ms http_req_sending...............: avg=75.36µs min=8.39µs med=20.01µs max=5.97ms p(90)=317.04µs p(95)=489.38µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.21s min=1.17s med=3.09s max=7.14s p(90)=4.39s p(95)=4.97s http_reqs......................: 960 30.294131/s iteration_duration.............: avg=3.23s min=1.18s med=3.1s max=7.16s p(90)=4.42s p(95)=5.07s iterations.....................: 960 30.294131/s vus............................: 54 min=54 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2646 ✗ 0 data_received..................: 77 MB 2.5 MB/s data_sent......................: 1.0 MB 34 kB/s http_req_blocked...............: avg=223.99µs min=1.69µs med=4.64µs max=6.47ms p(90)=454.58µs p(95)=1.77ms http_req_connecting............: avg=207.86µs min=0s med=0s max=6.38ms p(90)=379.13µs p(95)=1.71ms http_req_duration..............: avg=3.48s min=453.11ms med=3.19s max=8.75s p(90)=4.67s p(95)=5.49s { expected_response:true }...: avg=3.48s min=453.11ms med=3.19s max=8.75s p(90)=4.67s p(95)=5.49s http_req_failed................: 0.00% ✓ 0 ✗ 882 http_req_receiving.............: avg=755.38µs min=42.99µs med=133.06µs max=91.8ms p(90)=215.02µs p(95)=311.23µs http_req_sending...............: avg=241.01µs min=9.14µs med=28.4µs max=4.02ms p(90)=355.51µs p(95)=2.08ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.48s min=449.07ms med=3.19s max=8.74s p(90)=4.67s p(95)=5.49s http_reqs......................: 882 28.264516/s iteration_duration.............: avg=3.49s min=465.82ms med=3.2s max=8.76s p(90)=4.68s p(95)=5.5s iterations.....................: 882 28.264516/s vus............................: 35 min=35 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 151 4672 total, 0 failed avg: 605ms, p95: 775ms ✅
wundergraph 101 3124 total, 0 failed avg: 934ms, p95: 1191ms ✅
mesh-supergraph-bun 79 2466 total, 0 failed avg: 1204ms, p95: 1835ms ✅
cosmo 78 2453 total, 0 failed avg: 1214ms, p95: 1509ms ✅
apollo-server 48 1543 total, 0 failed avg: 1997ms, p95: 2282ms ✅
mesh-supergraph 28 896 total, 0 failed avg: 3458ms, p95: 5563ms ✅
mercurius 11 448 total, 0 failed avg: 7551ms, p95: 9023ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14016 ✗ 0 data_received..................: 410 MB 13 MB/s data_sent......................: 5.5 MB 180 kB/s http_req_blocked...............: avg=97.98µs min=1.38µs med=2.63µs max=60.69ms p(90)=3.86µs p(95)=5.01µs http_req_connecting............: avg=75.9µs min=0s med=0s max=7.96ms p(90)=0s p(95)=0s http_req_duration..............: avg=605.36ms min=313.81ms med=599.55ms max=1.17s p(90)=723.55ms p(95)=775.15ms { expected_response:true }...: avg=605.36ms min=313.81ms med=599.55ms max=1.17s p(90)=723.55ms p(95)=775.15ms http_req_failed................: 0.00% ✓ 0 ✗ 4672 http_req_receiving.............: avg=8.88ms min=37.46µs med=65.32µs max=422.57ms p(90)=16.57ms p(95)=56.41ms http_req_sending...............: avg=835.58µs min=7.92µs med=13.18µs max=263.55ms p(90)=31.86µs p(95)=220.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=595.63ms min=313.71ms med=592.34ms max=998.78ms p(90)=712.72ms p(95)=752.06ms http_reqs......................: 4672 151.710084/s iteration_duration.............: avg=648.83ms min=324.82ms med=635.63ms max=1.19s p(90)=791.54ms p(95)=863.77ms iterations.....................: 4672 151.710084/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9372 ✗ 0 data_received..................: 274 MB 8.9 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=53.72µs min=1.31µs med=2.68µs max=4.77ms p(90)=4.33µs p(95)=9.07µs http_req_connecting............: avg=44.04µs min=0s med=0s max=4.68ms p(90)=0s p(95)=0s http_req_duration..............: avg=933.64ms min=544.08ms med=916.78ms max=1.6s p(90)=1.1s p(95)=1.19s { expected_response:true }...: avg=933.64ms min=544.08ms med=916.78ms max=1.6s p(90)=1.1s p(95)=1.19s http_req_failed................: 0.00% ✓ 0 ✗ 3124 http_req_receiving.............: avg=11.97ms min=38.84µs med=90.92µs max=247.74ms p(90)=49.84ms p(95)=85.28ms http_req_sending...............: avg=1.41ms min=8.21µs med=13.04µs max=258.13ms p(90)=45.83µs p(95)=807.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=920.25ms min=542.87ms med=905.09ms max=1.56s p(90)=1.08s p(95)=1.15s http_reqs......................: 3124 101.574001/s iteration_duration.............: avg=970.43ms min=589.37ms med=951.25ms max=1.63s p(90)=1.14s p(95)=1.23s iterations.....................: 3124 101.574001/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7398 ✗ 0 data_received..................: 216 MB 7.0 MB/s data_sent......................: 2.9 MB 95 kB/s http_req_blocked...............: avg=41.46µs min=1.75µs med=3.81µs max=8.85ms p(90)=5.91µs p(95)=12.77µs http_req_connecting............: avg=30.51µs min=0s med=0s max=8.82ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=566.35ms med=1.14s max=3.3s p(90)=1.58s p(95)=1.83s { expected_response:true }...: avg=1.2s min=566.35ms med=1.14s max=3.3s p(90)=1.58s p(95)=1.83s http_req_failed................: 0.00% ✓ 0 ✗ 2466 http_req_receiving.............: avg=14.88ms min=42.92µs med=111.96µs max=719.55ms p(90)=6.06ms p(95)=56.15ms http_req_sending...............: avg=396.24µs min=8.74µs med=19.58µs max=80.44ms p(90)=60.51µs p(95)=297.49µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=563.34ms med=1.13s max=3.3s p(90)=1.56s p(95)=1.82s http_reqs......................: 2466 79.843716/s iteration_duration.............: avg=1.23s min=577.4ms med=1.17s max=3.34s p(90)=1.61s p(95)=1.87s iterations.....................: 2466 79.843716/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7359 ✗ 0 data_received..................: 215 MB 6.9 MB/s data_sent......................: 2.9 MB 93 kB/s http_req_blocked...............: avg=58.35µs min=1.31µs med=2.77µs max=30.91ms p(90)=4.52µs p(95)=10.26µs http_req_connecting............: avg=31.61µs min=0s med=0s max=2.58ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.21s min=843.12ms med=1.19s max=1.84s p(90)=1.42s p(95)=1.5s { expected_response:true }...: avg=1.21s min=843.12ms med=1.19s max=1.84s p(90)=1.42s p(95)=1.5s http_req_failed................: 0.00% ✓ 0 ✗ 2453 http_req_receiving.............: avg=9.45ms min=37.61µs med=75.94µs max=346.29ms p(90)=14.71ms p(95)=65.25ms http_req_sending...............: avg=1.23ms min=8.29µs med=13.51µs max=191.67ms p(90)=46.88µs p(95)=482.98µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.2s min=843ms med=1.18s max=1.77s p(90)=1.39s p(95)=1.48s http_reqs......................: 2453 78.57647/s iteration_duration.............: avg=1.25s min=894.39ms med=1.23s max=1.84s p(90)=1.47s p(95)=1.56s iterations.....................: 2453 78.57647/s vus............................: 41 min=41 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4629 ✗ 0 data_received..................: 136 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=38.65µs min=1.51µs med=2.88µs max=3.36ms p(90)=4.94µs p(95)=162.98µs http_req_connecting............: avg=33.03µs min=0s med=0s max=3.34ms p(90)=0s p(95)=125.22µs http_req_duration..............: avg=1.99s min=956.79ms med=1.81s max=13.72s p(90)=2.15s p(95)=2.28s { expected_response:true }...: avg=1.99s min=956.79ms med=1.81s max=13.72s p(90)=2.15s p(95)=2.28s http_req_failed................: 0.00% ✓ 0 ✗ 1543 http_req_receiving.............: avg=198.88µs min=43.14µs med=109.72µs max=58.42ms p(90)=171.48µs p(95)=203.86µs http_req_sending...............: avg=58.51µs min=8.47µs med=14.92µs max=15.83ms p(90)=32.78µs p(95)=116.63µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.99s min=956.61ms med=1.81s max=13.72s p(90)=2.15s p(95)=2.28s http_reqs......................: 1543 48.845937/s iteration_duration.............: avg=2s min=965.03ms med=1.82s max=13.73s p(90)=2.16s p(95)=2.29s iterations.....................: 1543 48.845937/s vus............................: 67 min=67 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2688 ✗ 0 data_received..................: 79 MB 2.5 MB/s data_sent......................: 1.1 MB 33 kB/s http_req_blocked...............: avg=64.62µs min=1.81µs med=4.92µs max=11.71ms p(90)=99.24µs p(95)=115.13µs http_req_connecting............: avg=51.65µs min=0s med=0s max=11.43ms p(90)=70.11µs p(95)=80.73µs http_req_duration..............: avg=3.45s min=1.48s med=3.17s max=7.76s p(90)=4.69s p(95)=5.56s { expected_response:true }...: avg=3.45s min=1.48s med=3.17s max=7.76s p(90)=4.69s p(95)=5.56s http_req_failed................: 0.00% ✓ 0 ✗ 896 http_req_receiving.............: avg=3.41ms min=46.11µs med=205.29µs max=87.47ms p(90)=1.92ms p(95)=12.58ms http_req_sending...............: avg=50.42µs min=9.13µs med=26.76µs max=10.32ms p(90)=42.8µs p(95)=74.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.45s min=1.48s med=3.16s max=7.68s p(90)=4.69s p(95)=5.56s http_reqs......................: 896 28.07453/s iteration_duration.............: avg=3.47s min=1.5s med=3.18s max=7.78s p(90)=4.71s p(95)=5.58s iterations.....................: 896 28.07453/s vus............................: 62 min=62 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1344 ✗ 0 data_received..................: 39 MB 1.1 MB/s data_sent......................: 532 kB 14 kB/s http_req_blocked...............: avg=178.52µs min=1.5µs med=3.98µs max=6.53ms p(90)=548.19µs p(95)=1.15ms http_req_connecting............: avg=138.66µs min=0s med=0s max=6.49ms p(90)=435.56µs p(95)=990.41µs http_req_duration..............: avg=7.55s min=3.19s med=7.71s max=9.34s p(90)=8.78s p(95)=9.02s { expected_response:true }...: avg=7.55s min=3.19s med=7.71s max=9.34s p(90)=8.78s p(95)=9.02s http_req_failed................: 0.00% ✓ 0 ✗ 448 http_req_receiving.............: avg=300.69µs min=67.79µs med=120.6µs max=73.6ms p(90)=187.65µs p(95)=226.58µs http_req_sending...............: avg=98.97µs min=8.32µs med=21.67µs max=3.08ms p(90)=166.72µs p(95)=543.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.55s min=3.19s med=7.71s max=9.34s p(90)=8.78s p(95)=9.02s http_reqs......................: 448 11.980043/s iteration_duration.............: avg=7.55s min=3.2s med=7.72s max=9.35s p(90)=8.78s p(95)=9.03s iterations.....................: 448 11.980043/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 2612ms 172 12067 total, 0 failed avg: 853ms, p95: 2613ms, max: 8698ms, med: 485ms ✅
cosmo 2776ms 166 11632 total, 0 failed avg: 823ms, p95: 2777ms, max: 8836ms, med: 473ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
wundergraph 2996ms 164 11506 total, 0 failed avg: 879ms, p95: 2996ms, max: 11556ms, med: 548ms ✅
mesh-supergraph-bun 5628ms 115 8053 total, 0 failed avg: 2261ms, p95: 5628ms, max: 8986ms, med: 2140ms ✅
mesh-supergraph 6383ms 70 4926 total, 0 failed avg: 3866ms, p95: 6383ms, max: 8154ms, med: 4049ms ✅
apollo-server 24267ms 67 4952 total, 0 failed avg: 4222ms, p95: 24268ms, max: 45192ms, med: 2199ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36201 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 205 kB/s http_req_blocked...............: avg=16.34ms min=1.68µs med=3.19µs max=4.62s p(90)=5.33µs p(95)=12.64µs http_req_connecting............: avg=15.78ms min=0s med=0s max=4.62s p(90)=0s p(95)=0s http_req_duration..............: avg=853.25ms min=6.44ms med=485.23ms max=8.69s p(90)=2.08s p(95)=2.61s { expected_response:true }...: avg=853.25ms min=6.44ms med=485.23ms max=8.69s p(90)=2.08s p(95)=2.61s http_req_failed................: 0.00% ✓ 0 ✗ 12067 http_req_receiving.............: avg=351.86ms min=30.67µs med=83.1µs max=5.77s p(90)=1.34s p(95)=2s http_req_sending...............: avg=32.87ms min=8.39µs med=14.94µs max=5.58s p(90)=211.78µs p(95)=49.7ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=468.51ms min=6.35ms med=336.35ms max=2.62s p(90)=1.04s p(95)=1.28s http_reqs......................: 12067 172.360879/s iteration_duration.............: avg=1.52s min=12.07ms med=969.28ms max=12.76s p(90)=3.59s p(95)=4.69s iterations.....................: 12067 172.360879/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 11631 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 11631 / ✗ 1 checks.........................: 99.99% ✓ 34894 ✗ 2 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 197 kB/s http_req_blocked...............: avg=16.85ms min=1.69µs med=3.71µs max=5s p(90)=6.45µs p(95)=15.72µs http_req_connecting............: avg=16.3ms min=0s med=0s max=5s p(90)=0s p(95)=0s http_req_duration..............: avg=822.52ms min=6.99ms med=473.34ms max=8.83s p(90)=2.1s p(95)=2.77s { expected_response:true }...: avg=822.52ms min=6.99ms med=473.34ms max=8.83s p(90)=2.1s p(95)=2.77s http_req_failed................: 0.00% ✓ 0 ✗ 11632 http_req_receiving.............: avg=362.64ms min=29.82µs med=104.88µs max=5.02s p(90)=1.44s p(95)=2.06s http_req_sending...............: avg=41.77ms min=8.97µs med=18.67µs max=5.58s p(90)=274.79µs p(95)=75.82ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=418.1ms min=6.87ms med=342.98ms max=2.23s p(90)=861.36ms p(95)=1.03s http_reqs......................: 11632 166.145262/s iteration_duration.............: avg=1.58s min=12.71ms med=977.5ms max=13.25s p(90)=3.91s p(95)=4.93s iterations.....................: 11632 166.145262/s vus............................: 1 min=1 max=490 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34518 ✗ 0 data_received..................: 1.0 GB 14 MB/s data_sent......................: 14 MB 195 kB/s http_req_blocked...............: avg=20.17ms min=1.62µs med=3.16µs max=5.04s p(90)=5.02µs p(95)=22.09µs http_req_connecting............: avg=16.94ms min=0s med=0s max=5.04s p(90)=0s p(95)=0s http_req_duration..............: avg=878.87ms min=6.48ms med=548.22ms max=11.55s p(90)=2.13s p(95)=2.99s { expected_response:true }...: avg=878.87ms min=6.48ms med=548.22ms max=11.55s p(90)=2.13s p(95)=2.99s http_req_failed................: 0.00% ✓ 0 ✗ 11506 http_req_receiving.............: avg=388.11ms min=34.72µs med=85.84µs max=11.48s p(90)=1.38s p(95)=2.3s http_req_sending...............: avg=54.96ms min=7.7µs med=14.91µs max=6.09s p(90)=11.6ms p(95)=157.56ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=435.8ms min=6.4ms med=353.04ms max=2.61s p(90)=900.6ms p(95)=1.1s http_reqs......................: 11506 164.340718/s iteration_duration.............: avg=1.59s min=11.85ms med=991.09ms max=16.37s p(90)=3.86s p(95)=5.2s iterations.....................: 11506 164.340718/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24159 ✗ 0 data_received..................: 706 MB 10 MB/s data_sent......................: 9.6 MB 137 kB/s http_req_blocked...............: avg=1.99ms min=1.59µs med=3.22µs max=369.81ms p(90)=5.81µs p(95)=229.6µs http_req_connecting............: avg=1.89ms min=0s med=0s max=369.72ms p(90)=0s p(95)=155.53µs http_req_duration..............: avg=2.26s min=5.38ms med=2.13s max=8.98s p(90)=4.17s p(95)=5.62s { expected_response:true }...: avg=2.26s min=5.38ms med=2.13s max=8.98s p(90)=4.17s p(95)=5.62s http_req_failed................: 0.00% ✓ 0 ✗ 8053 http_req_receiving.............: avg=24.26ms min=31.26µs med=79.35µs max=1.26s p(90)=13.89ms p(95)=162.94ms http_req_sending...............: avg=3.33ms min=8.78µs med=15.16µs max=681.38ms p(90)=101.15µs p(95)=10.02ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.23s min=5.2ms med=2.1s max=8.91s p(90)=4.07s p(95)=5.6s http_reqs......................: 8053 115.028343/s iteration_duration.............: avg=2.32s min=10.91ms med=2.18s max=9.36s p(90)=4.2s p(95)=5.73s iterations.....................: 8053 115.028343/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14778 ✗ 0 data_received..................: 432 MB 6.2 MB/s data_sent......................: 5.8 MB 84 kB/s http_req_blocked...............: avg=524.08µs min=1.33µs med=3.51µs max=195.63ms p(90)=131.81µs p(95)=400.76µs http_req_connecting............: avg=501.08µs min=0s med=0s max=195.56ms p(90)=90.27µs p(95)=331.5µs http_req_duration..............: avg=3.86s min=10.57ms med=4.04s max=8.15s p(90)=6s p(95)=6.38s { expected_response:true }...: avg=3.86s min=10.57ms med=4.04s max=8.15s p(90)=6s p(95)=6.38s http_req_failed................: 0.00% ✓ 0 ✗ 4926 http_req_receiving.............: avg=2.69ms min=39.21µs med=96.84µs max=425.37ms p(90)=1.36ms p(95)=9.17ms http_req_sending...............: avg=471.41µs min=7.79µs med=17.5µs max=142.99ms p(90)=49.56µs p(95)=114.97µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.86s min=10.49ms med=4.04s max=8.15s p(90)=5.99s p(95)=6.38s http_reqs......................: 4926 70.355644/s iteration_duration.............: avg=3.89s min=16.62ms med=4.08s max=8.37s p(90)=6.05s p(95)=6.43s iterations.....................: 4926 70.355644/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14856 ✗ 0 data_received..................: 435 MB 5.9 MB/s data_sent......................: 5.9 MB 80 kB/s http_req_blocked...............: avg=91.72µs min=1.34µs med=3.3µs max=30.35ms p(90)=168.85µs p(95)=319.61µs http_req_connecting............: avg=79.09µs min=0s med=0s max=30.28ms p(90)=82.68µs p(95)=238.1µs http_req_duration..............: avg=4.22s min=82.31ms med=2.19s max=45.19s p(90)=3.29s p(95)=24.26s { expected_response:true }...: avg=4.22s min=82.31ms med=2.19s max=45.19s p(90)=3.29s p(95)=24.26s http_req_failed................: 0.00% ✓ 0 ✗ 4952 http_req_receiving.............: avg=234.89µs min=46.15µs med=117.22µs max=161.89ms p(90)=179.17µs p(95)=216.24µs http_req_sending...............: avg=66.45µs min=8.17µs med=16.97µs max=30.52ms p(90)=41.12µs p(95)=62.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.22s min=82.2ms med=2.19s max=45.19s p(90)=3.29s p(95)=24.26s http_reqs......................: 4952 67.634237/s iteration_duration.............: avg=4.23s min=88.74ms med=2.2s max=45.2s p(90)=3.31s p(95)=24.27s iterations.....................: 4952 67.634237/s vus............................: 22 min=22 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview