search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @graphql-mesh/cli to v0.89.6 #412

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/cli (source) 0.89.4 -> 0.89.6 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/cli) ### [`v0.89.6`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0896) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/8518c1ca6a88684b599a1e594a6741447f2ccdb0...@graphql-mesh/cli@0.89.6) ##### Patch Changes - Updated dependencies \[]: - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.6 ### [`v0.89.5`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0895) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/103621c913f20849d97184a1f87a5127a3d8a1ca...8518c1ca6a88684b599a1e594a6741447f2ccdb0) ##### Patch Changes - Updated dependencies \[[`18e0d49`](https://togithub.com/ardatan/graphql-mesh/commit/18e0d495053f0b67fd1ba488270318e5d11309f8)]: - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.5 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.5 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.5

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 177 5400 total, 0 failed avg: 489ms, p95: 661ms ✅
apollo-router 161 4934 total, 0 failed avg: 553ms, p95: 748ms ✅
wundergraph 158 4816 total, 0 failed avg: 558ms, p95: 970ms ✅
mesh-supergraph-bun 97 3006 total, 0 failed avg: 985ms, p95: 1703ms ✅
apollo-server 50 1591 total, 0 failed avg: 1925ms, p95: 2254ms ✅
mercurius 32 987 total, 0 failed avg: 3066ms, p95: 4532ms ✅
mesh-supergraph 30 956 total, 0 failed avg: 3213ms, p95: 5101ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16200 ✗ 0 data_received..................: 474 MB 16 MB/s data_sent......................: 6.4 MB 211 kB/s http_req_blocked...............: avg=41.69µs min=1.23µs med=2.51µs max=68.77ms p(90)=3.7µs p(95)=4.71µs http_req_connecting............: avg=12.65µs min=0s med=0s max=1.88ms p(90)=0s p(95)=0s http_req_duration..............: avg=488.7ms min=21.4ms med=490.63ms max=1.63s p(90)=602.46ms p(95)=661.19ms { expected_response:true }...: avg=488.7ms min=21.4ms med=490.63ms max=1.63s p(90)=602.46ms p(95)=661.19ms http_req_failed................: 0.00% ✓ 0 ✗ 5400 http_req_receiving.............: avg=26.7ms min=36.4µs med=72.79µs max=1.37s p(90)=51.29ms p(95)=193.09ms http_req_sending...............: avg=1.45ms min=7.82µs med=12.61µs max=993ms p(90)=28.99µs p(95)=153.47µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=460.54ms min=15.32ms med=480.58ms max=885.46ms p(90)=568.69ms p(95)=600.33ms http_reqs......................: 5400 177.806564/s iteration_duration.............: avg=559.74ms min=44.92ms med=529.7ms max=2.27s p(90)=752.59ms p(95)=884.29ms iterations.....................: 5400 177.806564/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14802 ✗ 0 data_received..................: 433 MB 14 MB/s data_sent......................: 5.9 MB 192 kB/s http_req_blocked...............: avg=37.71µs min=1.74µs med=3.83µs max=35.19ms p(90)=5.85µs p(95)=7.34µs http_req_connecting............: avg=18.66µs min=0s med=0s max=3.64ms p(90)=0s p(95)=0s http_req_duration..............: avg=552.68ms min=148.63ms med=547.61ms max=1.09s p(90)=694.95ms p(95)=748.04ms { expected_response:true }...: avg=552.68ms min=148.63ms med=547.61ms max=1.09s p(90)=694.95ms p(95)=748.04ms http_req_failed................: 0.00% ✓ 0 ✗ 4934 http_req_receiving.............: avg=13.04ms min=40.54µs med=82.98µs max=844.18ms p(90)=29.35ms p(95)=78.27ms http_req_sending...............: avg=1.15ms min=8.85µs med=19.42µs max=369.88ms p(90)=45.44µs p(95)=258.36µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=538.48ms min=117.01ms med=537.65ms max=971.17ms p(90)=674.51ms p(95)=711.15ms http_reqs......................: 4934 161.951726/s iteration_duration.............: avg=613.4ms min=159.81ms med=597.82ms max=1.82s p(90)=779.66ms p(95)=874.68ms iterations.....................: 4934 161.951726/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14448 ✗ 0 data_received..................: 423 MB 14 MB/s data_sent......................: 5.7 MB 188 kB/s http_req_blocked...............: avg=52.45µs min=1.12µs med=2.8µs max=56.31ms p(90)=4.61µs p(95)=5.87µs http_req_connecting............: avg=33.85µs min=0s med=0s max=5.26ms p(90)=0s p(95)=0s http_req_duration..............: avg=557.99ms min=20.17ms med=530.85ms max=1.86s p(90)=844.87ms p(95)=970.3ms { expected_response:true }...: avg=557.99ms min=20.17ms med=530.85ms max=1.86s p(90)=844.87ms p(95)=970.3ms http_req_failed................: 0.00% ✓ 0 ✗ 4816 http_req_receiving.............: avg=32.11ms min=35.05µs med=83.12µs max=1.25s p(90)=82.2ms p(95)=192.39ms http_req_sending...............: avg=2ms min=7.98µs med=13.49µs max=559.78ms p(90)=38.27µs p(95)=685.35µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=523.88ms min=15.32ms med=505.7ms max=1.4s p(90)=797.28ms p(95)=889.24ms http_reqs......................: 4816 158.407541/s iteration_duration.............: avg=627.68ms min=29.92ms med=588.49ms max=2.62s p(90)=950.83ms p(95)=1.09s iterations.....................: 4816 158.407541/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9018 ✗ 0 data_received..................: 264 MB 8.6 MB/s data_sent......................: 3.6 MB 116 kB/s http_req_blocked...............: avg=61.02µs min=1.25µs med=2.67µs max=9.43ms p(90)=4.26µs p(95)=9.27µs http_req_connecting............: avg=47.58µs min=0s med=0s max=4.16ms p(90)=0s p(95)=0s http_req_duration..............: avg=984.59ms min=345.11ms med=847.46ms max=2.76s p(90)=1.58s p(95)=1.7s { expected_response:true }...: avg=984.59ms min=345.11ms med=847.46ms max=2.76s p(90)=1.58s p(95)=1.7s http_req_failed................: 0.00% ✓ 0 ✗ 3006 http_req_receiving.............: avg=10.72ms min=37.35µs med=90.35µs max=532.82ms p(90)=2.02ms p(95)=47.95ms http_req_sending...............: avg=538.81µs min=7.81µs med=13.29µs max=199.68ms p(90)=40.94µs p(95)=288.21µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=973.33ms min=344.58ms med=841.13ms max=2.75s p(90)=1.57s p(95)=1.68s http_reqs......................: 3006 97.912159/s iteration_duration.............: avg=1.01s min=354.48ms med=870.63ms max=2.77s p(90)=1.6s p(95)=1.73s iterations.....................: 3006 97.912159/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4773 ✗ 0 data_received..................: 140 MB 4.5 MB/s data_sent......................: 1.9 MB 60 kB/s http_req_blocked...............: avg=77.84µs min=1.46µs med=2.82µs max=3.19ms p(90)=4.7µs p(95)=191.68µs http_req_connecting............: avg=67.97µs min=0s med=0s max=3.16ms p(90)=0s p(95)=139.81µs http_req_duration..............: avg=1.92s min=734.01ms med=1.65s max=20.13s p(90)=1.92s p(95)=2.25s { expected_response:true }...: avg=1.92s min=734.01ms med=1.65s max=20.13s p(90)=1.92s p(95)=2.25s http_req_failed................: 0.00% ✓ 0 ✗ 1591 http_req_receiving.............: avg=236.12µs min=41.35µs med=120.03µs max=46.03ms p(90)=182.89µs p(95)=219.9µs http_req_sending...............: avg=108.77µs min=8.64µs med=14.68µs max=4.69ms p(90)=31.76µs p(95)=286.38µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.92s min=733.88ms med=1.65s max=20.13s p(90)=1.92s p(95)=2.25s http_reqs......................: 1591 50.691294/s iteration_duration.............: avg=1.93s min=744.5ms med=1.66s max=20.14s p(90)=1.94s p(95)=2.26s iterations.....................: 1591 50.691294/s vus............................: 39 min=39 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2961 ✗ 0 data_received..................: 87 MB 2.8 MB/s data_sent......................: 1.2 MB 38 kB/s http_req_blocked...............: avg=236.38µs min=1.75µs med=3.61µs max=11.78ms p(90)=108.16µs p(95)=629.68µs http_req_connecting............: avg=228.4µs min=0s med=0s max=11.74ms p(90)=77.65µs p(95)=595.32µs http_req_duration..............: avg=3.06s min=453.16ms med=2.86s max=7.92s p(90)=4.11s p(95)=4.53s { expected_response:true }...: avg=3.06s min=453.16ms med=2.86s max=7.92s p(90)=4.11s p(95)=4.53s http_req_failed................: 0.00% ✓ 0 ✗ 987 http_req_receiving.............: avg=290.22µs min=43.7µs med=117.46µs max=66.33ms p(90)=187.81µs p(95)=258.52µs http_req_sending...............: avg=152.97µs min=9.04µs med=19.25µs max=19.16ms p(90)=34.98µs p(95)=825.08µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.06s min=452.75ms med=2.86s max=7.91s p(90)=4.11s p(95)=4.53s http_reqs......................: 987 32.202225/s iteration_duration.............: avg=3.07s min=463.99ms med=2.87s max=7.93s p(90)=4.12s p(95)=4.54s iterations.....................: 987 32.202225/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2868 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=147.22µs min=1.49µs med=3.93µs max=9.48ms p(90)=96.45µs p(95)=1.14ms http_req_connecting............: avg=130.59µs min=0s med=0s max=9.45ms p(90)=68.17µs p(95)=1ms http_req_duration..............: avg=3.21s min=1.26s med=2.96s max=7.56s p(90)=4.28s p(95)=5.1s { expected_response:true }...: avg=3.21s min=1.26s med=2.96s max=7.56s p(90)=4.28s p(95)=5.1s http_req_failed................: 0.00% ✓ 0 ✗ 956 http_req_receiving.............: avg=3.45ms min=40.77µs med=157.12µs max=106.94ms p(90)=1.61ms p(95)=13.1ms http_req_sending...............: avg=117.21µs min=7.62µs med=21.74µs max=18.31ms p(90)=82.36µs p(95)=610.5µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.2s min=1.26s med=2.96s max=7.56s p(90)=4.28s p(95)=5.09s http_reqs......................: 956 30.277193/s iteration_duration.............: avg=3.22s min=1.27s med=2.97s max=7.57s p(90)=4.3s p(95)=5.11s iterations.....................: 956 30.277193/s vus............................: 47 min=47 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 148 4566 total, 0 failed avg: 614ms, p95: 793ms ✅
wundergraph 104 3202 total, 0 failed avg: 908ms, p95: 1136ms ✅
cosmo 82 2534 total, 0 failed avg: 1173ms, p95: 1378ms ✅
mesh-supergraph-bun 82 2583 total, 0 failed avg: 1155ms, p95: 1666ms ✅
apollo-server 47 1480 total, 0 failed avg: 2075ms, p95: 2448ms ✅
mesh-supergraph 29 958 total, 0 failed avg: 3257ms, p95: 5527ms ✅
mercurius 11 440 total, 0 failed avg: 7686ms, p95: 9172ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13698 ✗ 0 data_received..................: 401 MB 13 MB/s data_sent......................: 5.4 MB 177 kB/s http_req_blocked...............: avg=40.12µs min=1.32µs med=2.79µs max=9.99ms p(90)=4.37µs p(95)=5.65µs http_req_connecting............: avg=33.3µs min=0s med=0s max=9.89ms p(90)=0s p(95)=0s http_req_duration..............: avg=613.95ms min=289.18ms med=609.19ms max=1.07s p(90)=745.36ms p(95)=792.77ms { expected_response:true }...: avg=613.95ms min=289.18ms med=609.19ms max=1.07s p(90)=745.36ms p(95)=792.77ms http_req_failed................: 0.00% ✓ 0 ✗ 4566 http_req_receiving.............: avg=10.56ms min=33.67µs med=68.8µs max=342.71ms p(90)=34.99ms p(95)=78.95ms http_req_sending...............: avg=1.16ms min=8.16µs med=13.35µs max=216.82ms p(90)=34.96µs p(95)=510.16µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=602.21ms min=289.07ms med=599.47ms max=1.03s p(90)=730.27ms p(95)=774.98ms http_reqs......................: 4566 148.856862/s iteration_duration.............: avg=665.64ms min=306.57ms med=654.08ms max=1.43s p(90)=819.78ms p(95)=886.67ms iterations.....................: 4566 148.856862/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9606 ✗ 0 data_received..................: 281 MB 9.1 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=152.58µs min=1.17µs med=2.95µs max=12.77ms p(90)=4.92µs p(95)=8.66µs http_req_connecting............: avg=144µs min=0s med=0s max=12.03ms p(90)=0s p(95)=0s http_req_duration..............: avg=908.36ms min=555.43ms med=892.85ms max=1.55s p(90)=1.06s p(95)=1.13s { expected_response:true }...: avg=908.36ms min=555.43ms med=892.85ms max=1.55s p(90)=1.06s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3202 http_req_receiving.............: avg=8.85ms min=36.78µs med=90.93µs max=290.35ms p(90)=26.62ms p(95)=61.63ms http_req_sending...............: avg=1.34ms min=7.34µs med=13.86µs max=234.09ms p(90)=71.73µs p(95)=486.68µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=898.16ms min=555.36ms med=883.05ms max=1.45s p(90)=1.05s p(95)=1.12s http_reqs......................: 3202 104.082339/s iteration_duration.............: avg=946.9ms min=573.3ms med=926.11ms max=1.58s p(90)=1.12s p(95)=1.18s iterations.....................: 3202 104.082339/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7602 ✗ 0 data_received..................: 222 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=59.5µs min=1.3µs med=2.46µs max=36.78ms p(90)=3.79µs p(95)=9.17µs http_req_connecting............: avg=27.89µs min=0s med=0s max=3.8ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=758.25ms med=1.17s max=1.61s p(90)=1.33s p(95)=1.37s { expected_response:true }...: avg=1.17s min=758.25ms med=1.17s max=1.61s p(90)=1.33s p(95)=1.37s http_req_failed................: 0.00% ✓ 0 ✗ 2534 http_req_receiving.............: avg=6.7ms min=37.65µs med=72.08µs max=192.97ms p(90)=16.47ms p(95)=51.34ms http_req_sending...............: avg=1.24ms min=7.74µs med=12.51µs max=195.03ms p(90)=36.87µs p(95)=412.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=758.08ms med=1.16s max=1.53s p(90)=1.32s p(95)=1.36s http_reqs......................: 2534 82.078903/s iteration_duration.............: avg=1.21s min=795.06ms med=1.21s max=1.62s p(90)=1.38s p(95)=1.43s iterations.....................: 2534 82.078903/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7749 ✗ 0 data_received..................: 227 MB 7.3 MB/s data_sent......................: 3.1 MB 98 kB/s http_req_blocked...............: avg=70.98µs min=1.3µs med=3.02µs max=4.83ms p(90)=5.1µs p(95)=9.6µs http_req_connecting............: avg=66.46µs min=0s med=0s max=4.81ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=573.6ms med=1.1s max=2.96s p(90)=1.5s p(95)=1.66s { expected_response:true }...: avg=1.15s min=573.6ms med=1.1s max=2.96s p(90)=1.5s p(95)=1.66s http_req_failed................: 0.00% ✓ 0 ✗ 2583 http_req_receiving.............: avg=14.05ms min=37.88µs med=88.97µs max=617.58ms p(90)=768.85µs p(95)=36.11ms http_req_sending...............: avg=454.6µs min=8.08µs med=14.48µs max=123.61ms p(90)=43.44µs p(95)=705.08µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=573.3ms med=1.09s max=2.96s p(90)=1.45s p(95)=1.62s http_reqs......................: 2583 82.932279/s iteration_duration.............: avg=1.18s min=584.9ms med=1.13s max=2.97s p(90)=1.54s p(95)=1.69s iterations.....................: 2583 82.932279/s vus............................: 15 min=15 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4440 ✗ 0 data_received..................: 130 MB 4.1 MB/s data_sent......................: 1.8 MB 56 kB/s http_req_blocked...............: avg=70.36µs min=1.55µs med=3.73µs max=4.7ms p(90)=5.73µs p(95)=288.61µs http_req_connecting............: avg=61.66µs min=0s med=0s max=3.75ms p(90)=0s p(95)=246.73µs http_req_duration..............: avg=2.07s min=958.51ms med=1.83s max=14.97s p(90)=2.26s p(95)=2.44s { expected_response:true }...: avg=2.07s min=958.51ms med=1.83s max=14.97s p(90)=2.26s p(95)=2.44s http_req_failed................: 0.00% ✓ 0 ✗ 1480 http_req_receiving.............: avg=247.1µs min=54.16µs med=125.25µs max=54.51ms p(90)=184.85µs p(95)=214.98µs http_req_sending...............: avg=58.11µs min=8.64µs med=19.69µs max=4.17ms p(90)=36.2µs p(95)=197.61µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.07s min=958.36ms med=1.83s max=14.97s p(90)=2.26s p(95)=2.44s http_reqs......................: 1480 47.02456/s iteration_duration.............: avg=2.08s min=964.99ms med=1.84s max=14.98s p(90)=2.27s p(95)=2.46s iterations.....................: 1480 47.02456/s vus............................: 56 min=56 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2874 ✗ 0 data_received..................: 84 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=393.83µs min=1.55µs med=3.78µs max=16.99ms p(90)=133.16µs p(95)=2.67ms http_req_connecting............: avg=317.85µs min=0s med=0s max=16.87ms p(90)=96.37µs p(95)=2.26ms http_req_duration..............: avg=3.25s min=1.79s med=2.99s max=7.62s p(90)=4.61s p(95)=5.52s { expected_response:true }...: avg=3.25s min=1.79s med=2.99s max=7.62s p(90)=4.61s p(95)=5.52s http_req_failed................: 0.00% ✓ 0 ✗ 958 http_req_receiving.............: avg=3.12ms min=44.03µs med=165.28µs max=262.26ms p(90)=963.66µs p(95)=9.9ms http_req_sending...............: avg=279.99µs min=8.14µs med=19.62µs max=8.84ms p(90)=155.01µs p(95)=880.08µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.25s min=1.79s med=2.99s max=7.62s p(90)=4.61s p(95)=5.52s http_reqs......................: 958 29.879497/s iteration_duration.............: avg=3.27s min=1.81s med=3.01s max=7.65s p(90)=4.63s p(95)=5.54s iterations.....................: 958 29.879497/s vus............................: 4 min=4 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1320 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 522 kB 14 kB/s http_req_blocked...............: avg=190.68µs min=2.38µs med=4.97µs max=8.89ms p(90)=471.41µs p(95)=1.14ms http_req_connecting............: avg=167.7µs min=0s med=0s max=8.85ms p(90)=353.29µs p(95)=1.09ms http_req_duration..............: avg=7.68s min=2.87s med=7.86s max=9.36s p(90)=9.03s p(95)=9.17s { expected_response:true }...: avg=7.68s min=2.87s med=7.86s max=9.36s p(90)=9.03s p(95)=9.17s http_req_failed................: 0.00% ✓ 0 ✗ 440 http_req_receiving.............: avg=160.84µs min=75.35µs med=136.89µs max=2.79ms p(90)=191.98µs p(95)=230.72µs http_req_sending...............: avg=93.54µs min=12.39µs med=28.88µs max=1.88ms p(90)=215.98µs p(95)=435.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.68s min=2.87s med=7.86s max=9.36s p(90)=9.03s p(95)=9.17s http_reqs......................: 440 11.766301/s iteration_duration.............: avg=7.69s min=2.87s med=7.87s max=9.37s p(90)=9.04s p(95)=9.18s iterations.....................: 440 11.766301/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 159 4882 total, 0 failed avg: 549ms, p95: 754ms ✅
wundergraph 105 3251 total, 0 failed avg: 899ms, p95: 1083ms ✅
mesh-supergraph-bun 99 3105 total, 0 failed avg: 946ms, p95: 1322ms ✅
cosmo 81 2564 total, 0 failed avg: 1174ms, p95: 1481ms ✅
apollo-server 63 1979 total, 0 failed avg: 1543ms, p95: 1927ms ✅
mesh-supergraph 61 1919 total, 0 failed avg: 1571ms, p95: 2367ms ✅
mercurius 12 478 total, 0 failed avg: 7109ms, p95: 8451ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14646 ✗ 0 data_received..................: 428 MB 14 MB/s data_sent......................: 5.8 MB 189 kB/s http_req_blocked...............: avg=62.5µs min=1.67µs med=3.52µs max=127.68ms p(90)=5.53µs p(95)=6.67µs http_req_connecting............: avg=30.29µs min=0s med=0s max=4.85ms p(90)=0s p(95)=0s http_req_duration..............: avg=548.98ms min=255.34ms med=536.17ms max=1.12s p(90)=689.03ms p(95)=754.19ms { expected_response:true }...: avg=548.98ms min=255.34ms med=536.17ms max=1.12s p(90)=689.03ms p(95)=754.19ms http_req_failed................: 0.00% ✓ 0 ✗ 4882 http_req_receiving.............: avg=21.6ms min=38.13µs med=87.8µs max=443.32ms p(90)=75.26ms p(95)=137.74ms http_req_sending...............: avg=1.62ms min=9.61µs med=16.63µs max=382.34ms p(90)=55.07µs p(95)=201.36µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=525.76ms min=255.24ms med=522.13ms max=906.68ms p(90)=645.57ms p(95)=692.26ms http_reqs......................: 4882 159.539641/s iteration_duration.............: avg=619.82ms min=314.39ms med=604.03ms max=1.22s p(90)=800.31ms p(95)=887.09ms iterations.....................: 4882 159.539641/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9753 ✗ 0 data_received..................: 285 MB 9.3 MB/s data_sent......................: 3.9 MB 126 kB/s http_req_blocked...............: avg=30.75µs min=1.31µs med=2.67µs max=7.64ms p(90)=4.02µs p(95)=8.61µs http_req_connecting............: avg=22.17µs min=0s med=0s max=3.57ms p(90)=0s p(95)=0s http_req_duration..............: avg=898.94ms min=560.51ms med=895.39ms max=1.22s p(90)=1.03s p(95)=1.08s { expected_response:true }...: avg=898.94ms min=560.51ms med=895.39ms max=1.22s p(90)=1.03s p(95)=1.08s http_req_failed................: 0.00% ✓ 0 ✗ 3251 http_req_receiving.............: avg=6.14ms min=40.13µs med=75.09µs max=245.91ms p(90)=11.52ms p(95)=51.23ms http_req_sending...............: avg=1.19ms min=7.99µs med=12.97µs max=158.12ms p(90)=35.57µs p(95)=341.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=891.6ms min=559.99ms med=888.68ms max=1.22s p(90)=1.02s p(95)=1.06s http_reqs......................: 3251 105.971306/s iteration_duration.............: avg=935.07ms min=579.81ms med=930.01ms max=1.37s p(90)=1.08s p(95)=1.12s iterations.....................: 3251 105.971306/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9315 ✗ 0 data_received..................: 272 MB 8.8 MB/s data_sent......................: 3.7 MB 119 kB/s http_req_blocked...............: avg=58.84µs min=1.53µs med=3.03µs max=51.5ms p(90)=4.84µs p(95)=10.24µs http_req_connecting............: avg=18.55µs min=0s med=0s max=5.95ms p(90)=0s p(95)=0s http_req_duration..............: avg=945.92ms min=355.82ms med=929.5ms max=2.07s p(90)=1.21s p(95)=1.32s { expected_response:true }...: avg=945.92ms min=355.82ms med=929.5ms max=2.07s p(90)=1.21s p(95)=1.32s http_req_failed................: 0.00% ✓ 0 ✗ 3105 http_req_receiving.............: avg=15.93ms min=38.79µs med=92.51µs max=550.11ms p(90)=19.8ms p(95)=112.33ms http_req_sending...............: avg=582.76µs min=8.31µs med=14.43µs max=137.38ms p(90)=37.07µs p(95)=151.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=929.41ms min=353.37ms med=916.44ms max=1.98s p(90)=1.19s p(95)=1.28s http_reqs......................: 3105 99.802926/s iteration_duration.............: avg=984.67ms min=369.14ms med=963ms max=2.19s p(90)=1.27s p(95)=1.38s iterations.....................: 3105 99.802926/s vus............................: 6 min=6 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7692 ✗ 0 data_received..................: 225 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=236.78µs min=1.35µs med=2.99µs max=7.35ms p(90)=5.05µs p(95)=10.58µs http_req_connecting............: avg=34.57µs min=0s med=0s max=4.94ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=681.29ms med=1.16s max=1.65s p(90)=1.4s p(95)=1.48s { expected_response:true }...: avg=1.17s min=681.29ms med=1.16s max=1.65s p(90)=1.4s p(95)=1.48s http_req_failed................: 0.00% ✓ 0 ✗ 2564 http_req_receiving.............: avg=11.97ms min=38.56µs med=89.58µs max=361.59ms p(90)=35.99ms p(95)=87.5ms http_req_sending...............: avg=1.57ms min=8.34µs med=13.86µs max=194.32ms p(90)=57.55µs p(95)=536.23µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=681.18ms med=1.15s max=1.65s p(90)=1.38s p(95)=1.44s http_reqs......................: 2564 81.55344/s iteration_duration.............: avg=1.21s min=693.41ms med=1.2s max=1.8s p(90)=1.47s p(95)=1.55s iterations.....................: 2564 81.55344/s vus............................: 80 min=80 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5937 ✗ 0 data_received..................: 174 MB 5.6 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=41.36µs min=1.59µs med=3.35µs max=2.45ms p(90)=5.06µs p(95)=93.82µs http_req_connecting............: avg=32.19µs min=0s med=0s max=2.32ms p(90)=0s p(95)=65.45µs http_req_duration..............: avg=1.54s min=770.44ms med=1.47s max=9.61s p(90)=1.78s p(95)=1.92s { expected_response:true }...: avg=1.54s min=770.44ms med=1.47s max=9.61s p(90)=1.78s p(95)=1.92s http_req_failed................: 0.00% ✓ 0 ✗ 1979 http_req_receiving.............: avg=174.36µs min=43.26µs med=115.08µs max=16.09ms p(90)=180.6µs p(95)=244.97µs http_req_sending...............: avg=38.36µs min=9.23µs med=17.65µs max=10.33ms p(90)=33.22µs p(95)=68.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.54s min=769.88ms med=1.47s max=9.61s p(90)=1.78s p(95)=1.92s http_reqs......................: 1979 63.434241/s iteration_duration.............: avg=1.55s min=782.21ms med=1.48s max=9.63s p(90)=1.79s p(95)=1.93s iterations.....................: 1979 63.434241/s vus............................: 34 min=34 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5757 ✗ 0 data_received..................: 168 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=43.92µs min=1.82µs med=3.79µs max=3.44ms p(90)=5.55µs p(95)=97.04µs http_req_connecting............: avg=36.22µs min=0s med=0s max=3.15ms p(90)=0s p(95)=69.63µs http_req_duration..............: avg=1.57s min=586.49ms med=1.53s max=3.72s p(90)=2.13s p(95)=2.36s { expected_response:true }...: avg=1.57s min=586.49ms med=1.53s max=3.72s p(90)=2.13s p(95)=2.36s http_req_failed................: 0.00% ✓ 0 ✗ 1919 http_req_receiving.............: avg=3.14ms min=44.4µs med=115.62µs max=456.94ms p(90)=1.38ms p(95)=7.94ms http_req_sending...............: avg=167.39µs min=9.59µs med=20.08µs max=100.45ms p(90)=38.37µs p(95)=112.84µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.56s min=550.09ms med=1.53s max=3.72s p(90)=2.12s p(95)=2.36s http_reqs......................: 1919 61.831927/s iteration_duration.............: avg=1.59s min=597.08ms med=1.56s max=3.75s p(90)=2.16s p(95)=2.4s iterations.....................: 1919 61.831927/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1434 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 567 kB 15 kB/s http_req_blocked...............: avg=616.08µs min=1.52µs med=3.38µs max=6.54ms p(90)=2.27ms p(95)=4.88ms http_req_connecting............: avg=600µs min=0s med=0s max=6.51ms p(90)=2.25ms p(95)=4.85ms http_req_duration..............: avg=7.1s min=2.78s med=7.37s max=8.79s p(90)=8.23s p(95)=8.45s { expected_response:true }...: avg=7.1s min=2.78s med=7.37s max=8.79s p(90)=8.23s p(95)=8.45s http_req_failed................: 0.00% ✓ 0 ✗ 478 http_req_receiving.............: avg=148.46µs min=56.28µs med=122.92µs max=4.73ms p(90)=191.75µs p(95)=233.98µs http_req_sending...............: avg=75.91µs min=9.5µs med=20.08µs max=592.8µs p(90)=281.79µs p(95)=451.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.1s min=2.78s med=7.36s max=8.79s p(90)=8.23s p(95)=8.45s http_reqs......................: 478 12.751992/s iteration_duration.............: avg=7.11s min=2.78s med=7.38s max=8.79s p(90)=8.24s p(95)=8.45s iterations.....................: 478 12.751992/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2203ms 172 12098 total, 0 failed avg: 804ms, p95: 2204ms, max: 7209ms, med: 569ms ✅
apollo-router 2412ms 168 11787 total, 0 failed avg: 878ms, p95: 2412ms, max: 8206ms, med: 611ms ✅
wundergraph 2956ms 165 11552 total, 0 failed avg: 848ms, p95: 2956ms, max: 8969ms, med: 467ms ✅
mesh-supergraph-bun 5676ms 116 8156 total, 0 failed avg: 2266ms, p95: 5677ms, max: 8990ms, med: 1961ms ✅
mesh-supergraph 6833ms 69 4894 total, 0 failed avg: 3899ms, p95: 6833ms, max: 8952ms, med: 3833ms ✅
apollo-server 24959ms 66 4861 total, 0 failed avg: 4307ms, p95: 24959ms, max: 45548ms, med: 2222ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36294 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 205 kB/s http_req_blocked...............: avg=16.05ms min=1.59µs med=3.16µs max=3.44s p(90)=5.38µs p(95)=12.56µs http_req_connecting............: avg=15.22ms min=0s med=0s max=3.1s p(90)=0s p(95)=0s http_req_duration..............: avg=804.01ms min=7.13ms med=569.17ms max=7.2s p(90)=1.69s p(95)=2.2s { expected_response:true }...: avg=804.01ms min=7.13ms med=569.17ms max=7.2s p(90)=1.69s p(95)=2.2s http_req_failed................: 0.00% ✓ 0 ✗ 12098 http_req_receiving.............: avg=300.57ms min=31.24µs med=94.65µs max=4.92s p(90)=1.07s p(95)=1.53s http_req_sending...............: avg=40.71ms min=7.85µs med=14.44µs max=4.88s p(90)=434.98µs p(95)=82.75ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=462.72ms min=7.03ms med=367.2ms max=2.18s p(90)=1.01s p(95)=1.21s http_reqs......................: 12098 172.824346/s iteration_duration.............: avg=1.53s min=14.22ms med=1.03s max=11.3s p(90)=3.54s p(95)=4.55s iterations.....................: 12098 172.824346/s vus............................: 2 min=2 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35361 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 200 kB/s http_req_blocked...............: avg=17.36ms min=1.49µs med=3.5µs max=5.21s p(90)=5.81µs p(95)=15.72µs http_req_connecting............: avg=16.64ms min=0s med=0s max=3.48s p(90)=0s p(95)=0s http_req_duration..............: avg=878.36ms min=7.6ms med=611.09ms max=8.2s p(90)=1.97s p(95)=2.41s { expected_response:true }...: avg=878.36ms min=7.6ms med=611.09ms max=8.2s p(90)=1.97s p(95)=2.41s http_req_failed................: 0.00% ✓ 0 ✗ 11787 http_req_receiving.............: avg=264.08ms min=32.73µs med=85.05µs max=5.05s p(90)=1.13s p(95)=1.5s http_req_sending...............: avg=40.55ms min=7.87µs med=16.99µs max=3.97s p(90)=390.08µs p(95)=108.98ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=573.73ms min=7.51ms med=464.91ms max=2.89s p(90)=1.18s p(95)=1.48s http_reqs......................: 11787 168.368778/s iteration_duration.............: avg=1.55s min=13.91ms med=1.07s max=12.39s p(90)=3.63s p(95)=4.42s iterations.....................: 11787 168.368778/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34656 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 196 kB/s http_req_blocked...............: avg=18.43ms min=1.53µs med=3.25µs max=5.42s p(90)=5.37µs p(95)=19.49µs http_req_connecting............: avg=15.74ms min=0s med=0s max=4.65s p(90)=0s p(95)=0s http_req_duration..............: avg=848.42ms min=6.18ms med=466.72ms max=8.96s p(90)=2.21s p(95)=2.95s { expected_response:true }...: avg=848.42ms min=6.18ms med=466.72ms max=8.96s p(90)=2.21s p(95)=2.95s http_req_failed................: 0.00% ✓ 0 ✗ 11552 http_req_receiving.............: avg=380.72ms min=33.69µs med=86.6µs max=8.58s p(90)=1.57s p(95)=2.25s http_req_sending...............: avg=41.36ms min=8.22µs med=15.12µs max=4.66s p(90)=615.85µs p(95)=63.6ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=426.33ms min=6.12ms med=304.29ms max=2.94s p(90)=960.73ms p(95)=1.18s http_reqs......................: 11552 165.000846/s iteration_duration.............: avg=1.6s min=11.81ms med=940.61ms max=13.92s p(90)=4.06s p(95)=5.06s iterations.....................: 11552 165.000846/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24468 ✗ 0 data_received..................: 716 MB 10 MB/s data_sent......................: 9.7 MB 138 kB/s http_req_blocked...............: avg=1.73ms min=1.48µs med=3.31µs max=417.8ms p(90)=6.02µs p(95)=217.67µs http_req_connecting............: avg=1.7ms min=0s med=0s max=417.74ms p(90)=0s p(95)=148.33µs http_req_duration..............: avg=2.26s min=6.1ms med=1.96s max=8.98s p(90)=4.2s p(95)=5.67s { expected_response:true }...: avg=2.26s min=6.1ms med=1.96s max=8.98s p(90)=4.2s p(95)=5.67s http_req_failed................: 0.00% ✓ 0 ✗ 8156 http_req_receiving.............: avg=28.38ms min=34.95µs med=81.28µs max=1.41s p(90)=52.79ms p(95)=192.9ms http_req_sending...............: avg=2.88ms min=8.67µs med=15.24µs max=538.15ms p(90)=81.03µs p(95)=4.95ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.23s min=5.94ms med=1.92s max=8.98s p(90)=4.13s p(95)=5.58s http_reqs......................: 8156 116.509797/s iteration_duration.............: avg=2.32s min=12.51ms med=2.04s max=9.52s p(90)=4.31s p(95)=5.75s iterations.....................: 8156 116.509797/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14682 ✗ 0 data_received..................: 429 MB 6.1 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=589.21µs min=1.35µs med=3.72µs max=138.79ms p(90)=148.36µs p(95)=410.69µs http_req_connecting............: avg=545.83µs min=0s med=0s max=132.08ms p(90)=97.35µs p(95)=344.05µs http_req_duration..............: avg=3.89s min=12.29ms med=3.83s max=8.95s p(90)=6.42s p(95)=6.83s { expected_response:true }...: avg=3.89s min=12.29ms med=3.83s max=8.95s p(90)=6.42s p(95)=6.83s http_req_failed................: 0.00% ✓ 0 ✗ 4894 http_req_receiving.............: avg=2.01ms min=40.95µs med=97.96µs max=637.8ms p(90)=844.21µs p(95)=7.55ms http_req_sending...............: avg=445.76µs min=8.28µs med=19.56µs max=102.85ms p(90)=49.77µs p(95)=117.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.89s min=12.16ms med=3.83s max=8.95s p(90)=6.42s p(95)=6.83s http_reqs......................: 4894 69.898306/s iteration_duration.............: avg=3.93s min=18.47ms med=3.85s max=9.1s p(90)=6.44s p(95)=6.88s iterations.....................: 4894 69.898306/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14583 ✗ 0 data_received..................: 427 MB 5.8 MB/s data_sent......................: 5.8 MB 78 kB/s http_req_blocked...............: avg=91.77µs min=1.71µs med=4.06µs max=40.64ms p(90)=182.59µs p(95)=314.06µs http_req_connecting............: avg=79.42µs min=0s med=0s max=40.57ms p(90)=121.89µs p(95)=237.73µs http_req_duration..............: avg=4.3s min=85.5ms med=2.22s max=45.54s p(90)=3.55s p(95)=24.95s { expected_response:true }...: avg=4.3s min=85.5ms med=2.22s max=45.54s p(90)=3.55s p(95)=24.95s http_req_failed................: 0.00% ✓ 0 ✗ 4861 http_req_receiving.............: avg=376.96µs min=44.35µs med=125.06µs max=165.63ms p(90)=184.43µs p(95)=220.5µs http_req_sending...............: avg=53.71µs min=9.17µs med=22.34µs max=40.84ms p(90)=44.65µs p(95)=63.29µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.3s min=85.34ms med=2.22s max=45.54s p(90)=3.55s p(95)=24.95s http_reqs......................: 4861 66.076793/s iteration_duration.............: avg=4.31s min=96.17ms med=2.23s max=45.56s p(90)=3.56s p(95)=24.96s iterations.....................: 4861 66.076793/s vus............................: 35 min=35 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview