search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @graphql-mesh/cli to v0.89.7 #420

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/cli (source) 0.89.6 -> 0.89.7 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/cli) ### [`v0.89.7`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0897) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/cli@0.89.6...@graphql-mesh/cli@0.89.7) ##### Patch Changes - Updated dependencies \[[`52f74e7`](https://togithub.com/ardatan/graphql-mesh/commit/52f74e75219a32d30dea693a571c64c9c7519eb6)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.5 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.7 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.6 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.6 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.5 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.5

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 173 5282 total, 0 failed avg: 506ms, p95: 665ms ✅
apollo-router 169 5172 total, 0 failed avg: 529ms, p95: 713ms ✅
wundergraph 158 4825 total, 0 failed avg: 529ms, p95: 919ms ✅
mesh-supergraph-bun 97 2995 total, 0 failed avg: 980ms, p95: 1668ms ✅
apollo-server 46 1480 total, 0 failed avg: 2083ms, p95: 2609ms ✅
mercurius 33 1034 total, 0 failed avg: 2936ms, p95: 4182ms ✅
mesh-supergraph 29 934 total, 0 failed avg: 3318ms, p95: 5486ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15846 ✗ 0 data_received..................: 463 MB 15 MB/s data_sent......................: 6.3 MB 206 kB/s http_req_blocked...............: avg=29.86µs min=1.38µs med=2.89µs max=9.03ms p(90)=4.54µs p(95)=5.92µs http_req_connecting............: avg=23.3µs min=0s med=0s max=8.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=505.71ms min=65.5ms med=504.95ms max=1.45s p(90)=607.46ms p(95)=665.48ms { expected_response:true }...: avg=505.71ms min=65.5ms med=504.95ms max=1.45s p(90)=607.46ms p(95)=665.48ms http_req_failed................: 0.00% ✓ 0 ✗ 5282 http_req_receiving.............: avg=22.96ms min=38.61µs med=76.67µs max=1.05s p(90)=48.38ms p(95)=152.34ms http_req_sending...............: avg=1.29ms min=8.29µs med=13.38µs max=516.15ms p(90)=39.21µs p(95)=490.7µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=481.45ms min=38.93ms med=493.78ms max=827.97ms p(90)=577.93ms p(95)=604.64ms http_reqs......................: 5282 173.66772/s iteration_duration.............: avg=572.16ms min=85.28ms med=543.26ms max=2.15s p(90)=739.14ms p(95)=881.72ms iterations.....................: 5282 173.66772/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15516 ✗ 0 data_received..................: 454 MB 15 MB/s data_sent......................: 6.1 MB 201 kB/s http_req_blocked...............: avg=52.56µs min=1.35µs med=2.73µs max=57.8ms p(90)=4.14µs p(95)=5.27µs http_req_connecting............: avg=35.01µs min=0s med=0s max=6.15ms p(90)=0s p(95)=0s http_req_duration..............: avg=528.79ms min=86.11ms med=525.61ms max=1.57s p(90)=661.22ms p(95)=712.87ms { expected_response:true }...: avg=528.79ms min=86.11ms med=525.61ms max=1.57s p(90)=661.22ms p(95)=712.87ms http_req_failed................: 0.00% ✓ 0 ✗ 5172 http_req_receiving.............: avg=14.7ms min=33.81µs med=65.09µs max=1.02s p(90)=20.37ms p(95)=84.82ms http_req_sending...............: avg=1.02ms min=7.82µs med=13.32µs max=344.68ms p(90)=33.88µs p(95)=459.58µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=513.05ms min=86ms med=517.35ms max=847.8ms p(90)=640.08ms p(95)=678.7ms http_reqs......................: 5172 169.31188/s iteration_duration.............: avg=586.83ms min=108.61ms med=565.74ms max=2.27s p(90)=747.46ms p(95)=858.28ms iterations.....................: 5172 169.31188/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14475 ✗ 0 data_received..................: 423 MB 14 MB/s data_sent......................: 5.7 MB 188 kB/s http_req_blocked...............: avg=56.87µs min=1.32µs med=2.69µs max=126.72ms p(90)=3.95µs p(95)=4.95µs http_req_connecting............: avg=19.68µs min=0s med=0s max=3.17ms p(90)=0s p(95)=0s http_req_duration..............: avg=528.92ms min=10.83ms med=506.47ms max=2.18s p(90)=819ms p(95)=918.61ms { expected_response:true }...: avg=528.92ms min=10.83ms med=506.47ms max=2.18s p(90)=819ms p(95)=918.61ms http_req_failed................: 0.00% ✓ 0 ✗ 4825 http_req_receiving.............: avg=36.55ms min=37.44µs med=79.79µs max=1.4s p(90)=93.04ms p(95)=262.3ms http_req_sending...............: avg=2.06ms min=7.28µs med=12.86µs max=462.2ms p(90)=31.53µs p(95)=321.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=490.3ms min=10.76ms med=474.09ms max=1.22s p(90)=762.35ms p(95)=864.86ms http_reqs......................: 4825 158.632809/s iteration_duration.............: avg=626.88ms min=26.6ms med=583.86ms max=2.73s p(90)=975.5ms p(95)=1.15s iterations.....................: 4825 158.632809/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8985 ✗ 0 data_received..................: 263 MB 8.6 MB/s data_sent......................: 3.6 MB 116 kB/s http_req_blocked...............: avg=75.22µs min=1.27µs med=2.8µs max=24.46ms p(90)=4.49µs p(95)=9.94µs http_req_connecting............: avg=61.79µs min=0s med=0s max=4.78ms p(90)=0s p(95)=0s http_req_duration..............: avg=979.5ms min=368.14ms med=845.93ms max=2.51s p(90)=1.55s p(95)=1.66s { expected_response:true }...: avg=979.5ms min=368.14ms med=845.93ms max=2.51s p(90)=1.55s p(95)=1.66s http_req_failed................: 0.00% ✓ 0 ✗ 2995 http_req_receiving.............: avg=12.52ms min=38.34µs med=87.94µs max=728.63ms p(90)=3.64ms p(95)=72.66ms http_req_sending...............: avg=529.54µs min=8.34µs med=13.55µs max=104.08ms p(90)=30.64µs p(95)=168.35µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=966.45ms min=367.25ms med=835.57ms max=2.51s p(90)=1.55s p(95)=1.66s http_reqs......................: 2995 97.922177/s iteration_duration.............: avg=1.01s min=377.26ms med=872.83ms max=2.53s p(90)=1.58s p(95)=1.7s iterations.....................: 2995 97.922177/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4440 ✗ 0 data_received..................: 130 MB 4.1 MB/s data_sent......................: 1.8 MB 56 kB/s http_req_blocked...............: avg=174.39µs min=1.82µs med=4.49µs max=6.3ms p(90)=6.3µs p(95)=1.06ms http_req_connecting............: avg=147.94µs min=0s med=0s max=6.26ms p(90)=0s p(95)=842.8µs http_req_duration..............: avg=2.08s min=869.08ms med=1.67s max=21.38s p(90)=2.2s p(95)=2.6s { expected_response:true }...: avg=2.08s min=869.08ms med=1.67s max=21.38s p(90)=2.2s p(95)=2.6s http_req_failed................: 0.00% ✓ 0 ✗ 1480 http_req_receiving.............: avg=193.84µs min=60.85µs med=140.1µs max=39.22ms p(90)=194.5µs p(95)=217.02µs http_req_sending...............: avg=34.53µs min=9.05µs med=25.29µs max=406.94µs p(90)=40.25µs p(95)=110.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.08s min=868.64ms med=1.67s max=21.38s p(90)=2.2s p(95)=2.6s http_reqs......................: 1480 46.836445/s iteration_duration.............: avg=2.09s min=882.95ms med=1.68s max=21.39s p(90)=2.21s p(95)=2.61s iterations.....................: 1480 46.836445/s vus............................: 57 min=57 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 3102 ✗ 0 data_received..................: 91 MB 2.9 MB/s data_sent......................: 1.2 MB 40 kB/s http_req_blocked...............: avg=40.68µs min=1.57µs med=3.49µs max=1.45ms p(90)=9.02µs p(95)=213.42µs http_req_connecting............: avg=29.9µs min=0s med=0s max=1.38ms p(90)=0s p(95)=164.02µs http_req_duration..............: avg=2.93s min=366.2ms med=2.76s max=7.5s p(90)=3.9s p(95)=4.18s { expected_response:true }...: avg=2.93s min=366.2ms med=2.76s max=7.5s p(90)=3.9s p(95)=4.18s http_req_failed................: 0.00% ✓ 0 ✗ 1034 http_req_receiving.............: avg=218.05µs min=41.56µs med=113.15µs max=81.14ms p(90)=179.64µs p(95)=227.58µs http_req_sending...............: avg=45.1µs min=8.35µs med=19.3µs max=4.2ms p(90)=37.49µs p(95)=137.74µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.93s min=365.73ms med=2.76s max=7.5s p(90)=3.9s p(95)=4.18s http_reqs......................: 1034 33.59604/s iteration_duration.............: avg=2.94s min=375.71ms med=2.77s max=7.51s p(90)=3.92s p(95)=4.19s iterations.....................: 1034 33.59604/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2802 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=126.51µs min=1.46µs med=4.3µs max=9.49ms p(90)=118.45µs p(95)=776.31µs http_req_connecting............: avg=116.44µs min=0s med=0s max=9.46ms p(90)=84.34µs p(95)=703.12µs http_req_duration..............: avg=3.31s min=1.38s med=3.16s max=6.92s p(90)=4.6s p(95)=5.48s { expected_response:true }...: avg=3.31s min=1.38s med=3.16s max=6.92s p(90)=4.6s p(95)=5.48s http_req_failed................: 0.00% ✓ 0 ✗ 934 http_req_receiving.............: avg=3.48ms min=45.94µs med=162.78µs max=404.53ms p(90)=3.21ms p(95)=13.13ms http_req_sending...............: avg=56.55µs min=7.93µs med=23.29µs max=817.98µs p(90)=63.73µs p(95)=331.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.31s min=1.38s med=3.15s max=6.92s p(90)=4.59s p(95)=5.48s http_reqs......................: 934 29.318338/s iteration_duration.............: avg=3.33s min=1.41s med=3.17s max=6.93s p(90)=4.61s p(95)=5.49s iterations.....................: 934 29.318338/s vus............................: 62 min=62 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5057 total, 0 failed avg: 537ms, p95: 713ms ✅
wundergraph 101 3102 total, 0 failed avg: 936ms, p95: 1171ms ✅
mesh-supergraph-bun 99 3063 total, 0 failed avg: 959ms, p95: 1343ms ✅
cosmo 83 2580 total, 0 failed avg: 1147ms, p95: 1404ms ✅
apollo-server 62 1949 total, 0 failed avg: 1559ms, p95: 1891ms ✅
mesh-supergraph 61 1894 total, 0 failed avg: 1585ms, p95: 2418ms ✅
mercurius 12 478 total, 0 failed avg: 7068ms, p95: 8265ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15171 ✗ 0 data_received..................: 444 MB 15 MB/s data_sent......................: 6.0 MB 197 kB/s http_req_blocked...............: avg=35.38µs min=1.43µs med=3.1µs max=61.21ms p(90)=4.87µs p(95)=6.29µs http_req_connecting............: avg=18.23µs min=0s med=0s max=6.75ms p(90)=0s p(95)=0s http_req_duration..............: avg=537.11ms min=232.12ms med=528.8ms max=1.08s p(90)=661.41ms p(95)=712.85ms { expected_response:true }...: avg=537.11ms min=232.12ms med=528.8ms max=1.08s p(90)=661.41ms p(95)=712.85ms http_req_failed................: 0.00% ✓ 0 ✗ 5057 http_req_receiving.............: avg=16.93ms min=37.08µs med=77.21µs max=363.77ms p(90)=63.88ms p(95)=113.08ms http_req_sending...............: avg=1.84ms min=8.13µs med=14.19µs max=274.54ms p(90)=43.8µs p(95)=468.59µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=518.34ms min=232.05ms med=516.55ms max=860.38ms p(90)=628.88ms p(95)=666.98ms http_reqs......................: 5057 165.994518/s iteration_duration.............: avg=598.2ms min=247.86ms med=585.17ms max=1.33s p(90)=755.33ms p(95)=833.35ms iterations.....................: 5057 165.994518/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9306 ✗ 0 data_received..................: 272 MB 8.9 MB/s data_sent......................: 3.7 MB 120 kB/s http_req_blocked...............: avg=57.92µs min=1.35µs med=2.84µs max=7.56ms p(90)=4.44µs p(95)=8.7µs http_req_connecting............: avg=42.87µs min=0s med=0s max=4.32ms p(90)=0s p(95)=0s http_req_duration..............: avg=935.77ms min=631.16ms med=919.74ms max=1.46s p(90)=1.1s p(95)=1.17s { expected_response:true }...: avg=935.77ms min=631.16ms med=919.74ms max=1.46s p(90)=1.1s p(95)=1.17s http_req_failed................: 0.00% ✓ 0 ✗ 3102 http_req_receiving.............: avg=15.11ms min=37.14µs med=87.4µs max=309.32ms p(90)=59.27ms p(95)=105.41ms http_req_sending...............: avg=2.04ms min=8.08µs med=13.5µs max=348.81ms p(90)=48.01µs p(95)=536.47µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=918.62ms min=631.1ms med=909.49ms max=1.3s p(90)=1.07s p(95)=1.14s http_reqs......................: 3102 101.128812/s iteration_duration.............: avg=977.39ms min=653.91ms med=960.57ms max=1.47s p(90)=1.15s p(95)=1.22s iterations.....................: 3102 101.128812/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9189 ✗ 0 data_received..................: 269 MB 8.7 MB/s data_sent......................: 3.6 MB 118 kB/s http_req_blocked...............: avg=123.52µs min=1.76µs med=3.2µs max=5.42ms p(90)=4.91µs p(95)=9.53µs http_req_connecting............: avg=24.68µs min=0s med=0s max=1.89ms p(90)=0s p(95)=0s http_req_duration..............: avg=958.65ms min=376.26ms med=935.03ms max=1.94s p(90)=1.23s p(95)=1.34s { expected_response:true }...: avg=958.65ms min=376.26ms med=935.03ms max=1.94s p(90)=1.23s p(95)=1.34s http_req_failed................: 0.00% ✓ 0 ✗ 3063 http_req_receiving.............: avg=15.43ms min=39.4µs med=90.13µs max=822.86ms p(90)=4.02ms p(95)=68.49ms http_req_sending...............: avg=409.47µs min=9.46µs med=15.04µs max=98.34ms p(90)=43.2µs p(95)=227.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=942.81ms min=375.96ms med=923.4ms max=1.77s p(90)=1.2s p(95)=1.3s http_reqs......................: 3063 99.198935/s iteration_duration.............: avg=993.5ms min=385.94ms med=965.98ms max=2.03s p(90)=1.29s p(95)=1.41s iterations.....................: 3063 99.198935/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7740 ✗ 0 data_received..................: 226 MB 7.3 MB/s data_sent......................: 3.1 MB 99 kB/s http_req_blocked...............: avg=70.67µs min=1.34µs med=2.74µs max=11.43ms p(90)=4.48µs p(95)=9.63µs http_req_connecting............: avg=28.51µs min=0s med=0s max=5.63ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=788.84ms med=1.13s max=1.67s p(90)=1.33s p(95)=1.4s { expected_response:true }...: avg=1.14s min=788.84ms med=1.13s max=1.67s p(90)=1.33s p(95)=1.4s http_req_failed................: 0.00% ✓ 0 ✗ 2580 http_req_receiving.............: avg=9.72ms min=38.63µs med=82.17µs max=295.27ms p(90)=32.26ms p(95)=75.52ms http_req_sending...............: avg=1.87ms min=7.42µs med=13.14µs max=206.92ms p(90)=68.98µs p(95)=669.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=788.77ms med=1.12s max=1.49s p(90)=1.32s p(95)=1.37s http_reqs......................: 2580 83.341374/s iteration_duration.............: avg=1.18s min=798.39ms med=1.17s max=1.7s p(90)=1.36s p(95)=1.44s iterations.....................: 2580 83.341374/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5847 ✗ 0 data_received..................: 171 MB 5.5 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=104.19µs min=1.66µs med=3.89µs max=12.04ms p(90)=5.61µs p(95)=98.7µs http_req_connecting............: avg=77.53µs min=0s med=0s max=5.93ms p(90)=0s p(95)=66.54µs http_req_duration..............: avg=1.55s min=749.1ms med=1.48s max=9.59s p(90)=1.74s p(95)=1.89s { expected_response:true }...: avg=1.55s min=749.1ms med=1.48s max=9.59s p(90)=1.74s p(95)=1.89s http_req_failed................: 0.00% ✓ 0 ✗ 1949 http_req_receiving.............: avg=161.11µs min=53.41µs med=118.3µs max=10.97ms p(90)=182.97µs p(95)=229.28µs http_req_sending...............: avg=149.97µs min=9.26µs med=20.59µs max=17.69ms p(90)=36.5µs p(95)=148.21µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.55s min=748.94ms med=1.48s max=9.59s p(90)=1.74s p(95)=1.89s http_reqs......................: 1949 62.7733/s iteration_duration.............: avg=1.57s min=756.46ms med=1.49s max=9.61s p(90)=1.75s p(95)=1.91s iterations.....................: 1949 62.7733/s vus............................: 6 min=6 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5682 ✗ 0 data_received..................: 166 MB 5.4 MB/s data_sent......................: 2.2 MB 73 kB/s http_req_blocked...............: avg=85.2µs min=1.46µs med=4.43µs max=9.93ms p(90)=6.18µs p(95)=167.52µs http_req_connecting............: avg=72.41µs min=0s med=0s max=6.05ms p(90)=0s p(95)=100.56µs http_req_duration..............: avg=1.58s min=686.56ms med=1.51s max=3.86s p(90)=2.07s p(95)=2.41s { expected_response:true }...: avg=1.58s min=686.56ms med=1.51s max=3.86s p(90)=2.07s p(95)=2.41s http_req_failed................: 0.00% ✓ 0 ✗ 1894 http_req_receiving.............: avg=1.98ms min=42.96µs med=129.48µs max=123.18ms p(90)=2.4ms p(95)=10.41ms http_req_sending...............: avg=145.05µs min=8.78µs med=23.82µs max=86.84ms p(90)=43.02µs p(95)=146.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.58s min=686.47ms med=1.51s max=3.86s p(90)=2.07s p(95)=2.41s http_reqs......................: 1894 61.212759/s iteration_duration.............: avg=1.6s min=765.03ms med=1.53s max=3.89s p(90)=2.11s p(95)=2.43s iterations.....................: 1894 61.212759/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1434 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 567 kB 15 kB/s http_req_blocked...............: avg=559.88µs min=1.38µs med=3.19µs max=7.5ms p(90)=2.39ms p(95)=4.4ms http_req_connecting............: avg=522.22µs min=0s med=0s max=7.44ms p(90)=2.1ms p(95)=4.13ms http_req_duration..............: avg=7.06s min=2.93s med=7.38s max=8.56s p(90)=8.1s p(95)=8.26s { expected_response:true }...: avg=7.06s min=2.93s med=7.38s max=8.56s p(90)=8.1s p(95)=8.26s http_req_failed................: 0.00% ✓ 0 ✗ 478 http_req_receiving.............: avg=142.04µs min=59.81µs med=117.55µs max=7.75ms p(90)=172.39µs p(95)=205.63µs http_req_sending...............: avg=254.07µs min=8.17µs med=19.3µs max=1.77ms p(90)=1.46ms p(95)=1.63ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.06s min=2.93s med=7.37s max=8.56s p(90)=8.1s p(95)=8.26s http_reqs......................: 478 12.833291/s iteration_duration.............: avg=7.07s min=2.94s med=7.38s max=8.57s p(90)=8.11s p(95)=8.27s iterations.....................: 478 12.833291/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4634 total, 0 failed avg: 600ms, p95: 788ms ✅
wundergraph 101 3113 total, 0 failed avg: 945ms, p95: 1177ms ✅
mesh-supergraph-bun 84 2582 total, 0 failed avg: 1149ms, p95: 1699ms ✅
cosmo 78 2442 total, 0 failed avg: 1216ms, p95: 1454ms ✅
apollo-server 47 1486 total, 0 failed avg: 2051ms, p95: 2453ms ✅
mesh-supergraph 29 949 total, 0 failed avg: 3263ms, p95: 5146ms ✅
mercurius 11 450 total, 0 failed avg: 7576ms, p95: 8946ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13902 ✗ 0 data_received..................: 407 MB 13 MB/s data_sent......................: 5.5 MB 179 kB/s http_req_blocked...............: avg=18.34µs min=1.37µs med=2.83µs max=28.22ms p(90)=4.26µs p(95)=5.36µs http_req_connecting............: avg=7.63µs min=0s med=0s max=1.53ms p(90)=0s p(95)=0s http_req_duration..............: avg=600.15ms min=296.03ms med=589.2ms max=1.2s p(90)=739.81ms p(95)=788.41ms { expected_response:true }...: avg=600.15ms min=296.03ms med=589.2ms max=1.2s p(90)=739.81ms p(95)=788.41ms http_req_failed................: 0.00% ✓ 0 ✗ 4634 http_req_receiving.............: avg=12.23ms min=35.72µs med=69.15µs max=349.11ms p(90)=33.59ms p(95)=83.9ms http_req_sending...............: avg=1.06ms min=8.12µs med=13.28µs max=273.67ms p(90)=36.59µs p(95)=167.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=586.86ms min=295.95ms med=579.05ms max=1.1s p(90)=719.89ms p(95)=762.29ms http_reqs......................: 4634 150.974979/s iteration_duration.............: avg=652.31ms min=306.67ms med=633.11ms max=1.32s p(90)=817.73ms p(95)=900.13ms iterations.....................: 4634 150.974979/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9339 ✗ 0 data_received..................: 273 MB 8.9 MB/s data_sent......................: 3.7 MB 120 kB/s http_req_blocked...............: avg=59.7µs min=1.23µs med=2.51µs max=6.62ms p(90)=3.72µs p(95)=8.61µs http_req_connecting............: avg=55.47µs min=0s med=0s max=6.59ms p(90)=0s p(95)=0s http_req_duration..............: avg=944.73ms min=578.62ms med=928.1ms max=1.68s p(90)=1.09s p(95)=1.17s { expected_response:true }...: avg=944.73ms min=578.62ms med=928.1ms max=1.68s p(90)=1.09s p(95)=1.17s http_req_failed................: 0.00% ✓ 0 ✗ 3113 http_req_receiving.............: avg=11.47ms min=39.22µs med=75.5µs max=491.94ms p(90)=39.54ms p(95)=84.84ms http_req_sending...............: avg=1.52ms min=7.32µs med=12.59µs max=351.93ms p(90)=35.67µs p(95)=460.25µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=931.73ms min=578.49ms med=920.32ms max=1.47s p(90)=1.06s p(95)=1.14s http_reqs......................: 3113 101.095831/s iteration_duration.............: avg=981.58ms min=589.39ms med=959.28ms max=1.7s p(90)=1.14s p(95)=1.27s iterations.....................: 3113 101.095831/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7746 ✗ 0 data_received..................: 227 MB 7.4 MB/s data_sent......................: 3.1 MB 100 kB/s http_req_blocked...............: avg=171.64µs min=1.38µs med=2.98µs max=10.57ms p(90)=4.79µs p(95)=10.22µs http_req_connecting............: avg=161.03µs min=0s med=0s max=10.53ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=549.95ms med=1.09s max=4.19s p(90)=1.51s p(95)=1.69s { expected_response:true }...: avg=1.14s min=549.95ms med=1.09s max=4.19s p(90)=1.51s p(95)=1.69s http_req_failed................: 0.00% ✓ 0 ✗ 2582 http_req_receiving.............: avg=14.56ms min=39.47µs med=95.8µs max=682.62ms p(90)=1.67ms p(95)=76.76ms http_req_sending...............: avg=501.23µs min=7.77µs med=14.36µs max=150.1ms p(90)=52.46µs p(95)=277.18µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=549.84ms med=1.08s max=4.19s p(90)=1.48s p(95)=1.68s http_reqs......................: 2582 84.304652/s iteration_duration.............: avg=1.17s min=560.91ms med=1.12s max=4.21s p(90)=1.55s p(95)=1.72s iterations.....................: 2582 84.304652/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7326 ✗ 0 data_received..................: 214 MB 6.8 MB/s data_sent......................: 2.9 MB 93 kB/s http_req_blocked...............: avg=53.15µs min=1.38µs med=2.68µs max=3.62ms p(90)=4.11µs p(95)=9.24µs http_req_connecting............: avg=48.53µs min=0s med=0s max=3.59ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.21s min=843.3ms med=1.22s max=1.71s p(90)=1.39s p(95)=1.45s { expected_response:true }...: avg=1.21s min=843.3ms med=1.22s max=1.71s p(90)=1.39s p(95)=1.45s http_req_failed................: 0.00% ✓ 0 ✗ 2442 http_req_receiving.............: avg=10.47ms min=38.89µs med=82.74µs max=364.73ms p(90)=34.93ms p(95)=69.11ms http_req_sending...............: avg=1.36ms min=7.34µs med=12.98µs max=177.19ms p(90)=49.64µs p(95)=926.76µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.2s min=842.91ms med=1.21s max=1.58s p(90)=1.38s p(95)=1.43s http_reqs......................: 2442 78.077141/s iteration_duration.............: avg=1.25s min=875.14ms med=1.25s max=1.74s p(90)=1.44s p(95)=1.5s iterations.....................: 2442 78.077141/s vus............................: 22 min=22 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4458 ✗ 0 data_received..................: 131 MB 4.2 MB/s data_sent......................: 1.8 MB 56 kB/s http_req_blocked...............: avg=43.12µs min=1.58µs med=3.74µs max=2.73ms p(90)=5.82µs p(95)=183.02µs http_req_connecting............: avg=34.73µs min=0s med=0s max=1.87ms p(90)=0s p(95)=138.12µs http_req_duration..............: avg=2.05s min=990.57ms med=1.84s max=14.47s p(90)=2.25s p(95)=2.45s { expected_response:true }...: avg=2.05s min=990.57ms med=1.84s max=14.47s p(90)=2.25s p(95)=2.45s http_req_failed................: 0.00% ✓ 0 ✗ 1486 http_req_receiving.............: avg=258.54µs min=55.47µs med=124.28µs max=31.36ms p(90)=185.05µs p(95)=220.43µs http_req_sending...............: avg=64.56µs min=9.19µs med=20.65µs max=17.26ms p(90)=37.57µs p(95)=93.67µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.05s min=990.41ms med=1.84s max=14.47s p(90)=2.25s p(95)=2.44s http_reqs......................: 1486 47.529739/s iteration_duration.............: avg=2.06s min=1s med=1.85s max=14.48s p(90)=2.26s p(95)=2.46s iterations.....................: 1486 47.529739/s vus............................: 38 min=38 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2847 ✗ 0 data_received..................: 83 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=491.33µs min=1.45µs med=3.74µs max=12.74ms p(90)=111.52µs p(95)=2.77ms http_req_connecting............: avg=471.76µs min=0s med=0s max=12.71ms p(90)=77.61µs p(95)=1.78ms http_req_duration..............: avg=3.26s min=1.44s med=3.09s max=6.76s p(90)=4.35s p(95)=5.14s { expected_response:true }...: avg=3.26s min=1.44s med=3.09s max=6.76s p(90)=4.35s p(95)=5.14s http_req_failed................: 0.00% ✓ 0 ✗ 949 http_req_receiving.............: avg=3.04ms min=44.76µs med=144.37µs max=87.16ms p(90)=2.56ms p(95)=10.1ms http_req_sending...............: avg=114.69µs min=7.92µs med=20.26µs max=35.55ms p(90)=92.91µs p(95)=304.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.25s min=1.44s med=3.09s max=6.76s p(90)=4.35s p(95)=5.14s http_reqs......................: 949 29.876965/s iteration_duration.............: avg=3.27s min=1.45s med=3.1s max=6.78s p(90)=4.37s p(95)=5.17s iterations.....................: 949 29.876965/s vus............................: 64 min=64 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1350 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 534 kB 14 kB/s http_req_blocked...............: avg=322.95µs min=1.82µs med=4.26µs max=6.19ms p(90)=1.27ms p(95)=2.43ms http_req_connecting............: avg=310.28µs min=0s med=0s max=6.15ms p(90)=1.23ms p(95)=2.39ms http_req_duration..............: avg=7.57s min=3.54s med=7.71s max=9.26s p(90)=8.84s p(95)=8.94s { expected_response:true }...: avg=7.57s min=3.54s med=7.71s max=9.26s p(90)=8.84s p(95)=8.94s http_req_failed................: 0.00% ✓ 0 ✗ 450 http_req_receiving.............: avg=341.94µs min=60.08µs med=127.51µs max=82.51ms p(90)=196.46µs p(95)=222.81µs http_req_sending...............: avg=118.45µs min=9.25µs med=22.91µs max=2.18ms p(90)=399.79µs p(95)=614.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.57s min=3.54s med=7.71s max=9.26s p(90)=8.84s p(95)=8.94s http_reqs......................: 450 11.965849/s iteration_duration.............: avg=7.58s min=3.55s med=7.72s max=9.26s p(90)=8.85s p(95)=8.95s iterations.....................: 450 11.965849/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2141ms 175 12275 total, 0 failed avg: 745ms, p95: 2142ms, max: 6726ms, med: 505ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
apollo-router 2430ms 174 12242 total, 0 failed avg: 755ms, p95: 2430ms, max: 7012ms, med: 510ms ✅
wundergraph 2910ms 159 11196 total, 0 failed avg: 882ms, p95: 2910ms, max: 9918ms, med: 480ms ✅
mesh-supergraph-bun 5377ms 117 8255 total, 0 failed avg: 2214ms, p95: 5377ms, max: 9102ms, med: 2044ms ✅
mesh-supergraph 6441ms 69 4890 total, 0 failed avg: 3879ms, p95: 6442ms, max: 7888ms, med: 4063ms ✅
apollo-server 24715ms 66 4904 total, 0 failed avg: 4275ms, p95: 24716ms, max: 45541ms, med: 2251ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12274 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 12274 / ✗ 1 checks.........................: 99.99% ✓ 36823 ✗ 2 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=13.66ms min=1.46µs med=3.16µs max=2.43s p(90)=5.26µs p(95)=12.97µs http_req_connecting............: avg=12.73ms min=0s med=0s max=2.43s p(90)=0s p(95)=0s http_req_duration..............: avg=745.2ms min=6.66ms med=504.92ms max=6.72s p(90)=1.76s p(95)=2.14s { expected_response:true }...: avg=745.2ms min=6.66ms med=504.92ms max=6.72s p(90)=1.76s p(95)=2.14s http_req_failed................: 0.00% ✓ 0 ✗ 12275 http_req_receiving.............: avg=264.54ms min=28.27µs med=84.39µs max=6.34s p(90)=1.05s p(95)=1.54s http_req_sending...............: avg=37.54ms min=7.95µs med=14.37µs max=3.36s p(90)=1.64ms p(95)=114.31ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=443.11ms min=6.56ms med=342.94ms max=2.4s p(90)=919.8ms p(95)=1.17s http_reqs......................: 12275 175.353558/s iteration_duration.............: avg=1.48s min=12.11ms med=987.82ms max=11.11s p(90)=3.46s p(95)=4.38s iterations.....................: 12275 175.353558/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36726 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=14.44ms min=1.54µs med=3.05µs max=3.64s p(90)=5.13µs p(95)=12.67µs http_req_connecting............: avg=13.9ms min=0s med=0s max=3.63s p(90)=0s p(95)=0s http_req_duration..............: avg=754.59ms min=6.08ms med=510.05ms max=7.01s p(90)=1.73s p(95)=2.43s { expected_response:true }...: avg=754.59ms min=6.08ms med=510.05ms max=7.01s p(90)=1.73s p(95)=2.43s http_req_failed................: 0.00% ✓ 0 ✗ 12242 http_req_receiving.............: avg=301.17ms min=31.69µs med=82.94µs max=5.76s p(90)=1.11s p(95)=1.64s http_req_sending...............: avg=23.14ms min=7.58µs med=14.22µs max=4.71s p(90)=142.29µs p(95)=25.8ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=430.28ms min=6.01ms med=364.51ms max=2.46s p(90)=836.04ms p(95)=1.01s http_reqs......................: 12242 174.856172/s iteration_duration.............: avg=1.5s min=11.58ms med=903.44ms max=12.41s p(90)=3.8s p(95)=4.87s iterations.....................: 12242 174.856172/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 33588 ✗ 0 data_received..................: 982 MB 14 MB/s data_sent......................: 13 MB 190 kB/s http_req_blocked...............: avg=19.45ms min=1.69µs med=3.7µs max=5.91s p(90)=5.96µs p(95)=26.43µs http_req_connecting............: avg=18.97ms min=0s med=0s max=5.91s p(90)=0s p(95)=0s http_req_duration..............: avg=881.72ms min=6.38ms med=480.42ms max=9.91s p(90)=2.27s p(95)=2.91s { expected_response:true }...: avg=881.72ms min=6.38ms med=480.42ms max=9.91s p(90)=2.27s p(95)=2.91s http_req_failed................: 0.00% ✓ 0 ✗ 11196 http_req_receiving.............: avg=407.97ms min=34.99µs med=98.5µs max=9.04s p(90)=1.7s p(95)=2.21s http_req_sending...............: avg=37.42ms min=7.91µs med=18.69µs max=6s p(90)=374.43µs p(95)=72.99ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=436.31ms min=6.27ms med=337.8ms max=2.21s p(90)=964.48ms p(95)=1.17s http_reqs......................: 11196 159.911768/s iteration_duration.............: avg=1.66s min=11.86ms med=966.1ms max=14.28s p(90)=4.12s p(95)=5.37s iterations.....................: 11196 159.911768/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24765 ✗ 0 data_received..................: 724 MB 10 MB/s data_sent......................: 9.8 MB 140 kB/s http_req_blocked...............: avg=2.04ms min=1.33µs med=2.89µs max=499.31ms p(90)=5.02µs p(95)=221.64µs http_req_connecting............: avg=1.94ms min=0s med=0s max=499.23ms p(90)=0s p(95)=149.05µs http_req_duration..............: avg=2.21s min=4.85ms med=2.04s max=9.1s p(90)=4.05s p(95)=5.37s { expected_response:true }...: avg=2.21s min=4.85ms med=2.04s max=9.1s p(90)=4.05s p(95)=5.37s http_req_failed................: 0.00% ✓ 0 ✗ 8255 http_req_receiving.............: avg=22.19ms min=35.48µs med=76.66µs max=1.51s p(90)=15.49ms p(95)=167.13ms http_req_sending...............: avg=2.57ms min=8.41µs med=13.71µs max=524.95ms p(90)=80.8µs p(95)=9.3ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.18s min=4.66ms med=2.02s max=9.1s p(90)=4.01s p(95)=5.35s http_reqs......................: 8255 117.914539/s iteration_duration.............: avg=2.28s min=10.21ms med=2.1s max=9.51s p(90)=4.13s p(95)=5.51s iterations.....................: 8255 117.914539/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14670 ✗ 0 data_received..................: 429 MB 6.1 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=505.86µs min=1.38µs med=3.86µs max=233.1ms p(90)=168.83µs p(95)=428µs http_req_connecting............: avg=410.58µs min=0s med=0s max=233.02ms p(90)=111.08µs p(95)=361.25µs http_req_duration..............: avg=3.87s min=10.23ms med=4.06s max=7.88s p(90)=6.06s p(95)=6.44s { expected_response:true }...: avg=3.87s min=10.23ms med=4.06s max=7.88s p(90)=6.06s p(95)=6.44s http_req_failed................: 0.00% ✓ 0 ✗ 4890 http_req_receiving.............: avg=3.22ms min=37.47µs med=101.27µs max=587.88ms p(90)=1.18ms p(95)=8.96ms http_req_sending...............: avg=447.55µs min=8.18µs med=20.58µs max=149.78ms p(90)=50.25µs p(95)=115.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.87s min=10.13ms med=4.05s max=7.88s p(90)=6.06s p(95)=6.44s http_reqs......................: 4890 69.84353/s iteration_duration.............: avg=3.9s min=16.14ms med=4.08s max=7.89s p(90)=6.1s p(95)=6.47s iterations.....................: 4890 69.84353/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14712 ✗ 0 data_received..................: 431 MB 5.9 MB/s data_sent......................: 5.8 MB 79 kB/s http_req_blocked...............: avg=83.85µs min=1.68µs med=4.02µs max=37.26ms p(90)=121.15µs p(95)=294.01µs http_req_connecting............: avg=72.17µs min=0s med=0s max=37.19ms p(90)=86.6µs p(95)=215.43µs http_req_duration..............: avg=4.27s min=113.6ms med=2.25s max=45.54s p(90)=3.67s p(95)=24.71s { expected_response:true }...: avg=4.27s min=113.6ms med=2.25s max=45.54s p(90)=3.67s p(95)=24.71s http_req_failed................: 0.00% ✓ 0 ✗ 4904 http_req_receiving.............: avg=425.36µs min=50.51µs med=124.81µs max=228.75ms p(90)=186.34µs p(95)=223.49µs http_req_sending...............: avg=65.79µs min=8.73µs med=21.97µs max=32.09ms p(90)=47.01µs p(95)=66.78µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.27s min=113.48ms med=2.25s max=45.54s p(90)=3.67s p(95)=24.71s http_reqs......................: 4904 66.832368/s iteration_duration.............: avg=4.28s min=120.67ms med=2.26s max=45.56s p(90)=3.68s p(95)=24.72s iterations.....................: 4904 66.832368/s vus............................: 35 min=35 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview