search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update dependency @graphql-mesh/graphql to v0.97.5 #421

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/graphql (source) 0.97.4 -> 0.97.5 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/graphql) ### [`v0.97.5`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/graphql/CHANGELOG.md#0975) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/103621c913f20849d97184a1f87a5127a3d8a1ca...@graphql-mesh/graphql@0.97.5) ##### Patch Changes - Updated dependencies \[[`52f74e7`](https://togithub.com/ardatan/graphql-mesh/commit/52f74e75219a32d30dea693a571c64c9c7519eb6)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.5 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.5 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.5

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 155 4736 total, 0 failed avg: 591ms, p95: 777ms ✅
wundergraph 103 3173 total, 0 failed avg: 926ms, p95: 1156ms ✅
cosmo 82 2564 total, 0 failed avg: 1163ms, p95: 1367ms ✅
mesh-supergraph-bun 67 2072 total, 0 failed avg: 1419ms, p95: 2378ms ✅
apollo-server 49 1560 total, 0 failed avg: 1991ms, p95: 2305ms ✅
mesh-supergraph 29 936 total, 0 failed avg: 3296ms, p95: 5162ms ✅
mercurius 12 449 total, 0 failed avg: 7536ms, p95: 9021ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14208 ✗ 0 data_received..................: 416 MB 14 MB/s data_sent......................: 5.6 MB 184 kB/s http_req_blocked...............: avg=62.72µs min=1.34µs med=2.56µs max=213.65ms p(90)=3.82µs p(95)=4.75µs http_req_connecting............: avg=13.71µs min=0s med=0s max=2.04ms p(90)=0s p(95)=0s http_req_duration..............: avg=590.55ms min=301.17ms med=577.93ms max=1.11s p(90)=721.24ms p(95)=776.64ms { expected_response:true }...: avg=590.55ms min=301.17ms med=577.93ms max=1.11s p(90)=721.24ms p(95)=776.64ms http_req_failed................: 0.00% ✓ 0 ✗ 4736 http_req_receiving.............: avg=9.09ms min=37.11µs med=63.25µs max=333.95ms p(90)=22.34ms p(95)=66.34ms http_req_sending...............: avg=1.05ms min=8.04µs med=12.83µs max=202.69ms p(90)=29.49µs p(95)=169.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=580.4ms min=291.94ms med=571.58ms max=954.07ms p(90)=701.38ms p(95)=759.02ms http_reqs......................: 4736 155.362824/s iteration_duration.............: avg=639.22ms min=311.92ms med=621.04ms max=1.31s p(90)=801.66ms p(95)=888.35ms iterations.....................: 4736 155.362824/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9519 ✗ 0 data_received..................: 278 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=32.7µs min=1.3µs med=2.49µs max=7.62ms p(90)=3.79µs p(95)=7.61µs http_req_connecting............: avg=24.6µs min=0s med=0s max=1.91ms p(90)=0s p(95)=0s http_req_duration..............: avg=925.83ms min=599.95ms med=915.54ms max=1.5s p(90)=1.07s p(95)=1.15s { expected_response:true }...: avg=925.83ms min=599.95ms med=915.54ms max=1.5s p(90)=1.07s p(95)=1.15s http_req_failed................: 0.00% ✓ 0 ✗ 3173 http_req_receiving.............: avg=8.17ms min=38.84µs med=78.53µs max=224.59ms p(90)=27.63ms p(95)=60.54ms http_req_sending...............: avg=1.28ms min=7.55µs med=12.61µs max=162.02ms p(90)=63.21µs p(95)=669.28µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=916.37ms min=599.47ms med=909.67ms max=1.39s p(90)=1.06s p(95)=1.14s http_reqs......................: 3173 103.063585/s iteration_duration.............: avg=959.73ms min=622.66ms med=944.76ms max=1.53s p(90)=1.13s p(95)=1.19s iterations.....................: 3173 103.063585/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7692 ✗ 0 data_received..................: 225 MB 7.2 MB/s data_sent......................: 3.0 MB 98 kB/s http_req_blocked...............: avg=37.93µs min=1.27µs med=2.42µs max=5.59ms p(90)=3.72µs p(95)=8.91µs http_req_connecting............: avg=28.45µs min=0s med=0s max=5.55ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=728.59ms med=1.15s max=1.66s p(90)=1.32s p(95)=1.36s { expected_response:true }...: avg=1.16s min=728.59ms med=1.15s max=1.66s p(90)=1.32s p(95)=1.36s http_req_failed................: 0.00% ✓ 0 ✗ 2564 http_req_receiving.............: avg=6.64ms min=37.26µs med=70.95µs max=271.92ms p(90)=9.28ms p(95)=48.32ms http_req_sending...............: avg=1.06ms min=7.77µs med=12.51µs max=185.73ms p(90)=43.38µs p(95)=358.26µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=728.5ms med=1.14s max=1.51s p(90)=1.31s p(95)=1.35s http_reqs......................: 2564 82.575536/s iteration_duration.............: avg=1.19s min=738.77ms med=1.18s max=1.67s p(90)=1.36s p(95)=1.41s iterations.....................: 2564 82.575536/s vus............................: 1 min=1 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6216 ✗ 0 data_received..................: 182 MB 5.9 MB/s data_sent......................: 2.5 MB 80 kB/s http_req_blocked...............: avg=127.13µs min=1.46µs med=4.01µs max=23.14ms p(90)=6.55µs p(95)=81.61µs http_req_connecting............: avg=107.34µs min=0s med=0s max=6.37ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.41s min=513.71ms med=1.34s max=3.68s p(90)=1.96s p(95)=2.37s { expected_response:true }...: avg=1.41s min=513.71ms med=1.34s max=3.68s p(90)=1.96s p(95)=2.37s http_req_failed................: 0.00% ✓ 0 ✗ 2072 http_req_receiving.............: avg=23.34ms min=39.86µs med=108.18µs max=921.98ms p(90)=18.92ms p(95)=143.22ms http_req_sending...............: avg=520.6µs min=8.14µs med=19.68µs max=83.38ms p(90)=109.45µs p(95)=460.47µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.39s min=513.55ms med=1.32s max=3.48s p(90)=1.9s p(95)=2.36s http_reqs......................: 2072 67.204202/s iteration_duration.............: avg=1.46s min=594.3ms med=1.39s max=3.7s p(90)=2.01s p(95)=2.41s iterations.....................: 2072 67.204202/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4680 ✗ 0 data_received..................: 137 MB 4.3 MB/s data_sent......................: 1.9 MB 58 kB/s http_req_blocked...............: avg=256.74µs min=1.43µs med=3.09µs max=10.61ms p(90)=5.03µs p(95)=1.79ms http_req_connecting............: avg=251.52µs min=0s med=0s max=10.47ms p(90)=0s p(95)=1.77ms http_req_duration..............: avg=1.99s min=936.95ms med=1.8s max=13.72s p(90)=2.16s p(95)=2.3s { expected_response:true }...: avg=1.99s min=936.95ms med=1.8s max=13.72s p(90)=2.16s p(95)=2.3s http_req_failed................: 0.00% ✓ 0 ✗ 1560 http_req_receiving.............: avg=191.4µs min=46.59µs med=119.05µs max=33.35ms p(90)=179.54µs p(95)=238.55µs http_req_sending...............: avg=53.63µs min=8.15µs med=15.56µs max=18.11ms p(90)=33.14µs p(95)=171.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.99s min=936.83ms med=1.8s max=13.72s p(90)=2.16s p(95)=2.3s http_reqs......................: 1560 49.189139/s iteration_duration.............: avg=2s min=954.81ms med=1.81s max=13.73s p(90)=2.17s p(95)=2.31s iterations.....................: 1560 49.189139/s vus............................: 80 min=80 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2808 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=270.73µs min=1.37µs med=4µs max=4.57ms p(90)=495.29µs p(95)=2.67ms http_req_connecting............: avg=259.7µs min=0s med=0s max=4.5ms p(90)=422.46µs p(95)=2.62ms http_req_duration..............: avg=3.29s min=1.45s med=3.19s max=6.82s p(90)=4.28s p(95)=5.16s { expected_response:true }...: avg=3.29s min=1.45s med=3.19s max=6.82s p(90)=4.28s p(95)=5.16s http_req_failed................: 0.00% ✓ 0 ✗ 936 http_req_receiving.............: avg=2.67ms min=44.68µs med=187.43µs max=74.37ms p(90)=2.2ms p(95)=8.27ms http_req_sending...............: avg=143.47µs min=8.36µs med=21.82µs max=15.72ms p(90)=117.89µs p(95)=923.36µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.29s min=1.45s med=3.19s max=6.82s p(90)=4.28s p(95)=5.14s http_reqs......................: 936 29.582196/s iteration_duration.............: avg=3.31s min=1.46s med=3.21s max=6.84s p(90)=4.29s p(95)=5.17s iterations.....................: 936 29.582196/s vus............................: 53 min=53 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1347 ✗ 0 data_received..................: 39 MB 1.1 MB/s data_sent......................: 533 kB 14 kB/s http_req_blocked...............: avg=209.75µs min=1.63µs med=3.56µs max=3.04ms p(90)=791.18µs p(95)=1.27ms http_req_connecting............: avg=183.49µs min=0s med=0s max=2.94ms p(90)=742.06µs p(95)=1.14ms http_req_duration..............: avg=7.53s min=3.26s med=7.61s max=9.37s p(90)=8.89s p(95)=9.02s { expected_response:true }...: avg=7.53s min=3.26s med=7.61s max=9.37s p(90)=8.89s p(95)=9.02s http_req_failed................: 0.00% ✓ 0 ✗ 449 http_req_receiving.............: avg=134.76µs min=61.38µs med=121.34µs max=564.53µs p(90)=175µs p(95)=220.54µs http_req_sending...............: avg=105.11µs min=8.66µs med=20.4µs max=2.92ms p(90)=395.28µs p(95)=519.41µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.53s min=3.26s med=7.61s max=9.37s p(90)=8.89s p(95)=9.02s http_reqs......................: 449 12.043861/s iteration_duration.............: avg=7.54s min=3.27s med=7.62s max=9.38s p(90)=8.9s p(95)=9.02s iterations.....................: 449 12.043861/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 171 5219 total, 0 failed avg: 492ms, p95: 723ms ✅
apollo-router 170 5205 total, 0 failed avg: 508ms, p95: 699ms ✅
wundergraph 159 4824 total, 0 failed avg: 538ms, p95: 957ms ✅
mesh-supergraph-bun 98 2996 total, 0 failed avg: 979ms, p95: 1679ms ✅
apollo-server 47 1499 total, 0 failed avg: 2043ms, p95: 2546ms ✅
mercurius 32 982 total, 0 failed avg: 3082ms, p95: 4420ms ✅
mesh-supergraph 29 936 total, 0 failed avg: 3293ms, p95: 5374ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15657 ✗ 0 data_received..................: 458 MB 15 MB/s data_sent......................: 6.2 MB 204 kB/s http_req_blocked...............: avg=31.67µs min=1.34µs med=2.62µs max=8.47ms p(90)=4.02µs p(95)=5.27µs http_req_connecting............: avg=25.74µs min=0s med=0s max=3.81ms p(90)=0s p(95)=0s http_req_duration..............: avg=492.12ms min=25.28ms med=494.24ms max=2.03s p(90)=624.07ms p(95)=722.76ms { expected_response:true }...: avg=492.12ms min=25.28ms med=494.24ms max=2.03s p(90)=624.07ms p(95)=722.76ms http_req_failed................: 0.00% ✓ 0 ✗ 5219 http_req_receiving.............: avg=37.83ms min=37.25µs med=75.23µs max=1.43s p(90)=75.76ms p(95)=298.82ms http_req_sending...............: avg=3.17ms min=7.63µs med=12.72µs max=1.09s p(90)=33.97µs p(95)=281.9µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=451.11ms min=18.56ms med=481.75ms max=817.86ms p(90)=574.74ms p(95)=606.05ms http_reqs......................: 5219 171.54834/s iteration_duration.............: avg=579.64ms min=43.37ms med=538.56ms max=2.17s p(90)=835.45ms p(95)=1.03s iterations.....................: 5219 171.54834/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15615 ✗ 0 data_received..................: 457 MB 15 MB/s data_sent......................: 6.2 MB 203 kB/s http_req_blocked...............: avg=38.21µs min=1.35µs med=2.92µs max=23.55ms p(90)=4.6µs p(95)=5.63µs http_req_connecting............: avg=28.22µs min=0s med=0s max=3.45ms p(90)=0s p(95)=0s http_req_duration..............: avg=508.16ms min=23.52ms med=510.85ms max=1.3s p(90)=647.27ms p(95)=698.58ms { expected_response:true }...: avg=508.16ms min=23.52ms med=510.85ms max=1.3s p(90)=647.27ms p(95)=698.58ms http_req_failed................: 0.00% ✓ 0 ✗ 5205 http_req_receiving.............: avg=20.36ms min=34.83µs med=71.29µs max=901.17ms p(90)=46.69ms p(95)=110.59ms http_req_sending...............: avg=2.01ms min=7.55µs med=13.7µs max=810.17ms p(90)=37.38µs p(95)=424.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=485.78ms min=19.77ms med=498.19ms max=857.9ms p(90)=615.63ms p(95)=654.23ms http_reqs......................: 5205 170.972582/s iteration_duration.............: avg=580.5ms min=67.56ms med=557.55ms max=1.85s p(90)=741.69ms p(95)=844.4ms iterations.....................: 5205 170.972582/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14472 ✗ 0 data_received..................: 423 MB 14 MB/s data_sent......................: 5.7 MB 189 kB/s http_req_blocked...............: avg=94.06µs min=1.19µs med=2.7µs max=155.27ms p(90)=4.03µs p(95)=5.62µs http_req_connecting............: avg=46.55µs min=0s med=0s max=60.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=538.48ms min=18.24ms med=512.03ms max=2.05s p(90)=832.46ms p(95)=956.61ms { expected_response:true }...: avg=538.48ms min=18.24ms med=512.03ms max=2.05s p(90)=832.46ms p(95)=956.61ms http_req_failed................: 0.00% ✓ 0 ✗ 4824 http_req_receiving.............: avg=43.89ms min=39.39µs med=79.43µs max=1.38s p(90)=100.73ms p(95)=315.75ms http_req_sending...............: avg=3.17ms min=7.6µs med=13.2µs max=991.31ms p(90)=43.05µs p(95)=435.11µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=491.41ms min=18.14ms med=477.07ms max=1.26s p(90)=767.21ms p(95)=863.71ms http_reqs......................: 4824 159.06936/s iteration_duration.............: avg=625.69ms min=36.24ms med=577.71ms max=2.6s p(90)=985.9ms p(95)=1.18s iterations.....................: 4824 159.06936/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8988 ✗ 0 data_received..................: 263 MB 8.6 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=85.69µs min=1.27µs med=2.77µs max=7.77ms p(90)=4.3µs p(95)=9.54µs http_req_connecting............: avg=74.44µs min=0s med=0s max=6.62ms p(90)=0s p(95)=0s http_req_duration..............: avg=979.48ms min=436.23ms med=841.94ms max=2.5s p(90)=1.54s p(95)=1.67s { expected_response:true }...: avg=979.48ms min=436.23ms med=841.94ms max=2.5s p(90)=1.54s p(95)=1.67s http_req_failed................: 0.00% ✓ 0 ✗ 2996 http_req_receiving.............: avg=11.94ms min=37.68µs med=82.48µs max=709.64ms p(90)=1.06ms p(95)=45.31ms http_req_sending...............: avg=395.09µs min=8.11µs med=13.41µs max=103.77ms p(90)=32.3µs p(95)=245.29µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=967.14ms min=429.19ms med=836.24ms max=2.5s p(90)=1.53s p(95)=1.64s http_reqs......................: 2996 98.153181/s iteration_duration.............: avg=1s min=449.77ms med=868.19ms max=2.51s p(90)=1.57s p(95)=1.73s iterations.....................: 2996 98.153181/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4497 ✗ 0 data_received..................: 132 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=207.63µs min=1.72µs med=4.04µs max=6.77ms p(90)=6.17µs p(95)=1.29ms http_req_connecting............: avg=192.98µs min=0s med=0s max=6.6ms p(90)=0s p(95)=1.27ms http_req_duration..............: avg=2.04s min=839.75ms med=1.7s max=20.95s p(90)=2.05s p(95)=2.54s { expected_response:true }...: avg=2.04s min=839.75ms med=1.7s max=20.95s p(90)=2.05s p(95)=2.54s http_req_failed................: 0.00% ✓ 0 ✗ 1499 http_req_receiving.............: avg=232.38µs min=51.67µs med=128.39µs max=51.79ms p(90)=185.49µs p(95)=215.61µs http_req_sending...............: avg=48.31µs min=9.24µs med=20.56µs max=5.27ms p(90)=39.54µs p(95)=205.77µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.04s min=839.61ms med=1.7s max=20.95s p(90)=2.05s p(95)=2.54s http_reqs......................: 1499 47.82416/s iteration_duration.............: avg=2.05s min=847.87ms med=1.72s max=20.96s p(90)=2.07s p(95)=2.55s iterations.....................: 1499 47.82416/s vus............................: 39 min=39 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2946 ✗ 0 data_received..................: 86 MB 2.8 MB/s data_sent......................: 1.2 MB 38 kB/s http_req_blocked...............: avg=145.83µs min=1.42µs med=3.72µs max=4ms p(90)=107.75µs p(95)=1.08ms http_req_connecting............: avg=135.09µs min=0s med=0s max=3.75ms p(90)=80.05µs p(95)=1.05ms http_req_duration..............: avg=3.08s min=420.27ms med=2.92s max=7.51s p(90)=4.09s p(95)=4.42s { expected_response:true }...: avg=3.08s min=420.27ms med=2.92s max=7.51s p(90)=4.09s p(95)=4.42s http_req_failed................: 0.00% ✓ 0 ✗ 982 http_req_receiving.............: avg=200.15µs min=39.9µs med=118.8µs max=22.2ms p(90)=183.73µs p(95)=218.05µs http_req_sending...............: avg=174.29µs min=8.2µs med=20.13µs max=2.94ms p(90)=67.77µs p(95)=2.41ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.08s min=419.86ms med=2.92s max=7.51s p(90)=4.09s p(95)=4.42s http_reqs......................: 982 32.070919/s iteration_duration.............: avg=3.09s min=428.8ms med=2.93s max=7.52s p(90)=4.1s p(95)=4.43s iterations.....................: 982 32.070919/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2808 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=260.09µs min=1.61µs med=4.38µs max=4.98ms p(90)=709.44µs p(95)=2.34ms http_req_connecting............: avg=251.14µs min=0s med=0s max=4.92ms p(90)=683.76µs p(95)=2.31ms http_req_duration..............: avg=3.29s min=1.28s med=3.1s max=6.72s p(90)=4.43s p(95)=5.37s { expected_response:true }...: avg=3.29s min=1.28s med=3.1s max=6.72s p(90)=4.43s p(95)=5.37s http_req_failed................: 0.00% ✓ 0 ✗ 936 http_req_receiving.............: avg=3.58ms min=43.03µs med=177.11µs max=96.16ms p(90)=1.82ms p(95)=15.84ms http_req_sending...............: avg=52.4µs min=8.78µs med=24.85µs max=3.1ms p(90)=95.04µs p(95)=193.29µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.28s min=1.28s med=3.1s max=6.72s p(90)=4.43s p(95)=5.37s http_reqs......................: 936 29.637564/s iteration_duration.............: avg=3.3s min=1.3s med=3.11s max=6.74s p(90)=4.45s p(95)=5.38s iterations.....................: 936 29.637564/s vus............................: 49 min=49 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 163 5005 total, 0 failed avg: 543ms, p95: 733ms ✅
wundergraph 104 3202 total, 0 failed avg: 905ms, p95: 1106ms ✅
mesh-supergraph-bun 99 3066 total, 0 failed avg: 948ms, p95: 1360ms ✅
cosmo 81 2545 total, 0 failed avg: 1166ms, p95: 1433ms ✅
apollo-server 63 1949 total, 0 failed avg: 1549ms, p95: 1919ms ✅
mesh-supergraph 61 1899 total, 0 failed avg: 1573ms, p95: 2407ms ✅
mercurius 12 474 total, 0 failed avg: 7182ms, p95: 8424ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15015 ✗ 0 data_received..................: 439 MB 14 MB/s data_sent......................: 5.9 MB 195 kB/s http_req_blocked...............: avg=69.81µs min=1.32µs med=2.84µs max=7.39ms p(90)=4.24µs p(95)=5.36µs http_req_connecting............: avg=65.01µs min=0s med=0s max=7.36ms p(90)=0s p(95)=0s http_req_duration..............: avg=542.56ms min=239.41ms med=532.45ms max=1.16s p(90)=679.81ms p(95)=733.4ms { expected_response:true }...: avg=542.56ms min=239.41ms med=532.45ms max=1.16s p(90)=679.81ms p(95)=733.4ms http_req_failed................: 0.00% ✓ 0 ✗ 5005 http_req_receiving.............: avg=18.81ms min=38.79µs med=76.23µs max=515.99ms p(90)=65.58ms p(95)=118.76ms http_req_sending...............: avg=1.59ms min=7.4µs med=13.51µs max=245.55ms p(90)=43.1µs p(95)=379.46µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=522.15ms min=239.33ms med=516.89ms max=929.46ms p(90)=641.64ms p(95)=674.13ms http_reqs......................: 5005 163.866827/s iteration_duration.............: avg=604.61ms min=268.07ms med=587.52ms max=1.27s p(90)=773.14ms p(95)=848.07ms iterations.....................: 5005 163.866827/s vus............................: 99 min=99 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9606 ✗ 0 data_received..................: 281 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=100.8µs min=1.3µs med=2.64µs max=64ms p(90)=4.12µs p(95)=6.58µs http_req_connecting............: avg=76.16µs min=0s med=0s max=4.42ms p(90)=0s p(95)=0s http_req_duration..............: avg=905.07ms min=538.03ms med=905.58ms max=1.41s p(90)=1.04s p(95)=1.1s { expected_response:true }...: avg=905.07ms min=538.03ms med=905.58ms max=1.41s p(90)=1.04s p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 3202 http_req_receiving.............: avg=11.16ms min=38.28µs med=81.46µs max=334.94ms p(90)=33.61ms p(95)=67.49ms http_req_sending...............: avg=1.96ms min=8.42µs med=13.07µs max=290.16ms p(90)=103.78µs p(95)=718.49µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=891.94ms min=514.73ms med=898.48ms max=1.26s p(90)=1.02s p(95)=1.06s http_reqs......................: 3202 104.502196/s iteration_duration.............: avg=944.84ms min=563.72ms med=939.21ms max=1.48s p(90)=1.1s p(95)=1.17s iterations.....................: 3202 104.502196/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9198 ✗ 0 data_received..................: 269 MB 8.8 MB/s data_sent......................: 3.6 MB 118 kB/s http_req_blocked...............: avg=22.14µs min=1.64µs med=3.16µs max=2.95ms p(90)=4.86µs p(95)=10.03µs http_req_connecting............: avg=14.24µs min=0s med=0s max=1.49ms p(90)=0s p(95)=0s http_req_duration..............: avg=947.92ms min=386.44ms med=924.68ms max=1.8s p(90)=1.25s p(95)=1.36s { expected_response:true }...: avg=947.92ms min=386.44ms med=924.68ms max=1.8s p(90)=1.25s p(95)=1.36s http_req_failed................: 0.00% ✓ 0 ✗ 3066 http_req_receiving.............: avg=14.96ms min=36.57µs med=87.84µs max=671.49ms p(90)=6.39ms p(95)=112.19ms http_req_sending...............: avg=795.71µs min=8.87µs med=15µs max=320.49ms p(90)=43.47µs p(95)=407.58µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=932.16ms min=386.18ms med=909.95ms max=1.8s p(90)=1.22s p(95)=1.33s http_reqs......................: 3066 99.746083/s iteration_duration.............: avg=988.81ms min=397.12ms med=963.06ms max=1.97s p(90)=1.31s p(95)=1.41s iterations.....................: 3066 99.746083/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7635 ✗ 0 data_received..................: 223 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=66.73µs min=1.35µs med=2.56µs max=6.17ms p(90)=3.85µs p(95)=8.87µs http_req_connecting............: avg=60.39µs min=0s med=0s max=4.83ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=672.81ms med=1.15s max=1.69s p(90)=1.37s p(95)=1.43s { expected_response:true }...: avg=1.16s min=672.81ms med=1.15s max=1.69s p(90)=1.37s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2545 http_req_receiving.............: avg=12.47ms min=38.1µs med=75.61µs max=382.42ms p(90)=39.05ms p(95)=83.96ms http_req_sending...............: avg=1.3ms min=7.97µs med=12.74µs max=169.49ms p(90)=54.88µs p(95)=1.21ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=640.56ms med=1.14s max=1.57s p(90)=1.35s p(95)=1.38s http_reqs......................: 2545 81.805152/s iteration_duration.............: avg=1.2s min=682.6ms med=1.19s max=1.71s p(90)=1.41s p(95)=1.49s iterations.....................: 2545 81.805152/s vus............................: 24 min=24 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5847 ✗ 0 data_received..................: 171 MB 5.5 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=221.77µs min=1.52µs med=3.38µs max=8.06ms p(90)=5.16µs p(95)=820.58µs http_req_connecting............: avg=215.9µs min=0s med=0s max=7.94ms p(90)=0s p(95)=759.66µs http_req_duration..............: avg=1.54s min=751.62ms med=1.46s max=9.63s p(90)=1.74s p(95)=1.91s { expected_response:true }...: avg=1.54s min=751.62ms med=1.46s max=9.63s p(90)=1.74s p(95)=1.91s http_req_failed................: 0.00% ✓ 0 ✗ 1949 http_req_receiving.............: avg=171.95µs min=48.32µs med=119.33µs max=21.6ms p(90)=184.5µs p(95)=256.44µs http_req_sending...............: avg=49.65µs min=9.24µs med=17.33µs max=16.27ms p(90)=35.11µs p(95)=123.05µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.54s min=751.48ms med=1.46s max=9.63s p(90)=1.74s p(95)=1.91s http_reqs......................: 1949 63.053035/s iteration_duration.............: avg=1.56s min=758.66ms med=1.48s max=9.64s p(90)=1.76s p(95)=1.93s iterations.....................: 1949 63.053035/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5697 ✗ 0 data_received..................: 167 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=297.2µs min=1.54µs med=4.17µs max=15.26ms p(90)=6.17µs p(95)=698.55µs http_req_connecting............: avg=269.06µs min=0s med=0s max=14.99ms p(90)=0s p(95)=487.42µs http_req_duration..............: avg=1.57s min=551.4ms med=1.53s max=3.43s p(90)=2.02s p(95)=2.4s { expected_response:true }...: avg=1.57s min=551.4ms med=1.53s max=3.43s p(90)=2.02s p(95)=2.4s http_req_failed................: 0.00% ✓ 0 ✗ 1899 http_req_receiving.............: avg=3.53ms min=41.25µs med=122.12µs max=353.81ms p(90)=2.39ms p(95)=11.62ms http_req_sending...............: avg=441.31µs min=8.86µs med=22.79µs max=73.42ms p(90)=53.33µs p(95)=261.29µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.56s min=551.32ms med=1.53s max=3.42s p(90)=2.01s p(95)=2.37s http_reqs......................: 1899 61.537204/s iteration_duration.............: avg=1.6s min=566.13ms med=1.56s max=3.44s p(90)=2.07s p(95)=2.45s iterations.....................: 1899 61.537204/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1422 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 563 kB 15 kB/s http_req_blocked...............: avg=387.24µs min=1.52µs med=3.65µs max=4.66ms p(90)=1.74ms p(95)=3.5ms http_req_connecting............: avg=366.22µs min=0s med=0s max=4.63ms p(90)=1.63ms p(95)=3.38ms http_req_duration..............: avg=7.18s min=3.07s med=7.52s max=8.84s p(90)=8.28s p(95)=8.42s { expected_response:true }...: avg=7.18s min=3.07s med=7.52s max=8.84s p(90)=8.28s p(95)=8.42s http_req_failed................: 0.00% ✓ 0 ✗ 474 http_req_receiving.............: avg=134.08µs min=68.13µs med=124.03µs max=892.87µs p(90)=179.09µs p(95)=199.56µs http_req_sending...............: avg=70.06µs min=8.53µs med=20.79µs max=577.01µs p(90)=328.18µs p(95)=438.24µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.18s min=3.07s med=7.52s max=8.84s p(90)=8.28s p(95)=8.42s http_reqs......................: 474 12.620956/s iteration_duration.............: avg=7.19s min=3.07s med=7.52s max=8.84s p(90)=8.29s p(95)=8.43s iterations.....................: 474 12.620956/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2549ms 170 11964 total, 0 failed avg: 816ms, p95: 2549ms, max: 7268ms, med: 553ms ✅
apollo-router 2664ms 173 12178 total, 0 failed avg: 842ms, p95: 2664ms, max: 9134ms, med: 487ms ✅
wundergraph 2844ms 176 12342 total, 0 failed avg: 785ms, p95: 2845ms, max: 8348ms, med: 409ms ✅
mesh-supergraph-bun 5698ms 116 8122 total, 0 failed avg: 2255ms, p95: 5698ms, max: 8970ms, med: 1989ms ✅
mesh-supergraph 6812ms 69 4835 total, 0 failed avg: 3926ms, p95: 6812ms, max: 8494ms, med: 3970ms ✅
apollo-server 23629ms 68 5044 total, 0 failed avg: 4139ms, p95: 23630ms, max: 45068ms, med: 2271ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35892 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 203 kB/s http_req_blocked...............: avg=18.77ms min=1.68µs med=3.23µs max=3.96s p(90)=5.19µs p(95)=12.79µs http_req_connecting............: avg=16.94ms min=0s med=0s max=3.74s p(90)=0s p(95)=0s http_req_duration..............: avg=815.94ms min=6.88ms med=553.02ms max=7.26s p(90)=2s p(95)=2.54s { expected_response:true }...: avg=815.94ms min=6.88ms med=553.02ms max=7.26s p(90)=2s p(95)=2.54s http_req_failed................: 0.00% ✓ 0 ✗ 11964 http_req_receiving.............: avg=338.49ms min=31.57µs med=93.4µs max=5.12s p(90)=1.29s p(95)=1.91s http_req_sending...............: avg=32.77ms min=8.28µs med=14.53µs max=4.32s p(90)=156.45µs p(95)=57.83ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=444.67ms min=6.79ms med=345.42ms max=2.26s p(90)=947.68ms p(95)=1.12s http_reqs......................: 11964 170.887278/s iteration_duration.............: avg=1.55s min=12.67ms med=1.03s max=11.78s p(90)=3.74s p(95)=4.65s iterations.....................: 11964 170.887278/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36534 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=14.88ms min=1.53µs med=3.06µs max=6.85s p(90)=4.86µs p(95)=11.68µs http_req_connecting............: avg=14.05ms min=0s med=0s max=6.85s p(90)=0s p(95)=0s http_req_duration..............: avg=842.45ms min=6.11ms med=486.71ms max=9.13s p(90)=2.01s p(95)=2.66s { expected_response:true }...: avg=842.45ms min=6.11ms med=486.71ms max=9.13s p(90)=2.01s p(95)=2.66s http_req_failed................: 0.00% ✓ 0 ✗ 12178 http_req_receiving.............: avg=357.42ms min=27.25µs med=82.55µs max=6.79s p(90)=1.26s p(95)=2.08s http_req_sending...............: avg=31.51ms min=8.4µs med=14.41µs max=6.12s p(90)=178.88µs p(95)=48.64ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=453.52ms min=6.03ms med=340.63ms max=2.63s p(90)=969.48ms p(95)=1.23s http_reqs......................: 12178 173.967644/s iteration_duration.............: avg=1.49s min=11.57ms med=888.46ms max=13.91s p(90)=3.62s p(95)=4.71s iterations.....................: 12178 173.967644/s vus............................: 1 min=1 max=463 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 37026 ✗ 0 data_received..................: 1.1 GB 16 MB/s data_sent......................: 15 MB 209 kB/s http_req_blocked...............: avg=21.29ms min=1.23µs med=2.81µs max=6.62s p(90)=4.26µs p(95)=10.97µs http_req_connecting............: avg=19.98ms min=0s med=0s max=4.97s p(90)=0s p(95)=0s http_req_duration..............: avg=785.43ms min=7.05ms med=409.47ms max=8.34s p(90)=2.04s p(95)=2.84s { expected_response:true }...: avg=785.43ms min=7.05ms med=409.47ms max=8.34s p(90)=2.04s p(95)=2.84s http_req_failed................: 0.00% ✓ 0 ✗ 12342 http_req_receiving.............: avg=374.58ms min=31.76µs med=79.52µs max=7.67s p(90)=1.36s p(95)=2.28s http_req_sending...............: avg=38.27ms min=7.95µs med=13.25µs max=5.63s p(90)=248.33µs p(95)=63.69ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=372.57ms min=6.99ms med=280.77ms max=2.52s p(90)=792.14ms p(95)=1.09s http_reqs......................: 12342 176.295987/s iteration_duration.............: avg=1.46s min=12.8ms med=808.66ms max=14.94s p(90)=3.78s p(95)=4.77s iterations.....................: 12342 176.295987/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24366 ✗ 0 data_received..................: 713 MB 10 MB/s data_sent......................: 9.6 MB 138 kB/s http_req_blocked...............: avg=2.35ms min=1.44µs med=3.54µs max=758.5ms p(90)=6.41µs p(95)=222.17µs http_req_connecting............: avg=2.31ms min=0s med=0s max=758.44ms p(90)=0s p(95)=154.47µs http_req_duration..............: avg=2.25s min=5.7ms med=1.98s max=8.97s p(90)=4.26s p(95)=5.69s { expected_response:true }...: avg=2.25s min=5.7ms med=1.98s max=8.97s p(90)=4.26s p(95)=5.69s http_req_failed................: 0.00% ✓ 0 ✗ 8122 http_req_receiving.............: avg=26.6ms min=36.32µs med=82.95µs max=1.54s p(90)=12.11ms p(95)=141.02ms http_req_sending...............: avg=2.76ms min=8.46µs med=17.13µs max=900ms p(90)=86.71µs p(95)=9.88ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.22s min=5.51ms med=1.97s max=8.46s p(90)=4.22s p(95)=5.69s http_reqs......................: 8122 116.016579/s iteration_duration.............: avg=2.32s min=12.15ms med=2.09s max=9s p(90)=4.33s p(95)=5.76s iterations.....................: 8122 116.016579/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14505 ✗ 0 data_received..................: 424 MB 6.1 MB/s data_sent......................: 5.7 MB 82 kB/s http_req_blocked...............: avg=668.95µs min=1.48µs med=3.74µs max=230.02ms p(90)=169.37µs p(95)=407.42µs http_req_connecting............: avg=629.2µs min=0s med=0s max=229.94ms p(90)=111.66µs p(95)=334.66µs http_req_duration..............: avg=3.92s min=11.42ms med=3.96s max=8.49s p(90)=6.3s p(95)=6.81s { expected_response:true }...: avg=3.92s min=11.42ms med=3.96s max=8.49s p(90)=6.3s p(95)=6.81s http_req_failed................: 0.00% ✓ 0 ✗ 4835 http_req_receiving.............: avg=1.85ms min=35.46µs med=96.85µs max=235.59ms p(90)=821.64µs p(95)=7.57ms http_req_sending...............: avg=468.84µs min=6.97µs med=19.48µs max=140.9ms p(90)=56.82µs p(95)=140.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.92s min=11.32ms med=3.96s max=8.49s p(90)=6.3s p(95)=6.81s http_reqs......................: 4835 69.068938/s iteration_duration.............: avg=3.95s min=16.93ms med=4s max=8.66s p(90)=6.35s p(95)=6.86s iterations.....................: 4835 69.068938/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15132 ✗ 0 data_received..................: 443 MB 6.1 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=90.18µs min=1.44µs med=3.38µs max=48.7ms p(90)=31µs p(95)=325.17µs http_req_connecting............: avg=77.9µs min=0s med=0s max=48.62ms p(90)=0s p(95)=238.92µs http_req_duration..............: avg=4.13s min=88.6ms med=2.27s max=45.06s p(90)=3.49s p(95)=23.62s { expected_response:true }...: avg=4.13s min=88.6ms med=2.27s max=45.06s p(90)=3.49s p(95)=23.62s http_req_failed................: 0.00% ✓ 0 ✗ 5044 http_req_receiving.............: avg=371.82µs min=47.9µs med=116.85µs max=164.17ms p(90)=184.73µs p(95)=220.97µs http_req_sending...............: avg=49.06µs min=8.42µs med=17.03µs max=57.15ms p(90)=38.99µs p(95)=57.96µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.13s min=88.5ms med=2.27s max=45.06s p(90)=3.49s p(95)=23.62s http_reqs......................: 5044 68.904948/s iteration_duration.............: avg=4.15s min=95.41ms med=2.28s max=45.07s p(90)=3.5s p(95)=23.63s iterations.....................: 5044 68.904948/s vus............................: 20 min=20 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview