search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @graphql-mesh/supergraph to v0.3.0 #422

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/supergraph (source) 0.2.4 -> 0.3.0 age adoption passing confidence
@graphql-mesh/supergraph (source) ^0.2.0 -> ^0.3.0 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/supergraph) ### [`v0.3.0`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/handlers/supergraph/CHANGELOG.md#030) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/103621c913f20849d97184a1f87a5127a3d8a1ca...@graphql-mesh/supergraph@0.3.0) ##### Minor Changes - [`52f74e7`](https://togithub.com/ardatan/graphql-mesh/commit/52f74e75219a32d30dea693a571c64c9c7519eb6) Thanks [@​ardatan](https://togithub.com/ardatan)! - Ability to configure subgraphs ##### Patch Changes - Updated dependencies \[[`52f74e7`](https://togithub.com/ardatan/graphql-mesh/commit/52f74e75219a32d30dea693a571c64c9c7519eb6)]: - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.5 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.5 - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.5

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about these updates again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 146 4453 total, 0 failed avg: 587ms, p95: 808ms ✅
mesh-supergraph-bun 105 3237 total, 0 failed avg: 910ms, p95: 1266ms ✅
wundergraph 103 3200 total, 0 failed avg: 923ms, p95: 1114ms ✅
cosmo 81 2533 total, 0 failed avg: 1172ms, p95: 1441ms ✅
apollo-server 64 2012 total, 0 failed avg: 1513ms, p95: 1864ms ✅
mesh-supergraph 61 1893 total, 0 failed avg: 1589ms, p95: 2447ms ✅
mercurius 12 480 total, 0 failed avg: 7023ms, p95: 8222ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13359 ✗ 0 data_received..................: 391 MB 13 MB/s data_sent......................: 5.3 MB 174 kB/s http_req_blocked...............: avg=80.14µs min=1.44µs med=3.64µs max=58.56ms p(90)=5.91µs p(95)=8.16µs http_req_connecting............: avg=52.77µs min=0s med=0s max=6.73ms p(90)=0s p(95)=0s http_req_duration..............: avg=586.86ms min=302.03ms med=574.88ms max=1.33s p(90)=734.09ms p(95)=807.56ms { expected_response:true }...: avg=586.86ms min=302.03ms med=574.88ms max=1.33s p(90)=734.09ms p(95)=807.56ms http_req_failed................: 0.00% ✓ 0 ✗ 4453 http_req_receiving.............: avg=24.88ms min=41.77µs med=110.14µs max=660.56ms p(90)=89.38ms p(95)=147.91ms http_req_sending...............: avg=2.26ms min=9.12µs med=16µs max=561.49ms p(90)=64.25µs p(95)=233.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=559.71ms min=282.1ms med=553.47ms max=966.33ms p(90)=690.2ms p(95)=739.82ms http_reqs......................: 4453 146.179137/s iteration_duration.............: avg=678.53ms min=318.88ms med=660.95ms max=1.76s p(90)=881.63ms p(95)=1s iterations.....................: 4453 146.179137/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9711 ✗ 0 data_received..................: 284 MB 9.2 MB/s data_sent......................: 3.8 MB 125 kB/s http_req_blocked...............: avg=51.72µs min=1.59µs med=3.01µs max=5.05ms p(90)=4.83µs p(95)=9.47µs http_req_connecting............: avg=45.78µs min=0s med=0s max=5.02ms p(90)=0s p(95)=0s http_req_duration..............: avg=910.1ms min=400.09ms med=891.27ms max=1.79s p(90)=1.16s p(95)=1.26s { expected_response:true }...: avg=910.1ms min=400.09ms med=891.27ms max=1.79s p(90)=1.16s p(95)=1.26s http_req_failed................: 0.00% ✓ 0 ✗ 3237 http_req_receiving.............: avg=12.28ms min=37.3µs med=91.55µs max=575.49ms p(90)=1.27ms p(95)=41.06ms http_req_sending...............: avg=423.07µs min=8.56µs med=14.39µs max=102.67ms p(90)=35.45µs p(95)=130.35µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=897.39ms min=399.79ms med=883.74ms max=1.65s p(90)=1.13s p(95)=1.23s http_reqs......................: 3237 105.226165/s iteration_duration.............: avg=939.52ms min=409.82ms med=917.73ms max=1.8s p(90)=1.2s p(95)=1.32s iterations.....................: 3237 105.226165/s vus............................: 99 min=99 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9600 ✗ 0 data_received..................: 281 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=100.46µs min=1.52µs med=2.85µs max=6.8ms p(90)=4.57µs p(95)=9.28µs http_req_connecting............: avg=93.89µs min=0s med=0s max=6.73ms p(90)=0s p(95)=0s http_req_duration..............: avg=923.38ms min=579.8ms med=920.44ms max=1.37s p(90)=1.06s p(95)=1.11s { expected_response:true }...: avg=923.38ms min=579.8ms med=920.44ms max=1.37s p(90)=1.06s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3200 http_req_receiving.............: avg=11.28ms min=42.06µs med=87.39µs max=274.78ms p(90)=43.97ms p(95)=72.61ms http_req_sending...............: avg=1.99ms min=8.49µs med=13.68µs max=219.17ms p(90)=91.48µs p(95)=1.26ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=910.1ms min=579.6ms med=910.29ms max=1.29s p(90)=1.04s p(95)=1.09s http_reqs......................: 3200 103.070146/s iteration_duration.............: avg=957.47ms min=589.04ms med=954.52ms max=1.41s p(90)=1.1s p(95)=1.15s iterations.....................: 3200 103.070146/s vus............................: 24 min=24 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7599 ✗ 0 data_received..................: 222 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=134.16µs min=1.08µs med=2.45µs max=8.74ms p(90)=3.75µs p(95)=9.19µs http_req_connecting............: avg=129.23µs min=0s med=0s max=8.5ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=697.89ms med=1.16s max=1.76s p(90)=1.37s p(95)=1.44s { expected_response:true }...: avg=1.17s min=697.89ms med=1.16s max=1.76s p(90)=1.37s p(95)=1.44s http_req_failed................: 0.00% ✓ 0 ✗ 2533 http_req_receiving.............: avg=15.89ms min=38.31µs med=90.18µs max=289.54ms p(90)=59.05ms p(95)=105.68ms http_req_sending...............: avg=1.4ms min=7.59µs med=12.41µs max=310.81ms p(90)=75.34µs p(95)=823.31µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=697.76ms med=1.15s max=1.57s p(90)=1.33s p(95)=1.38s http_reqs......................: 2533 81.90054/s iteration_duration.............: avg=1.21s min=749.66ms med=1.2s max=1.78s p(90)=1.42s p(95)=1.48s iterations.....................: 2533 81.90054/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6036 ✗ 0 data_received..................: 177 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=28.65µs min=1.54µs med=3.02µs max=1.39ms p(90)=4.74µs p(95)=30.1µs http_req_connecting............: avg=22.84µs min=0s med=0s max=1.36ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.51s min=760.87ms med=1.43s max=9.52s p(90)=1.72s p(95)=1.86s { expected_response:true }...: avg=1.51s min=760.87ms med=1.43s max=9.52s p(90)=1.72s p(95)=1.86s http_req_failed................: 0.00% ✓ 0 ✗ 2012 http_req_receiving.............: avg=191.61µs min=47.9µs med=111.02µs max=29.6ms p(90)=177.61µs p(95)=240.76µs http_req_sending...............: avg=50.98µs min=8.87µs med=15.31µs max=12.96ms p(90)=31.36µs p(95)=95.02µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.51s min=760.72ms med=1.43s max=9.52s p(90)=1.72s p(95)=1.86s http_reqs......................: 2012 64.580599/s iteration_duration.............: avg=1.52s min=770.07ms med=1.45s max=9.52s p(90)=1.73s p(95)=1.87s iterations.....................: 2012 64.580599/s vus............................: 32 min=32 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5679 ✗ 0 data_received..................: 166 MB 5.4 MB/s data_sent......................: 2.2 MB 73 kB/s http_req_blocked...............: avg=353.54µs min=1.58µs med=4.5µs max=15.19ms p(90)=6.28µs p(95)=3.87ms http_req_connecting............: avg=46.95µs min=0s med=0s max=5.66ms p(90)=0s p(95)=72.23µs http_req_duration..............: avg=1.58s min=576.88ms med=1.52s max=3.41s p(90)=2.18s p(95)=2.44s { expected_response:true }...: avg=1.58s min=576.88ms med=1.52s max=3.41s p(90)=2.18s p(95)=2.44s http_req_failed................: 0.00% ✓ 0 ✗ 1893 http_req_receiving.............: avg=1.27ms min=44.42µs med=121.78µs max=90.82ms p(90)=1.2ms p(95)=7.43ms http_req_sending...............: avg=103.89µs min=9.08µs med=23.95µs max=18.02ms p(90)=43.79µs p(95)=256.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.58s min=576.76ms med=1.52s max=3.41s p(90)=2.18s p(95)=2.44s http_reqs......................: 1893 61.336166/s iteration_duration.............: avg=1.61s min=610.47ms med=1.55s max=3.42s p(90)=2.2s p(95)=2.47s iterations.....................: 1893 61.336166/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1440 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 570 kB 15 kB/s http_req_blocked...............: avg=164.67µs min=1.55µs med=3.15µs max=3.57ms p(90)=474.59µs p(95)=1.04ms http_req_connecting............: avg=126.66µs min=0s med=0s max=3.44ms p(90)=362.09µs p(95)=818.89µs http_req_duration..............: avg=7.02s min=3.03s med=7.3s max=8.46s p(90)=8.09s p(95)=8.22s { expected_response:true }...: avg=7.02s min=3.03s med=7.3s max=8.46s p(90)=8.09s p(95)=8.22s http_req_failed................: 0.00% ✓ 0 ✗ 480 http_req_receiving.............: avg=131.78µs min=57.8µs med=116.58µs max=836.17µs p(90)=176.65µs p(95)=214.06µs http_req_sending...............: avg=60.66µs min=8.62µs med=18.45µs max=476.27µs p(90)=213.17µs p(95)=376.44µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.02s min=3.03s med=7.3s max=8.46s p(90)=8.09s p(95)=8.22s http_reqs......................: 480 12.905675/s iteration_duration.............: avg=7.03s min=3.03s med=7.31s max=8.47s p(90)=8.09s p(95)=8.22s iterations.....................: 480 12.905675/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 153 4700 total, 0 failed avg: 600ms, p95: 778ms ✅
wundergraph 100 3126 total, 0 failed avg: 931ms, p95: 1167ms ✅
mesh-supergraph-bun 82 2567 total, 0 failed avg: 1156ms, p95: 1671ms ✅
cosmo 80 2518 total, 0 failed avg: 1177ms, p95: 1412ms ✅
apollo-server 48 1532 total, 0 failed avg: 2002ms, p95: 2292ms ✅
mesh-supergraph 30 969 total, 0 failed avg: 3202ms, p95: 5371ms ✅
mercurius 11 450 total, 0 failed avg: 7564ms, p95: 9042ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14100 ✗ 0 data_received..................: 412 MB 14 MB/s data_sent......................: 5.6 MB 182 kB/s http_req_blocked...............: avg=66.61µs min=1.24µs med=2.67µs max=11.06ms p(90)=3.93µs p(95)=4.93µs http_req_connecting............: avg=57.97µs min=0s med=0s max=8.2ms p(90)=0s p(95)=0s http_req_duration..............: avg=600.07ms min=339.36ms med=592.21ms max=1.15s p(90)=723.39ms p(95)=778.23ms { expected_response:true }...: avg=600.07ms min=339.36ms med=592.21ms max=1.15s p(90)=723.39ms p(95)=778.23ms http_req_failed................: 0.00% ✓ 0 ✗ 4700 http_req_receiving.............: avg=9.73ms min=36.64µs med=65.06µs max=404.84ms p(90)=20.9ms p(95)=65.3ms http_req_sending...............: avg=944.43µs min=7.65µs med=12.76µs max=276.29ms p(90)=29.94µs p(95)=174.69µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=589.39ms min=339.17ms med=582.47ms max=937.11ms p(90)=710.08ms p(95)=758.33ms http_reqs......................: 4700 153.572182/s iteration_duration.............: avg=645.66ms min=351.13ms med=634.45ms max=1.24s p(90)=796.17ms p(95)=870.23ms iterations.....................: 4700 153.572182/s vus............................: 93 min=93 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9378 ✗ 0 data_received..................: 274 MB 8.9 MB/s data_sent......................: 3.7 MB 120 kB/s http_req_blocked...............: avg=28.49µs min=1.34µs med=2.48µs max=28.12ms p(90)=3.69µs p(95)=7.83µs http_req_connecting............: avg=13.85µs min=0s med=0s max=1.77ms p(90)=0s p(95)=0s http_req_duration..............: avg=931.16ms min=564.5ms med=916.29ms max=1.65s p(90)=1.09s p(95)=1.16s { expected_response:true }...: avg=931.16ms min=564.5ms med=916.29ms max=1.65s p(90)=1.09s p(95)=1.16s http_req_failed................: 0.00% ✓ 0 ✗ 3126 http_req_receiving.............: avg=13.71ms min=37.53µs med=75.14µs max=387.43ms p(90)=48.3ms p(95)=92.33ms http_req_sending...............: avg=1.54ms min=8.09µs med=12.61µs max=284.52ms p(90)=33.93µs p(95)=328.3µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=915.9ms min=564.4ms med=905.14ms max=1.35s p(90)=1.06s p(95)=1.14s http_reqs......................: 3126 100.964914/s iteration_duration.............: avg=971.87ms min=600.18ms med=957.47ms max=1.67s p(90)=1.14s p(95)=1.21s iterations.....................: 3126 100.964914/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7701 ✗ 0 data_received..................: 225 MB 7.3 MB/s data_sent......................: 3.0 MB 98 kB/s http_req_blocked...............: avg=111.86µs min=1.6µs med=3.04µs max=6.35ms p(90)=4.78µs p(95)=11.03µs http_req_connecting............: avg=102.88µs min=0s med=0s max=6.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=524.82ms med=1.12s max=2.27s p(90)=1.47s p(95)=1.67s { expected_response:true }...: avg=1.15s min=524.82ms med=1.12s max=2.27s p(90)=1.47s p(95)=1.67s http_req_failed................: 0.00% ✓ 0 ✗ 2567 http_req_receiving.............: avg=15.69ms min=38.28µs med=92.18µs max=668.75ms p(90)=3.84ms p(95)=83.75ms http_req_sending...............: avg=515.88µs min=8.24µs med=15.07µs max=197.79ms p(90)=45.82µs p(95)=436.59µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=524.69ms med=1.1s max=2.27s p(90)=1.44s p(95)=1.63s http_reqs......................: 2567 82.908316/s iteration_duration.............: avg=1.18s min=537.01ms med=1.15s max=2.29s p(90)=1.52s p(95)=1.7s iterations.....................: 2567 82.908316/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7554 ✗ 0 data_received..................: 221 MB 7.0 MB/s data_sent......................: 3.0 MB 95 kB/s http_req_blocked...............: avg=119.4µs min=1.3µs med=2.44µs max=24.45ms p(90)=3.87µs p(95)=9.16µs http_req_connecting............: avg=104.97µs min=0s med=0s max=6.38ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=711.9ms med=1.17s max=1.86s p(90)=1.34s p(95)=1.41s { expected_response:true }...: avg=1.17s min=711.9ms med=1.17s max=1.86s p(90)=1.34s p(95)=1.41s http_req_failed................: 0.00% ✓ 0 ✗ 2518 http_req_receiving.............: avg=9.96ms min=37.5µs med=75.55µs max=290.13ms p(90)=28.65ms p(95)=69.71ms http_req_sending...............: avg=1.14ms min=8.06µs med=12.65µs max=173.51ms p(90)=33.71µs p(95)=380.18µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=711.76ms med=1.16s max=1.59s p(90)=1.32s p(95)=1.37s http_reqs......................: 2518 80.137539/s iteration_duration.............: avg=1.21s min=722.42ms med=1.2s max=1.87s p(90)=1.4s p(95)=1.45s iterations.....................: 2518 80.137539/s vus............................: 4 min=4 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4596 ✗ 0 data_received..................: 135 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=37.41µs min=1.56µs med=3.26µs max=2.65ms p(90)=5.4µs p(95)=164.04µs http_req_connecting............: avg=28.01µs min=0s med=0s max=1.24ms p(90)=0s p(95)=108.74µs http_req_duration..............: avg=2s min=887.71ms med=1.79s max=13.97s p(90)=2.16s p(95)=2.29s { expected_response:true }...: avg=2s min=887.71ms med=1.79s max=13.97s p(90)=2.16s p(95)=2.29s http_req_failed................: 0.00% ✓ 0 ✗ 1532 http_req_receiving.............: avg=150.88µs min=53.02µs med=123.95µs max=12.09ms p(90)=177.33µs p(95)=198.99µs http_req_sending...............: avg=34.96µs min=8.54µs med=17.47µs max=2.3ms p(90)=34.21µs p(95)=111.92µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2s min=887.58ms med=1.79s max=13.97s p(90)=2.16s p(95)=2.29s http_reqs......................: 1532 48.737222/s iteration_duration.............: avg=2.01s min=898.58ms med=1.8s max=13.98s p(90)=2.17s p(95)=2.29s iterations.....................: 1532 48.737222/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2907 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.2 MB 36 kB/s http_req_blocked...............: avg=89.14µs min=1.41µs med=3.94µs max=3.02ms p(90)=96.59µs p(95)=530.75µs http_req_connecting............: avg=73.36µs min=0s med=0s max=2.63ms p(90)=65.58µs p(95)=504.29µs http_req_duration..............: avg=3.2s min=989.56ms med=2.99s max=7.07s p(90)=4.57s p(95)=5.37s { expected_response:true }...: avg=3.2s min=989.56ms med=2.99s max=7.07s p(90)=4.57s p(95)=5.37s http_req_failed................: 0.00% ✓ 0 ✗ 969 http_req_receiving.............: avg=4.17ms min=45.32µs med=197.42µs max=99.44ms p(90)=2.85ms p(95)=55.48ms http_req_sending...............: avg=65.46µs min=8.56µs med=21.23µs max=10.97ms p(90)=71.77µs p(95)=196.94µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.19s min=989.5ms med=2.99s max=7.07s p(90)=4.57s p(95)=5.37s http_reqs......................: 969 30.296892/s iteration_duration.............: avg=3.21s min=996.95ms med=3.01s max=7.08s p(90)=4.58s p(95)=5.39s iterations.....................: 969 30.296892/s vus............................: 64 min=64 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1350 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 534 kB 14 kB/s http_req_blocked...............: avg=80.14µs min=1.44µs med=3.33µs max=1.78ms p(90)=284.22µs p(95)=508.82µs http_req_connecting............: avg=60.48µs min=0s med=0s max=888.36µs p(90)=230.12µs p(95)=395.71µs http_req_duration..............: avg=7.56s min=3.25s med=7.75s max=9.4s p(90)=8.94s p(95)=9.04s { expected_response:true }...: avg=7.56s min=3.25s med=7.75s max=9.4s p(90)=8.94s p(95)=9.04s http_req_failed................: 0.00% ✓ 0 ✗ 450 http_req_receiving.............: avg=140.18µs min=55.92µs med=116.1µs max=4.35ms p(90)=182.43µs p(95)=209.8µs http_req_sending...............: avg=65.04µs min=8.91µs med=19.34µs max=7.58ms p(90)=145.37µs p(95)=252.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.56s min=3.25s med=7.75s max=9.4s p(90)=8.94s p(95)=9.04s http_reqs......................: 450 11.98575/s iteration_duration.............: avg=7.57s min=3.26s med=7.76s max=9.41s p(90)=8.95s p(95)=9.05s iterations.....................: 450 11.98575/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5345 total, 0 failed avg: 484ms, p95: 763ms ✅
apollo-router 171 5232 total, 0 failed avg: 531ms, p95: 702ms ✅
wundergraph 158 4830 total, 0 failed avg: 523ms, p95: 941ms ✅
mesh-supergraph-bun 97 2988 total, 0 failed avg: 987ms, p95: 1710ms ✅
apollo-server 47 1499 total, 0 failed avg: 2051ms, p95: 2725ms ✅
mercurius 30 946 total, 0 failed avg: 3217ms, p95: 4567ms ✅
mesh-supergraph 30 962 total, 0 failed avg: 3219ms, p95: 5376ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16035 ✗ 0 data_received..................: 469 MB 15 MB/s data_sent......................: 6.3 MB 209 kB/s http_req_blocked...............: avg=59.1µs min=1.19µs med=2.61µs max=118.91ms p(90)=4µs p(95)=5.07µs http_req_connecting............: avg=30.48µs min=0s med=0s max=5.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=484.3ms min=41.34ms med=484.16ms max=2.04s p(90)=623.05ms p(95)=762.84ms { expected_response:true }...: avg=484.3ms min=41.34ms med=484.16ms max=2.04s p(90)=623.05ms p(95)=762.84ms http_req_failed................: 0.00% ✓ 0 ✗ 5345 http_req_receiving.............: avg=38.91ms min=35.24µs med=76.14µs max=911.73ms p(90)=105.37ms p(95)=307.32ms http_req_sending...............: avg=2.59ms min=7.17µs med=12.69µs max=940.14ms p(90)=38.16µs p(95)=1.07ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=442.79ms min=26.92ms med=464.62ms max=795.75ms p(90)=559.78ms p(95)=590.62ms http_reqs......................: 5345 175.737241/s iteration_duration.............: avg=565.42ms min=54.28ms med=523.56ms max=3.03s p(90)=807.06ms p(95)=983.58ms iterations.....................: 5345 175.737241/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15696 ✗ 0 data_received..................: 459 MB 15 MB/s data_sent......................: 6.2 MB 204 kB/s http_req_blocked...............: avg=83.82µs min=1.48µs med=2.97µs max=149.02ms p(90)=4.65µs p(95)=5.56µs http_req_connecting............: avg=22.82µs min=0s med=0s max=6.75ms p(90)=0s p(95)=0s http_req_duration..............: avg=531.31ms min=194.76ms med=528.25ms max=973.83ms p(90)=659.65ms p(95)=701.79ms { expected_response:true }...: avg=531.31ms min=194.76ms med=528.25ms max=973.83ms p(90)=659.65ms p(95)=701.79ms http_req_failed................: 0.00% ✓ 0 ✗ 5232 http_req_receiving.............: avg=11.22ms min=37.01µs med=71.11µs max=452.03ms p(90)=31.27ms p(95)=81.2ms http_req_sending...............: avg=1.2ms min=8.26µs med=14.04µs max=395.53ms p(90)=35.96µs p(95)=234.23µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=518.89ms min=194.68ms med=518.35ms max=916.28ms p(90)=642ms p(95)=679.67ms http_reqs......................: 5232 171.760151/s iteration_duration.............: avg=579.27ms min=215.09ms med=567.65ms max=1.24s p(90)=735.47ms p(95)=800.24ms iterations.....................: 5232 171.760151/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14490 ✗ 0 data_received..................: 424 MB 14 MB/s data_sent......................: 5.7 MB 188 kB/s http_req_blocked...............: avg=126.68µs min=1.26µs med=2.62µs max=250.48ms p(90)=4.03µs p(95)=5.12µs http_req_connecting............: avg=44.46µs min=0s med=0s max=31.91ms p(90)=0s p(95)=0s http_req_duration..............: avg=522.8ms min=19.15ms med=492.14ms max=1.76s p(90)=823.32ms p(95)=941.21ms { expected_response:true }...: avg=522.8ms min=19.15ms med=492.14ms max=1.76s p(90)=823.32ms p(95)=941.21ms http_req_failed................: 0.00% ✓ 0 ✗ 4830 http_req_receiving.............: avg=41.47ms min=38.99µs med=83.24µs max=1.43s p(90)=107.33ms p(95)=324.37ms http_req_sending...............: avg=1.78ms min=7.81µs med=13.07µs max=493.33ms p(90)=30.71µs p(95)=1.07ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=479.53ms min=19.04ms med=456.51ms max=1.38s p(90)=764.85ms p(95)=872.8ms http_reqs......................: 4830 158.466753/s iteration_duration.............: avg=627.33ms min=39.26ms med=584.24ms max=2.7s p(90)=992.44ms p(95)=1.15s iterations.....................: 4830 158.466753/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8964 ✗ 0 data_received..................: 262 MB 8.6 MB/s data_sent......................: 3.5 MB 116 kB/s http_req_blocked...............: avg=54.43µs min=1.29µs med=2.71µs max=15.89ms p(90)=4.13µs p(95)=8.87µs http_req_connecting............: avg=39.9µs min=0s med=0s max=4.45ms p(90)=0s p(95)=0s http_req_duration..............: avg=987.19ms min=439.47ms med=854.45ms max=2.31s p(90)=1.63s p(95)=1.7s { expected_response:true }...: avg=987.19ms min=439.47ms med=854.45ms max=2.31s p(90)=1.63s p(95)=1.7s http_req_failed................: 0.00% ✓ 0 ✗ 2988 http_req_receiving.............: avg=10.96ms min=38.98µs med=89.06µs max=569.28ms p(90)=1.3ms p(95)=58.25ms http_req_sending...............: avg=330.13µs min=7.58µs med=13.36µs max=87.09ms p(90)=33.73µs p(95)=161.3µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=975.9ms min=436ms med=850.43ms max=2.31s p(90)=1.63s p(95)=1.7s http_reqs......................: 2988 97.742136/s iteration_duration.............: avg=1.01s min=446.05ms med=879.42ms max=2.34s p(90)=1.67s p(95)=1.74s iterations.....................: 2988 97.742136/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4497 ✗ 0 data_received..................: 132 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=51.98µs min=1.8µs med=4.17µs max=3.17ms p(90)=6.28µs p(95)=180.98µs http_req_connecting............: avg=40.8µs min=0s med=0s max=2.23ms p(90)=0s p(95)=128.51µs http_req_duration..............: avg=2.05s min=529.66ms med=1.68s max=21.75s p(90)=2.17s p(95)=2.72s { expected_response:true }...: avg=2.05s min=529.66ms med=1.68s max=21.75s p(90)=2.17s p(95)=2.72s http_req_failed................: 0.00% ✓ 0 ✗ 1499 http_req_receiving.............: avg=285.74µs min=50.66µs med=133.23µs max=59.95ms p(90)=194.72µs p(95)=228.56µs http_req_sending...............: avg=69.92µs min=8.82µs med=23.72µs max=11.04ms p(90)=40.53µs p(95)=118.67µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.05s min=529.51ms med=1.68s max=21.75s p(90)=2.17s p(95)=2.72s http_reqs......................: 1499 47.633141/s iteration_duration.............: avg=2.06s min=536.9ms med=1.69s max=21.76s p(90)=2.18s p(95)=2.73s iterations.....................: 1499 47.633141/s vus............................: 52 min=52 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2838 ✗ 0 data_received..................: 83 MB 2.7 MB/s data_sent......................: 1.1 MB 37 kB/s http_req_blocked...............: avg=59.32µs min=1.78µs med=3.79µs max=9.21ms p(90)=104.8µs p(95)=289.18µs http_req_connecting............: avg=50.12µs min=0s med=0s max=9.15ms p(90)=73.53µs p(95)=251.25µs http_req_duration..............: avg=3.21s min=817.01ms med=2.98s max=7.89s p(90)=4.18s p(95)=4.56s { expected_response:true }...: avg=3.21s min=817.01ms med=2.98s max=7.89s p(90)=4.18s p(95)=4.56s http_req_failed................: 0.00% ✓ 0 ✗ 946 http_req_receiving.............: avg=414.93µs min=46.79µs med=119.93µs max=79.02ms p(90)=184.07µs p(95)=279.88µs http_req_sending...............: avg=42.13µs min=9.43µs med=21.03µs max=2.86ms p(90)=44.16µs p(95)=140.77µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.21s min=816.49ms med=2.98s max=7.89s p(90)=4.18s p(95)=4.56s http_reqs......................: 946 30.718633/s iteration_duration.............: avg=3.22s min=825.91ms med=2.99s max=7.9s p(90)=4.19s p(95)=4.57s iterations.....................: 946 30.718633/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2886 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=334.55µs min=1.44µs med=4.26µs max=6.54ms p(90)=205.08µs p(95)=3.4ms http_req_connecting............: avg=324.02µs min=0s med=0s max=6.17ms p(90)=177.29µs p(95)=3.37ms http_req_duration..............: avg=3.21s min=1.37s med=3.02s max=7.59s p(90)=4.79s p(95)=5.37s { expected_response:true }...: avg=3.21s min=1.37s med=3.02s max=7.59s p(90)=4.79s p(95)=5.37s http_req_failed................: 0.00% ✓ 0 ✗ 962 http_req_receiving.............: avg=2.99ms min=43.3µs med=162.13µs max=90.6ms p(90)=1.4ms p(95)=9.77ms http_req_sending...............: avg=109.99µs min=8.48µs med=23.26µs max=11.16ms p(90)=402.11µs p(95)=479.6µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.21s min=1.37s med=3s max=7.58s p(90)=4.79s p(95)=5.37s http_reqs......................: 962 30.313106/s iteration_duration.............: avg=3.23s min=1.38s med=3.03s max=7.6s p(90)=4.81s p(95)=5.38s iterations.....................: 962 30.313106/s vus............................: 69 min=69 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2424ms 175 12260 total, 0 failed avg: 817ms, p95: 2425ms, max: 6382ms, med: 573ms ✅
wundergraph 2446ms 155 10890 total, 0 failed avg: 813ms, p95: 2446ms, max: 9626ms, med: 547ms ✅
apollo-router 2697ms 174 12195 total, 0 failed avg: 853ms, p95: 2698ms, max: 7370ms, med: 544ms ✅
mesh-supergraph-bun 5412ms 117 8236 total, 0 failed avg: 2227ms, p95: 5412ms, max: 9163ms, med: 2007ms ✅
mesh-supergraph 6546ms 71 4982 total, 0 failed avg: 3805ms, p95: 6546ms, max: 8445ms, med: 3941ms ✅
apollo-server 23733ms 68 5038 total, 0 failed avg: 4134ms, p95: 23733ms, max: 44874ms, med: 2215ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36780 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=16.36ms min=1.44µs med=2.8µs max=3.41s p(90)=4.44µs p(95)=11.43µs http_req_connecting............: avg=16.05ms min=0s med=0s max=3.41s p(90)=0s p(95)=0s http_req_duration..............: avg=817.3ms min=6.55ms med=573.29ms max=6.38s p(90)=1.81s p(95)=2.42s { expected_response:true }...: avg=817.3ms min=6.55ms med=573.29ms max=6.38s p(90)=1.81s p(95)=2.42s http_req_failed................: 0.00% ✓ 0 ✗ 12260 http_req_receiving.............: avg=278.54ms min=33.54µs med=77.19µs max=5.45s p(90)=1.1s p(95)=1.68s http_req_sending...............: avg=30.49ms min=7.83µs med=13.37µs max=3.4s p(90)=176.93µs p(95)=68.1ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=508.26ms min=6.47ms med=412.97ms max=2.64s p(90)=1.04s p(95)=1.37s http_reqs......................: 12260 175.128992/s iteration_duration.............: avg=1.49s min=12.06ms med=996.91ms max=14.04s p(90)=3.53s p(95)=4.61s iterations.....................: 12260 175.128992/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 32670 ✗ 0 data_received..................: 956 MB 14 MB/s data_sent......................: 13 MB 185 kB/s http_req_blocked...............: avg=18.87ms min=1.86µs med=4.54µs max=4.2s p(90)=6.93µs p(95)=42.16µs http_req_connecting............: avg=16.79ms min=0s med=0s max=4.2s p(90)=0s p(95)=0s http_req_duration..............: avg=812.84ms min=6.5ms med=547.17ms max=9.62s p(90)=1.81s p(95)=2.44s { expected_response:true }...: avg=812.84ms min=6.5ms med=547.17ms max=9.62s p(90)=1.81s p(95)=2.44s http_req_failed................: 0.00% ✓ 0 ✗ 10890 http_req_receiving.............: avg=320.19ms min=36.37µs med=119.77µs max=9.11s p(90)=1.21s p(95)=1.63s http_req_sending...............: avg=44.31ms min=8.12µs med=25.8µs max=3.93s p(90)=4.07ms p(95)=161.21ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=448.32ms min=6.4ms med=343.26ms max=3.24s p(90)=930.31ms p(95)=1.17s http_reqs......................: 10890 155.557352/s iteration_duration.............: avg=1.69s min=12.72ms med=1.08s max=13.55s p(90)=4.17s p(95)=5.09s iterations.....................: 10890 155.557352/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36585 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=15.46ms min=1.57µs med=3.11µs max=5.43s p(90)=4.98µs p(95)=12.32µs http_req_connecting............: avg=14.68ms min=0s med=0s max=4.05s p(90)=0s p(95)=0s http_req_duration..............: avg=853.36ms min=6.21ms med=544.49ms max=7.37s p(90)=2.1s p(95)=2.69s { expected_response:true }...: avg=853.36ms min=6.21ms med=544.49ms max=7.37s p(90)=2.1s p(95)=2.69s http_req_failed................: 0.00% ✓ 0 ✗ 12195 http_req_receiving.............: avg=362.28ms min=27.66µs med=91.78µs max=6.27s p(90)=1.36s p(95)=2s http_req_sending...............: avg=30.82ms min=8.54µs med=14.26µs max=4.43s p(90)=1.38ms p(95)=77.34ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=460.24ms min=6.12ms med=377.01ms max=2.05s p(90)=930.75ms p(95)=1.1s http_reqs......................: 12195 174.186519/s iteration_duration.............: avg=1.5s min=11.97ms med=970.34ms max=12.99s p(90)=3.58s p(95)=4.71s iterations.....................: 12195 174.186519/s vus............................: 1 min=1 max=498 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24708 ✗ 0 data_received..................: 723 MB 10 MB/s data_sent......................: 9.8 MB 140 kB/s http_req_blocked...............: avg=2.29ms min=1.26µs med=2.87µs max=564.51ms p(90)=4.95µs p(95)=215.32µs http_req_connecting............: avg=2.26ms min=0s med=0s max=564.45ms p(90)=0s p(95)=143.5µs http_req_duration..............: avg=2.22s min=6.27ms med=2s max=9.16s p(90)=4.36s p(95)=5.41s { expected_response:true }...: avg=2.22s min=6.27ms med=2s max=9.16s p(90)=4.36s p(95)=5.41s http_req_failed................: 0.00% ✓ 0 ✗ 8236 http_req_receiving.............: avg=23.45ms min=34.45µs med=75.57µs max=1.61s p(90)=16.87ms p(95)=145.81ms http_req_sending...............: avg=3.05ms min=7.78µs med=13.7µs max=766.33ms p(90)=74.71µs p(95)=9.93ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.2s min=6.06ms med=1.98s max=8.81s p(90)=4.27s p(95)=5.4s http_reqs......................: 8236 117.626192/s iteration_duration.............: avg=2.3s min=12.41ms med=2.06s max=9.18s p(90)=4.45s p(95)=5.5s iterations.....................: 8236 117.626192/s vus............................: 1 min=1 max=497 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14946 ✗ 0 data_received..................: 437 MB 6.2 MB/s data_sent......................: 5.9 MB 85 kB/s http_req_blocked...............: avg=578.3µs min=1.32µs med=3.63µs max=123.75ms p(90)=144.62µs p(95)=417.38µs http_req_connecting............: avg=563.03µs min=0s med=0s max=123.69ms p(90)=65.4µs p(95)=358.45µs http_req_duration..............: avg=3.8s min=9.9ms med=3.94s max=8.44s p(90)=5.99s p(95)=6.54s { expected_response:true }...: avg=3.8s min=9.9ms med=3.94s max=8.44s p(90)=5.99s p(95)=6.54s http_req_failed................: 0.00% ✓ 0 ✗ 4982 http_req_receiving.............: avg=2.67ms min=38.59µs med=95.78µs max=409.19ms p(90)=1.34ms p(95)=8.99ms http_req_sending...............: avg=582.64µs min=7.89µs med=18.2µs max=231.36ms p(90)=45.98µs p(95)=108.5µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.8s min=9.82ms med=3.94s max=8.44s p(90)=5.98s p(95)=6.53s http_reqs......................: 4982 71.168633/s iteration_duration.............: avg=3.83s min=15.82ms med=3.97s max=8.49s p(90)=6.03s p(95)=6.56s iterations.....................: 4982 71.168633/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15114 ✗ 0 data_received..................: 443 MB 6.1 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=126.59µs min=1.41µs med=3.3µs max=57.95ms p(90)=52.93µs p(95)=299.86µs http_req_connecting............: avg=113.83µs min=0s med=0s max=57.89ms p(90)=0s p(95)=224.21µs http_req_duration..............: avg=4.13s min=88.59ms med=2.21s max=44.87s p(90)=3.49s p(95)=23.73s { expected_response:true }...: avg=4.13s min=88.59ms med=2.21s max=44.87s p(90)=3.49s p(95)=23.73s http_req_failed................: 0.00% ✓ 0 ✗ 5038 http_req_receiving.............: avg=427.91µs min=42.51µs med=112.73µs max=164.36ms p(90)=182.18µs p(95)=225.65µs http_req_sending...............: avg=80.12µs min=8.24µs med=17.29µs max=45.85ms p(90)=42.63µs p(95)=65.52µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.13s min=88.5ms med=2.21s max=44.87s p(90)=3.49s p(95)=23.73s http_reqs......................: 5038 68.861704/s iteration_duration.............: avg=4.14s min=96.64ms med=2.22s max=44.88s p(90)=3.5s p(95)=23.74s iterations.....................: 5038 68.861704/s vus............................: 14 min=14 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview