search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update dependency @types/node to v20.11.29 #406

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@types/node (source) 20.11.28 -> 20.11.29 age adoption passing confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5063 total, 0 failed avg: 536ms, p95: 692ms ✅
wundergraph 104 3229 total, 0 failed avg: 907ms, p95: 1104ms ✅
mesh-supergraph-bun 102 3163 total, 0 failed avg: 929ms, p95: 1291ms ✅
cosmo 80 2487 total, 0 failed avg: 1195ms, p95: 1430ms ✅
apollo-server 64 2022 total, 0 failed avg: 1512ms, p95: 1859ms ✅
mesh-supergraph 62 1946 total, 0 failed avg: 1543ms, p95: 2374ms ✅
mercurius 12 476 total, 0 failed avg: 7109ms, p95: 8461ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15189 ✗ 0 data_received..................: 444 MB 15 MB/s data_sent......................: 6.0 MB 197 kB/s http_req_blocked...............: avg=27.3µs min=1.4µs med=2.91µs max=29.77ms p(90)=4.34µs p(95)=5.37µs http_req_connecting............: avg=15.51µs min=0s med=0s max=2.8ms p(90)=0s p(95)=0s http_req_duration..............: avg=535.51ms min=269.45ms med=529.45ms max=1.09s p(90)=653.72ms p(95)=691.77ms { expected_response:true }...: avg=535.51ms min=269.45ms med=529.45ms max=1.09s p(90)=653.72ms p(95)=691.77ms http_req_failed................: 0.00% ✓ 0 ✗ 5063 http_req_receiving.............: avg=13.83ms min=37.4µs med=73.99µs max=439.25ms p(90)=54.41ms p(95)=90.26ms http_req_sending...............: avg=1.57ms min=8.44µs med=13.52µs max=433.06ms p(90)=37.14µs p(95)=678.97µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=520.11ms min=269.33ms med=517.67ms max=843.55ms p(90)=623.91ms p(95)=657.85ms http_reqs......................: 5063 165.857634/s iteration_duration.............: avg=598.2ms min=283.33ms med=583.5ms max=1.25s p(90)=753ms p(95)=824.42ms iterations.....................: 5063 165.857634/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9687 ✗ 0 data_received..................: 283 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=66.84µs min=1.15µs med=2.55µs max=7.12ms p(90)=3.82µs p(95)=7.57µs http_req_connecting............: avg=56.89µs min=0s med=0s max=6.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=906.65ms min=600.62ms med=899.56ms max=1.39s p(90)=1.05s p(95)=1.1s { expected_response:true }...: avg=906.65ms min=600.62ms med=899.56ms max=1.39s p(90)=1.05s p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 3229 http_req_receiving.............: avg=9.74ms min=37.54µs med=75.28µs max=373.88ms p(90)=23.15ms p(95)=66.59ms http_req_sending...............: avg=864.41µs min=7.96µs med=12.71µs max=242.29ms p(90)=32.65µs p(95)=504.92µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=896.04ms min=600.45ms med=893.3ms max=1.27s p(90)=1.03s p(95)=1.06s http_reqs......................: 3229 104.600551/s iteration_duration.............: avg=944.71ms min=628.24ms med=935.93ms max=1.41s p(90)=1.1s p(95)=1.16s iterations.....................: 3229 104.600551/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9489 ✗ 0 data_received..................: 278 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=48.53µs min=1.35µs med=2.93µs max=6.14ms p(90)=4.58µs p(95)=9.6µs http_req_connecting............: avg=41.66µs min=0s med=0s max=6.11ms p(90)=0s p(95)=0s http_req_duration..............: avg=928.72ms min=383.74ms med=909.77ms max=1.75s p(90)=1.17s p(95)=1.29s { expected_response:true }...: avg=928.72ms min=383.74ms med=909.77ms max=1.75s p(90)=1.17s p(95)=1.29s http_req_failed................: 0.00% ✓ 0 ✗ 3163 http_req_receiving.............: avg=11.72ms min=35.88µs med=93.08µs max=624.05ms p(90)=657.49µs p(95)=37.24ms http_req_sending...............: avg=605.85µs min=8.54µs med=13.95µs max=213.67ms p(90)=33.75µs p(95)=172.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=916.39ms min=383.52ms med=901.17ms max=1.75s p(90)=1.15s p(95)=1.25s http_reqs......................: 3163 102.876749/s iteration_duration.............: avg=964.61ms min=394.2ms med=940.14ms max=1.87s p(90)=1.24s p(95)=1.36s iterations.....................: 3163 102.876749/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7461 ✗ 0 data_received..................: 218 MB 7.0 MB/s data_sent......................: 3.0 MB 95 kB/s http_req_blocked...............: avg=38.76µs min=1.39µs med=2.55µs max=2.79ms p(90)=3.88µs p(95)=9.11µs http_req_connecting............: avg=32.86µs min=0s med=0s max=2.75ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=717.88ms med=1.19s max=1.78s p(90)=1.37s p(95)=1.42s { expected_response:true }...: avg=1.19s min=717.88ms med=1.19s max=1.78s p(90)=1.37s p(95)=1.42s http_req_failed................: 0.00% ✓ 0 ✗ 2487 http_req_receiving.............: avg=13.54ms min=40.28µs med=86.66µs max=323.42ms p(90)=57.23ms p(95)=95.21ms http_req_sending...............: avg=1.32ms min=8.12µs med=12.89µs max=239.07ms p(90)=61.82µs p(95)=263.28µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=717.67ms med=1.18s max=1.63s p(90)=1.34s p(95)=1.4s http_reqs......................: 2487 80.247772/s iteration_duration.............: avg=1.23s min=728.53ms med=1.23s max=1.85s p(90)=1.42s p(95)=1.48s iterations.....................: 2487 80.247772/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6066 ✗ 0 data_received..................: 178 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=59.37µs min=1.54µs med=3.05µs max=8.86ms p(90)=4.79µs p(95)=78.76µs http_req_connecting............: avg=54.04µs min=0s med=0s max=8.82ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.51s min=748.14ms med=1.43s max=9.15s p(90)=1.74s p(95)=1.85s { expected_response:true }...: avg=1.51s min=748.14ms med=1.43s max=9.15s p(90)=1.74s p(95)=1.85s http_req_failed................: 0.00% ✓ 0 ✗ 2022 http_req_receiving.............: avg=483.37µs min=41.68µs med=110.48µs max=77.32ms p(90)=188.62µs p(95)=319.78µs http_req_sending...............: avg=63.36µs min=8.76µs med=16.2µs max=27.36ms p(90)=32.61µs p(95)=121.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.51s min=747.37ms med=1.43s max=9.15s p(90)=1.73s p(95)=1.85s http_reqs......................: 2022 64.733884/s iteration_duration.............: avg=1.52s min=758.69ms med=1.44s max=9.16s p(90)=1.75s p(95)=1.87s iterations.....................: 2022 64.733884/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5838 ✗ 0 data_received..................: 171 MB 5.5 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=113.55µs min=1.58µs med=4.01µs max=6.6ms p(90)=5.83µs p(95)=104.95µs http_req_connecting............: avg=89.98µs min=0s med=0s max=5.13ms p(90)=0s p(95)=67.15µs http_req_duration..............: avg=1.54s min=603.4ms med=1.47s max=3.66s p(90)=2.07s p(95)=2.37s { expected_response:true }...: avg=1.54s min=603.4ms med=1.47s max=3.66s p(90)=2.07s p(95)=2.37s http_req_failed................: 0.00% ✓ 0 ✗ 1946 http_req_receiving.............: avg=2.03ms min=41.26µs med=122.45µs max=102.16ms p(90)=2.78ms p(95)=10.87ms http_req_sending...............: avg=337.28µs min=8.74µs med=20.22µs max=107.55ms p(90)=40.78µs p(95)=190.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.54s min=603.26ms med=1.46s max=3.64s p(90)=2.07s p(95)=2.36s http_reqs......................: 1946 62.907138/s iteration_duration.............: avg=1.57s min=613.33ms med=1.5s max=3.73s p(90)=2.11s p(95)=2.44s iterations.....................: 1946 62.907138/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1428 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 565 kB 15 kB/s http_req_blocked...............: avg=362.22µs min=1.73µs med=4.18µs max=4.63ms p(90)=1.5ms p(95)=2.55ms http_req_connecting............: avg=306.5µs min=0s med=0s max=4.58ms p(90)=1.2ms p(95)=2.24ms http_req_duration..............: avg=7.1s min=3.3s med=7.34s max=8.93s p(90)=8.28s p(95)=8.46s { expected_response:true }...: avg=7.1s min=3.3s med=7.34s max=8.93s p(90)=8.28s p(95)=8.46s http_req_failed................: 0.00% ✓ 0 ✗ 476 http_req_receiving.............: avg=151.98µs min=59.27µs med=131.73µs max=2.86ms p(90)=197.46µs p(95)=242.09µs http_req_sending...............: avg=154.81µs min=9.92µs med=22.95µs max=1.14ms p(90)=661.11µs p(95)=987.64µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.1s min=3.3s med=7.34s max=8.93s p(90)=8.28s p(95)=8.46s http_reqs......................: 476 12.768804/s iteration_duration.............: avg=7.11s min=3.31s med=7.34s max=8.94s p(90)=8.29s p(95)=8.46s iterations.....................: 476 12.768804/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2273ms 175 12257 total, 0 failed avg: 774ms, p95: 2274ms, max: 7029ms, med: 529ms ✅
wundergraph 2356ms 165 11610 total, 0 failed avg: 780ms, p95: 2356ms, max: 6177ms, med: 500ms ✅
apollo-router 2766ms 171 11980 total, 0 failed avg: 850ms, p95: 2766ms, max: 7089ms, med: 528ms ✅
mesh-supergraph-bun 5474ms 118 8274 total, 0 failed avg: 2201ms, p95: 5475ms, max: 8639ms, med: 1977ms ✅
mesh-supergraph 6982ms 64 4507 total, 0 failed avg: 4239ms, p95: 6983ms, max: 9057ms, med: 4429ms ✅
apollo-server 23369ms 69 5066 total, 0 failed avg: 4119ms, p95: 23370ms, max: 44826ms, med: 2231ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36771 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=17.56ms min=1.38µs med=2.86µs max=6.02s p(90)=4.7µs p(95)=11.54µs http_req_connecting............: avg=16.54ms min=0s med=0s max=6.02s p(90)=0s p(95)=0s http_req_duration..............: avg=774.34ms min=6.65ms med=528.94ms max=7.02s p(90)=1.68s p(95)=2.27s { expected_response:true }...: avg=774.34ms min=6.65ms med=528.94ms max=7.02s p(90)=1.68s p(95)=2.27s http_req_failed................: 0.00% ✓ 0 ✗ 12257 http_req_receiving.............: avg=272.45ms min=33.53µs med=77.26µs max=5.84s p(90)=1.09s p(95)=1.63s http_req_sending...............: avg=29.52ms min=7.57µs med=13.55µs max=5.62s p(90)=204.56µs p(95)=65.67ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=472.35ms min=6.56ms med=370.93ms max=2.78s p(90)=984.7ms p(95)=1.27s http_reqs......................: 12257 175.091942/s iteration_duration.............: avg=1.51s min=12.01ms med=1s max=11.68s p(90)=3.67s p(95)=4.57s iterations.....................: 12257 175.091942/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34830 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 197 kB/s http_req_blocked...............: avg=23.42ms min=1.48µs med=3.01µs max=4.56s p(90)=4.78µs p(95)=14.08µs http_req_connecting............: avg=22.43ms min=0s med=0s max=4.56s p(90)=0s p(95)=0s http_req_duration..............: avg=780.25ms min=6.55ms med=499.54ms max=6.17s p(90)=1.89s p(95)=2.35s { expected_response:true }...: avg=780.25ms min=6.55ms med=499.54ms max=6.17s p(90)=1.89s p(95)=2.35s http_req_failed................: 0.00% ✓ 0 ✗ 11610 http_req_receiving.............: avg=280.43ms min=29.16µs med=80.22µs max=5.96s p(90)=1.15s p(95)=1.84s http_req_sending...............: avg=33.62ms min=8.23µs med=14.46µs max=4.51s p(90)=142.51µs p(95)=49.86ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=466.19ms min=6.45ms med=323.5ms max=4.18s p(90)=1.06s p(95)=1.38s http_reqs......................: 11610 165.826754/s iteration_duration.............: avg=1.58s min=12.06ms med=1s max=15.51s p(90)=3.92s p(95)=4.97s iterations.....................: 11610 165.826754/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35940 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 203 kB/s http_req_blocked...............: avg=12.33ms min=1.63µs med=3.32µs max=4.05s p(90)=5.54µs p(95)=13.04µs http_req_connecting............: avg=11.68ms min=0s med=0s max=3.51s p(90)=0s p(95)=0s http_req_duration..............: avg=850.38ms min=7.44ms med=527.53ms max=7.08s p(90)=2.17s p(95)=2.76s { expected_response:true }...: avg=850.38ms min=7.44ms med=527.53ms max=7.08s p(90)=2.17s p(95)=2.76s http_req_failed................: 0.00% ✓ 0 ✗ 11980 http_req_receiving.............: avg=373.89ms min=30.8µs med=89.84µs max=5.87s p(90)=1.43s p(95)=2.07s http_req_sending...............: avg=30.6ms min=7.64µs med=16.02µs max=4.68s p(90)=171.78µs p(95)=46.5ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=445.88ms min=7.34ms med=383.07ms max=1.74s p(90)=857.54ms p(95)=1s http_reqs......................: 11980 171.11933/s iteration_duration.............: avg=1.53s min=15.94ms med=939.89ms max=11.24s p(90)=3.77s p(95)=4.91s iterations.....................: 11980 171.11933/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24822 ✗ 0 data_received..................: 726 MB 10 MB/s data_sent......................: 9.8 MB 140 kB/s http_req_blocked...............: avg=2.24ms min=1.42µs med=2.97µs max=388.47ms p(90)=5.26µs p(95)=217.16µs http_req_connecting............: avg=2.18ms min=0s med=0s max=388.4ms p(90)=0s p(95)=142.6µs http_req_duration..............: avg=2.2s min=4.7ms med=1.97s max=8.63s p(90)=4.4s p(95)=5.47s { expected_response:true }...: avg=2.2s min=4.7ms med=1.97s max=8.63s p(90)=4.4s p(95)=5.47s http_req_failed................: 0.00% ✓ 0 ✗ 8274 http_req_receiving.............: avg=32.12ms min=37.39µs med=77.11µs max=1.47s p(90)=51.21ms p(95)=227.34ms http_req_sending...............: avg=3.42ms min=8.1µs med=14.03µs max=997.91ms p(90)=85.64µs p(95)=9.03ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.16s min=4.51ms med=1.94s max=8.63s p(90)=4.35s p(95)=5.45s http_reqs......................: 8274 118.196164/s iteration_duration.............: avg=2.28s min=10.33ms med=2.05s max=8.88s p(90)=4.53s p(95)=5.52s iterations.....................: 8274 118.196164/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13521 ✗ 0 data_received..................: 396 MB 5.6 MB/s data_sent......................: 5.3 MB 76 kB/s http_req_blocked...............: avg=556.73µs min=1.75µs med=4.83µs max=122.43ms p(90)=200.47µs p(95)=463.42µs http_req_connecting............: avg=519.86µs min=0s med=0s max=122.36ms p(90)=141.24µs p(95)=385.99µs http_req_duration..............: avg=4.23s min=11.59ms med=4.42s max=9.05s p(90)=6.67s p(95)=6.98s { expected_response:true }...: avg=4.23s min=11.59ms med=4.42s max=9.05s p(90)=6.67s p(95)=6.98s http_req_failed................: 0.00% ✓ 0 ✗ 4507 http_req_receiving.............: avg=2.52ms min=43.53µs med=124.46µs max=643.36ms p(90)=2.41ms p(95)=9.93ms http_req_sending...............: avg=472.58µs min=9.29µs med=27.47µs max=234.41ms p(90)=60.11µs p(95)=124.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.23s min=11.47ms med=4.42s max=9.05s p(90)=6.66s p(95)=6.98s http_reqs......................: 4507 64.385314/s iteration_duration.............: avg=4.26s min=17.39ms med=4.45s max=9.22s p(90)=6.7s p(95)=7.01s iterations.....................: 4507 64.385314/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15198 ✗ 0 data_received..................: 445 MB 6.1 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=89.94µs min=1.46µs med=3.19µs max=30.36ms p(90)=26.8µs p(95)=263.58µs http_req_connecting............: avg=77.26µs min=0s med=0s max=30.28ms p(90)=0s p(95)=187.28µs http_req_duration..............: avg=4.11s min=94.31ms med=2.23s max=44.82s p(90)=3.34s p(95)=23.36s { expected_response:true }...: avg=4.11s min=94.31ms med=2.23s max=44.82s p(90)=3.34s p(95)=23.36s http_req_failed................: 0.00% ✓ 0 ✗ 5066 http_req_receiving.............: avg=214.07µs min=46.72µs med=114.03µs max=133.38ms p(90)=175.85µs p(95)=204.01µs http_req_sending...............: avg=87.05µs min=7.81µs med=16.55µs max=37.07ms p(90)=40.83µs p(95)=61.82µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.11s min=94.19ms med=2.23s max=44.82s p(90)=3.34s p(95)=23.36s http_reqs......................: 5066 69.267091/s iteration_duration.............: avg=4.13s min=101.13ms med=2.24s max=44.83s p(90)=3.35s p(95)=23.37s iterations.....................: 5066 69.267091/s vus............................: 17 min=17 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5353 total, 0 failed avg: 493ms, p95: 674ms ✅
apollo-router 168 5124 total, 0 failed avg: 531ms, p95: 712ms ✅
wundergraph 160 4864 total, 0 failed avg: 520ms, p95: 959ms ✅
mesh-supergraph-bun 97 2996 total, 0 failed avg: 992ms, p95: 1676ms ✅
apollo-server 50 1591 total, 0 failed avg: 1919ms, p95: 2436ms ✅
mesh-supergraph 30 971 total, 0 failed avg: 3165ms, p95: 5247ms ✅
mercurius 29 915 total, 0 failed avg: 3316ms, p95: 4942ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16059 ✗ 0 data_received..................: 470 MB 15 MB/s data_sent......................: 6.4 MB 209 kB/s http_req_blocked...............: avg=227.77µs min=1.37µs med=2.71µs max=130.46ms p(90)=4.03µs p(95)=5.06µs http_req_connecting............: avg=141.29µs min=0s med=0s max=44.45ms p(90)=0s p(95)=0s http_req_duration..............: avg=492.79ms min=49.37ms med=493.62ms max=1.76s p(90)=609.79ms p(95)=674.11ms { expected_response:true }...: avg=492.79ms min=49.37ms med=493.62ms max=1.76s p(90)=609.79ms p(95)=674.11ms http_req_failed................: 0.00% ✓ 0 ✗ 5353 http_req_receiving.............: avg=27.44ms min=39.75µs med=74.04µs max=1.27s p(90)=70.82ms p(95)=196.92ms http_req_sending...............: avg=1.69ms min=7.69µs med=12.95µs max=1.07s p(90)=32.71µs p(95)=262.53µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=463.66ms min=49.28ms med=481.59ms max=744.35ms p(90)=567.43ms p(95)=596.34ms http_reqs......................: 5353 175.817696/s iteration_duration.............: avg=565.32ms min=59.33ms med=538.67ms max=2.34s p(90)=738.88ms p(95)=886.62ms iterations.....................: 5353 175.817696/s vus............................: 96 min=96 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15372 ✗ 0 data_received..................: 450 MB 15 MB/s data_sent......................: 6.1 MB 200 kB/s http_req_blocked...............: avg=22.68µs min=1.29µs med=2.82µs max=20.01ms p(90)=4.32µs p(95)=5.46µs http_req_connecting............: avg=12.43µs min=0s med=0s max=1.67ms p(90)=0s p(95)=0s http_req_duration..............: avg=530.8ms min=158.87ms med=531.98ms max=1.3s p(90)=665.29ms p(95)=712.09ms { expected_response:true }...: avg=530.8ms min=158.87ms med=531.98ms max=1.3s p(90)=665.29ms p(95)=712.09ms http_req_failed................: 0.00% ✓ 0 ✗ 5124 http_req_receiving.............: avg=13.68ms min=36.55µs med=67.52µs max=865.92ms p(90)=12.92ms p(95)=67.25ms http_req_sending...............: avg=1.32ms min=8.06µs med=13.61µs max=509.96ms p(90)=35.63µs p(95)=219.58µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=515.79ms min=158.81ms med=522.8ms max=945.4ms p(90)=642.94ms p(95)=679.73ms http_reqs......................: 5124 168.170156/s iteration_duration.............: avg=590.63ms min=168.14ms med=574.81ms max=1.59s p(90)=745.79ms p(95)=837.36ms iterations.....................: 5124 168.170156/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14592 ✗ 0 data_received..................: 427 MB 14 MB/s data_sent......................: 5.8 MB 190 kB/s http_req_blocked...............: avg=24.92µs min=1.24µs med=2.72µs max=7.5ms p(90)=4.4µs p(95)=5.49µs http_req_connecting............: avg=17.55µs min=0s med=0s max=3.55ms p(90)=0s p(95)=0s http_req_duration..............: avg=520.37ms min=9.31ms med=502.77ms max=1.99s p(90)=840.93ms p(95)=958.82ms { expected_response:true }...: avg=520.37ms min=9.31ms med=502.77ms max=1.99s p(90)=840.93ms p(95)=958.82ms http_req_failed................: 0.00% ✓ 0 ✗ 4864 http_req_receiving.............: avg=55ms min=38.31µs med=80.42µs max=1.55s p(90)=196.65ms p(95)=428.79ms http_req_sending...............: avg=2.42ms min=7.47µs med=13.3µs max=929.68ms p(90)=37.07µs p(95)=321.97µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=462.95ms min=9.2ms med=452.84ms max=1.3s p(90)=759.88ms p(95)=857.92ms http_reqs......................: 4864 160.352043/s iteration_duration.............: avg=620.43ms min=19.96ms med=578ms max=2.73s p(90)=999.86ms p(95)=1.18s iterations.....................: 4864 160.352043/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8988 ✗ 0 data_received..................: 263 MB 8.5 MB/s data_sent......................: 3.6 MB 116 kB/s http_req_blocked...............: avg=46.13µs min=1.27µs med=2.8µs max=36.86ms p(90)=4.51µs p(95)=9.73µs http_req_connecting............: avg=25.07µs min=0s med=0s max=7.18ms p(90)=0s p(95)=0s http_req_duration..............: avg=992.13ms min=296.67ms med=857.69ms max=2.57s p(90)=1.59s p(95)=1.67s { expected_response:true }...: avg=992.13ms min=296.67ms med=857.69ms max=2.57s p(90)=1.59s p(95)=1.67s http_req_failed................: 0.00% ✓ 0 ✗ 2996 http_req_receiving.............: avg=10.9ms min=34.61µs med=89.99µs max=695.36ms p(90)=2.28ms p(95)=52.13ms http_req_sending...............: avg=333.73µs min=7.49µs med=13.63µs max=86.73ms p(90)=35.09µs p(95)=147.25µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=980.89ms min=295.79ms med=852.6ms max=2.57s p(90)=1.59s p(95)=1.66s http_reqs......................: 2996 97.380045/s iteration_duration.............: avg=1.01s min=308.2ms med=880.64ms max=2.65s p(90)=1.63s p(95)=1.71s iterations.....................: 2996 97.380045/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4773 ✗ 0 data_received..................: 140 MB 4.5 MB/s data_sent......................: 1.9 MB 60 kB/s http_req_blocked...............: avg=55.91µs min=1.37µs med=2.94µs max=6.75ms p(90)=5.21µs p(95)=175.22µs http_req_connecting............: avg=40.45µs min=0s med=0s max=2.22ms p(90)=0s p(95)=118.77µs http_req_duration..............: avg=1.91s min=414.37ms med=1.63s max=20.81s p(90)=1.92s p(95)=2.43s { expected_response:true }...: avg=1.91s min=414.37ms med=1.63s max=20.81s p(90)=1.92s p(95)=2.43s http_req_failed................: 0.00% ✓ 0 ✗ 1591 http_req_receiving.............: avg=179.13µs min=49.74µs med=122.29µs max=32.94ms p(90)=181.62µs p(95)=210.58µs http_req_sending...............: avg=45.41µs min=8.4µs med=15.45µs max=1.26ms p(90)=32.59µs p(95)=124.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.91s min=414.09ms med=1.63s max=20.81s p(90)=1.92s p(95)=2.43s http_reqs......................: 1591 50.88637/s iteration_duration.............: avg=1.92s min=426.47ms med=1.64s max=20.82s p(90)=1.93s p(95)=2.44s iterations.....................: 1591 50.88637/s vus............................: 32 min=32 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2913 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=140.81µs min=1.22µs med=3.61µs max=13.06ms p(90)=100.48µs p(95)=632.65µs http_req_connecting............: avg=116.51µs min=0s med=0s max=5.11ms p(90)=64.32µs p(95)=511.86µs http_req_duration..............: avg=3.16s min=1.43s med=3.07s max=7.23s p(90)=4.45s p(95)=5.24s { expected_response:true }...: avg=3.16s min=1.43s med=3.07s max=7.23s p(90)=4.45s p(95)=5.24s http_req_failed................: 0.00% ✓ 0 ✗ 971 http_req_receiving.............: avg=3.34ms min=43.76µs med=137.89µs max=83.15ms p(90)=2.26ms p(95)=12.26ms http_req_sending...............: avg=85.46µs min=7.6µs med=19.85µs max=22.68ms p(90)=108.82µs p(95)=240.51µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.16s min=1.43s med=3.07s max=7.23s p(90)=4.45s p(95)=5.24s http_reqs......................: 971 30.762358/s iteration_duration.............: avg=3.18s min=1.43s med=3.08s max=7.24s p(90)=4.46s p(95)=5.27s iterations.....................: 971 30.762358/s vus............................: 42 min=42 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2745 ✗ 0 data_received..................: 80 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=90.42µs min=1.68µs med=4.3µs max=3.71ms p(90)=132.58µs p(95)=617.76µs http_req_connecting............: avg=79.65µs min=0s med=0s max=2.65ms p(90)=98.73µs p(95)=554.84µs http_req_duration..............: avg=3.31s min=444.51ms med=3.11s max=8.18s p(90)=4.4s p(95)=4.94s { expected_response:true }...: avg=3.31s min=444.51ms med=3.11s max=8.18s p(90)=4.4s p(95)=4.94s http_req_failed................: 0.00% ✓ 0 ✗ 915 http_req_receiving.............: avg=395.22µs min=45.06µs med=124.77µs max=76.15ms p(90)=182.76µs p(95)=231.46µs http_req_sending...............: avg=70.74µs min=9.28µs med=24.77µs max=8.4ms p(90)=66.6µs p(95)=334.52µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.31s min=444.28ms med=3.11s max=8.18s p(90)=4.4s p(95)=4.94s http_reqs......................: 915 29.676931/s iteration_duration.............: avg=3.32s min=453.93ms med=3.12s max=8.19s p(90)=4.4s p(95)=4.95s iterations.....................: 915 29.676931/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 149 4566 total, 0 failed avg: 609ms, p95: 815ms ✅
wundergraph 98 3038 total, 0 failed avg: 962ms, p95: 1228ms ✅
mesh-supergraph-bun 81 2507 total, 0 failed avg: 1182ms, p95: 1731ms ✅
cosmo 79 2470 total, 0 failed avg: 1198ms, p95: 1472ms ✅
apollo-server 47 1484 total, 0 failed avg: 2048ms, p95: 2303ms ✅
mesh-supergraph 31 994 total, 0 failed avg: 3097ms, p95: 4845ms ✅
mercurius 11 449 total, 0 failed avg: 7591ms, p95: 9002ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13698 ✗ 0 data_received..................: 401 MB 13 MB/s data_sent......................: 5.4 MB 177 kB/s http_req_blocked...............: avg=55.3µs min=1.27µs med=2.63µs max=87.01ms p(90)=4.04µs p(95)=5.25µs http_req_connecting............: avg=24.59µs min=0s med=0s max=7.2ms p(90)=0s p(95)=0s http_req_duration..............: avg=609.05ms min=287.03ms med=602.17ms max=1.24s p(90)=758.16ms p(95)=814.87ms { expected_response:true }...: avg=609.05ms min=287.03ms med=602.17ms max=1.24s p(90)=758.16ms p(95)=814.87ms http_req_failed................: 0.00% ✓ 0 ✗ 4566 http_req_receiving.............: avg=13.93ms min=32.7µs med=68.51µs max=314.51ms p(90)=54.98ms p(95)=98.24ms http_req_sending...............: avg=1.32ms min=7.25µs med=12.98µs max=218.72ms p(90)=33.19µs p(95)=225.48µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=593.79ms min=286.92ms med=589.37ms max=1.24s p(90)=730.04ms p(95)=775.35ms http_reqs......................: 4566 149.213928/s iteration_duration.............: avg=664.12ms min=298.05ms med=651.36ms max=1.29s p(90)=835.45ms p(95)=930.07ms iterations.....................: 4566 149.213928/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9114 ✗ 0 data_received..................: 267 MB 8.7 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=72.31µs min=2.06µs med=4.41µs max=7.19ms p(90)=7.75µs p(95)=12.8µs http_req_connecting............: avg=63.47µs min=0s med=0s max=7.14ms p(90)=0s p(95)=0s http_req_duration..............: avg=961.91ms min=579.67ms med=942.65ms max=1.8s p(90)=1.13s p(95)=1.22s { expected_response:true }...: avg=961.91ms min=579.67ms med=942.65ms max=1.8s p(90)=1.13s p(95)=1.22s http_req_failed................: 0.00% ✓ 0 ✗ 3038 http_req_receiving.............: avg=10.42ms min=41.63µs med=118.43µs max=385.92ms p(90)=39.53ms p(95)=70.47ms http_req_sending...............: avg=1.23ms min=9.54µs med=23.42µs max=318.15ms p(90)=84.31µs p(95)=758.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=950.25ms min=579.6ms med=933.56ms max=1.59s p(90)=1.11s p(95)=1.2s http_reqs......................: 3038 98.595676/s iteration_duration.............: avg=1s min=601.44ms med=980.6ms max=1.83s p(90)=1.18s p(95)=1.28s iterations.....................: 3038 98.595676/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7521 ✗ 0 data_received..................: 220 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=106.42µs min=1.39µs med=3.54µs max=20.64ms p(90)=5.71µs p(95)=11.78µs http_req_connecting............: avg=77.99µs min=0s med=0s max=6.71ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.18s min=501.85ms med=1.14s max=2.35s p(90)=1.54s p(95)=1.73s { expected_response:true }...: avg=1.18s min=501.85ms med=1.14s max=2.35s p(90)=1.54s p(95)=1.73s http_req_failed................: 0.00% ✓ 0 ✗ 2507 http_req_receiving.............: avg=14.89ms min=39.89µs med=103.53µs max=719.42ms p(90)=4.89ms p(95)=66.07ms http_req_sending...............: avg=536.13µs min=8.41µs med=17.15µs max=108.25ms p(90)=47.07µs p(95)=534.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=501.55ms med=1.12s max=2.35s p(90)=1.5s p(95)=1.7s http_reqs......................: 2507 81.212681/s iteration_duration.............: avg=1.21s min=509.78ms med=1.17s max=2.47s p(90)=1.57s p(95)=1.78s iterations.....................: 2507 81.212681/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7410 ✗ 0 data_received..................: 217 MB 7.0 MB/s data_sent......................: 2.9 MB 94 kB/s http_req_blocked...............: avg=26.5µs min=1.47µs med=2.76µs max=7.82ms p(90)=4.56µs p(95)=9.39µs http_req_connecting............: avg=20.16µs min=0s med=0s max=7.77ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=737.58ms med=1.19s max=1.72s p(90)=1.41s p(95)=1.47s { expected_response:true }...: avg=1.19s min=737.58ms med=1.19s max=1.72s p(90)=1.41s p(95)=1.47s http_req_failed................: 0.00% ✓ 0 ✗ 2470 http_req_receiving.............: avg=11.45ms min=39.81µs med=88.25µs max=413.14ms p(90)=37.13ms p(95)=83.65ms http_req_sending...............: avg=1.44ms min=7.61µs med=13.18µs max=197.59ms p(90)=66.22µs p(95)=322.97µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=737.46ms med=1.19s max=1.63s p(90)=1.38s p(95)=1.43s http_reqs......................: 2470 79.364306/s iteration_duration.............: avg=1.24s min=772.43ms med=1.23s max=1.75s p(90)=1.48s p(95)=1.54s iterations.....................: 2470 79.364306/s vus............................: 39 min=39 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4452 ✗ 0 data_received..................: 130 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=265.34µs min=1.42µs med=3.21µs max=10.81ms p(90)=5.32µs p(95)=1.28ms http_req_connecting............: avg=256.23µs min=0s med=0s max=10.75ms p(90)=0s p(95)=1.01ms http_req_duration..............: avg=2.04s min=1.12s med=1.9s max=12.87s p(90)=2.2s p(95)=2.3s { expected_response:true }...: avg=2.04s min=1.12s med=1.9s max=12.87s p(90)=2.2s p(95)=2.3s http_req_failed................: 0.00% ✓ 0 ✗ 1484 http_req_receiving.............: avg=260.31µs min=45.75µs med=114.32µs max=45.98ms p(90)=187.38µs p(95)=273.55µs http_req_sending...............: avg=304.24µs min=8.36µs med=16.7µs max=68.67ms p(90)=41.52µs p(95)=863.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.04s min=1.12s med=1.9s max=12.87s p(90)=2.2s p(95)=2.3s http_reqs......................: 1484 47.654624/s iteration_duration.............: avg=2.06s min=1.13s med=1.92s max=12.89s p(90)=2.22s p(95)=2.33s iterations.....................: 1484 47.654624/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2982 ✗ 0 data_received..................: 87 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=200.84µs min=1.33µs med=3.19µs max=15.97ms p(90)=117.91µs p(95)=853.99µs http_req_connecting............: avg=139.75µs min=0s med=0s max=11.32ms p(90)=45.73µs p(95)=566.32µs http_req_duration..............: avg=3.09s min=1.38s med=2.9s max=7.17s p(90)=4.01s p(95)=4.84s { expected_response:true }...: avg=3.09s min=1.38s med=2.9s max=7.17s p(90)=4.01s p(95)=4.84s http_req_failed................: 0.00% ✓ 0 ✗ 994 http_req_receiving.............: avg=2.98ms min=39.59µs med=140.67µs max=82.9ms p(90)=1.74ms p(95)=9.98ms http_req_sending...............: avg=125.17µs min=8.13µs med=17.78µs max=22.61ms p(90)=106.97µs p(95)=291.28µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.09s min=1.38s med=2.89s max=7.17s p(90)=4s p(95)=4.84s http_reqs......................: 994 31.340792/s iteration_duration.............: avg=3.11s min=1.39s med=2.91s max=7.18s p(90)=4.03s p(95)=4.85s iterations.....................: 994 31.340792/s vus............................: 52 min=52 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1347 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 533 kB 14 kB/s http_req_blocked...............: avg=150.72µs min=1.48µs med=3.82µs max=3.38ms p(90)=552.03µs p(95)=1.05ms http_req_connecting............: avg=135.57µs min=0s med=0s max=3.35ms p(90)=502.83µs p(95)=999.2µs http_req_duration..............: avg=7.59s min=3.74s med=7.76s max=9.39s p(90)=8.88s p(95)=9s { expected_response:true }...: avg=7.59s min=3.74s med=7.76s max=9.39s p(90)=8.88s p(95)=9s http_req_failed................: 0.00% ✓ 0 ✗ 449 http_req_receiving.............: avg=139.94µs min=61.34µs med=119.2µs max=1.38ms p(90)=180.52µs p(95)=228.79µs http_req_sending...............: avg=97.38µs min=8.52µs med=21.96µs max=1.47ms p(90)=274.91µs p(95)=469.92µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.59s min=3.74s med=7.76s max=9.39s p(90)=8.88s p(95)=9s http_reqs......................: 449 11.928966/s iteration_duration.............: avg=7.59s min=3.74s med=7.77s max=9.4s p(90)=8.88s p(95)=9s iterations.....................: 449 11.928966/s vus............................: 14 min=14 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview