the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Lock file maintenance #404

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Update Change
lockFileMaintenance All locks refreshed

🔧 This Pull Request updates lock files to use the latest dependency versions.


Configuration

📅 Schedule: Branch creation - "before 4am on monday" (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.



This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 171 5227 total, 0 failed avg: 509ms, p95: 678ms
apollo-router 165 5017 total, 0 failed avg: 557ms, p95: 724ms
wundergraph 153 4684 total, 0 failed avg: 568ms, p95: 958ms
mesh-supergraph-bun 97 2974 total, 0 failed avg: 992ms, p95: 1725ms
apollo-server 46 1474 total, 0 failed avg: 2094ms, p95: 2544ms
mercurius 31 976 total, 0 failed avg: 3114ms, p95: 4448ms
mesh-supergraph 29 950 total, 0 failed avg: 3251ms, p95: 5391ms
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15681 ✗ 0 data_received..................: 459 MB 15 MB/s data_sent......................: 6.2 MB 204 kB/s http_req_blocked...............: avg=40.3µs min=1.32µs med=2.77µs max=91.32ms p(90)=4.2µs p(95)=5.43µs http_req_connecting............: avg=16.12µs min=0s med=0s max=2.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=508.91ms min=26.91ms med=513.75ms max=1.87s p(90)=623.36ms p(95)=678.06ms { expected_response:true }...: avg=508.91ms min=26.91ms med=513.75ms max=1.87s p(90)=623.36ms p(95)=678.06ms http_req_failed................: 0.00% ✓ 0 ✗ 5227 http_req_receiving.............: avg=29.7ms min=38.57µs med=76.78µs max=1.51s p(90)=71.91ms p(95)=200.43ms http_req_sending...............: avg=1.43ms min=7.91µs med=13.28µs max=695.09ms p(90)=33.21µs p(95)=184.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=477.76ms min=20.04ms med=497.57ms max=758.18ms p(90)=589.16ms p(95)=614.21ms http_reqs......................: 5227 171.629533/s iteration_duration.............: avg=579.6ms min=50.04ms med=552.55ms max=2.5s p(90)=764.12ms p(95)=922.08ms iterations.....................: 5227 171.629533/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15051 ✗ 0 data_received..................: 440 MB 15 MB/s data_sent......................: 6.0 MB 196 kB/s http_req_blocked...............: avg=53.4µs min=1.71µs med=3.22µs max=7.22ms p(90)=4.81µs p(95)=5.91µs http_req_connecting............: avg=47.24µs min=0s med=0s max=7.18ms p(90)=0s p(95)=0s http_req_duration..............: avg=556.62ms min=195.91ms med=550.18ms max=1.22s p(90)=682.39ms p(95)=724ms { expected_response:true }...: avg=556.62ms min=195.91ms med=550.18ms max=1.22s p(90)=682.39ms p(95)=724ms http_req_failed................: 0.00% ✓ 0 ✗ 5017 http_req_receiving.............: avg=9.28ms min=34.76µs med=73.74µs max=725.33ms p(90)=10.95ms p(95)=60.56ms http_req_sending...............: avg=862.11µs min=8.72µs med=15.17µs max=282.34ms p(90)=39.5µs p(95)=188.47µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=546.47ms min=195.85ms med=542.37ms max=918.25ms p(90)=664.4ms p(95)=703.14ms http_reqs......................: 5017 165.242595/s iteration_duration.............: avg=601.33ms min=283.59ms med=588.45ms max=1.27s p(90)=741.86ms p(95)=803.45ms iterations.....................: 5017 165.242595/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14052 ✗ 0 data_received..................: 411 MB 14 MB/s data_sent......................: 5.6 MB 182 kB/s http_req_blocked...............: avg=156.83µs min=1.55µs med=3.22µs max=437.32ms p(90)=5.35µs p(95)=6.48µs http_req_connecting............: avg=125.58µs min=0s med=0s max=437.26ms p(90)=0s p(95)=0s http_req_duration..............: avg=567.8ms min=38.53ms med=546.39ms max=2.13s p(90)=833.67ms p(95)=957.6ms { expected_response:true }...: avg=567.8ms min=38.53ms med=546.39ms max=2.13s p(90)=833.67ms p(95)=957.6ms http_req_failed................: 0.00% ✓ 0 ✗ 4684 http_req_receiving.............: avg=30.68ms min=39.02µs med=96.07µs max=836.38ms p(90)=98.44ms p(95)=205.43ms http_req_sending...............: avg=2ms min=7.51µs med=15.88µs max=444.86ms p(90)=39.66µs p(95)=392.28µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=535.11ms min=38.15ms med=519.69ms max=1.46s p(90)=790.79ms p(95)=875.5ms http_reqs......................: 4684 153.642111/s iteration_duration.............: avg=646.44ms min=50.61ms med=611.21ms max=2.29s p(90)=976.37ms p(95)=1.11s iterations.....................: 4684 153.642111/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8922 ✗ 0 data_received..................: 261 MB 8.5 MB/s data_sent......................: 3.5 MB 116 kB/s http_req_blocked...............: avg=47.66µs min=1.28µs med=3.06µs max=5.56ms p(90)=5µs p(95)=9.86µs http_req_connecting............: avg=39.58µs min=0s med=0s max=5.51ms p(90)=0s p(95)=0s http_req_duration..............: avg=991.5ms min=390.68ms med=855.37ms max=2.77s p(90)=1.59s p(95)=1.72s { expected_response:true }...: avg=991.5ms min=390.68ms med=855.37ms max=2.77s p(90)=1.59s p(95)=1.72s http_req_failed................: 0.00% ✓ 0 ✗ 2974 http_req_receiving.............: avg=10.68ms min=38.65µs med=91.38µs max=606.18ms p(90)=1.25ms p(95)=51.67ms http_req_sending...............: avg=443.47µs min=7.58µs med=14.4µs max=141.06ms p(90)=37µs p(95)=143.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=980.37ms min=390.14ms med=850.78ms max=2.65s p(90)=1.59s p(95)=1.71s http_reqs......................: 2974 97.411301/s iteration_duration.............: avg=1.01s min=399.82ms med=877.93ms max=2.79s p(90)=1.62s p(95)=1.76s iterations.....................: 2974 97.411301/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4422 ✗ 0 data_received..................: 130 MB 4.1 MB/s data_sent......................: 1.7 MB 56 kB/s http_req_blocked...............: avg=115.97µs min=1.59µs med=4.23µs max=5.73ms p(90)=6.33µs p(95)=286.35µs http_req_connecting............: avg=93.83µs min=0s med=0s max=5.29ms p(90)=0s p(95)=257.73µs http_req_duration..............: avg=2.09s min=822.09ms med=1.73s max=21.27s p(90)=2.21s p(95)=2.54s { expected_response:true }...: avg=2.09s min=822.09ms med=1.73s max=21.27s p(90)=2.21s p(95)=2.54s http_req_failed................: 0.00% ✓ 0 ✗ 1474 http_req_receiving.............: avg=595.76µs min=53.42µs med=131.32µs max=95.76ms p(90)=200.55µs p(95)=238.55µs http_req_sending...............: avg=80.55µs min=8.81µs med=23.21µs max=19.28ms p(90)=40.39µs p(95)=147.41µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.09s min=821.88ms med=1.73s max=21.27s p(90)=2.2s p(95)=2.54s http_reqs......................: 1474 46.717845/s iteration_duration.............: avg=2.1s min=834.52ms med=1.75s max=21.28s p(90)=2.22s p(95)=2.56s iterations.....................: 1474 46.717845/s vus............................: 60 min=60 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2928 ✗ 0 data_received..................: 86 MB 2.8 MB/s data_sent......................: 1.2 MB 38 kB/s http_req_blocked...............: avg=79.15µs min=1.39µs med=3.74µs max=2.95ms p(90)=103.28µs p(95)=570.45µs http_req_connecting............: avg=70.3µs min=0s med=0s max=2.84ms p(90)=72.33µs p(95)=518.16µs http_req_duration..............: avg=3.11s min=650.86ms med=2.96s max=7.62s p(90)=4.15s p(95)=4.44s { expected_response:true }...: avg=3.11s min=650.86ms med=2.96s max=7.62s p(90)=4.15s p(95)=4.44s http_req_failed................: 0.00% ✓ 0 ✗ 976 http_req_receiving.............: avg=333.08µs min=41.29µs med=118.81µs max=60.91ms p(90)=179.25µs p(95)=260.11µs http_req_sending...............: avg=59.98µs min=8.74µs med=20.59µs max=1.59ms p(90)=44µs p(95)=302.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.11s min=649.34ms med=2.96s max=7.61s p(90)=4.15s p(95)=4.44s http_reqs......................: 976 31.601067/s iteration_duration.............: avg=3.12s min=662.27ms med=2.96s max=7.62s p(90)=4.16s p(95)=4.45s iterations.....................: 976 31.601067/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2850 ✗ 0 data_received..................: 83 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=98.85µs min=1.57µs med=4.31µs max=4.25ms p(90)=92.5µs p(95)=298.96µs http_req_connecting............: avg=86.29µs min=0s med=0s max=4.22ms p(90)=62.91µs p(95)=232.68µs http_req_duration..............: avg=3.25s min=1.4s med=3.09s max=7.21s p(90)=4.19s p(95)=5.39s { expected_response:true }...: avg=3.25s min=1.4s med=3.09s max=7.21s p(90)=4.19s p(95)=5.39s http_req_failed................: 0.00% ✓ 0 ✗ 950 http_req_receiving.............: avg=3.78ms min=50.8µs med=165.55µs max=118.82ms p(90)=3.54ms p(95)=16ms http_req_sending...............: avg=75.06µs min=8.65µs med=23.72µs max=7.73ms p(90)=67.7µs p(95)=159.68µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.24s min=1.4s med=3.09s max=7.21s p(90)=4.19s p(95)=5.39s http_reqs......................: 950 29.860812/s iteration_duration.............: avg=3.26s min=1.41s med=3.1s max=7.22s p(90)=4.21s p(95)=5.4s iterations.....................: 950 29.860812/s vus............................: 56 min=56 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 151 4630 total, 0 failed avg: 612ms, p95: 800ms
wundergraph 100 3121 total, 0 failed avg: 937ms, p95: 1171ms
mesh-supergraph-bun 85 2634 total, 0 failed avg: 1121ms, p95: 1620ms
cosmo 75 2318 total, 0 failed avg: 1275ms, p95: 1533ms
apollo-server 48 1504 total, 0 failed avg: 2025ms, p95: 2387ms
mesh-supergraph 30 956 total, 0 failed avg: 3214ms, p95: 5226ms
mercurius 12 453 total, 0 failed avg: 7535ms, p95: 9206ms
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13890 ✗ 0 data_received..................: 406 MB 13 MB/s data_sent......................: 5.5 MB 180 kB/s http_req_blocked...............: avg=107.69µs min=1.67µs med=3.08µs max=76.5ms p(90)=4.78µs p(95)=5.71µs http_req_connecting............: avg=68.36µs min=0s med=0s max=7.14ms p(90)=0s p(95)=0s http_req_duration..............: avg=611.8ms min=328.6ms med=598.27ms max=1.13s p(90)=738.47ms p(95)=800.01ms { expected_response:true }...: avg=611.8ms min=328.6ms med=598.27ms max=1.13s p(90)=738.47ms p(95)=800.01ms http_req_failed................: 0.00% ✓ 0 ✗ 4630 http_req_receiving.............: avg=10.86ms min=36.52µs med=75.87µs max=335.34ms p(90)=33.31ms p(95)=73.25ms http_req_sending...............: avg=909.45µs min=8.24µs med=14.44µs max=297.48ms p(90)=35.13µs p(95)=170.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=600.03ms min=328.54ms med=590.22ms max=991.25ms p(90)=718.91ms p(95)=771.45ms http_reqs......................: 4630 151.448236/s iteration_duration.............: avg=655.72ms min=355.06ms med=638.19ms max=1.22s p(90)=817.31ms p(95)=882.99ms iterations.....................: 4630 151.448236/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9363 ✗ 0 data_received..................: 274 MB 8.9 MB/s data_sent......................: 3.7 MB 120 kB/s http_req_blocked...............: avg=63.72µs min=1.44µs med=2.86µs max=45.23ms p(90)=4.53µs p(95)=8.58µs http_req_connecting............: avg=42.19µs min=0s med=0s max=8.43ms p(90)=0s p(95)=0s http_req_duration..............: avg=937.24ms min=513.32ms med=933.06ms max=1.52s p(90)=1.08s p(95)=1.17s { expected_response:true }...: avg=937.24ms min=513.32ms med=933.06ms max=1.52s p(90)=1.08s p(95)=1.17s http_req_failed................: 0.00% ✓ 0 ✗ 3121 http_req_receiving.............: avg=8.24ms min=41.37µs med=87.12µs max=258.7ms p(90)=27.76ms p(95)=60.56ms http_req_sending...............: avg=1.42ms min=8.2µs med=13.69µs max=203.82ms p(90)=70.86µs p(95)=717.6µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=927.57ms min=513.19ms med=923.29ms max=1.52s p(90)=1.07s p(95)=1.14s http_reqs......................: 3121 100.921487/s iteration_duration.............: avg=973.51ms min=522.87ms med=963.47ms max=1.54s p(90)=1.13s p(95)=1.22s iterations.....................: 3121 100.921487/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7902 ✗ 0 data_received..................: 231 MB 7.5 MB/s data_sent......................: 3.1 MB 101 kB/s http_req_blocked...............: avg=29.74µs min=1.35µs med=2.86µs max=7.95ms p(90)=4.38µs p(95)=9.5µs http_req_connecting............: avg=22.98µs min=0s med=0s max=7.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.12s min=516.54ms med=1.08s max=2.44s p(90)=1.45s p(95)=1.62s { expected_response:true }...: avg=1.12s min=516.54ms med=1.08s max=2.44s p(90)=1.45s p(95)=1.62s http_req_failed................: 0.00% ✓ 0 ✗ 2634 http_req_receiving.............: avg=15.87ms min=36.85µs med=90.91µs max=619.56ms p(90)=2.13ms p(95)=94.3ms http_req_sending...............: avg=406.72µs min=7.93µs med=13.78µs max=154ms p(90)=33.1µs p(95)=137.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.1s min=516.43ms med=1.07s max=2.38s p(90)=1.41s p(95)=1.54s http_reqs......................: 2634 85.182271/s iteration_duration.............: avg=1.15s min=531.09ms med=1.11s max=2.47s p(90)=1.5s p(95)=1.66s iterations.....................: 2634 85.182271/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6954 ✗ 0 data_received..................: 203 MB 6.6 MB/s data_sent......................: 2.8 MB 89 kB/s http_req_blocked...............: avg=261.66µs min=1.32µs med=2.48µs max=11.66ms p(90)=3.77µs p(95)=9.7µs http_req_connecting............: avg=252.87µs min=0s med=0s max=11.56ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.27s min=809.49ms med=1.26s max=1.92s p(90)=1.45s p(95)=1.53s { expected_response:true }...: avg=1.27s min=809.49ms med=1.26s max=1.92s p(90)=1.45s p(95)=1.53s http_req_failed................: 0.00% ✓ 0 ✗ 2318 http_req_receiving.............: avg=22.64ms min=36.55µs med=82.59µs max=482.02ms p(90)=85.15ms p(95)=158.11ms http_req_sending...............: avg=1.36ms min=8.07µs med=12.38µs max=238.29ms p(90)=44.17µs p(95)=790.52µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.25s min=806.44ms med=1.24s max=1.67s p(90)=1.42s p(95)=1.47s http_reqs......................: 2318 75.170203/s iteration_duration.............: avg=1.31s min=832.18ms med=1.29s max=1.95s p(90)=1.53s p(95)=1.62s iterations.....................: 2318 75.170203/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4512 ✗ 0 data_received..................: 132 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=78.96µs min=1.61µs med=3.42µs max=5.86ms p(90)=5.45µs p(95)=312.4µs http_req_connecting............: avg=66.32µs min=0s med=0s max=3.65ms p(90)=0s p(95)=286.57µs http_req_duration..............: avg=2.02s min=804.1ms med=1.81s max=14.02s p(90)=2.22s p(95)=2.38s { expected_response:true }...: avg=2.02s min=804.1ms med=1.81s max=14.02s p(90)=2.22s p(95)=2.38s http_req_failed................: 0.00% ✓ 0 ✗ 1504 http_req_receiving.............: avg=188.23µs min=46.73µs med=119.2µs max=44.81ms p(90)=180.34µs p(95)=219.17µs http_req_sending...............: avg=51.93µs min=8.81µs med=19.53µs max=2.82ms p(90)=36.65µs p(95)=136.52µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.02s min=803.94ms med=1.81s max=14.02s p(90)=2.22s p(95)=2.38s http_reqs......................: 1504 48.116419/s iteration_duration.............: avg=2.03s min=810.74ms med=1.82s max=14.03s p(90)=2.23s p(95)=2.39s iterations.....................: 1504 48.116419/s vus............................: 34 min=34 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2868 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=257.13µs min=1.32µs med=3.6µs max=5.55ms p(90)=227.64µs p(95)=2.37ms http_req_connecting............: avg=232.03µs min=0s med=0s max=5.5ms p(90)=148.05µs p(95)=2.23ms http_req_duration..............: avg=3.21s min=1.34s med=2.88s max=7.29s p(90)=4.58s p(95)=5.22s { expected_response:true }...: avg=3.21s min=1.34s med=2.88s max=7.29s p(90)=4.58s p(95)=5.22s http_req_failed................: 0.00% ✓ 0 ✗ 956 http_req_receiving.............: avg=2.49ms min=41.65µs med=156.02µs max=85.25ms p(90)=1.55ms p(95)=7.71ms http_req_sending...............: avg=77.39µs min=8.19µs med=20.24µs max=5.95ms p(90)=90.17µs p(95)=260.48µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.21s min=1.34s med=2.88s max=7.29s p(90)=4.58s p(95)=5.22s http_reqs......................: 956 30.361211/s iteration_duration.............: avg=3.22s min=1.34s med=2.89s max=7.3s p(90)=4.59s p(95)=5.24s iterations.....................: 956 30.361211/s vus............................: 43 min=43 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1359 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 538 kB 14 kB/s http_req_blocked...............: avg=148.66µs min=1.5µs med=3.38µs max=3.88ms p(90)=546.9µs p(95)=883.97µs http_req_connecting............: avg=115.62µs min=0s med=0s max=3.8ms p(90)=477.57µs p(95)=792.25µs http_req_duration..............: avg=7.53s min=3.17s med=7.71s max=9.39s p(90)=8.84s p(95)=9.2s { expected_response:true }...: avg=7.53s min=3.17s med=7.71s max=9.39s p(90)=8.84s p(95)=9.2s http_req_failed................: 0.00% ✓ 0 ✗ 453 http_req_receiving.............: avg=606.8µs min=54.83µs med=123.29µs max=77.61ms p(90)=196.07µs p(95)=227.11µs http_req_sending...............: avg=68.36µs min=9.24µs med=19.84µs max=569.51µs p(90)=267.17µs p(95)=354.18µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.53s min=3.17s med=7.71s max=9.39s p(90)=8.84s p(95)=9.2s http_reqs......................: 453 12.047123/s iteration_duration.............: avg=7.54s min=3.18s med=7.71s max=9.41s p(90)=8.85s p(95)=9.21s iterations.....................: 453 12.047123/s vus............................: 14 min=14 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 167 5101 total, 0 failed avg: 531ms, p95: 708ms
wundergraph 104 3197 total, 0 failed avg: 912ms, p95: 1119ms
mesh-supergraph-bun 99 3063 total, 0 failed avg: 955ms, p95: 1369ms
cosmo 82 2540 total, 0 failed avg: 1166ms, p95: 1439ms
apollo-server 63 1974 total, 0 failed avg: 1526ms, p95: 1847ms
mesh-supergraph 61 1907 total, 0 failed avg: 1576ms, p95: 2464ms
mercurius 12 474 total, 0 failed avg: 7184ms, p95: 8434ms
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15303 ✗ 0 data_received..................: 448 MB 15 MB/s data_sent......................: 6.1 MB 199 kB/s http_req_blocked...............: avg=45.34µs min=1.35µs med=2.81µs max=111.37ms p(90)=4.43µs p(95)=5.56µs http_req_connecting............: avg=16.65µs min=0s med=0s max=8.04ms p(90)=0s p(95)=0s http_req_duration..............: avg=531.41ms min=293.78ms med=523.47ms max=1.06s p(90)=654.54ms p(95)=707.65ms { expected_response:true }...: avg=531.41ms min=293.78ms med=523.47ms max=1.06s p(90)=654.54ms p(95)=707.65ms http_req_failed................: 0.00% ✓ 0 ✗ 5101 http_req_receiving.............: avg=16.25ms min=37.42µs med=74.9µs max=360.44ms p(90)=63.45ms p(95)=105.83ms http_req_sending...............: avg=1.92ms min=7.79µs med=13.42µs max=389.44ms p(90)=43.35µs p(95)=246.06µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=513.22ms min=293.72ms med=508.77ms max=873.42ms p(90)=623.9ms p(95)=655.18ms http_reqs......................: 5101 167.414846/s iteration_duration.............: avg=592.68ms min=306.39ms med=574.85ms max=1.39s p(90)=752.94ms p(95)=821.6ms iterations.....................: 5101 167.414846/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9591 ✗ 0 data_received..................: 281 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=96.09µs min=1.3µs med=2.57µs max=54.91ms p(90)=3.87µs p(95)=8.67µs http_req_connecting............: avg=70.84µs min=0s med=0s max=6.45ms p(90)=0s p(95)=0s http_req_duration..............: avg=911.77ms min=595.02ms med=904.68ms max=1.48s p(90)=1.06s p(95)=1.11s { expected_response:true }...: avg=911.77ms min=595.02ms med=904.68ms max=1.48s p(90)=1.06s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3197 http_req_receiving.............: avg=10.52ms min=39.28µs med=82.47µs max=311.11ms p(90)=32.25ms p(95)=71.64ms http_req_sending...............: avg=1.88ms min=8.09µs med=12.66µs max=320.54ms p(90)=71.13µs p(95)=3.83ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=899.36ms min=594.44ms med=896.13ms max=1.24s p(90)=1.04s p(95)=1.08s http_reqs......................: 3197 104.611496/s iteration_duration.............: avg=951.19ms min=608.79ms med=937.32ms max=1.51s p(90)=1.12s p(95)=1.18s iterations.....................: 3197 104.611496/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9189 ✗ 0 data_received..................: 269 MB 8.7 MB/s data_sent......................: 3.6 MB 118 kB/s http_req_blocked...............: avg=70.84µs min=1.54µs med=3.23µs max=42.33ms p(90)=5.13µs p(95)=9.66µs http_req_connecting............: avg=28.47µs min=0s med=0s max=5.99ms p(90)=0s p(95)=0s http_req_duration..............: avg=955.04ms min=329.2ms med=926.8ms max=2.22s p(90)=1.24s p(95)=1.36s { expected_response:true }...: avg=955.04ms min=329.2ms med=926.8ms max=2.22s p(90)=1.24s p(95)=1.36s http_req_failed................: 0.00% ✓ 0 ✗ 3063 http_req_receiving.............: avg=13.34ms min=39.16µs med=94.6µs max=736.98ms p(90)=2.12ms p(95)=62.19ms http_req_sending...............: avg=737.94µs min=8.87µs med=15.86µs max=219.11ms p(90)=38.67µs p(95)=142.32µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=940.96ms min=327.8ms med=916.33ms max=2.03s p(90)=1.2s p(95)=1.33s http_reqs......................: 3063 99.63365/s iteration_duration.............: avg=993.55ms min=338.46ms med=958.93ms max=2.25s p(90)=1.29s p(95)=1.46s iterations.....................: 3063 99.63365/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7620 ✗ 0 data_received..................: 223 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=52.43µs min=1.31µs med=2.49µs max=3.86ms p(90)=3.81µs p(95)=9.05µs http_req_connecting............: avg=45.17µs min=0s med=0s max=3.78ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=769.78ms med=1.15s max=1.81s p(90)=1.36s p(95)=1.43s { expected_response:true }...: avg=1.16s min=769.78ms med=1.15s max=1.81s p(90)=1.36s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2540 http_req_receiving.............: avg=14.04ms min=39.98µs med=77.06µs max=333.25ms p(90)=43.77ms p(95)=88.19ms http_req_sending...............: avg=1.53ms min=7.76µs med=12.57µs max=220.06ms p(90)=59.64µs p(95)=504.96µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=769.72ms med=1.14s max=1.57s p(90)=1.32s p(95)=1.37s http_reqs......................: 2540 82.047989/s iteration_duration.............: avg=1.2s min=784.33ms med=1.19s max=1.82s p(90)=1.41s p(95)=1.5s iterations.....................: 2540 82.047989/s vus............................: 96 min=96 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5922 ✗ 0 data_received..................: 174 MB 5.6 MB/s data_sent......................: 2.3 MB 76 kB/s http_req_blocked...............: avg=109.27µs min=1.57µs med=3.04µs max=5.24ms p(90)=4.79µs p(95)=128.48µs http_req_connecting............: avg=101.42µs min=0s med=0s max=5.22ms p(90)=0s p(95)=70.73µs http_req_duration..............: avg=1.52s min=821.45ms med=1.45s max=9.36s p(90)=1.72s p(95)=1.84s { expected_response:true }...: avg=1.52s min=821.45ms med=1.45s max=9.36s p(90)=1.72s p(95)=1.84s http_req_failed................: 0.00% ✓ 0 ✗ 1974 http_req_receiving.............: avg=669.67µs min=45.52µs med=108.76µs max=153.03ms p(90)=183.18µs p(95)=284.76µs http_req_sending...............: avg=92.56µs min=8.86µs med=15.27µs max=14.18ms p(90)=31.87µs p(95)=377.72µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.52s min=821.26ms med=1.45s max=9.36s p(90)=1.72s p(95)=1.84s http_reqs......................: 1974 63.753298/s iteration_duration.............: avg=1.54s min=829.1ms med=1.47s max=9.37s p(90)=1.74s p(95)=1.86s iterations.....................: 1974 63.753298/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5721 ✗ 0 data_received..................: 167 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=80.17µs min=1.53µs med=4.2µs max=5.24ms p(90)=6.05µs p(95)=105.16µs http_req_connecting............: avg=59.73µs min=0s med=0s max=4.02ms p(90)=0s p(95)=69.19µs http_req_duration..............: avg=1.57s min=580.64ms med=1.57s max=4.02s p(90)=2.22s p(95)=2.46s { expected_response:true }...: avg=1.57s min=580.64ms med=1.57s max=4.02s p(90)=2.22s p(95)=2.46s http_req_failed................: 0.00% ✓ 0 ✗ 1907 http_req_receiving.............: avg=1.84ms min=40.5µs med=118.73µs max=426.31ms p(90)=1.76ms p(95)=6.82ms http_req_sending...............: avg=139.06µs min=8.87µs med=22.39µs max=46.2ms p(90)=41.01µs p(95)=186.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.57s min=580.52ms med=1.57s max=4.02s p(90)=2.22s p(95)=2.45s http_reqs......................: 1907 61.760151/s iteration_duration.............: avg=1.59s min=617.39ms med=1.59s max=4.03s p(90)=2.25s p(95)=2.48s iterations.....................: 1907 61.760151/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1422 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 563 kB 15 kB/s http_req_blocked...............: avg=460.26µs min=1.56µs med=3.46µs max=5.75ms p(90)=1.59ms p(95)=4.06ms http_req_connecting............: avg=413.83µs min=0s med=0s max=5.72ms p(90)=1.11ms p(95)=3.7ms http_req_duration..............: avg=7.18s min=2.98s med=7.46s max=8.72s p(90)=8.27s p(95)=8.43s { expected_response:true }...: avg=7.18s min=2.98s med=7.46s max=8.72s p(90)=8.27s p(95)=8.43s http_req_failed................: 0.00% ✓ 0 ✗ 474 http_req_receiving.............: avg=130.87µs min=60.95µs med=117.27µs max=906.79µs p(90)=185.4µs p(95)=207.19µs http_req_sending...............: avg=172.51µs min=8.86µs med=20.08µs max=1.45ms p(90)=821.73µs p(95)=1.42ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.18s min=2.98s med=7.45s max=8.72s p(90)=8.27s p(95)=8.43s http_reqs......................: 474 12.630007/s iteration_duration.............: avg=7.19s min=2.99s med=7.46s max=8.73s p(90)=8.28s p(95)=8.44s iterations.....................: 474 12.630007/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 2291ms 171 12039 total, 0 failed avg: 760ms, p95: 2291ms, max: 6681ms, med: 492ms
wundergraph 2502ms 163 11415 total, 0 failed avg: 820ms, p95: 2502ms, max: 6379ms, med: 588ms
cosmo 2591ms 174 12235 total, 0 failed avg: 808ms, p95: 2591ms, max: 8341ms, med: 520ms ❌ 3 unexpected GraphQL errors, non-compatible response structure (3)
mesh-supergraph-bun 5751ms 110 7756 total, 0 failed avg: 2353ms, p95: 5751ms, max: 9436ms, med: 2015ms
mesh-supergraph 6600ms 72 5091 total, 0 failed avg: 3741ms, p95: 6601ms, max: 8947ms, med: 3762ms
apollo-server 24365ms 67 4925 total, 0 failed avg: 4245ms, p95: 24365ms, max: 45274ms, med: 2221ms
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36117 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 204 kB/s http_req_blocked...............: avg=13.29ms min=1.4µs med=3.14µs max=3.93s p(90)=5.11µs p(95)=12.61µs http_req_connecting............: avg=12.09ms min=0s med=0s max=2.99s p(90)=0s p(95)=0s http_req_duration..............: avg=760.06ms min=7.4ms med=491.69ms max=6.68s p(90)=1.77s p(95)=2.29s { expected_response:true }...: avg=760.06ms min=7.4ms med=491.69ms max=6.68s p(90)=1.77s p(95)=2.29s http_req_failed................: 0.00% ✓ 0 ✗ 12039 http_req_receiving.............: avg=262.11ms min=30.3µs med=77.88µs max=6.27s p(90)=1.04s p(95)=1.69s http_req_sending...............: avg=27.25ms min=7.95µs med=14.56µs max=3.73s p(90)=135.92µs p(95)=35.25ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=470.68ms min=7.31ms med=395.39ms max=2.85s p(90)=932.92ms p(95)=1.2s http_reqs......................: 12039 171.969835/s iteration_duration.............: avg=1.52s min=15.36ms med=923.16ms max=14.28s p(90)=3.75s p(95)=4.77s iterations.....................: 12039 171.969835/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34245 ✗ 0 data_received..................: 1.0 GB 14 MB/s data_sent......................: 14 MB 194 kB/s http_req_blocked...............: avg=17.44ms min=1.72µs med=3.44µs max=5.12s p(90)=5.58µs p(95)=22.96µs http_req_connecting............: avg=16.06ms min=0s med=0s max=4.42s p(90)=0s p(95)=0s http_req_duration..............: avg=819.74ms min=6.02ms med=587.98ms max=6.37s p(90)=1.9s p(95)=2.5s { expected_response:true }...: avg=819.74ms min=6.02ms med=587.98ms max=6.37s p(90)=1.9s p(95)=2.5s http_req_failed................: 0.00% ✓ 0 ✗ 11415 http_req_receiving.............: avg=315.54ms min=31.47µs med=92.13µs max=5.2s p(90)=1.16s p(95)=1.95s http_req_sending...............: avg=36.28ms min=8.85µs med=16.85µs max=3.82s p(90)=1.06ms p(95)=100.6ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=467.91ms min=5.93ms med=380.68ms max=2.56s p(90)=953.56ms p(95)=1.15s http_reqs......................: 11415 163.050529/s iteration_duration.............: avg=1.6s min=12.55ms med=1.07s max=12.57s p(90)=3.8s p(95)=4.84s iterations.....................: 11415 163.050529/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12232 / ✗ 3 ✗ valid response structure ↳ 99% — ✓ 12232 / ✗ 3 checks.........................: 99.98% ✓ 36699 ✗ 6 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=14.5ms min=1.26µs med=2.87µs max=4.79s p(90)=4.52µs p(95)=11.2µs http_req_connecting............: avg=13.65ms min=0s med=0s max=4.79s p(90)=0s p(95)=0s http_req_duration..............: avg=808.47ms min=6.63ms med=519.9ms max=8.34s p(90)=1.9s p(95)=2.59s { expected_response:true }...: avg=808.47ms min=6.63ms med=519.9ms max=8.34s p(90)=1.9s p(95)=2.59s http_req_failed................: 0.00% ✓ 0 ✗ 12235 http_req_receiving.............: avg=356.58ms min=23.52µs med=81.97µs max=6.11s p(90)=1.33s p(95)=2.04s http_req_sending...............: avg=26.84ms min=7.4µs med=13.63µs max=4.19s p(90)=153.13µs p(95)=44.31ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=425.04ms min=6.53ms med=351.16ms max=4.12s p(90)=870.9ms p(95)=1.02s http_reqs......................: 12235 174.752922/s iteration_duration.............: avg=1.48s min=12.12ms med=968.73ms max=10.74s p(90)=3.63s p(95)=4.6s iterations.....................: 12235 174.752922/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 23268 ✗ 0 data_received..................: 680 MB 9.7 MB/s data_sent......................: 9.2 MB 132 kB/s http_req_blocked...............: avg=2.23ms min=1.57µs med=3.33µs max=298.13ms p(90)=7.37µs p(95)=236.74µs http_req_connecting............: avg=2.16ms min=0s med=0s max=298.05ms p(90)=0s p(95)=158.52µs http_req_duration..............: avg=2.35s min=6.89ms med=2.01s max=9.43s p(90)=4.64s p(95)=5.75s { expected_response:true }...: avg=2.35s min=6.89ms med=2.01s max=9.43s p(90)=4.64s p(95)=5.75s http_req_failed................: 0.00% ✓ 0 ✗ 7756 http_req_receiving.............: avg=29.75ms min=36.07µs med=88.76µs max=1.77s p(90)=32.57ms p(95)=201.76ms http_req_sending...............: avg=3.3ms min=8.45µs med=16.22µs max=1.22s p(90)=108.26µs p(95)=11.15ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.32s min=6.66ms med=1.98s max=9.43s p(90)=4.62s p(95)=5.68s http_reqs......................: 7756 110.754805/s iteration_duration.............: avg=2.44s min=15.01ms med=2.1s max=9.94s p(90)=4.7s p(95)=5.84s iterations.....................: 7756 110.754805/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15273 ✗ 0 data_received..................: 447 MB 6.4 MB/s data_sent......................: 6.0 MB 86 kB/s http_req_blocked...............: avg=528.23µs min=1.27µs med=3.39µs max=155.24ms p(90)=23.94µs p(95)=401.93µs http_req_connecting............: avg=510.71µs min=0s med=0s max=155.16ms p(90)=0s p(95)=321.38µs http_req_duration..............: avg=3.74s min=10ms med=3.76s max=8.94s p(90)=6.01s p(95)=6.6s { expected_response:true }...: avg=3.74s min=10ms med=3.76s max=8.94s p(90)=6.01s p(95)=6.6s http_req_failed................: 0.00% ✓ 0 ✗ 5091 http_req_receiving.............: avg=3.03ms min=37.07µs med=90.8µs max=397.8ms p(90)=816.86µs p(95)=8.47ms http_req_sending...............: avg=749.21µs min=7.28µs med=16.96µs max=258.64ms p(90)=47.67µs p(95)=120.84µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.73s min=9.91ms med=3.76s max=8.94s p(90)=6s p(95)=6.6s http_reqs......................: 5091 72.707908/s iteration_duration.............: avg=3.77s min=16.82ms med=3.79s max=9.05s p(90)=6.08s p(95)=6.64s iterations.....................: 5091 72.707908/s vus............................: 2 min=2 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14775 ✗ 0 data_received..................: 433 MB 5.9 MB/s data_sent......................: 5.8 MB 80 kB/s http_req_blocked...............: avg=101.84µs min=1.64µs med=3.55µs max=35.97ms p(90)=167.85µs p(95)=303.1µs http_req_connecting............: avg=89.63µs min=0s med=0s max=35.9ms p(90)=107.29µs p(95)=227.43µs http_req_duration..............: avg=4.24s min=84.67ms med=2.22s max=45.27s p(90)=3.91s p(95)=24.36s { expected_response:true }...: avg=4.24s min=84.67ms med=2.22s max=45.27s p(90)=3.91s p(95)=24.36s http_req_failed................: 0.00% ✓ 0 ✗ 4925 http_req_receiving.............: avg=285.61µs min=49.15µs med=120.45µs max=188.2ms p(90)=183.42µs p(95)=220.51µs http_req_sending...............: avg=66.03µs min=8.97µs med=18.42µs max=29.43ms p(90)=45.21µs p(95)=66.63µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.24s min=84.53ms med=2.22s max=45.27s p(90)=3.91s p(95)=24.36s http_reqs......................: 4925 67.128378/s iteration_duration.............: avg=4.25s min=91.58ms med=2.23s max=45.28s p(90)=3.92s p(95)=24.37s iterations.....................: 4925 67.128378/s vus............................: 31 min=31 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview