search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update prom/prometheus Docker tag to v2.51.0 #409

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Update Change
prom/prometheus minor v2.50.1 -> v2.51.0

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 168 5152 total, 0 failed avg: 529ms, p95: 705ms ✅
wundergraph 102 3175 total, 0 failed avg: 922ms, p95: 1130ms ✅
mesh-supergraph-bun 100 3114 total, 0 failed avg: 946ms, p95: 1386ms ✅
cosmo 82 2580 total, 0 failed avg: 1155ms, p95: 1430ms ✅
apollo-server 63 1969 total, 0 failed avg: 1547ms, p95: 1900ms ✅
mesh-supergraph 59 1849 total, 0 failed avg: 1636ms, p95: 2318ms ✅
mercurius 12 473 total, 0 failed avg: 7182ms, p95: 8412ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15456 ✗ 0 data_received..................: 452 MB 15 MB/s data_sent......................: 6.1 MB 200 kB/s http_req_blocked...............: avg=51.26µs min=1.38µs med=2.82µs max=86.82ms p(90)=4.39µs p(95)=5.37µs http_req_connecting............: avg=18.75µs min=0s med=0s max=4.02ms p(90)=0s p(95)=0s http_req_duration..............: avg=529.07ms min=255.67ms med=518.73ms max=1.16s p(90)=651.92ms p(95)=705.37ms { expected_response:true }...: avg=529.07ms min=255.67ms med=518.73ms max=1.16s p(90)=651.92ms p(95)=705.37ms http_req_failed................: 0.00% ✓ 0 ✗ 5152 http_req_receiving.............: avg=17.74ms min=37.39µs med=75.91µs max=577.68ms p(90)=62.93ms p(95)=110.31ms http_req_sending...............: avg=1.65ms min=7.64µs med=13.41µs max=347.01ms p(90)=38.54µs p(95)=329.67µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=509.67ms min=255.58ms med=506.74ms max=839.62ms p(90)=623.22ms p(95)=664.4ms http_reqs......................: 5152 168.386243/s iteration_duration.............: avg=588.06ms min=267.28ms med=567.98ms max=1.22s p(90)=749.78ms p(95)=836.16ms iterations.....................: 5152 168.386243/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9525 ✗ 0 data_received..................: 279 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=134.96µs min=1.61µs med=3.24µs max=114.1ms p(90)=5.25µs p(95)=10.12µs http_req_connecting............: avg=91.09µs min=0s med=0s max=6.68ms p(90)=0s p(95)=0s http_req_duration..............: avg=922.24ms min=595.3ms med=915.62ms max=1.41s p(90)=1.06s p(95)=1.13s { expected_response:true }...: avg=922.24ms min=595.3ms med=915.62ms max=1.41s p(90)=1.06s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3175 http_req_receiving.............: avg=14.43ms min=41.17µs med=104.52µs max=307.13ms p(90)=49.72ms p(95)=95.98ms http_req_sending...............: avg=1.45ms min=8.5µs med=15.28µs max=229.49ms p(90)=67.24µs p(95)=329.44µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=906.35ms min=585.56ms med=905.22ms max=1.32s p(90)=1.04s p(95)=1.09s http_reqs......................: 3175 102.702656/s iteration_duration.............: avg=959.3ms min=605.69ms med=949.15ms max=1.45s p(90)=1.12s p(95)=1.18s iterations.....................: 3175 102.702656/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9342 ✗ 0 data_received..................: 273 MB 8.8 MB/s data_sent......................: 3.7 MB 119 kB/s http_req_blocked...............: avg=59.74µs min=1.63µs med=3.17µs max=14.31ms p(90)=5.02µs p(95)=9.67µs http_req_connecting............: avg=44.26µs min=0s med=0s max=4.26ms p(90)=0s p(95)=0s http_req_duration..............: avg=946.14ms min=354.95ms med=922.37ms max=1.86s p(90)=1.26s p(95)=1.38s { expected_response:true }...: avg=946.14ms min=354.95ms med=922.37ms max=1.86s p(90)=1.26s p(95)=1.38s http_req_failed................: 0.00% ✓ 0 ✗ 3114 http_req_receiving.............: avg=16.64ms min=39.39µs med=86.7µs max=719.73ms p(90)=12.57ms p(95)=101.12ms http_req_sending...............: avg=676.51µs min=8.33µs med=15.1µs max=237.59ms p(90)=46.38µs p(95)=397.04µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=928.82ms min=354.65ms med=910.03ms max=1.83s p(90)=1.22s p(95)=1.32s http_reqs......................: 3114 100.234637/s iteration_duration.............: avg=988.12ms min=367.78ms med=963.35ms max=1.89s p(90)=1.32s p(95)=1.45s iterations.....................: 3114 100.234637/s vus............................: 22 min=22 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7740 ✗ 0 data_received..................: 226 MB 7.2 MB/s data_sent......................: 3.1 MB 98 kB/s http_req_blocked...............: avg=32.55µs min=1.29µs med=2.52µs max=7.4ms p(90)=3.91µs p(95)=9.55µs http_req_connecting............: avg=26.33µs min=0s med=0s max=7.38ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=709.71ms med=1.14s max=1.7s p(90)=1.36s p(95)=1.43s { expected_response:true }...: avg=1.15s min=709.71ms med=1.14s max=1.7s p(90)=1.36s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2580 http_req_receiving.............: avg=10.98ms min=39.78µs med=82.3µs max=382.93ms p(90)=31.42ms p(95)=79.18ms http_req_sending...............: avg=1.51ms min=7.94µs med=12.67µs max=357.5ms p(90)=55.48µs p(95)=409.29µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=709.59ms med=1.13s max=1.64s p(90)=1.34s p(95)=1.39s http_reqs......................: 2580 82.467656/s iteration_duration.............: avg=1.19s min=721.35ms med=1.18s max=1.85s p(90)=1.44s p(95)=1.51s iterations.....................: 2580 82.467656/s vus............................: 59 min=59 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5907 ✗ 0 data_received..................: 173 MB 5.5 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=33.77µs min=1.57µs med=3.29µs max=2.89ms p(90)=4.98µs p(95)=93.86µs http_req_connecting............: avg=26.99µs min=0s med=0s max=2.86ms p(90)=0s p(95)=62.73µs http_req_duration..............: avg=1.54s min=730.72ms med=1.46s max=10.01s p(90)=1.77s p(95)=1.89s { expected_response:true }...: avg=1.54s min=730.72ms med=1.46s max=10.01s p(90)=1.77s p(95)=1.89s http_req_failed................: 0.00% ✓ 0 ✗ 1969 http_req_receiving.............: avg=268.65µs min=46.59µs med=113.42µs max=41.24ms p(90)=189.31µs p(95)=273.78µs http_req_sending...............: avg=42.76µs min=9.07µs med=17.21µs max=14.27ms p(90)=32.7µs p(95)=70.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.54s min=730.48ms med=1.46s max=10.01s p(90)=1.77s p(95)=1.89s http_reqs......................: 1969 63.068001/s iteration_duration.............: avg=1.56s min=738.61ms med=1.47s max=10.04s p(90)=1.78s p(95)=1.91s iterations.....................: 1969 63.068001/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5547 ✗ 0 data_received..................: 162 MB 5.2 MB/s data_sent......................: 2.2 MB 71 kB/s http_req_blocked...............: avg=184.61µs min=1.85µs med=4.34µs max=8.37ms p(90)=6.33µs p(95)=574.52µs http_req_connecting............: avg=161.74µs min=0s med=0s max=7.46ms p(90)=0s p(95)=399.54µs http_req_duration..............: avg=1.63s min=810.13ms med=1.58s max=3.4s p(90)=2.02s p(95)=2.31s { expected_response:true }...: avg=1.63s min=810.13ms med=1.58s max=3.4s p(90)=2.02s p(95)=2.31s http_req_failed................: 0.00% ✓ 0 ✗ 1849 http_req_receiving.............: avg=1.81ms min=42.21µs med=134.33µs max=79.8ms p(90)=3ms p(95)=10.12ms http_req_sending...............: avg=150.21µs min=9.03µs med=23.26µs max=51.3ms p(90)=44.41µs p(95)=146.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.63s min=809.49ms med=1.58s max=3.4s p(90)=2.02s p(95)=2.31s http_reqs......................: 1849 59.481878/s iteration_duration.............: avg=1.65s min=871.81ms med=1.6s max=3.42s p(90)=2.05s p(95)=2.34s iterations.....................: 1849 59.481878/s vus............................: 14 min=14 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1419 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 562 kB 15 kB/s http_req_blocked...............: avg=1.12ms min=1.43µs med=3.76µs max=15.22ms p(90)=4.14ms p(95)=9.08ms http_req_connecting............: avg=1.11ms min=0s med=0s max=15.19ms p(90)=4.02ms p(95)=9.04ms http_req_duration..............: avg=7.18s min=3.04s med=7.46s max=8.78s p(90)=8.26s p(95)=8.41s { expected_response:true }...: avg=7.18s min=3.04s med=7.46s max=8.78s p(90)=8.26s p(95)=8.41s http_req_failed................: 0.00% ✓ 0 ✗ 473 http_req_receiving.............: avg=142.25µs min=65.45µs med=121.14µs max=2.09ms p(90)=183.37µs p(95)=225.33µs http_req_sending...............: avg=894.19µs min=8.6µs med=21.47µs max=6.91ms p(90)=4.45ms p(95)=5.83ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.18s min=3.04s med=7.46s max=8.78s p(90)=8.26s p(95)=8.41s http_reqs......................: 473 12.608952/s iteration_duration.............: avg=7.19s min=3.05s med=7.47s max=8.78s p(90)=8.28s p(95)=8.41s iterations.....................: 473 12.608952/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5331 total, 0 failed avg: 487ms, p95: 724ms ✅
apollo-router 163 4997 total, 0 failed avg: 549ms, p95: 727ms ✅
wundergraph 153 4652 total, 0 failed avg: 550ms, p95: 986ms ✅
mesh-supergraph-bun 90 2784 total, 0 failed avg: 1068ms, p95: 1784ms ✅
apollo-server 47 1477 total, 0 failed avg: 2073ms, p95: 2713ms ✅
mercurius 30 921 total, 0 failed avg: 3284ms, p95: 4453ms ✅
mesh-supergraph 30 966 total, 0 failed avg: 3247ms, p95: 5350ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15993 ✗ 0 data_received..................: 468 MB 15 MB/s data_sent......................: 6.3 MB 209 kB/s http_req_blocked...............: avg=56.78µs min=1.52µs med=2.66µs max=57.29ms p(90)=3.91µs p(95)=5.27µs http_req_connecting............: avg=13.99µs min=0s med=0s max=3.07ms p(90)=0s p(95)=0s http_req_duration..............: avg=487.49ms min=21.82ms med=488.3ms max=1.26s p(90)=628.51ms p(95)=724.17ms { expected_response:true }...: avg=487.49ms min=21.82ms med=488.3ms max=1.26s p(90)=628.51ms p(95)=724.17ms http_req_failed................: 0.00% ✓ 0 ✗ 5331 http_req_receiving.............: avg=36.1ms min=38.21µs med=71.67µs max=869.81ms p(90)=97.54ms p(95)=316.44ms http_req_sending...............: avg=1.6ms min=7.83µs med=12.93µs max=770.25ms p(90)=28.55µs p(95)=179.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=449.78ms min=15.98ms med=472.13ms max=854.13ms p(90)=571.54ms p(95)=608.05ms http_reqs......................: 5331 175.767353/s iteration_duration.............: avg=564.73ms min=32.11ms med=530.53ms max=2.09s p(90)=806.82ms p(95)=940.8ms iterations.....................: 5331 175.767353/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14991 ✗ 0 data_received..................: 438 MB 14 MB/s data_sent......................: 5.9 MB 195 kB/s http_req_blocked...............: avg=48.53µs min=1.47µs med=3.33µs max=44.86ms p(90)=5.15µs p(95)=6.38µs http_req_connecting............: avg=20.49µs min=0s med=0s max=4.57ms p(90)=0s p(95)=0s http_req_duration..............: avg=549.23ms min=66.16ms med=550.83ms max=1.28s p(90)=682.77ms p(95)=726.92ms { expected_response:true }...: avg=549.23ms min=66.16ms med=550.83ms max=1.28s p(90)=682.77ms p(95)=726.92ms http_req_failed................: 0.00% ✓ 0 ✗ 4997 http_req_receiving.............: avg=12.22ms min=39.24µs med=74.74µs max=724.55ms p(90)=13.54ms p(95)=63.47ms http_req_sending...............: avg=1.4ms min=8.19µs med=15.61µs max=454.05ms p(90)=41.34µs p(95)=400.76µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=535.61ms min=66.07ms med=540.82ms max=930.93ms p(90)=663.21ms p(95)=698.15ms http_reqs......................: 4997 163.940031/s iteration_duration.............: avg=606.31ms min=91.12ms med=591.57ms max=2.06s p(90)=764.64ms p(95)=848.18ms iterations.....................: 4997 163.940031/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13956 ✗ 0 data_received..................: 408 MB 13 MB/s data_sent......................: 5.5 MB 182 kB/s http_req_blocked...............: avg=70.43µs min=1.27µs med=3.12µs max=165.56ms p(90)=5.39µs p(95)=7.63µs http_req_connecting............: avg=18.44µs min=0s med=0s max=6.79ms p(90)=0s p(95)=0s http_req_duration..............: avg=550.08ms min=20.93ms med=515.84ms max=1.97s p(90)=855.15ms p(95)=986.27ms { expected_response:true }...: avg=550.08ms min=20.93ms med=515.84ms max=1.97s p(90)=855.15ms p(95)=986.27ms http_req_failed................: 0.00% ✓ 0 ✗ 4652 http_req_receiving.............: avg=45.06ms min=29.15µs med=91.44µs max=1.42s p(90)=143.89ms p(95)=323.91ms http_req_sending...............: avg=2.84ms min=7.23µs med=14.71µs max=1.4s p(90)=40.44µs p(95)=277.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=502.17ms min=20.79ms med=477.46ms max=1.49s p(90)=802.74ms p(95)=891.59ms http_reqs......................: 4652 153.259346/s iteration_duration.............: avg=649.08ms min=31.86ms med=598.59ms max=2.73s p(90)=1.02s p(95)=1.21s iterations.....................: 4652 153.259346/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8352 ✗ 0 data_received..................: 244 MB 7.9 MB/s data_sent......................: 3.3 MB 107 kB/s http_req_blocked...............: avg=45.39µs min=1.46µs med=4.07µs max=18.46ms p(90)=6.04µs p(95)=12.35µs http_req_connecting............: avg=19.01µs min=0s med=0s max=2.48ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.06s min=536.41ms med=948.11ms max=3.32s p(90)=1.63s p(95)=1.78s { expected_response:true }...: avg=1.06s min=536.41ms med=948.11ms max=3.32s p(90)=1.63s p(95)=1.78s http_req_failed................: 0.00% ✓ 0 ✗ 2784 http_req_receiving.............: avg=11.57ms min=39.18µs med=111.5µs max=542.98ms p(90)=1.08ms p(95)=57.93ms http_req_sending...............: avg=515.75µs min=8.92µs med=20.75µs max=295.48ms p(90)=42.33µs p(95)=147.66µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.05s min=536.31ms med=939.74ms max=3.32s p(90)=1.63s p(95)=1.77s http_reqs......................: 2784 90.405754/s iteration_duration.............: avg=1.09s min=547.66ms med=974.83ms max=3.35s p(90)=1.65s p(95)=1.8s iterations.....................: 2784 90.405754/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4431 ✗ 0 data_received..................: 130 MB 4.1 MB/s data_sent......................: 1.8 MB 56 kB/s http_req_blocked...............: avg=196.74µs min=1.82µs med=4.41µs max=6.48ms p(90)=6.14µs p(95)=1.48ms http_req_connecting............: avg=186.74µs min=0s med=0s max=6.37ms p(90)=0s p(95)=1.46ms http_req_duration..............: avg=2.07s min=764.81ms med=1.72s max=21.74s p(90)=2.07s p(95)=2.71s { expected_response:true }...: avg=2.07s min=764.81ms med=1.72s max=21.74s p(90)=2.07s p(95)=2.71s http_req_failed................: 0.00% ✓ 0 ✗ 1477 http_req_receiving.............: avg=234.93µs min=53.88µs med=133.9µs max=64.04ms p(90)=189.37µs p(95)=225.11µs http_req_sending...............: avg=67.35µs min=9.22µs med=24.37µs max=11.27ms p(90)=40.49µs p(95)=313.64µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.07s min=764.68ms med=1.72s max=21.74s p(90)=2.07s p(95)=2.71s http_reqs......................: 1477 47.05052/s iteration_duration.............: avg=2.08s min=774.29ms med=1.73s max=21.75s p(90)=2.08s p(95)=2.72s iterations.....................: 1477 47.05052/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2763 ✗ 0 data_received..................: 81 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=161.67µs min=1.44µs med=4.29µs max=4.67ms p(90)=103.23µs p(95)=758.85µs http_req_connecting............: avg=142.61µs min=0s med=0s max=4.64ms p(90)=72.25µs p(95)=570.38µs http_req_duration..............: avg=3.28s min=617.55ms med=3.09s max=7.21s p(90)=4.24s p(95)=4.45s { expected_response:true }...: avg=3.28s min=617.55ms med=3.09s max=7.21s p(90)=4.24s p(95)=4.45s http_req_failed................: 0.00% ✓ 0 ✗ 921 http_req_receiving.............: avg=287.22µs min=43.34µs med=124.34µs max=44.64ms p(90)=199.78µs p(95)=275.43µs http_req_sending...............: avg=74.89µs min=8.59µs med=22.66µs max=3.92ms p(90)=64.58µs p(95)=568.5µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.28s min=617.47ms med=3.09s max=7.21s p(90)=4.24s p(95)=4.45s http_reqs......................: 921 30.094227/s iteration_duration.............: avg=3.29s min=632.32ms med=3.1s max=7.22s p(90)=4.25s p(95)=4.45s iterations.....................: 921 30.094227/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2898 ✗ 0 data_received..................: 85 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=329.58µs min=1.48µs med=3.63µs max=14.24ms p(90)=102.9µs p(95)=1.62ms http_req_connecting............: avg=283.74µs min=0s med=0s max=13.85ms p(90)=72.41µs p(95)=1.13ms http_req_duration..............: avg=3.24s min=1.6s med=3.09s max=6.56s p(90)=4.6s p(95)=5.35s { expected_response:true }...: avg=3.24s min=1.6s med=3.09s max=6.56s p(90)=4.6s p(95)=5.35s http_req_failed................: 0.00% ✓ 0 ✗ 966 http_req_receiving.............: avg=3.61ms min=44.37µs med=204.6µs max=504.75ms p(90)=2.76ms p(95)=12.88ms http_req_sending...............: avg=137.7µs min=7.92µs med=19.92µs max=18.52ms p(90)=62.88µs p(95)=803.67µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.24s min=1.6s med=3.09s max=6.56s p(90)=4.58s p(95)=5.34s http_reqs......................: 966 30.158978/s iteration_duration.............: avg=3.26s min=1.65s med=3.11s max=6.57s p(90)=4.61s p(95)=5.36s iterations.....................: 966 30.158978/s vus............................: 8 min=8 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4601 total, 0 failed avg: 608ms, p95: 798ms ✅
wundergraph 102 3177 total, 0 failed avg: 925ms, p95: 1119ms ✅
mesh-supergraph-bun 81 2521 total, 0 failed avg: 1181ms, p95: 1759ms ✅
cosmo 77 2407 total, 0 failed avg: 1233ms, p95: 1470ms ✅
apollo-server 46 1463 total, 0 failed avg: 2080ms, p95: 2445ms ✅
mesh-supergraph 29 953 total, 0 failed avg: 3257ms, p95: 5399ms ✅
mercurius 12 452 total, 0 failed avg: 7533ms, p95: 8986ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13803 ✗ 0 data_received..................: 404 MB 13 MB/s data_sent......................: 5.5 MB 179 kB/s http_req_blocked...............: avg=28.49µs min=1.48µs med=2.73µs max=10.11ms p(90)=4.14µs p(95)=5.81µs http_req_connecting............: avg=17.5µs min=0s med=0s max=2.93ms p(90)=0s p(95)=0s http_req_duration..............: avg=608.3ms min=321.42ms med=598.03ms max=1.48s p(90)=732.71ms p(95)=798.44ms { expected_response:true }...: avg=608.3ms min=321.42ms med=598.03ms max=1.48s p(90)=732.71ms p(95)=798.44ms http_req_failed................: 0.00% ✓ 0 ✗ 4601 http_req_receiving.............: avg=12.86ms min=34.99µs med=67.97µs max=552.29ms p(90)=40.44ms p(95)=81.47ms http_req_sending...............: avg=1.06ms min=7.75µs med=12.87µs max=242.31ms p(90)=29.97µs p(95)=153.18µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=594.38ms min=321.37ms med=585.73ms max=1.02s p(90)=718.62ms p(95)=772.8ms http_reqs......................: 4601 150.7353/s iteration_duration.............: avg=657.74ms min=331.79ms med=645.39ms max=1.57s p(90)=812.08ms p(95)=876.26ms iterations.....................: 4601 150.7353/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9531 ✗ 0 data_received..................: 279 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=83.7µs min=1.2µs med=2.59µs max=5.45ms p(90)=3.93µs p(95)=5.71µs http_req_connecting............: avg=78.84µs min=0s med=0s max=5.42ms p(90)=0s p(95)=0s http_req_duration..............: avg=925.25ms min=580.14ms med=903.06ms max=1.83s p(90)=1.05s p(95)=1.11s { expected_response:true }...: avg=925.25ms min=580.14ms med=903.06ms max=1.83s p(90)=1.05s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3177 http_req_receiving.............: avg=9.72ms min=39.89µs med=78.55µs max=457.28ms p(90)=23.92ms p(95)=58.51ms http_req_sending...............: avg=1.17ms min=7.94µs med=13.06µs max=425.21ms p(90)=60.69µs p(95)=569.44µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=914.36ms min=579.99ms med=897.79ms max=1.44s p(90)=1.04s p(95)=1.1s http_reqs......................: 3177 102.854868/s iteration_duration.............: avg=958.06ms min=590.16ms med=933.87ms max=1.86s p(90)=1.09s p(95)=1.16s iterations.....................: 3177 102.854868/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7563 ✗ 0 data_received..................: 221 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=179.5µs min=1.46µs med=3.59µs max=32.18ms p(90)=5.65µs p(95)=12.13µs http_req_connecting............: avg=161.24µs min=0s med=0s max=11.65ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.18s min=486.21ms med=1.13s max=2.43s p(90)=1.54s p(95)=1.75s { expected_response:true }...: avg=1.18s min=486.21ms med=1.13s max=2.43s p(90)=1.54s p(95)=1.75s http_req_failed................: 0.00% ✓ 0 ✗ 2521 http_req_receiving.............: avg=15.41ms min=39.13µs med=102.81µs max=631.94ms p(90)=884.53µs p(95)=50.21ms http_req_sending...............: avg=568.12µs min=7.68µs med=18.02µs max=332.04ms p(90)=52.99µs p(95)=870.82µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=485.94ms med=1.11s max=2.43s p(90)=1.5s p(95)=1.73s http_reqs......................: 2521 81.245685/s iteration_duration.............: avg=1.21s min=496.74ms med=1.16s max=2.48s p(90)=1.59s p(95)=1.8s iterations.....................: 2521 81.245685/s vus............................: 1 min=1 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7221 ✗ 0 data_received..................: 211 MB 6.8 MB/s data_sent......................: 2.9 MB 92 kB/s http_req_blocked...............: avg=57.99µs min=1.42µs med=2.58µs max=4.77ms p(90)=3.94µs p(95)=9.5µs http_req_connecting............: avg=51.73µs min=0s med=0s max=4.7ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.23s min=644.64ms med=1.23s max=1.87s p(90)=1.41s p(95)=1.46s { expected_response:true }...: avg=1.23s min=644.64ms med=1.23s max=1.87s p(90)=1.41s p(95)=1.46s http_req_failed................: 0.00% ✓ 0 ✗ 2407 http_req_receiving.............: avg=15.04ms min=39.39µs med=88.46µs max=410.37ms p(90)=50.51ms p(95)=97.04ms http_req_sending...............: avg=1.27ms min=7.74µs med=12.73µs max=312.8ms p(90)=48.98µs p(95)=443.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.21s min=644.42ms med=1.22s max=1.58s p(90)=1.37s p(95)=1.43s http_reqs......................: 2407 77.477833/s iteration_duration.............: avg=1.26s min=727.38ms med=1.26s max=1.93s p(90)=1.45s p(95)=1.51s iterations.....................: 2407 77.477833/s vus............................: 16 min=16 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4389 ✗ 0 data_received..................: 129 MB 4.1 MB/s data_sent......................: 1.7 MB 56 kB/s http_req_blocked...............: avg=203.78µs min=1.58µs med=3.61µs max=6.52ms p(90)=5.77µs p(95)=1.47ms http_req_connecting............: avg=196.05µs min=0s med=0s max=6.48ms p(90)=0s p(95)=1.37ms http_req_duration..............: avg=2.08s min=1.07s med=1.89s max=13.66s p(90)=2.26s p(95)=2.44s { expected_response:true }...: avg=2.08s min=1.07s med=1.89s max=13.66s p(90)=2.26s p(95)=2.44s http_req_failed................: 0.00% ✓ 0 ✗ 1463 http_req_receiving.............: avg=348.52µs min=45.3µs med=121.38µs max=64.46ms p(90)=192.31µs p(95)=269.24µs http_req_sending...............: avg=61.59µs min=9.55µs med=19.08µs max=17.97ms p(90)=37.67µs p(95)=340.91µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.07s min=1.07s med=1.88s max=13.66s p(90)=2.26s p(95)=2.44s http_reqs......................: 1463 46.806652/s iteration_duration.............: avg=2.09s min=1.07s med=1.9s max=13.67s p(90)=2.27s p(95)=2.45s iterations.....................: 1463 46.806652/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2859 ✗ 0 data_received..................: 84 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=76.71µs min=1.49µs med=3.95µs max=4.06ms p(90)=101.31µs p(95)=542.28µs http_req_connecting............: avg=58.42µs min=0s med=0s max=1.94ms p(90)=67.92µs p(95)=389.14µs http_req_duration..............: avg=3.25s min=1.37s med=3.26s max=6.96s p(90)=4.58s p(95)=5.39s { expected_response:true }...: avg=3.25s min=1.37s med=3.26s max=6.96s p(90)=4.58s p(95)=5.39s http_req_failed................: 0.00% ✓ 0 ✗ 953 http_req_receiving.............: avg=2.02ms min=44.87µs med=150.73µs max=78.97ms p(90)=1.27ms p(95)=5.47ms http_req_sending...............: avg=59.75µs min=8.04µs med=21.5µs max=4.03ms p(90)=56.77µs p(95)=297.03µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.25s min=1.37s med=3.25s max=6.96s p(90)=4.58s p(95)=5.39s http_reqs......................: 953 29.960636/s iteration_duration.............: avg=3.27s min=1.39s med=3.27s max=6.97s p(90)=4.59s p(95)=5.41s iterations.....................: 953 29.960636/s vus............................: 64 min=64 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1356 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 537 kB 14 kB/s http_req_blocked...............: avg=165.16µs min=1.53µs med=3.46µs max=3.5ms p(90)=625.03µs p(95)=1.14ms http_req_connecting............: avg=144.78µs min=0s med=0s max=1.99ms p(90)=559.19µs p(95)=1.07ms http_req_duration..............: avg=7.53s min=3.48s med=7.74s max=9.29s p(90)=8.77s p(95)=8.98s { expected_response:true }...: avg=7.53s min=3.48s med=7.74s max=9.29s p(90)=8.77s p(95)=8.98s http_req_failed................: 0.00% ✓ 0 ✗ 452 http_req_receiving.............: avg=149.93µs min=54.93µs med=118.86µs max=7.94ms p(90)=181.12µs p(95)=209.55µs http_req_sending...............: avg=199.8µs min=9.5µs med=19.67µs max=2.67ms p(90)=340.8µs p(95)=2.03ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.53s min=3.48s med=7.74s max=9.29s p(90)=8.77s p(95)=8.98s http_reqs......................: 452 12.02588/s iteration_duration.............: avg=7.54s min=3.49s med=7.75s max=9.3s p(90)=8.78s p(95)=8.99s iterations.....................: 452 12.02588/s vus............................: 11 min=11 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2736ms 175 12316 total, 0 failed avg: 802ms, p95: 2736ms, max: 8947ms, med: 541ms ✅
apollo-router 2935ms 163 11449 total, 0 failed avg: 940ms, p95: 2936ms, max: 7433ms, med: 559ms ✅
wundergraph 3126ms 165 11619 total, 0 failed avg: 817ms, p95: 3127ms, max: 8296ms, med: 446ms ✅
mesh-supergraph-bun 5614ms 113 7954 total, 0 failed avg: 2322ms, p95: 5614ms, max: 9055ms, med: 2210ms ✅
mesh-supergraph 6867ms 69 4843 total, 0 failed avg: 3923ms, p95: 6868ms, max: 9373ms, med: 3952ms ✅
apollo-server 24358ms 67 4940 total, 0 failed avg: 4231ms, p95: 24359ms, max: 45303ms, med: 2196ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36948 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 209 kB/s http_req_blocked...............: avg=19.69ms min=1.44µs med=2.83µs max=4.81s p(90)=4.46µs p(95)=11.17µs http_req_connecting............: avg=18.47ms min=0s med=0s max=4.7s p(90)=0s p(95)=0s http_req_duration..............: avg=801.54ms min=6.49ms med=540.96ms max=8.94s p(90)=1.85s p(95)=2.73s { expected_response:true }...: avg=801.54ms min=6.49ms med=540.96ms max=8.94s p(90)=1.85s p(95)=2.73s http_req_failed................: 0.00% ✓ 0 ✗ 12316 http_req_receiving.............: avg=290.48ms min=32.45µs med=77.09µs max=8.42s p(90)=1.14s p(95)=1.89s http_req_sending...............: avg=31.98ms min=7.78µs med=13.4µs max=5.04s p(90)=140.95µs p(95)=68.88ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=479.07ms min=6.37ms med=368.06ms max=3.32s p(90)=1.01s p(95)=1.29s http_reqs......................: 12316 175.882771/s iteration_duration.............: avg=1.49s min=11.44ms med=968.63ms max=10.61s p(90)=3.53s p(95)=4.65s iterations.....................: 12316 175.882771/s vus............................: 1 min=1 max=490 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34347 ✗ 0 data_received..................: 1.0 GB 14 MB/s data_sent......................: 14 MB 194 kB/s http_req_blocked...............: avg=14.47ms min=1.82µs med=4.2µs max=4.22s p(90)=6.51µs p(95)=17.38µs http_req_connecting............: avg=13.02ms min=0s med=0s max=4.22s p(90)=0s p(95)=0s http_req_duration..............: avg=939.79ms min=8.13ms med=558.65ms max=7.43s p(90)=2.29s p(95)=2.93s { expected_response:true }...: avg=939.79ms min=8.13ms med=558.65ms max=7.43s p(90)=2.29s p(95)=2.93s http_req_failed................: 0.00% ✓ 0 ✗ 11449 http_req_receiving.............: avg=384.2ms min=30.3µs med=106.96µs max=6.14s p(90)=1.47s p(95)=2.12s http_req_sending...............: avg=31.63ms min=8.66µs med=22.31µs max=3.69s p(90)=163.97µs p(95)=43.5ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=523.95ms min=7.96ms med=417.15ms max=4.9s p(90)=1.07s p(95)=1.37s http_reqs......................: 11449 163.533877/s iteration_duration.............: avg=1.6s min=14.06ms med=1s max=10.39s p(90)=3.89s p(95)=4.84s iterations.....................: 11449 163.533877/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34857 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 197 kB/s http_req_blocked...............: avg=15.67ms min=1.28µs med=3.16µs max=4.39s p(90)=5.32µs p(95)=14.8µs http_req_connecting............: avg=14.56ms min=0s med=0s max=4.26s p(90)=0s p(95)=0s http_req_duration..............: avg=817.24ms min=6.39ms med=445.73ms max=8.29s p(90)=2.17s p(95)=3.12s { expected_response:true }...: avg=817.24ms min=6.39ms med=445.73ms max=8.29s p(90)=2.17s p(95)=3.12s http_req_failed................: 0.00% ✓ 0 ✗ 11619 http_req_receiving.............: avg=386.31ms min=34.94µs med=84.6µs max=7.84s p(90)=1.48s p(95)=2.4s http_req_sending...............: avg=38.05ms min=7.53µs med=14.88µs max=4.87s p(90)=378.71µs p(95)=71.85ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=392.87ms min=6.29ms med=304.41ms max=3.63s p(90)=823.45ms p(95)=975.14ms http_reqs......................: 11619 165.98027/s iteration_duration.............: avg=1.58s min=11.8ms med=935.41ms max=13.54s p(90)=4.04s p(95)=5.17s iterations.....................: 11619 165.98027/s vus............................: 1 min=1 max=486 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 23862 ✗ 0 data_received..................: 698 MB 10 MB/s data_sent......................: 9.4 MB 135 kB/s http_req_blocked...............: avg=1.91ms min=1.42µs med=3.31µs max=341.51ms p(90)=6.21µs p(95)=234.47µs http_req_connecting............: avg=1.85ms min=0s med=0s max=341.44ms p(90)=0s p(95)=156.63µs http_req_duration..............: avg=2.32s min=9.09ms med=2.21s max=9.05s p(90)=4.49s p(95)=5.61s { expected_response:true }...: avg=2.32s min=9.09ms med=2.21s max=9.05s p(90)=4.49s p(95)=5.61s http_req_failed................: 0.00% ✓ 0 ✗ 7954 http_req_receiving.............: avg=31.42ms min=37.79µs med=83.9µs max=1.7s p(90)=42.27ms p(95)=211.39ms http_req_sending...............: avg=2.45ms min=8.29µs med=15.64µs max=467.01ms p(90)=90.43µs p(95)=5.36ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.28s min=8.94ms med=2.16s max=8.94s p(90)=4.44s p(95)=5.54s http_reqs......................: 7954 113.625587/s iteration_duration.............: avg=2.39s min=20.33ms med=2.26s max=9.27s p(90)=4.58s p(95)=5.69s iterations.....................: 7954 113.625587/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14529 ✗ 0 data_received..................: 425 MB 6.1 MB/s data_sent......................: 5.7 MB 82 kB/s http_req_blocked...............: avg=662.06µs min=1.39µs med=3.93µs max=209.05ms p(90)=177.97µs p(95)=456.78µs http_req_connecting............: avg=618µs min=0s med=0s max=208.97ms p(90)=112.85µs p(95)=352.39µs http_req_duration..............: avg=3.92s min=13.02ms med=3.95s max=9.37s p(90)=6.16s p(95)=6.86s { expected_response:true }...: avg=3.92s min=13.02ms med=3.95s max=9.37s p(90)=6.16s p(95)=6.86s http_req_failed................: 0.00% ✓ 0 ✗ 4843 http_req_receiving.............: avg=2.67ms min=36.81µs med=104.7µs max=489.87ms p(90)=801.6µs p(95)=7.97ms http_req_sending...............: avg=457.29µs min=7.97µs med=21.24µs max=151.95ms p(90)=54.35µs p(95)=125.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.92s min=12.87ms med=3.95s max=9.37s p(90)=6.15s p(95)=6.86s http_reqs......................: 4843 69.164588/s iteration_duration.............: avg=3.95s min=19.65ms med=3.98s max=9.42s p(90)=6.19s p(95)=6.91s iterations.....................: 4843 69.164588/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14820 ✗ 0 data_received..................: 434 MB 5.9 MB/s data_sent......................: 5.9 MB 80 kB/s http_req_blocked...............: avg=133.77µs min=1.53µs med=3.64µs max=45.97ms p(90)=174.28µs p(95)=334.01µs http_req_connecting............: avg=87.41µs min=0s med=0s max=45.91ms p(90)=108.5µs p(95)=242.22µs http_req_duration..............: avg=4.23s min=96.69ms med=2.19s max=45.3s p(90)=3.28s p(95)=24.35s { expected_response:true }...: avg=4.23s min=96.69ms med=2.19s max=45.3s p(90)=3.28s p(95)=24.35s http_req_failed................: 0.00% ✓ 0 ✗ 4940 http_req_receiving.............: avg=300.02µs min=45.59µs med=122.23µs max=198.95ms p(90)=189.81µs p(95)=234.02µs http_req_sending...............: avg=79.44µs min=7.9µs med=18.77µs max=29.11ms p(90)=46.9µs p(95)=68.21µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.23s min=96.58ms med=2.19s max=45.3s p(90)=3.28s p(95)=24.35s http_reqs......................: 4940 67.314109/s iteration_duration.............: avg=4.24s min=104.85ms med=2.21s max=45.33s p(90)=3.29s p(95)=24.36s iterations.....................: 4940 67.314109/s vus............................: 32 min=32 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview