search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency tablemark to v3.1.0 #439

Closed renovate[bot] closed 3 days ago

renovate[bot] commented 6 months ago

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
tablemark 3.0.0 -> 3.1.0 age adoption passing confidence

Release Notes

haltcase/tablemark (tablemark) ### [`v3.1.0`](https://togithub.com/haltcase/tablemark/blob/HEAD/changelog.md#310-2024-04-02) [Compare Source](https://togithub.com/haltcase/tablemark/compare/v3.0.0...v3.1.0) ###### FEATURES - support eliding padding in header separator ([#​17](https://togithub.com/haltcase/tablemark/issues/17)) ([a4d24ce](https://togithub.com/haltcase/tablemark/commit/a4d24ce)), closes [#​16](https://togithub.com/haltcase/tablemark/issues/16) ***

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR was generated by Mend Renovate. View the repository job log.

github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 194 5933 total, 0 failed avg: 337ms, p95: 789ms ✅
apollo-router 175 5327 total, 0 failed avg: 482ms, p95: 728ms ✅
wundergraph 150 4588 total, 0 failed avg: 549ms, p95: 1011ms ✅
mesh-supergraph-bun 78 2412 total, 0 failed avg: 1227ms, p95: 2160ms ✅
apollo-server 53 1682 total, 0 failed avg: 1816ms, p95: 2110ms ✅
mercurius 29 906 total, 0 failed avg: 3353ms, p95: 4779ms ✅
mesh-supergraph 25 825 total, 0 failed avg: 3737ms, p95: 6126ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 17799 ✗ 0 data_received..................: 521 MB 17 MB/s data_sent......................: 7.0 MB 231 kB/s http_req_blocked...............: avg=247.63µs min=1.41µs med=2.7µs max=555.51ms p(90)=4µs p(95)=4.97µs http_req_connecting............: avg=100.14µs min=0s med=0s max=215.6ms p(90)=0s p(95)=0s http_req_duration..............: avg=336.76ms min=9.77ms med=290.21ms max=2.25s p(90)=604.42ms p(95)=788.95ms { expected_response:true }...: avg=336.76ms min=9.77ms med=290.21ms max=2.25s p(90)=604.42ms p(95)=788.95ms http_req_failed................: 0.00% ✓ 0 ✗ 5933 http_req_receiving.............: avg=82.68ms min=39.37µs med=78.06µs max=2.02s p(90)=321.97ms p(95)=543.62ms http_req_sending...............: avg=4.94ms min=7.46µs med=13.09µs max=924.05ms p(90)=98.54µs p(95)=8.69ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=249.13ms min=9.26ms med=236.78ms max=771.03ms p(90)=428.11ms p(95)=493.62ms http_reqs......................: 5933 194.975197/s iteration_duration.............: avg=509.64ms min=19.78ms med=435.42ms max=2.56s p(90)=968.84ms p(95)=1.21s iterations.....................: 5933 194.975197/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15981 ✗ 0 data_received..................: 467 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=36.23µs min=1.4µs med=2.78µs max=81.17ms p(90)=4.34µs p(95)=5.54µs http_req_connecting............: avg=14.22µs min=0s med=0s max=2.88ms p(90)=0s p(95)=0s http_req_duration..............: avg=481.74ms min=28.48ms med=479.61ms max=1.96s p(90)=624.31ms p(95)=727.61ms { expected_response:true }...: avg=481.74ms min=28.48ms med=479.61ms max=1.96s p(90)=624.31ms p(95)=727.61ms http_req_failed................: 0.00% ✓ 0 ✗ 5327 http_req_receiving.............: avg=37.15ms min=36.01µs med=74.83µs max=1.77s p(90)=82.64ms p(95)=201.03ms http_req_sending...............: avg=2.53ms min=8.03µs med=13.51µs max=1.16s p(90)=43.45µs p(95)=227.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=442.06ms min=17.99ms med=464.1ms max=927.39ms p(90)=578.51ms p(95)=609.64ms http_reqs......................: 5327 175.505151/s iteration_duration.............: avg=566.56ms min=41.5ms med=527.1ms max=2.81s p(90)=767.13ms p(95)=962.6ms iterations.....................: 5327 175.505151/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13764 ✗ 0 data_received..................: 403 MB 13 MB/s data_sent......................: 5.4 MB 179 kB/s http_req_blocked...............: avg=30.27µs min=1.38µs med=3.03µs max=24.54ms p(90)=4.69µs p(95)=6.41µs http_req_connecting............: avg=12.42µs min=0s med=0s max=2ms p(90)=0s p(95)=0s http_req_duration..............: avg=549.06ms min=23.29ms med=512.36ms max=1.94s p(90)=891.09ms p(95)=1.01s { expected_response:true }...: avg=549.06ms min=23.29ms med=512.36ms max=1.94s p(90)=891.09ms p(95)=1.01s http_req_failed................: 0.00% ✓ 0 ✗ 4588 http_req_receiving.............: avg=44.96ms min=39.68µs med=86.68µs max=1.71s p(90)=122.94ms p(95)=336.47ms http_req_sending...............: avg=3.14ms min=7.76µs med=13.87µs max=867.3ms p(90)=45.94µs p(95)=492.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=500.95ms min=20.8ms med=469.78ms max=1.59s p(90)=823.15ms p(95)=919.06ms http_reqs......................: 4588 150.835347/s iteration_duration.............: avg=659.89ms min=34.48ms med=602.06ms max=2.55s p(90)=1.08s p(95)=1.21s iterations.....................: 4588 150.835347/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7236 ✗ 0 data_received..................: 212 MB 6.9 MB/s data_sent......................: 2.9 MB 93 kB/s http_req_blocked...............: avg=166.57µs min=1.43µs med=3.13µs max=44.15ms p(90)=5.13µs p(95)=11.96µs http_req_connecting............: avg=142.01µs min=0s med=0s max=9.55ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.22s min=558.35ms med=1.05s max=3.18s p(90)=1.95s p(95)=2.15s { expected_response:true }...: avg=1.22s min=558.35ms med=1.05s max=3.18s p(90)=1.95s p(95)=2.15s http_req_failed................: 0.00% ✓ 0 ✗ 2412 http_req_receiving.............: avg=15.05ms min=40.98µs med=113.9µs max=588.85ms p(90)=3.03ms p(95)=78.71ms http_req_sending...............: avg=683.46µs min=8.63µs med=14.71µs max=185.49ms p(90)=41.61µs p(95)=487.34µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.21s min=558.29ms med=1.05s max=3.18s p(90)=1.92s p(95)=2.15s http_reqs......................: 2412 78.536682/s iteration_duration.............: avg=1.26s min=569.09ms med=1.08s max=3.21s p(90)=1.97s p(95)=2.22s iterations.....................: 2412 78.536682/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5046 ✗ 0 data_received..................: 148 MB 4.7 MB/s data_sent......................: 2.0 MB 64 kB/s http_req_blocked...............: avg=63.89µs min=1.54µs med=3.13µs max=2.93ms p(90)=5.22µs p(95)=192.61µs http_req_connecting............: avg=49.51µs min=0s med=0s max=2.75ms p(90)=0s p(95)=148.01µs http_req_duration..............: avg=1.81s min=848.24ms med=1.55s max=18.75s p(90)=1.77s p(95)=2.11s { expected_response:true }...: avg=1.81s min=848.24ms med=1.55s max=18.75s p(90)=1.77s p(95)=2.11s http_req_failed................: 0.00% ✓ 0 ✗ 1682 http_req_receiving.............: avg=209.89µs min=47.22µs med=121.13µs max=18.01ms p(90)=204.67µs p(95)=326.47µs http_req_sending...............: avg=58.72µs min=8.75µs med=15.9µs max=10.78ms p(90)=35.31µs p(95)=162.95µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.81s min=848.06ms med=1.55s max=18.75s p(90)=1.77s p(95)=2.11s http_reqs......................: 1682 53.841553/s iteration_duration.............: avg=1.82s min=888.87ms med=1.56s max=18.78s p(90)=1.79s p(95)=2.12s iterations.....................: 1682 53.841553/s vus............................: 38 min=38 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2718 ✗ 0 data_received..................: 80 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=118.98µs min=1.48µs med=4.21µs max=5.61ms p(90)=154.19µs p(95)=797.81µs http_req_connecting............: avg=100.07µs min=0s med=0s max=3.9ms p(90)=101.36µs p(95)=669.55µs http_req_duration..............: avg=3.35s min=559.47ms med=3.16s max=8.09s p(90)=4.18s p(95)=4.77s { expected_response:true }...: avg=3.35s min=559.47ms med=3.16s max=8.09s p(90)=4.18s p(95)=4.77s http_req_failed................: 0.00% ✓ 0 ✗ 906 http_req_receiving.............: avg=267.93µs min=45.87µs med=113.05µs max=72.1ms p(90)=203.08µs p(95)=309.55µs http_req_sending...............: avg=102.61µs min=9.12µs med=22.92µs max=2.23ms p(90)=66.84µs p(95)=389.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.35s min=559.22ms med=3.16s max=8.09s p(90)=4.18s p(95)=4.77s http_reqs......................: 906 29.435115/s iteration_duration.............: avg=3.36s min=572.06ms med=3.17s max=8.1s p(90)=4.19s p(95)=4.78s iterations.....................: 906 29.435115/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2475 ✗ 0 data_received..................: 72 MB 2.3 MB/s data_sent......................: 979 kB 31 kB/s http_req_blocked...............: avg=195.49µs min=1.41µs med=3.65µs max=5ms p(90)=208.07µs p(95)=1.87ms http_req_connecting............: avg=182.75µs min=0s med=0s max=4.97ms p(90)=156.64µs p(95)=1.7ms http_req_duration..............: avg=3.73s min=1.27s med=3.59s max=8.74s p(90)=5.4s p(95)=6.12s { expected_response:true }...: avg=3.73s min=1.27s med=3.59s max=8.74s p(90)=5.4s p(95)=6.12s http_req_failed................: 0.00% ✓ 0 ✗ 825 http_req_receiving.............: avg=2.55ms min=38.67µs med=143.2µs max=76.12ms p(90)=2.51ms p(95)=5.07ms http_req_sending...............: avg=88.94µs min=8.52µs med=20.56µs max=1.28ms p(90)=112.73µs p(95)=821.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.73s min=1.26s med=3.59s max=8.74s p(90)=5.39s p(95)=6.12s http_reqs......................: 825 25.771146/s iteration_duration.............: avg=3.75s min=1.29s med=3.61s max=8.75s p(90)=5.42s p(95)=6.15s iterations.....................: 825 25.771146/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 182 5545 total, 0 failed avg: 292ms, p95: 873ms ✅
apollo-router 171 5195 total, 0 failed avg: 337ms, p95: 902ms ✅
wundergraph 155 4705 total, 0 failed avg: 347ms, p95: 938ms ✅
mesh-supergraph-bun 85 2661 total, 0 failed avg: 1114ms, p95: 1888ms ✅
apollo-server 73 2272 total, 0 failed avg: 1333ms, p95: 1529ms ✅
mesh-supergraph 53 1671 total, 0 failed avg: 1814ms, p95: 2671ms ✅
mercurius 47 1445 total, 0 failed avg: 2088ms, p95: 2788ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16635 ✗ 0 data_received..................: 487 MB 16 MB/s data_sent......................: 6.6 MB 217 kB/s http_req_blocked...............: avg=43.16µs min=1.51µs med=3.03µs max=14.12ms p(90)=4.45µs p(95)=5.86µs http_req_connecting............: avg=33.4µs min=0s med=0s max=13.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=292.35ms min=9.02ms med=202.71ms max=2.3s p(90)=709.12ms p(95)=873.47ms { expected_response:true }...: avg=292.35ms min=9.02ms med=202.71ms max=2.3s p(90)=709.12ms p(95)=873.47ms http_req_failed................: 0.00% ✓ 0 ✗ 5545 http_req_receiving.............: avg=132.6ms min=33.75µs med=100.8µs max=1.97s p(90)=525.05ms p(95)=709.05ms http_req_sending...............: avg=6.62ms min=8.48µs med=14.16µs max=1.4s p(90)=78.44µs p(95)=3.26ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=153.12ms min=7.51ms med=140.26ms max=733.23ms p(90)=283.43ms p(95)=319.48ms http_reqs......................: 5545 182.886586/s iteration_duration.............: avg=544.3ms min=20.95ms med=397.42ms max=3.34s p(90)=1.18s p(95)=1.48s iterations.....................: 5545 182.886586/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15585 ✗ 0 data_received..................: 456 MB 15 MB/s data_sent......................: 6.2 MB 203 kB/s http_req_blocked...............: avg=28.78µs min=1.67µs med=2.99µs max=11.05ms p(90)=4.59µs p(95)=5.94µs http_req_connecting............: avg=20.54µs min=0s med=0s max=2.87ms p(90)=0s p(95)=0s http_req_duration..............: avg=337.29ms min=9.87ms med=245.68ms max=1.8s p(90)=733.94ms p(95)=901.53ms { expected_response:true }...: avg=337.29ms min=9.87ms med=245.68ms max=1.8s p(90)=733.94ms p(95)=901.53ms http_req_failed................: 0.00% ✓ 0 ✗ 5195 http_req_receiving.............: avg=134.72ms min=35.39µs med=85.87µs max=1.6s p(90)=509.75ms p(95)=675.31ms http_req_sending...............: avg=7.61ms min=8.68µs med=14.09µs max=1.21s p(90)=56.5µs p(95)=2.39ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=194.95ms min=9.79ms med=184.79ms max=883.62ms p(90)=329.98ms p(95)=393.28ms http_reqs......................: 5195 171.138577/s iteration_duration.............: avg=580.59ms min=30.61ms med=458.26ms max=3.33s p(90)=1.2s p(95)=1.47s iterations.....................: 5195 171.138577/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14115 ✗ 0 data_received..................: 413 MB 14 MB/s data_sent......................: 5.6 MB 184 kB/s http_req_blocked...............: avg=191.26µs min=1.49µs med=3.09µs max=249.94ms p(90)=4.48µs p(95)=8.02µs http_req_connecting............: avg=125.95µs min=0s med=0s max=212.16ms p(90)=0s p(95)=0s http_req_duration..............: avg=347.05ms min=13.75ms med=268.77ms max=3.68s p(90)=745.25ms p(95)=938.32ms { expected_response:true }...: avg=347.05ms min=13.75ms med=268.77ms max=3.68s p(90)=745.25ms p(95)=938.32ms http_req_failed................: 0.00% ✓ 0 ✗ 4705 http_req_receiving.............: avg=134.08ms min=38.46µs med=104.63µs max=2.62s p(90)=531.6ms p(95)=719.38ms http_req_sending...............: avg=6.2ms min=9.15µs med=14.19µs max=2.63s p(90)=119.64µs p(95)=2.05ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=206.75ms min=10.18ms med=195.62ms max=684.27ms p(90)=347.99ms p(95)=410.54ms http_reqs......................: 4705 155.139402/s iteration_duration.............: avg=641.06ms min=27.14ms med=517.87ms max=3.7s p(90)=1.31s p(95)=1.57s iterations.....................: 4705 155.139402/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7983 ✗ 0 data_received..................: 233 MB 7.5 MB/s data_sent......................: 3.2 MB 102 kB/s http_req_blocked...............: avg=29.44µs min=1.61µs med=2.85µs max=3.96ms p(90)=4.59µs p(95)=9.92µs http_req_connecting............: avg=22.27µs min=0s med=0s max=3.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.11s min=278.53ms med=964.99ms max=2.34s p(90)=1.74s p(95)=1.88s { expected_response:true }...: avg=1.11s min=278.53ms med=964.99ms max=2.34s p(90)=1.74s p(95)=1.88s http_req_failed................: 0.00% ✓ 0 ✗ 2661 http_req_receiving.............: avg=13.15ms min=37.35µs med=94.58µs max=518.23ms p(90)=6.5ms p(95)=99.31ms http_req_sending...............: avg=530.1µs min=8.87µs med=13.72µs max=166.36ms p(90)=43.74µs p(95)=148.5µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.1s min=278.03ms med=956.52ms max=2.34s p(90)=1.72s p(95)=1.87s http_reqs......................: 2661 85.850837/s iteration_duration.............: avg=1.15s min=291.76ms med=1s max=2.46s p(90)=1.78s p(95)=1.92s iterations.....................: 2661 85.850837/s vus............................: 1 min=1 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6816 ✗ 0 data_received..................: 200 MB 6.4 MB/s data_sent......................: 2.7 MB 87 kB/s http_req_blocked...............: avg=143.44µs min=1.42µs med=2.75µs max=7.09ms p(90)=4.58µs p(95)=15.51µs http_req_connecting............: avg=135.07µs min=0s med=0s max=7.06ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.33s min=489.82ms med=1.23s max=13.91s p(90)=1.36s p(95)=1.52s { expected_response:true }...: avg=1.33s min=489.82ms med=1.23s max=13.91s p(90)=1.36s p(95)=1.52s http_req_failed................: 0.00% ✓ 0 ✗ 2272 http_req_receiving.............: avg=170.09µs min=43.58µs med=111.55µs max=13.27ms p(90)=184.65µs p(95)=267.8µs http_req_sending...............: avg=47.81µs min=8.39µs med=13.99µs max=10.82ms p(90)=30.25µs p(95)=64.46µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.33s min=489.68ms med=1.23s max=13.91s p(90)=1.36s p(95)=1.52s http_reqs......................: 2272 73.320801/s iteration_duration.............: avg=1.34s min=499.09ms med=1.24s max=13.92s p(90)=1.37s p(95)=1.54s iterations.....................: 2272 73.320801/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5013 ✗ 0 data_received..................: 147 MB 4.7 MB/s data_sent......................: 2.0 MB 64 kB/s http_req_blocked...............: avg=51.34µs min=1.52µs med=4.31µs max=7.02ms p(90)=6.49µs p(95)=148.27µs http_req_connecting............: avg=39.58µs min=0s med=0s max=5.47ms p(90)=0s p(95)=104.02µs http_req_duration..............: avg=1.81s min=777.99ms med=1.76s max=4.09s p(90)=2.43s p(95)=2.67s { expected_response:true }...: avg=1.81s min=777.99ms med=1.76s max=4.09s p(90)=2.43s p(95)=2.67s http_req_failed................: 0.00% ✓ 0 ✗ 1671 http_req_receiving.............: avg=1.89ms min=43.17µs med=135.78µs max=149.56ms p(90)=2.72ms p(95)=5.86ms http_req_sending...............: avg=151.14µs min=9.01µs med=22.96µs max=34.62ms p(90)=48.82µs p(95)=165.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.81s min=764.73ms med=1.76s max=4.09s p(90)=2.43s p(95)=2.67s http_reqs......................: 1671 53.670969/s iteration_duration.............: avg=1.84s min=803.54ms med=1.79s max=4.13s p(90)=2.46s p(95)=2.69s iterations.....................: 1671 53.670969/s vus............................: 34 min=34 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4335 ✗ 0 data_received..................: 127 MB 4.1 MB/s data_sent......................: 1.7 MB 56 kB/s http_req_blocked...............: avg=49.92µs min=1.58µs med=4.08µs max=4.42ms p(90)=6.03µs p(95)=258.24µs http_req_connecting............: avg=33.24µs min=0s med=0s max=2.82ms p(90)=0s p(95)=181.51µs http_req_duration..............: avg=2.08s min=350.36ms med=2.05s max=4.99s p(90)=2.62s p(95)=2.78s { expected_response:true }...: avg=2.08s min=350.36ms med=2.05s max=4.99s p(90)=2.62s p(95)=2.78s http_req_failed................: 0.00% ✓ 0 ✗ 1445 http_req_receiving.............: avg=254.58µs min=47.12µs med=115.08µs max=37.64ms p(90)=206.11µs p(95)=319.31µs http_req_sending...............: avg=46.19µs min=9.26µs med=22µs max=4.09ms p(90)=39.21µs p(95)=126.07µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.08s min=350.1ms med=2.05s max=4.99s p(90)=2.62s p(95)=2.78s http_reqs......................: 1445 47.178758/s iteration_duration.............: avg=2.09s min=362.1ms med=2.06s max=5.03s p(90)=2.63s p(95)=2.8s iterations.....................: 1445 47.178758/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 191 5809 total, 0 failed avg: 337ms, p95: 709ms ✅
apollo-router 171 5230 total, 0 failed avg: 489ms, p95: 731ms ✅
wundergraph 153 4682 total, 0 failed avg: 533ms, p95: 1021ms ✅
mesh-supergraph-bun 67 2076 total, 0 failed avg: 1443ms, p95: 2509ms ✅
apollo-server 54 1703 total, 0 failed avg: 1791ms, p95: 2329ms ✅
mercurius 29 933 total, 0 failed avg: 3298ms, p95: 4280ms ✅
mesh-supergraph 24 779 total, 0 failed avg: 3949ms, p95: 6414ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 17427 ✗ 0 data_received..................: 510 MB 17 MB/s data_sent......................: 6.9 MB 227 kB/s http_req_blocked...............: avg=120.31µs min=1.49µs med=3.08µs max=240.27ms p(90)=4.98µs p(95)=5.99µs http_req_connecting............: avg=91.27µs min=0s med=0s max=240.21ms p(90)=0s p(95)=0s http_req_duration..............: avg=336.56ms min=10.57ms med=300.19ms max=2.19s p(90)=575.59ms p(95)=708.62ms { expected_response:true }...: avg=336.56ms min=10.57ms med=300.19ms max=2.19s p(90)=575.59ms p(95)=708.62ms http_req_failed................: 0.00% ✓ 0 ✗ 5809 http_req_receiving.............: avg=77.14ms min=39.51µs med=84.71µs max=2.04s p(90)=324.15ms p(95)=457.99ms http_req_sending...............: avg=4.12ms min=8.9µs med=14.45µs max=859.83ms p(90)=60.02µs p(95)=2.21ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=255.3ms min=10ms med=240.02ms max=723.35ms p(90)=424.53ms p(95)=486.96ms http_reqs......................: 5809 191.483439/s iteration_duration.............: avg=519.76ms min=24.34ms med=464.85ms max=2.57s p(90)=930.31ms p(95)=1.12s iterations.....................: 5809 191.483439/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15690 ✗ 0 data_received..................: 459 MB 15 MB/s data_sent......................: 6.2 MB 204 kB/s http_req_blocked...............: avg=45.61µs min=1.46µs med=2.91µs max=41.9ms p(90)=4.36µs p(95)=5.45µs http_req_connecting............: avg=26.71µs min=0s med=0s max=4.07ms p(90)=0s p(95)=0s http_req_duration..............: avg=488.65ms min=17.04ms med=482.49ms max=1.87s p(90)=645.57ms p(95)=730.92ms { expected_response:true }...: avg=488.65ms min=17.04ms med=482.49ms max=1.87s p(90)=645.57ms p(95)=730.92ms http_req_failed................: 0.00% ✓ 0 ✗ 5230 http_req_receiving.............: avg=36.32ms min=34.98µs med=75.19µs max=1.59s p(90)=83.14ms p(95)=255.63ms http_req_sending...............: avg=1.59ms min=8.55µs med=13.82µs max=876.13ms p(90)=45.1µs p(95)=163.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=450.72ms min=16.17ms med=466.95ms max=821.63ms p(90)=597.79ms p(95)=635.42ms http_reqs......................: 5230 171.713836/s iteration_duration.............: avg=578.17ms min=29.59ms med=537.9ms max=2.53s p(90)=816.2ms p(95)=1.02s iterations.....................: 5230 171.713836/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14046 ✗ 0 data_received..................: 411 MB 14 MB/s data_sent......................: 5.6 MB 183 kB/s http_req_blocked...............: avg=49µs min=1.1µs med=2.89µs max=4.81ms p(90)=4.65µs p(95)=5.91µs http_req_connecting............: avg=42.68µs min=0s med=0s max=4.78ms p(90)=0s p(95)=0s http_req_duration..............: avg=532.97ms min=20.74ms med=491.68ms max=2.5s p(90)=884.23ms p(95)=1.02s { expected_response:true }...: avg=532.97ms min=20.74ms med=491.68ms max=2.5s p(90)=884.23ms p(95)=1.02s http_req_failed................: 0.00% ✓ 0 ✗ 4682 http_req_receiving.............: avg=57.63ms min=35.02µs med=90.21µs max=2.34s p(90)=173.82ms p(95)=412.86ms http_req_sending...............: avg=3.36ms min=7.32µs med=13.43µs max=1.93s p(90)=47.41µs p(95)=1.01ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=471.97ms min=17.04ms med=446.72ms max=1.26s p(90)=800.61ms p(95)=917.82ms http_reqs......................: 4682 153.915087/s iteration_duration.............: avg=645.64ms min=34.13ms med=577.11ms max=3.19s p(90)=1.07s p(95)=1.3s iterations.....................: 4682 153.915087/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6228 ✗ 0 data_received..................: 182 MB 5.9 MB/s data_sent......................: 2.5 MB 80 kB/s http_req_blocked...............: avg=55.87µs min=1.6µs med=3.32µs max=3.02ms p(90)=5.52µs p(95)=27.7µs http_req_connecting............: avg=48.41µs min=0s med=0s max=2.84ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.44s min=666.4ms med=1.24s max=3.38s p(90)=2.36s p(95)=2.5s { expected_response:true }...: avg=1.44s min=666.4ms med=1.24s max=3.38s p(90)=2.36s p(95)=2.5s http_req_failed................: 0.00% ✓ 0 ✗ 2076 http_req_receiving.............: avg=15.11ms min=40.9µs med=148.41µs max=596.44ms p(90)=2.13ms p(95)=52.48ms http_req_sending...............: avg=289.49µs min=8.9µs med=16.88µs max=60.91ms p(90)=46.23µs p(95)=263.81µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.42s min=665.28ms med=1.23s max=3.32s p(90)=2.36s p(95)=2.49s http_reqs......................: 2076 67.292098/s iteration_duration.............: avg=1.46s min=675.61ms med=1.26s max=3.4s p(90)=2.38s p(95)=2.53s iterations.....................: 2076 67.292098/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5109 ✗ 0 data_received..................: 150 MB 4.8 MB/s data_sent......................: 2.0 MB 65 kB/s http_req_blocked...............: avg=51.62µs min=1.58µs med=3.17µs max=2.72ms p(90)=5.07µs p(95)=154.63µs http_req_connecting............: avg=43.05µs min=0s med=0s max=2.26ms p(90)=0s p(95)=103.69µs http_req_duration..............: avg=1.79s min=337.1ms med=1.5s max=19.58s p(90)=1.82s p(95)=2.32s { expected_response:true }...: avg=1.79s min=337.1ms med=1.5s max=19.58s p(90)=1.82s p(95)=2.32s http_req_failed................: 0.00% ✓ 0 ✗ 1703 http_req_receiving.............: avg=329.97µs min=41.32µs med=121.15µs max=69.27ms p(90)=204.39µs p(95)=299.12µs http_req_sending...............: avg=55.11µs min=8.65µs med=16.69µs max=6.52ms p(90)=33.72µs p(95)=100.3µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.79s min=336.93ms med=1.5s max=19.58s p(90)=1.82s p(95)=2.32s http_reqs......................: 1703 54.52862/s iteration_duration.............: avg=1.8s min=344.07ms med=1.51s max=19.59s p(90)=1.84s p(95)=2.33s iterations.....................: 1703 54.52862/s vus............................: 36 min=36 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2799 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=323.51µs min=1.43µs med=3.64µs max=6.77ms p(90)=320.29µs p(95)=3.58ms http_req_connecting............: avg=288.68µs min=0s med=0s max=6.63ms p(90)=191.76µs p(95)=3.04ms http_req_duration..............: avg=3.29s min=1.06s med=3.08s max=7.05s p(90)=4.08s p(95)=4.28s { expected_response:true }...: avg=3.29s min=1.06s med=3.08s max=7.05s p(90)=4.08s p(95)=4.28s http_req_failed................: 0.00% ✓ 0 ✗ 933 http_req_receiving.............: avg=635.77µs min=40.08µs med=111.14µs max=67.12ms p(90)=202.26µs p(95)=411.05µs http_req_sending...............: avg=63.03µs min=8.64µs med=19.76µs max=4.3ms p(90)=58.64µs p(95)=256.34µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.29s min=1.06s med=3.08s max=7.05s p(90)=4.08s p(95)=4.27s http_reqs......................: 933 29.89515/s iteration_duration.............: avg=3.31s min=1.07s med=3.1s max=7.06s p(90)=4.09s p(95)=4.28s iterations.....................: 933 29.89515/s vus............................: 33 min=33 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2337 ✗ 0 data_received..................: 68 MB 2.2 MB/s data_sent......................: 925 kB 29 kB/s http_req_blocked...............: avg=161.42µs min=1.56µs med=4.12µs max=7.68ms p(90)=252.58µs p(95)=1.07ms http_req_connecting............: avg=128.97µs min=0s med=0s max=3.92ms p(90)=173.95µs p(95)=889.18µs http_req_duration..............: avg=3.94s min=1.89s med=3.69s max=7.4s p(90)=5.8s p(95)=6.41s { expected_response:true }...: avg=3.94s min=1.89s med=3.69s max=7.4s p(90)=5.8s p(95)=6.41s http_req_failed................: 0.00% ✓ 0 ✗ 779 http_req_receiving.............: avg=2.53ms min=45.56µs med=171.93µs max=86.04ms p(90)=2.99ms p(95)=6.37ms http_req_sending...............: avg=60.5µs min=7.81µs med=22.26µs max=2.55ms p(90)=104.84µs p(95)=325.06µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.94s min=1.89s med=3.69s max=7.4s p(90)=5.8s p(95)=6.41s http_reqs......................: 779 24.689409/s iteration_duration.............: avg=3.96s min=1.9s med=3.71s max=7.41s p(90)=5.82s p(95)=6.43s iterations.....................: 779 24.689409/s vus............................: 46 min=46 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 days ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2250ms 182 12797 total, 0 failed avg: 748ms, p95: 2251ms, max: 9271ms, med: 501ms ✅
wundergraph 2422ms 159 11175 total, 0 failed avg: 865ms, p95: 2423ms, max: 7279ms, med: 675ms ✅
apollo-router 2847ms 168 11793 total, 0 failed avg: 861ms, p95: 2848ms, max: 9163ms, med: 551ms ✅
mesh-supergraph-bun 7823ms 85 6013 total, 0 failed avg: 3122ms, p95: 7824ms, max: 12433ms, med: 2861ms ✅
mesh-supergraph 8243ms 55 3904 total, 0 failed avg: 4948ms, p95: 8244ms, max: 10212ms, med: 5166ms ✅
apollo-server 22308ms 71 5195 total, 0 failed avg: 3994ms, p95: 22309ms, max: 44210ms, med: 2187ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 38391 ✗ 0 data_received..................: 1.1 GB 16 MB/s data_sent......................: 15 MB 217 kB/s http_req_blocked...............: avg=19.44ms min=1.39µs med=3.04µs max=4.3s p(90)=4.67µs p(95)=17.21µs http_req_connecting............: avg=18.79ms min=0s med=0s max=3.77s p(90)=0s p(95)=0s http_req_duration..............: avg=748.49ms min=3.58ms med=501.27ms max=9.27s p(90)=1.76s p(95)=2.25s { expected_response:true }...: avg=748.49ms min=3.58ms med=501.27ms max=9.27s p(90)=1.76s p(95)=2.25s http_req_failed................: 0.00% ✓ 0 ✗ 12797 http_req_receiving.............: avg=260.95ms min=33.97µs med=81.78µs max=6.72s p(90)=1.01s p(95)=1.61s http_req_sending...............: avg=30.08ms min=8.14µs med=13.96µs max=3.27s p(90)=319.38µs p(95)=76.24ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=457.45ms min=3.48ms med=302.55ms max=3.28s p(90)=1.05s p(95)=1.27s http_reqs......................: 12797 182.790768/s iteration_duration.............: avg=1.43s min=9.03ms med=970.93ms max=11.48s p(90)=3.4s p(95)=4.32s iterations.....................: 12797 182.790768/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 33525 ✗ 0 data_received..................: 981 MB 14 MB/s data_sent......................: 13 MB 190 kB/s http_req_blocked...............: avg=31.17ms min=1.45µs med=3.17µs max=3.82s p(90)=5.14µs p(95)=36µs http_req_connecting............: avg=29.94ms min=0s med=0s max=3.82s p(90)=0s p(95)=0s http_req_duration..............: avg=865.37ms min=6.08ms med=675.1ms max=7.27s p(90)=1.9s p(95)=2.42s { expected_response:true }...: avg=865.37ms min=6.08ms med=675.1ms max=7.27s p(90)=1.9s p(95)=2.42s http_req_failed................: 0.00% ✓ 0 ✗ 11175 http_req_receiving.............: avg=251.56ms min=32.98µs med=83.64µs max=6.74s p(90)=1.04s p(95)=1.47s http_req_sending...............: avg=36.25ms min=8.08µs med=14.95µs max=4.58s p(90)=2.57ms p(95)=133.98ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=577.56ms min=6.01ms med=475.46ms max=3.2s p(90)=1.19s p(95)=1.45s http_reqs......................: 11175 159.61647/s iteration_duration.............: avg=1.64s min=11.49ms med=1.24s max=10.1s p(90)=3.66s p(95)=4.61s iterations.....................: 11175 159.61647/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35379 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 200 kB/s http_req_blocked...............: avg=18.79ms min=1.55µs med=3.08µs max=4.19s p(90)=4.94µs p(95)=21.95µs http_req_connecting............: avg=17.62ms min=0s med=0s max=3.47s p(90)=0s p(95)=0s http_req_duration..............: avg=860.57ms min=6.21ms med=550.68ms max=9.16s p(90)=2.14s p(95)=2.84s { expected_response:true }...: avg=860.57ms min=6.21ms med=550.68ms max=9.16s p(90)=2.14s p(95)=2.84s http_req_failed................: 0.00% ✓ 0 ✗ 11793 http_req_receiving.............: avg=347.44ms min=32.44µs med=79.45µs max=7.26s p(90)=1.42s p(95)=2.14s http_req_sending...............: avg=39.55ms min=8.41µs med=14.47µs max=4.64s p(90)=371.1µs p(95)=73.63ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=473.58ms min=6.13ms med=372.53ms max=2.87s p(90)=986.87ms p(95)=1.19s http_reqs......................: 11793 168.461512/s iteration_duration.............: avg=1.57s min=11.8ms med=986.93ms max=12.48s p(90)=3.9s p(95)=4.89s iterations.....................: 11793 168.461512/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 18039 ✗ 0 data_received..................: 528 MB 7.5 MB/s data_sent......................: 7.1 MB 102 kB/s http_req_blocked...............: avg=1.61ms min=1.61µs med=3.18µs max=423.01ms p(90)=11µs p(95)=251.08µs http_req_connecting............: avg=1.51ms min=0s med=0s max=316.22ms p(90)=0s p(95)=165.42µs http_req_duration..............: avg=3.12s min=10.85ms med=2.86s max=12.43s p(90)=5.24s p(95)=7.82s { expected_response:true }...: avg=3.12s min=10.85ms med=2.86s max=12.43s p(90)=5.24s p(95)=7.82s http_req_failed................: 0.00% ✓ 0 ✗ 6013 http_req_receiving.............: avg=26.55ms min=37.65µs med=80.29µs max=1.82s p(90)=3.03ms p(95)=152.89ms http_req_sending...............: avg=2.59ms min=7.93µs med=15.03µs max=449.79ms p(90)=100.91µs p(95)=9.6ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.09s min=10.71ms med=2.85s max=12.43s p(90)=5.07s p(95)=7.82s http_reqs......................: 6013 85.886641/s iteration_duration.............: avg=3.18s min=16.94ms med=2.91s max=12.67s p(90)=5.27s p(95)=7.9s iterations.....................: 6013 85.886641/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 11712 ✗ 0 data_received..................: 343 MB 4.9 MB/s data_sent......................: 4.6 MB 66 kB/s http_req_blocked...............: avg=390.08µs min=1.71µs med=4.39µs max=145.52ms p(90)=208.06µs p(95)=471.06µs http_req_connecting............: avg=360.74µs min=0s med=0s max=145.44ms p(90)=145.61µs p(95)=384.48µs http_req_duration..............: avg=4.94s min=12.8ms med=5.16s max=10.21s p(90)=7.72s p(95)=8.24s { expected_response:true }...: avg=4.94s min=12.8ms med=5.16s max=10.21s p(90)=7.72s p(95)=8.24s http_req_failed................: 0.00% ✓ 0 ✗ 3904 http_req_receiving.............: avg=1.95ms min=40.2µs med=124.64µs max=253.47ms p(90)=2.39ms p(95)=5.18ms http_req_sending...............: avg=343.35µs min=8.45µs med=25.23µs max=90.69ms p(90)=57.57µs p(95)=106.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.94s min=12.71ms med=5.16s max=10.21s p(90)=7.71s p(95)=8.24s http_reqs......................: 3904 55.769571/s iteration_duration.............: avg=4.98s min=18.65ms med=5.19s max=10.24s p(90)=7.74s p(95)=8.28s iterations.....................: 3904 55.769571/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15585 ✗ 0 data_received..................: 457 MB 6.3 MB/s data_sent......................: 6.2 MB 85 kB/s http_req_blocked...............: avg=110.98µs min=1.42µs med=3.39µs max=51.7ms p(90)=19.11µs p(95)=251.15µs http_req_connecting............: avg=100.24µs min=0s med=0s max=51.63ms p(90)=0s p(95)=175.87µs http_req_duration..............: avg=3.99s min=72.06ms med=2.18s max=44.2s p(90)=3.37s p(95)=22.3s { expected_response:true }...: avg=3.99s min=72.06ms med=2.18s max=44.2s p(90)=3.37s p(95)=22.3s http_req_failed................: 0.00% ✓ 0 ✗ 5195 http_req_receiving.............: avg=333.61µs min=45.87µs med=112.78µs max=138.38ms p(90)=213.35µs p(95)=332.34µs http_req_sending...............: avg=72.87µs min=8.84µs med=18.07µs max=30.21ms p(90)=42.83µs p(95)=62.09µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.99s min=71.94ms med=2.18s max=44.2s p(90)=3.37s p(95)=22.3s http_reqs......................: 5195 71.267016/s iteration_duration.............: avg=4s min=84.01ms med=2.19s max=44.21s p(90)=3.38s p(95)=22.32s iterations.....................: 5195 71.267016/s vus............................: 70 min=57 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview