Closed gedigi closed 1 week ago
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> c83d229489a72bfa08affd9fab4e3f5a69e13b08
realistic_env_max_load
on c83d229489a72bfa08affd9fab4e3f5a69e13b08
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> c83d229489a72bfa08affd9fab4e3f5a69e13b08
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> c83d229489a72bfa08affd9fab4e3f5a69e13b08
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> c83d229489a72bfa08affd9fab4e3f5a69e13b08 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5894.342371228164 txn/s, latency: 5430.602625371309 ms, (p50: 5000 ms, p90: 8700 ms, p99: 11700 ms), latency samples: 228920
2. Upgrading first Validator to new version: c83d229489a72bfa08affd9fab4e3f5a69e13b08
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1375.5571931081624 txn/s, latency: 20094.68300679206 ms, (p50: 23600 ms, p90: 29200 ms, p99: 29600 ms), latency samples: 76560
3. Upgrading rest of first batch to new version: c83d229489a72bfa08affd9fab4e3f5a69e13b08
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1652.535488183317 txn/s, latency: 17356.888273166245 ms, (p50: 19300 ms, p90: 22300 ms, p99: 23000 ms), latency samples: 86980
4. upgrading second batch to new version: c83d229489a72bfa08affd9fab4e3f5a69e13b08
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3524.6795490536692 txn/s, latency: 8902.633142344332 ms, (p50: 9600 ms, p90: 12600 ms, p99: 12800 ms), latency samples: 144860
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> c83d229489a72bfa08affd9fab4e3f5a69e13b08 passed
Test Ok
realistic_env_max_load
success on c83d229489a72bfa08affd9fab4e3f5a69e13b08
two traffics test: inner traffic : committed: 7856.245550530235 txn/s, latency: 4991.194956243669 ms, (p50: 4800 ms, p90: 5900 ms, p99: 10500 ms), latency samples: 3396080
two traffics test : committed: 99.9363182389778 txn/s, latency: 2042.7096774193549 ms, (p50: 1900 ms, p90: 2100 ms, p99: 9900 ms), latency samples: 1860
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.209, avg: 0.207", "QsPosToProposal: max: 0.275, avg: 0.237", "ConsensusProposalToOrdered: max: 0.483, avg: 0.438", "ConsensusOrderedToCommit: max: 0.396, avg: 0.373", "ConsensusProposalToCommit: max: 0.835, avg: 0.811"]
Max round gap was 1 [limit 4] at version 1670082. Max no progress secs was 4.600958 [limit 15] at version 1670082.
Test Ok
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> c83d229489a72bfa08affd9fab4e3f5a69e13b08
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> c83d229489a72bfa08affd9fab4e3f5a69e13b08 (PR)
Upgrade the nodes to version: c83d229489a72bfa08affd9fab4e3f5a69e13b08
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1391.6380977759613 txn/s, submitted: 1393.8797828561417 txn/s, failed submission: 2.2416850801803503 txn/s, expired: 2.2416850801803503 txn/s, latency: 2244.1918572809277 ms, (p50: 1900 ms, p90: 3700 ms, p99: 6300 ms), latency samples: 124160
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1332.5926666601533 txn/s, submitted: 1335.49381179802 txn/s, failed submission: 2.901145137866807 txn/s, expired: 2.901145137866807 txn/s, latency: 2511.5006349782293 ms, (p50: 2100 ms, p90: 4300 ms, p99: 6600 ms), latency samples: 110240
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> c83d229489a72bfa08affd9fab4e3f5a69e13b08 passed
Upgrade the remaining nodes to version: c83d229489a72bfa08affd9fab4e3f5a69e13b08
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1266.7916839049606 txn/s, submitted: 1269.9445876515686 txn/s, failed submission: 3.152903746607902 txn/s, expired: 3.152903746607902 txn/s, latency: 2438.582071111111 ms, (p50: 2100 ms, p90: 4200 ms, p99: 5700 ms), latency samples: 112500
Test Ok
Description
Type of Change
Which Components or Systems Does This Change Impact?
How Has This Been Tested?
The workflow generated the right PRs:
Key Areas to Review
n/a
Checklist