Closed junkil-park closed 1 week ago
🚨 2 jobs on the last run were significantly faster/slower than expected
Job | Duration | vs 7d avg | Delta |
---|---|---|---|
cli-e2e-tests / run-cli-tests | 9m | 7m | |
rust-targeted-unit-tests | 24m | 20m |
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 0a4009abef98a1c61e089fb01257c3b937c406a8
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 0a4009abef98a1c61e089fb01257c3b937c406a8
realistic_env_max_load
on 0a4009abef98a1c61e089fb01257c3b937c406a8
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 0a4009abef98a1c61e089fb01257c3b937c406a8
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5651 txn/s, latency: 5652 ms, (p50: 4800 ms, p90: 9900 ms, p99: 11100 ms), latency samples: 237360
2. Upgrading first Validator to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1553 txn/s, latency: 18303 ms, (p50: 22700 ms, p90: 29200 ms, p99: 29900 ms), latency samples: 74560
3. Upgrading rest of first batch to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1609 txn/s, latency: 16874 ms, (p50: 19500 ms, p90: 22600 ms, p99: 24700 ms), latency samples: 86900
4. upgrading second batch to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3269 txn/s, latency: 9540 ms, (p50: 9900 ms, p90: 12500 ms, p99: 13900 ms), latency samples: 130780
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 passed
Test Ok
realistic_env_max_load
success on 0a4009abef98a1c61e089fb01257c3b937c406a8
two traffics test: inner traffic : committed: 7760 txn/s, latency: 5030 ms, (p50: 4800 ms, p90: 6000 ms, p99: 10200 ms), latency samples: 3367900
two traffics test : committed: 100 txn/s, latency: 1911 ms, (p50: 1800 ms, p90: 2100 ms, p99: 4400 ms), latency samples: 1840
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.208, avg: 0.202", "QsPosToProposal: max: 0.249, avg: 0.228", "ConsensusProposalToOrdered: max: 0.461, avg: 0.414", "ConsensusOrderedToCommit: max: 0.393, avg: 0.377", "ConsensusProposalToCommit: max: 0.805, avg: 0.791"]
Max round gap was 1 [limit 4] at version 1525615. Max no progress secs was 4.4573298 [limit 15] at version 1525615.
Test Ok
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 0a4009abef98a1c61e089fb01257c3b937c406a8
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 (PR)
Upgrade the nodes to version: 0a4009abef98a1c61e089fb01257c3b937c406a8
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1141 txn/s, submitted: 1143 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2722 ms, (p50: 2100 ms, p90: 4800 ms, p99: 7100 ms), latency samples: 102720
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1170 txn/s, submitted: 1173 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2722 ms, (p50: 2100 ms, p90: 4800 ms, p99: 8100 ms), latency samples: 106540
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 passed
Upgrade the remaining nodes to version: 0a4009abef98a1c61e089fb01257c3b937c406a8
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1214 txn/s, submitted: 1215 txn/s, failed submission: 1 txn/s, expired: 1 txn/s, latency: 2679 ms, (p50: 2100 ms, p90: 4800 ms, p99: 7400 ms), latency samples: 100780
Test Ok
Description
Type of Change
Which Components or Systems Does This Change Impact?
How Has This Been Tested?
Key Areas to Review
Checklist