Closed zjma closed 1 week ago
🚨 4 jobs on the last run were significantly faster/slower than expected
Job | Duration | vs 7d avg | Delta |
---|---|---|---|
rust-move-tests | 16m | 9m | |
run-tests-main-branch | 6m | 4m | |
windows-build | 43m | 36m | |
framework-upgrade-determinator | 3m | 4m |
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 07cff717eff321cf7b2b901f5433ff50929a197e
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 07cff717eff321cf7b2b901f5433ff50929a197e
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 07cff717eff321cf7b2b901f5433ff50929a197e (PR)
Upgrade the nodes to version: 07cff717eff321cf7b2b901f5433ff50929a197e
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1170 txn/s, submitted: 1172 txn/s, failed submission: 1 txn/s, expired: 1 txn/s, latency: 2843 ms, (p50: 2100 ms, p90: 5200 ms, p99: 8100 ms), latency samples: 95960
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1309 txn/s, submitted: 1310 txn/s, failed submission: 1 txn/s, expired: 1 txn/s, latency: 2774 ms, (p50: 2100 ms, p90: 5000 ms, p99: 8100 ms), latency samples: 107340
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 07cff717eff321cf7b2b901f5433ff50929a197e passed
Upgrade the remaining nodes to version: 07cff717eff321cf7b2b901f5433ff50929a197e
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1120 txn/s, submitted: 1122 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2797 ms, (p50: 2400 ms, p90: 4500 ms, p99: 6900 ms), latency samples: 97440
Test Ok
realistic_env_max_load
on 07cff717eff321cf7b2b901f5433ff50929a197e
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 07cff717eff321cf7b2b901f5433ff50929a197e
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 07cff717eff321cf7b2b901f5433ff50929a197e
realistic_env_max_load
success on 07cff717eff321cf7b2b901f5433ff50929a197e
two traffics test: inner traffic : committed: 8340 txn/s, latency: 4711 ms, (p50: 4500 ms, p90: 5500 ms, p99: 10200 ms), latency samples: 3594900
two traffics test : committed: 100 txn/s, latency: 1951 ms, (p50: 1900 ms, p90: 2200 ms, p99: 4900 ms), latency samples: 1640
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.206, avg: 0.204", "QsPosToProposal: max: 0.230, avg: 0.208", "ConsensusProposalToOrdered: max: 0.454, avg: 0.425", "ConsensusOrderedToCommit: max: 0.384, avg: 0.367", "ConsensusProposalToCommit: max: 0.808, avg: 0.792"]
Max round gap was 1 [limit 4] at version 1811417. Max no progress secs was 5.171591 [limit 15] at version 1811417.
Test Ok
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 07cff717eff321cf7b2b901f5433ff50929a197e
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 07cff717eff321cf7b2b901f5433ff50929a197e (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5782 txn/s, latency: 5231 ms, (p50: 5000 ms, p90: 8700 ms, p99: 10900 ms), latency samples: 248660
2. Upgrading first Validator to new version: 07cff717eff321cf7b2b901f5433ff50929a197e
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1561 txn/s, latency: 15852 ms, (p50: 18700 ms, p90: 21900 ms, p99: 23600 ms), latency samples: 89020
3. Upgrading rest of first batch to new version: 07cff717eff321cf7b2b901f5433ff50929a197e
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1713 txn/s, latency: 16833 ms, (p50: 19300 ms, p90: 22400 ms, p99: 22900 ms), latency samples: 89080
4. upgrading second batch to new version: 07cff717eff321cf7b2b901f5433ff50929a197e
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3604 txn/s, latency: 8780 ms, (p50: 9600 ms, p90: 12600 ms, p99: 12700 ms), latency samples: 144180
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 07cff717eff321cf7b2b901f5433ff50929a197e passed
Test Ok
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 07cff717eff321cf7b2b901f5433ff50929a197e
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 07cff717eff321cf7b2b901f5433ff50929a197e (PR)
Upgrade the nodes to version: 07cff717eff321cf7b2b901f5433ff50929a197e
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1334 txn/s, submitted: 1337 txn/s, failed submission: 3 txn/s, expired: 3 txn/s, latency: 2281 ms, (p50: 2100 ms, p90: 3900 ms, p99: 5100 ms), latency samples: 120060
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1316 txn/s, submitted: 1319 txn/s, failed submission: 3 txn/s, expired: 3 txn/s, latency: 2385 ms, (p50: 2000 ms, p90: 4200 ms, p99: 5400 ms), latency samples: 114500
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 07cff717eff321cf7b2b901f5433ff50929a197e passed
Upgrade the remaining nodes to version: 07cff717eff321cf7b2b901f5433ff50929a197e
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1131 txn/s, submitted: 1133 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2739 ms, (p50: 2300 ms, p90: 4700 ms, p99: 7500 ms), latency samples: 100660
Test Ok
Description
Type of Change
Which Components or Systems Does This Change Impact?
How Has This Been Tested?
Key Areas to Review
Checklist