Closed bchocho closed 1 week ago
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed
realistic_env_max_load
on 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 6537 txn/s, latency: 4926 ms, (p50: 4800 ms, p90: 8400 ms, p99: 10500 ms), latency samples: 241900
2. Upgrading first Validator to new version: 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1545 txn/s, latency: 18485 ms, (p50: 22400 ms, p90: 29800 ms, p99: 30200 ms), latency samples: 74180
3. Upgrading rest of first batch to new version: 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1710 txn/s, latency: 16530 ms, (p50: 19100 ms, p90: 23200 ms, p99: 23600 ms), latency samples: 90680
4. upgrading second batch to new version: 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3286 txn/s, latency: 9467 ms, (p50: 9900 ms, p90: 12300 ms, p99: 13600 ms), latency samples: 131460
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed passed
Test Ok
realistic_env_max_load
success on 43aeb1ea9b02040886048834f83f7ab79abfd5ed
two traffics test: inner traffic : committed: 8109 txn/s, latency: 4841 ms, (p50: 4500 ms, p90: 5700 ms, p99: 11100 ms), latency samples: 3495240
two traffics test : committed: 100 txn/s, latency: 1917 ms, (p50: 1900 ms, p90: 2200 ms, p99: 4400 ms), latency samples: 1700
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.207, avg: 0.202", "QsPosToProposal: max: 0.249, avg: 0.222", "ConsensusProposalToOrdered: max: 0.451, avg: 0.424", "ConsensusOrderedToCommit: max: 0.366, avg: 0.344", "ConsensusProposalToCommit: max: 0.789, avg: 0.768"]
Max round gap was 1 [limit 4] at version 1777052. Max no progress secs was 4.724326 [limit 15] at version 1777052.
Test Ok
realistic_env_max_load
on 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 6514 txn/s, latency: 5093 ms, (p50: 4800 ms, p90: 8900 ms, p99: 10100 ms), latency samples: 228020
2. Upgrading first Validator to new version: 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1728 txn/s, latency: 17321 ms, (p50: 19000 ms, p90: 24400 ms, p99: 24700 ms), latency samples: 93320
3. Upgrading rest of first batch to new version: 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1648 txn/s, latency: 17185 ms, (p50: 19500 ms, p90: 22300 ms, p99: 22800 ms), latency samples: 85720
4. upgrading second batch to new version: 43aeb1ea9b02040886048834f83f7ab79abfd5ed
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3622 txn/s, latency: 8867 ms, (p50: 9600 ms, p90: 12600 ms, p99: 12700 ms), latency samples: 144880
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed passed
Test Ok
realistic_env_max_load
success on 43aeb1ea9b02040886048834f83f7ab79abfd5ed
two traffics test: inner traffic : committed: 7320 txn/s, latency: 5362 ms, (p50: 5100 ms, p90: 6200 ms, p99: 12200 ms), latency samples: 3162560
two traffics test : committed: 100 txn/s, latency: 2085 ms, (p50: 2000 ms, p90: 2300 ms, p99: 6900 ms), latency samples: 1800
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.205, avg: 0.204", "QsPosToProposal: max: 0.280, avg: 0.256", "ConsensusProposalToOrdered: max: 0.472, avg: 0.444", "ConsensusOrderedToCommit: max: 0.395, avg: 0.383", "ConsensusProposalToCommit: max: 0.840, avg: 0.827"]
Max round gap was 1 [limit 4] at version 1525506. Max no progress secs was 4.651746 [limit 15] at version 1525506.
Test Ok
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed (PR)
Upgrade the nodes to version: 43aeb1ea9b02040886048834f83f7ab79abfd5ed
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1368 txn/s, submitted: 1370 txn/s, failed submission: 1 txn/s, expired: 1 txn/s, latency: 2373 ms, (p50: 2100 ms, p90: 3900 ms, p99: 5400 ms), latency samples: 113620
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1219 txn/s, submitted: 1222 txn/s, failed submission: 3 txn/s, expired: 3 txn/s, latency: 2533 ms, (p50: 1800 ms, p90: 4700 ms, p99: 8100 ms), latency samples: 108500
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 43aeb1ea9b02040886048834f83f7ab79abfd5ed passed
Upgrade the remaining nodes to version: 43aeb1ea9b02040886048834f83f7ab79abfd5ed
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1189 txn/s, submitted: 1193 txn/s, failed submission: 3 txn/s, expired: 3 txn/s, latency: 2518 ms, (p50: 2100 ms, p90: 4400 ms, p99: 6800 ms), latency samples: 105900
Test Ok
Description
Accidentally landed #13019 with local changes not committed.
Type of Change
Which Components or Systems Does This Change Impact?
How Has This Been Tested?
All CICD tests
Key Areas to Review
Checklist