Closed rahxephon89 closed 2 weeks ago
🚨 2 jobs on the last run were significantly faster/slower than expected
Job | Duration | vs 7d avg | Delta |
---|---|---|---|
cli-e2e-tests / run-cli-tests | 9m | 7m | |
windows-build | 26m | 39m |
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 57.6%. Comparing base (
7719765
) to head (498ba8f
). Report is 3 commits behind head on main.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
realistic_env_max_load
on 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 4c32c4d6550d5c3f9d1b9db49e4462af0887136e (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5430.038539147109 txn/s, latency: 5776.347198783359 ms, (p50: 5100 ms, p90: 9600 ms, p99: 14400 ms), latency samples: 203840
2. Upgrading first Validator to new version: 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1525.8210258771746 txn/s, latency: 17775.39031482291 ms, (p50: 18600 ms, p90: 29800 ms, p99: 30300 ms), latency samples: 91480
3. Upgrading rest of first batch to new version: 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1818.54723006301 txn/s, latency: 15886.506049355754 ms, (p50: 19000 ms, p90: 22300 ms, p99: 22600 ms), latency samples: 91580
4. upgrading second batch to new version: 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3514.6736642668197 txn/s, latency: 8934.8927276473 ms, (p50: 9600 ms, p90: 12700 ms, p99: 12900 ms), latency samples: 145620
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 4c32c4d6550d5c3f9d1b9db49e4462af0887136e passed
Test Ok
realistic_env_max_load
success on 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
two traffics test: inner traffic : committed: 8018.699323900655 txn/s, latency: 4883.463792596775 ms, (p50: 4800 ms, p90: 5700 ms, p99: 10500 ms), latency samples: 3470920
two traffics test : committed: 100.0452460077581 txn/s, latency: 1847.341304347826 ms, (p50: 1800 ms, p90: 2000 ms, p99: 2400 ms), latency samples: 1840
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.208, avg: 0.201", "QsPosToProposal: max: 0.245, avg: 0.226", "ConsensusProposalToOrdered: max: 0.469, avg: 0.431", "ConsensusOrderedToCommit: max: 0.358, avg: 0.342", "ConsensusProposalToCommit: max: 0.784, avg: 0.773"]
Max round gap was 1 [limit 4] at version 1679945. Max no progress secs was 4.728154 [limit 15] at version 1679945.
Test Ok
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 4c32c4d6550d5c3f9d1b9db49e4462af0887136e (PR)
Upgrade the nodes to version: 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1299.9010331037077 txn/s, submitted: 1303.0814970085403 txn/s, failed submission: 3.1804639048325596 txn/s, expired: 3.1804639048325596 txn/s, latency: 2357.6473610625653 ms, (p50: 2100 ms, p90: 3600 ms, p99: 4500 ms), latency samples: 114440
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1164.3543500884361 txn/s, submitted: 1167.6646827744344 txn/s, failed submission: 3.310332685998207 txn/s, expired: 3.310332685998207 txn/s, latency: 2576.574952615618 ms, (p50: 2100 ms, p90: 4500 ms, p99: 6800 ms), latency samples: 105520
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 4c32c4d6550d5c3f9d1b9db49e4462af0887136e passed
Upgrade the remaining nodes to version: 4c32c4d6550d5c3f9d1b9db49e4462af0887136e
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1244.1021865493997 txn/s, submitted: 1247.4051127083803 txn/s, failed submission: 3.302926158980707 txn/s, expired: 3.302926158980707 txn/s, latency: 2370.5520973451326 ms, (p50: 1800 ms, p90: 4200 ms, p99: 6300 ms), latency samples: 113000
Test Ok
realistic_env_max_load
on 498ba8f2ee56c83665db385b806d64ba2aafd949
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 498ba8f2ee56c83665db385b806d64ba2aafd949
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 498ba8f2ee56c83665db385b806d64ba2aafd949
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 498ba8f2ee56c83665db385b806d64ba2aafd949
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 498ba8f2ee56c83665db385b806d64ba2aafd949 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 6176.590903982719 txn/s, latency: 5023.092610776467 ms, (p50: 4800 ms, p90: 8700 ms, p99: 10600 ms), latency samples: 242380
2. Upgrading first Validator to new version: 498ba8f2ee56c83665db385b806d64ba2aafd949
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1616.5200402242888 txn/s, latency: 17265.247471910112 ms, (p50: 19600 ms, p90: 24000 ms, p99: 25000 ms), latency samples: 89000
3. Upgrading rest of first batch to new version: 498ba8f2ee56c83665db385b806d64ba2aafd949
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1462.7453213002148 txn/s, latency: 18002.79132928475 ms, (p50: 19600 ms, p90: 29400 ms, p99: 30800 ms), latency samples: 88920
4. upgrading second batch to new version: 498ba8f2ee56c83665db385b806d64ba2aafd949
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3560.902455323979 txn/s, latency: 8812.53654618474 ms, (p50: 9600 ms, p90: 12600 ms, p99: 12900 ms), latency samples: 144420
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 498ba8f2ee56c83665db385b806d64ba2aafd949 passed
Test Ok
realistic_env_max_load
success on 498ba8f2ee56c83665db385b806d64ba2aafd949
two traffics test: inner traffic : committed: 8266.684870944811 txn/s, latency: 4740.117610886364 ms, (p50: 4500 ms, p90: 5400 ms, p99: 9900 ms), latency samples: 3574380
two traffics test : committed: 100.03284891236171 txn/s, latency: 1837.6662921348316 ms, (p50: 1800 ms, p90: 2100 ms, p99: 3400 ms), latency samples: 1780
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.207, avg: 0.202", "QsPosToProposal: max: 0.225, avg: 0.213", "ConsensusProposalToOrdered: max: 0.441, avg: 0.400", "ConsensusOrderedToCommit: max: 0.399, avg: 0.386", "ConsensusProposalToCommit: max: 0.796, avg: 0.785"]
Max round gap was 1 [limit 4] at version 1126713. Max no progress secs was 4.828643 [limit 15] at version 1126713.
Test Ok
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 498ba8f2ee56c83665db385b806d64ba2aafd949
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 498ba8f2ee56c83665db385b806d64ba2aafd949 (PR)
Upgrade the nodes to version: 498ba8f2ee56c83665db385b806d64ba2aafd949
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1309.75959702479 txn/s, submitted: 1311.9954447493117 txn/s, failed submission: 2.235847724521663 txn/s, expired: 2.235847724521663 txn/s, latency: 2342.684525435302 ms, (p50: 2100 ms, p90: 4000 ms, p99: 5000 ms), latency samples: 117160
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1193.7325803247727 txn/s, submitted: 1195.1179566268904 txn/s, failed submission: 1.3853763021177248 txn/s, expired: 1.3853763021177248 txn/s, latency: 2710.4205222437135 ms, (p50: 2200 ms, p90: 4800 ms, p99: 6600 ms), latency samples: 103400
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 498ba8f2ee56c83665db385b806d64ba2aafd949 passed
Upgrade the remaining nodes to version: 498ba8f2ee56c83665db385b806d64ba2aafd949
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1271.032108561439 txn/s, submitted: 1273.1119792845395 txn/s, failed submission: 2.0798707231005364 txn/s, expired: 2.0798707231005364 txn/s, latency: 2584.6716818181817 ms, (p50: 2200 ms, p90: 4400 ms, p99: 6000 ms), latency samples: 110000
Test Ok
Description
This PR resolves the timeout issue in the third_party prover test by exchanging between source_dep and dep when creating the move model.
Also close #13251, close #13252
Type of Change
Which Components or Systems Does This Change Impact?
How Has This Been Tested?
Removed
pragma verify=false
from the spec ofround
inthird_party/move/move-stdlib/sources/fixed_point32.move
and the prover test still passes.Key Areas to Review
When calling the prover in third_party and aptos, we need to make sure the same arguments passed to the move model builder, especially for
source_deps
anddeps
.Checklist