search

lambdaclass / cairo-vm

cairo-vm is a Rust implementation of the Cairo VM. Cairo (CPU Algebraic Intermediate Representation) is a programming language for writing provable programs, where one party can prove to another that a certain computation was executed correctly without the need for this party to re-execute the same program.
https://lambdaclass.github.io/cairo-vm
Apache License 2.0
514 stars 144 forks source link

Cairo lang 2.6.3 && remove gas_usage_check #1704

Closed pefontana closed 5 months ago

pefontana commented 5 months ago

TITLE

Description

Description of the pull request changes and motivation.

Checklist

github-actions[bot] commented 5 months ago

Benchmark Results for modified programs :rocket:

Command Mean [s] Min [s] Max [s] Relative
head big_factorial 2.060 ± 0.073 2.004 2.247 1.00
Command Mean [s] Min [s] Max [s] Relative
head big_fibonacci 1.984 ± 0.038 1.958 2.085 1.00
Command Mean [s] Min [s] Max [s] Relative
head blake2s_integration_benchmark 7.065 ± 0.166 6.972 7.522 1.00
Command Mean [s] Min [s] Max [s] Relative
head compare_arrays_200000 2.100 ± 0.022 2.073 2.149 1.00
Command Mean [s] Min [s] Max [s] Relative
head dict_integration_benchmark 1.374 ± 0.027 1.357 1.428 1.00
Command Mean [s] Min [s] Max [s] Relative
head field_arithmetic_get_square_benchmark 1.161 ± 0.014 1.145 1.193 1.00
Command Mean [s] Min [s] Max [s] Relative
head integration_builtins 7.132 ± 0.054 7.070 7.242 1.00
Command Mean [s] Min [s] Max [s] Relative
head keccak_integration_benchmark 7.317 ± 0.045 7.231 7.367 1.00
Command Mean [s] Min [s] Max [s] Relative
head linear_search 2.146 ± 0.098 2.082 2.411 1.00
Command Mean [s] Min [s] Max [s] Relative
head math_cmp_and_pow_integration_benchmark 1.502 ± 0.022 1.481 1.558 1.00
Command Mean [s] Min [s] Max [s] Relative
head math_integration_benchmark 1.364 ± 0.010 1.346 1.373 1.00
Command Mean [s] Min [s] Max [s] Relative
head memory_integration_benchmark 1.191 ± 0.039 1.163 1.294 1.00
Command Mean [s] Min [s] Max [s] Relative
head operations_with_data_structures_benchmarks 1.535 ± 0.011 1.518 1.552 1.00
Command Mean [ms] Min [ms] Max [ms] Relative
head pedersen 568.0 ± 2.6 564.9 574.1 1.00
Command Mean [ms] Min [ms] Max [ms] Relative
head poseidon_integration_benchmark 958.2 ± 2.1 954.9 961.2 1.00
Command Mean [s] Min [s] Max [s] Relative
head secp_integration_benchmark 1.759 ± 0.009 1.743 1.773 1.00
Command Mean [ms] Min [ms] Max [ms] Relative
head set_integration_benchmark 724.6 ± 11.6 717.3 756.9 1.00
Command Mean [s] Min [s] Max [s] Relative
head uint256_integration_benchmark 4.058 ± 0.025 4.021 4.115 1.00
github-actions[bot] commented 5 months ago

Benchmark Results for unmodified programs :rocket:

Command Mean [s] Min [s] Max [s] Relative
base big_factorial 2.279 ± 0.022 2.248 2.310 1.00 ± 0.01
head big_factorial 2.278 ± 0.016 2.253 2.304 1.00
Command Mean [s] Min [s] Max [s] Relative
base big_fibonacci 2.310 ± 0.018 2.276 2.341 1.01 ± 0.01
head big_fibonacci 2.295 ± 0.016 2.264 2.315 1.00
Command Mean [s] Min [s] Max [s] Relative
base blake2s_integration_benchmark 8.537 ± 0.176 8.320 8.795 1.00 ± 0.03
head blake2s_integration_benchmark 8.524 ± 0.183 8.290 8.764 1.00
Command Mean [s] Min [s] Max [s] Relative
base compare_arrays_200000 2.330 ± 0.011 2.317 2.351 1.00
head compare_arrays_200000 2.332 ± 0.009 2.314 2.347 1.00 ± 0.01
Command Mean [s] Min [s] Max [s] Relative
base dict_integration_benchmark 1.446 ± 0.014 1.427 1.465 1.00
head dict_integration_benchmark 1.463 ± 0.012 1.445 1.489 1.01 ± 0.01
Command Mean [s] Min [s] Max [s] Relative
base field_arithmetic_get_square_benchmark 1.330 ± 0.033 1.301 1.392 1.00
head field_arithmetic_get_square_benchmark 1.340 ± 0.050 1.297 1.435 1.01 ± 0.04
Command Mean [s] Min [s] Max [s] Relative
base integration_builtins 8.624 ± 0.241 8.384 9.145 1.00 ± 0.03
head integration_builtins 8.594 ± 0.166 8.322 8.771 1.00
Command Mean [s] Min [s] Max [s] Relative
base keccak_integration_benchmark 8.923 ± 0.186 8.597 9.179 1.02 ± 0.03
head keccak_integration_benchmark 8.789 ± 0.198 8.606 9.064 1.00
Command Mean [s] Min [s] Max [s] Relative
base linear_search 2.385 ± 0.018 2.365 2.429 1.00
head linear_search 2.403 ± 0.026 2.369 2.460 1.01 ± 0.01
Command Mean [s] Min [s] Max [s] Relative
base math_cmp_and_pow_integration_benchmark 1.616 ± 0.027 1.586 1.683 1.01 ± 0.02
head math_cmp_and_pow_integration_benchmark 1.600 ± 0.020 1.572 1.633 1.00
Command Mean [s] Min [s] Max [s] Relative
base math_integration_benchmark 1.445 ± 0.017 1.424 1.484 1.00
head math_integration_benchmark 1.476 ± 0.040 1.434 1.573 1.02 ± 0.03
Command Mean [s] Min [s] Max [s] Relative
base memory_integration_benchmark 1.300 ± 0.017 1.275 1.331 1.00
head memory_integration_benchmark 1.306 ± 0.045 1.280 1.427 1.00 ± 0.04
Command Mean [s] Min [s] Max [s] Relative
base operations_with_data_structures_benchmarks 1.652 ± 0.016 1.634 1.691 1.00
head operations_with_data_structures_benchmarks 1.664 ± 0.031 1.635 1.746 1.01 ± 0.02
Command Mean [ms] Min [ms] Max [ms] Relative
base pedersen 598.4 ± 3.6 594.2 607.8 1.00
head pedersen 602.8 ± 10.7 596.2 628.8 1.01 ± 0.02
Command Mean [ms] Min [ms] Max [ms] Relative
base poseidon_integration_benchmark 999.9 ± 7.2 990.6 1012.5 1.00
head poseidon_integration_benchmark 1005.9 ± 3.7 999.1 1010.4 1.01 ± 0.01
Command Mean [s] Min [s] Max [s] Relative
base secp_integration_benchmark 1.889 ± 0.020 1.871 1.937 1.00 ± 0.01
head secp_integration_benchmark 1.881 ± 0.007 1.870 1.892 1.00
Command Mean [ms] Min [ms] Max [ms] Relative
base set_integration_benchmark 726.9 ± 4.4 722.0 734.8 1.02 ± 0.01
head set_integration_benchmark 715.0 ± 3.8 709.6 720.2 1.00
Command Mean [s] Min [s] Max [s] Relative
base uint256_integration_benchmark 4.703 ± 0.090 4.630 4.943 1.00
head uint256_integration_benchmark 4.740 ± 0.068 4.642 4.821 1.01 ± 0.02
fmoletta commented 5 months ago

Closed in favor of #1709