search

lambdaclass / cairo-vm

cairo-vm is a Rust implementation of the Cairo VM. Cairo (CPU Algebraic Intermediate Representation) is a programming language for writing provable programs, where one party can prove to another that a certain computation was executed correctly without the need for this party to re-execute the same program.
https://lambdaclass.github.io/cairo-vm
Apache License 2.0
488 stars 133 forks source link

Revert "Release 1.0.0 :rocket: (#1801)" #1802

Closed pefontana closed 2 weeks ago

pefontana commented 2 weeks ago

This reverts commit a2ec4296fd6b509286924077e82284f197ba72b0.

Revert Release v1.0.0

github-actions[bot] commented 2 weeks ago 
**Hyper Thereading Benchmark results**

hyperfine -r 2 -n "hyper_threading_main threads: 1" 'RAYON_NUM_THREADS=1 ./hyper_threading_main' -n "hyper_threading_pr threads: 1" 'RAYON_NUM_THREADS=1 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 1
  Time (mean ± σ):     26.119 s ±  0.203 s    [User: 25.370 s, System: 0.748 s]
  Range (min … max):   25.975 s … 26.262 s    2 runs

Benchmark 2: hyper_threading_pr threads: 1
  Time (mean ± σ):     26.097 s ±  0.005 s    [User: 25.393 s, System: 0.702 s]
  Range (min … max):   26.093 s … 26.101 s    2 runs

Summary
  'hyper_threading_pr threads: 1' ran
    1.00 ± 0.01 times faster than 'hyper_threading_main threads: 1'

hyperfine -r 2 -n "hyper_threading_main threads: 2" 'RAYON_NUM_THREADS=2 ./hyper_threading_main' -n "hyper_threading_pr threads: 2" 'RAYON_NUM_THREADS=2 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 2
  Time (mean ± σ):     14.668 s ±  0.040 s    [User: 25.951 s, System: 0.764 s]
  Range (min … max):   14.639 s … 14.696 s    2 runs

Benchmark 2: hyper_threading_pr threads: 2
  Time (mean ± σ):     14.750 s ±  0.048 s    [User: 26.122 s, System: 0.772 s]
  Range (min … max):   14.715 s … 14.784 s    2 runs

Summary
  'hyper_threading_main threads: 2' ran
    1.01 ± 0.00 times faster than 'hyper_threading_pr threads: 2'

hyperfine -r 2 -n "hyper_threading_main threads: 4" 'RAYON_NUM_THREADS=4 ./hyper_threading_main' -n "hyper_threading_pr threads: 4" 'RAYON_NUM_THREADS=4 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 4
  Time (mean ± σ):     10.564 s ±  0.321 s    [User: 37.740 s, System: 1.011 s]
  Range (min … max):   10.337 s … 10.791 s    2 runs

Benchmark 2: hyper_threading_pr threads: 4
  Time (mean ± σ):     10.715 s ±  0.477 s    [User: 38.139 s, System: 0.924 s]
  Range (min … max):   10.378 s … 11.053 s    2 runs

Summary
  'hyper_threading_main threads: 4' ran
    1.01 ± 0.05 times faster than 'hyper_threading_pr threads: 4'

hyperfine -r 2 -n "hyper_threading_main threads: 6" 'RAYON_NUM_THREADS=6 ./hyper_threading_main' -n "hyper_threading_pr threads: 6" 'RAYON_NUM_THREADS=6 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 6
  Time (mean ± σ):     10.523 s ±  0.102 s    [User: 37.724 s, System: 1.024 s]
  Range (min … max):   10.451 s … 10.596 s    2 runs

Benchmark 2: hyper_threading_pr threads: 6
  Time (mean ± σ):     10.517 s ±  0.222 s    [User: 37.953 s, System: 1.020 s]
  Range (min … max):   10.360 s … 10.674 s    2 runs

Summary
  'hyper_threading_pr threads: 6' ran
    1.00 ± 0.02 times faster than 'hyper_threading_main threads: 6'

hyperfine -r 2 -n "hyper_threading_main threads: 8" 'RAYON_NUM_THREADS=8 ./hyper_threading_main' -n "hyper_threading_pr threads: 8" 'RAYON_NUM_THREADS=8 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 8
  Time (mean ± σ):     10.268 s ±  0.359 s    [User: 37.847 s, System: 1.036 s]
  Range (min … max):   10.014 s … 10.522 s    2 runs

Benchmark 2: hyper_threading_pr threads: 8
  Time (mean ± σ):     10.477 s ±  0.151 s    [User: 38.230 s, System: 0.990 s]
  Range (min … max):   10.370 s … 10.584 s    2 runs

Summary
  'hyper_threading_main threads: 8' ran
    1.02 ± 0.04 times faster than 'hyper_threading_pr threads: 8'

hyperfine -r 2 -n "hyper_threading_main threads: 16" 'RAYON_NUM_THREADS=16 ./hyper_threading_main' -n "hyper_threading_pr threads: 16" 'RAYON_NUM_THREADS=16 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 16
  Time (mean ± σ):     10.212 s ±  0.069 s    [User: 38.103 s, System: 1.101 s]
  Range (min … max):   10.163 s … 10.261 s    2 runs

Benchmark 2: hyper_threading_pr threads: 16
  Time (mean ± σ):     10.217 s ±  0.053 s    [User: 38.615 s, System: 1.069 s]
  Range (min … max):   10.180 s … 10.255 s    2 runs

Summary
  'hyper_threading_main threads: 16' ran
    1.00 ± 0.01 times faster than 'hyper_threading_pr threads: 16'
codecov[bot] commented 2 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 94.79%. Comparing base (a2ec429) to head (0048143).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #1802 +/- ## ======================================= Coverage 94.79% 94.79% ======================================= Files 102 102 Lines 40138 40138 ======================================= Hits 38047 38047 Misses 2091 2091 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

github-actions[bot] commented 2 weeks ago

Benchmark Results for unmodified programs :rocket:

Command Mean [s] Min [s] Max [s] Relative
base big_factorial 2.070 ± 0.013 2.049 2.088 1.00 ± 0.01
head big_factorial 2.067 ± 0.009 2.049 2.080 1.00
Command Mean [s] Min [s] Max [s] Relative
base big_fibonacci 2.032 ± 0.053 2.003 2.179 1.01 ± 0.03
head big_fibonacci 2.019 ± 0.036 2.000 2.118 1.00
Command Mean [s] Min [s] Max [s] Relative
base blake2s_integration_benchmark 7.746 ± 0.093 7.571 7.849 1.01 ± 0.02
head blake2s_integration_benchmark 7.659 ± 0.105 7.543 7.842 1.00
Command Mean [s] Min [s] Max [s] Relative
base compare_arrays_200000 2.168 ± 0.022 2.149 2.224 1.01 ± 0.01
head compare_arrays_200000 2.154 ± 0.007 2.144 2.164 1.00
Command Mean [s] Min [s] Max [s] Relative
base dict_integration_benchmark 1.445 ± 0.032 1.428 1.535 1.03 ± 0.02
head dict_integration_benchmark 1.404 ± 0.010 1.393 1.431 1.00
Command Mean [s] Min [s] Max [s] Relative
base field_arithmetic_get_square_benchmark 1.239 ± 0.017 1.227 1.284 1.01 ± 0.02
head field_arithmetic_get_square_benchmark 1.224 ± 0.013 1.206 1.247 1.00
Command Mean [s] Min [s] Max [s] Relative
base integration_builtins 7.742 ± 0.065 7.616 7.845 1.00 ± 0.01
head integration_builtins 7.713 ± 0.080 7.605 7.812 1.00
Command Mean [s] Min [s] Max [s] Relative
base keccak_integration_benchmark 7.926 ± 0.102 7.797 8.087 1.00
head keccak_integration_benchmark 7.958 ± 0.115 7.777 8.086 1.00 ± 0.02
Command Mean [s] Min [s] Max [s] Relative
base linear_search 2.140 ± 0.011 2.116 2.152 1.00
head linear_search 2.152 ± 0.044 2.114 2.244 1.01 ± 0.02
Command Mean [s] Min [s] Max [s] Relative
base math_cmp_and_pow_integration_benchmark 1.508 ± 0.006 1.497 1.521 1.01 ± 0.01
head math_cmp_and_pow_integration_benchmark 1.486 ± 0.007 1.479 1.497 1.00
Command Mean [s] Min [s] Max [s] Relative
base math_integration_benchmark 1.456 ± 0.008 1.444 1.467 1.02 ± 0.01
head math_integration_benchmark 1.431 ± 0.005 1.425 1.438 1.00
Command Mean [s] Min [s] Max [s] Relative
base memory_integration_benchmark 1.190 ± 0.009 1.181 1.210 1.00 ± 0.01
head memory_integration_benchmark 1.188 ± 0.011 1.178 1.215 1.00
Command Mean [s] Min [s] Max [s] Relative
base operations_with_data_structures_benchmarks 1.564 ± 0.006 1.555 1.571 1.01 ± 0.02
head operations_with_data_structures_benchmarks 1.553 ± 0.030 1.535 1.638 1.00
Command Mean [ms] Min [ms] Max [ms] Relative
base pedersen 526.4 ± 1.1 524.0 528.0 1.01 ± 0.00
head pedersen 523.1 ± 1.0 521.6 524.6 1.00
Command Mean [ms] Min [ms] Max [ms] Relative
base poseidon_integration_benchmark 761.1 ± 1.5 758.8 763.6 1.00 ± 0.01
head poseidon_integration_benchmark 759.3 ± 4.3 755.2 770.6 1.00
Command Mean [s] Min [s] Max [s] Relative
base secp_integration_benchmark 1.822 ± 0.011 1.809 1.840 1.01 ± 0.01
head secp_integration_benchmark 1.798 ± 0.015 1.788 1.835 1.00
Command Mean [ms] Min [ms] Max [ms] Relative
base set_integration_benchmark 650.2 ± 1.6 648.0 652.6 1.00 ± 0.03
head set_integration_benchmark 648.2 ± 17.0 640.1 696.1 1.00
Command Mean [s] Min [s] Max [s] Relative
base uint256_integration_benchmark 4.273 ± 0.053 4.207 4.373 1.02 ± 0.02
head uint256_integration_benchmark 4.178 ± 0.045 4.134 4.270 1.00