scroll-tech / ceno

Accelerate Zero-knowledge Virtual Machine by Non-uniform Prover Based on GKR Protocol
Apache License 2.0
62 stars 10 forks source link

zkVM framework benchmark #100

Open hero78119 opened 3 months ago

hero78119 commented 3 months ago

This issue is for tracking benchmark result in rolling update fasion

hero78119 commented 3 months ago

Benchmark create_proof Commits: https://github.com/scroll-tech/ceno/pull/91/commits/7b5ce9f034d6cac0f5c9a9d0ee5516c1bafd5dea

RAYON_NUM_THREADS=16 cargo bench --bench riscv_add --package ceno_zkvm on [^1]:

RAYON_NUM_THREADS=8 cargo bench --bench riscv_add --package ceno_zkvm on [^2]:

[^1]: AMD EPYC 9R14 (16 phy cores) + 64GB memory [^2]: AMD R7 5800x (8 phy cores) + 32GB memory

hero78119 commented 3 months ago

Benchmark create_proof Commits: https://github.com/scroll-tech/ceno/pull/91/commits/a35d642869b44e4dfed5b076205b0af99612e8b4

RAYON_NUM_THREADS=32 cargo bench --bench riscv_add --package ceno_zkvm on [^1]:

[^1]: AMD EPYC 9R14 (16 phy cores) + 64GB memory

hero78119 commented 3 months ago

Benchmark create_proof on master branch after #91 merge Command: RAYON_NUM_THREADS=32 cargo bench --bench riscv_add --package ceno_zkvm Commits: https://github.com/scroll-tech/ceno/pull/91/commits/0a407211dcbb5eeb9e0b02438c92ed46b3197c5f

RAYON_NUM_THREADS=32 cargo bench --bench riscv_add --package ceno_zkvm on [^1]:

more or less the same as prev result

[^1]: AMD EPYC 9R14 (16 phy cores) + 64GB memory

hero78119 commented 2 months ago

command

RAYON_NUM_THREADS=32 cargo bench --bench riscv_add --package ceno_zkvm -- --save-baseline baseline

A throught put drop (+43.176%) on command between 2 commits on master, see comparison https://github.com/scroll-tech/ceno/compare/5a68423249224db51b81c67130b99890415cb817...71b1aa291cc0738088fa0822bd7bf15d0fd24d4a

Need investigate reason