codex-storage / nim-codex

Decentralized Durability Engine
58 stars 21 forks source link

Benchmark suite for proof circuits #773

Open elcritch opened 2 months ago

elcritch commented 2 months ago

Proof circuits work on a set number of chunks of given size, both of which are parameters that can be tweaked. We'd like to put together a benchmarking suite that allows us to understand how fast they work when generating and verifying proofs with various settings for these parameters.

Benchmarking entails a number of steps (download ceremony files, setup procedures, run actual benchmark) that should be automated as part of this task. The outcome should be a set of scripts that allows one to input different parameters and get performance statistics regarding proving and verification times for said parameters.

Starting point are the existing tests for proof generation and verification. The code for generating circuits is in the codex-storage-proofs-circuits repo.

elcritch commented 2 months ago

Created a simple benchmarking script for the Codex prover, seen here: https://github.com/codex-storage/nim-codex/pull/790