IntersectMBO / ouroboros-consensus

Implementation of a Consensus Layer for the Ouroboros family of protocols
https://ouroboros-consensus.cardano.intersectmbo.org
Apache License 2.0
36 stars 23 forks source link

Guarantee usefulness of `db-analyser` ledger ops result. #223

Open dnadales opened 1 year ago

dnadales commented 1 year ago

We need to establish that the benchmark-ledger-ops analysis of db-analyser are useful in spotting potential performance regressions or optimizations. For that, we need its results to be reproducible and meaningful.

We need to run the benchmark-ledger-ops analysis with the same build, data, machine, and workload and corroborate if the runs have small enough variance among each other. Additionally, we need to make sure the input data is suitable to clearly reveal any measurable changes wrt. ledger ops.

Requires https://github.com/input-output-hk/ouroboros-consensus/issues/230

Acceptance criteria

Subtasks

mgmeier commented 1 year ago

To enable establishing a posible correlation of this data with that gathered from system level benchmarks, a good starting point for input data are those exact ChainDBs that are produced as a result of running our benchmarking profiles.