search

briansmith / crypto-bench

Benchmarks for crypto libraries (in Rust, or with Rust bindings)
70 stars 11 forks source link

Add ease-of-installation benchmark #9

Closed briansmith closed 4 years ago

briansmith commented 8 years ago

For implementations that can be installed by just adding a dependency in Cargo.toml (ring, octavo, rust-crypto), this won't change anything.

Other implementations that require manual installation steps should become optional dependencies and should be off by default, enabled with a feature flag. In order to run the benchmarks, the user will have to learn and perform the manual installation steps first. This way, the benchmark runner can measure qualitatively and quantitatively the usability of the library as far as installation is concerned.

This is would be a very useful benchmark because ease-of-use is a key factor.

briansmith commented 8 years ago

Most of the programming work for this was done in https://github.com/briansmith/crypto-bench/commit/8a073daeb68ba353fee8154aa57448f03a46bbae. All that remains is documenting the ease-of-use issue and how we help people test ease-of-use.