Open nikomatsakis opened 8 years ago
Hi... right now I actually have a benchmark mode that runs with a fixed input
you do (inside the github.com/dropbox/rust-brotli repo)
cargo test --release --features=benchmark benchmark and it runs all the benchmarks that have been setup (right now just alice in wonderland)
running 1 test 1000 Iterations; Time 1.140078508 test integration_tests::benchmark_alice29 ... ok
It's easy to setup more like that
@danielrh that's great! I have to work a bit on the official runner, but I plan for it to just run cargo bench
, essentially. (In fact, I might prefer to just make all the actual benchmarks be crates.io packages, and the runner just gets a list of package+revision names and goes from there...)
so basically this seems very close to what I would want :)
At DropBox, @danielrh ported the C brotli decompressor to Rust. The code seems to be open-source. Seems like it would make a good addition to this benchmark suite! We'd have to snapshot a version with some fixed, representative input.
@danielrh, do you think you'd be able or willing to help prepare something like that? Even suggesting a good input would be a big help.