Igalia / snabb

Snabb Switch: Fast open source packet processing
Apache License 2.0
48 stars 5 forks source link

Add a release benchmarking script for the lwAFTR #1175

Closed takikawa closed 6 years ago

takikawa commented 6 years ago

This PR adds a script that tries to automate the process of running release benchmarks.

A sample invocation looks like this:

sudo SNABB_PCI0=82:00.0 SNABB_PCI1=02:00.0 SNABB_PCI2=82:00.1 SNABB_PCI3=02:00.1 SNABB_PCI4=83:00.0 SNABB_PCI5=03:00.0 SNABB_PCI6=83:00.1 SNABB_PCI7=03:00.1 ./release-benchmarks.sh

This will download a tarball with some data, do some manipulation on the data, compile configs, and run the benchmarks.

The script is parameterized over the NIC interfaces to use (though it should check that they are set, and maybe only run a subset if not all are set). The script should also be parameterized over the CPUs to use ideally.

It's still WIP for now because there seems to be some odd variability in runs, though adding the sleep in between the lwaftr invocation and load-test (at line 46) may have fixed some of it.

dpino commented 6 years ago

Looking good to me so far.

takikawa commented 6 years ago

Ok I've adjusted the script to take more configuration options (via environment variables) for CPUs to use (for lwAFTR and loadtest) and provide more info on failure. I think it's ready to merge now, though I wonder if it's too configurable now (would it be better if it were simpler?).