rust-vmm / rust-vmm-ci

Apache License 2.0
18 stars 33 forks source link

Build infrastructure for running performance tests on rust-vmm crates #24

Closed alxiord closed 1 year ago

alxiord commented 4 years ago

Add a dedicated Buildkite pipeline for performance tests for each crate that has such tests (alongside the "standard" CI pipeline). In the future, this can help separate performance runs from build / CI runs, and split tests on different machines according to our needs.

It's worth looking into critcmp as it seems easy to run and get a verdict from.

Long term, long duration performance tests will demand separate runs (nightly / on some other schedule). To begin with, we can add performance tests in the CI because:

alxiord commented 4 years ago

See https://github.com/rust-vmm/rust-vmm-container/issues/27 for additions to the rust-vmm-container

andreeaflorescu commented 4 years ago

Let's keep this issue open until we add the performance pipeline to the rust-vmm-ci instead of having it duplicated in all repositories that require performance tests.

alxiord commented 1 year ago

test_benchmark.py is part of rust-vmm-ci now. Closing.