Near-term: perform the ramble unit-test in a benchpark workspace, with a list of applications (perhaps the x86 versions to start)
Mid-term: create a list of applications (perhaps the x86 versions to start) and set them up to run in CI
Longer-term: dry-run test when a new experiment is contributed via a PR
This is how this works in Ramble: https://googlecloudplatform.github.io/ramble/tutorials/2_running_a_simple_gromacs_experiment.html#setting-up-the-experiments ramble repo add
ramble unit-test -k known_applications
Near-term: perform the ramble unit-test in a benchpark workspace, with a list of applications (perhaps the x86 versions to start) Mid-term: create a list of applications (perhaps the x86 versions to start) and set them up to run in CI Longer-term: dry-run test when a new experiment is contributed via a PR