LLNL / benchpark

An open collaborative repository for reproducible specifications of HPC benchmarks and cross site benchmarking environments
https://software.llnl.gov/benchpark/
Apache License 2.0
27 stars 24 forks source link

Set up dry-run tests for experiments in benchpark #221

Closed pearce8 closed 5 months ago

pearce8 commented 6 months ago

This is how this works in Ramble: https://googlecloudplatform.github.io/ramble/tutorials/2_running_a_simple_gromacs_experiment.html#setting-up-the-experiments ramble repo add ramble unit-test -k known_applications

Near-term: perform the ramble unit-test in a benchpark workspace, with a list of applications (perhaps the x86 versions to start) Mid-term: create a list of applications (perhaps the x86 versions to start) and set them up to run in CI Longer-term: dry-run test when a new experiment is contributed via a PR