phoronix-test-suite / test-profiles

A read-only Git copy of the OpenBenchmarking.org test profiles.
Other
68 stars 80 forks source link
benchmarks linux testing tests

Phoronix Test Suite / OpenBenchmarking.org Test Profiles

This Git repository serves as an auto-converted repository of all OpenBenchmarking.org test profiles used by the Phoronix Test Suite available in the form of a Git repository. OpenBenchmarking.org test profiles themselves are not stored in any Git repository but rather has relied upon its own custom version management system integrated into the Phoronix Test Suite. (This Git copy is auto-generated via phoronix-test-suite dump-tests-to-git.) This Git repository is here primarily for convenience.

These test profiles are not usable without the Phoronix Test Suite or from its Git repository. Since Phoronix Test Suite 3.0, test profiles have been versioned separately from the Phoronix Test Suite and served by OpenBenchmarking.org when needed by the client, rather than being bundled with the phoronix-test-suite package itself. This allows for test profiles to be updated independent of the Phoronix Test Suite client, new tests to be added past a Phoronix Test Suite release, and other benefits. The Phoronix Test Suite checks for new test profiles/suites on a daily basis when run, though the meta-data cache can be updated manually if desired via phoronix-test-suite openbenchmarking-refresh. The phoronix-test-profile openbenchmarking-changes sub-command also provides users from the CLI a convenient look at recently updated tests.

A test profile itself consists of a main XML file containing the test's meta-data (test-definition.xml), an XML file if needed to specify required files and its MD5/SHA256 hashes and file sizes (downloads.xml), and the install.sh script for installing the test and generating the run-script for execution by the Phoronix Test Suite at run-time. There are also other potential files like pre.sh, interim.sh, and post.sh for execution at pre-run, interim-run, and post-run stages by the Phoronix Test Suite.

If you are looking to get involved with test profile development, the simplest way is by starting at looking at a basic test like c-ray, tesseract or others. Simply run phoronix-test-suite benchmark tesseract and then look at the test profile's contents either via this Git repository or by the default locations in ~/.phoronix-test-suite/test-profiles or /var/lib/phoronix-test-suite/test-profiles/ if running as root. More documentation on test profile development will come in the future, but happy to answer any questions that may emerge and are not covered by documentation.

Purpose

The purpose of this Git repository is to satisfy those wanting a Git-based workflow around test profile development and updating. As well, for making use of GitHub's infrastructure if desired for reporting any test profile issues/bugs or submitting pull requests. Pull requests won't directly be used but any accepted changes will be applied to the OpenBenchmarking.org test profiles appropriately and will then appear back into this Git repository when updated by the PTS administrator.

If you want to submit your own OpenBenchmarking.org test profiles directly, that can always be done by creating an OpenBenchmarking.org account and then uploading any new/modified test profiles to your account using the phoronix-test-suite upload-test-profile <test identifier> sub-command.

Why OpenBenchmarking.org Doesn't Use Git For Tests

Among the reasons for not using Git as the primary form of test profile hosting for OpenBenchmarking.org includes:

Questions?

Contact commercial at phoronix-test-suite.com or open a ticket via this GitHub repository.