search

fortran-lang / benchmarks

Fortran benchmarks
MIT License
19 stars 11 forks source link

Benchmark driver #1

Open LKedward opened 4 years ago

LKedward commented 4 years ago

We need a framework for compiling and running benchmark cases across a test matrix and, if necessary, collecting and post-processing the results.

The main dimensions for the test matrix are: 1) Different compilers (and eventually different languages) 2) Different optimisation levels

and there may be others. The framework needs to be able to run locally and in CI for testing.

This can be achieved with a makefile, though this may not be as flexible as a custom solution.

certik commented 4 years ago

Furthermore, we also need to run other languages, at least C++, Julia and probably Python/NumPy (possibly via NumBa or other Python accelerator frameworks).

It should be done so that it's easy for people to run them, even if they don't have all the required languages installed (the runner would just skip those).