iu-parfunc / HSBencher

General benchmarking framework. Especially good at parameter studies.
13 stars 8 forks source link

A better scheme for computing benchmark names in absence of `progname` #70

Open rrnewton opened 9 years ago

rrnewton commented 9 years ago

Currently if progname is set manually, that had better be a unique identifier for the benchmark.

Otherwise, it currently falls back to basename of the target path. But sometimes the target path just ends in "Makefile". It should really do one of the following:

The problem with the latter strategy is that it's too complicated and can surprise people. Extending the benchmark suite could make non-local changes in the names of the existing suite. So for now, we'll stick with the first strategy.

rrnewton commented 9 years ago

Update: these respective behaviors are captured by canonicalBenchName vs prettyBenchName, though the latter isn't implemented yet and is just aliased to the former presently.

This ticket can stay open until the latter policy is implemented.