search

wichtounet / cpm

Continuous Perfomance Monitor (CPM) for C++ code
MIT License
40 stars 7 forks source link

Performance over commits #1

Open gnzlbg opened 9 years ago

gnzlbg commented 9 years ago

Is there a way to visualize the performance of a single test and for a single compiler/case over multiple commits to e.g. see if a commit introduces a regression?

wichtounet commented 9 years ago

You mean filter the web interface so that you see only one test ? Unfortunately, there are no filter features for the web interface right now.

But, if your benchmark only has one test and you run it for every commit, you'll have the behaviour you want.

gnzlbg commented 9 years ago

I was setting up a new project and decided to make a project structure first that sets up a couple of things more or less automatically.

One thing I would like, but I don't know how to do yet, is track the performance of some benchmarks over the project's time to display performance improvements and regressions. How reliable travis machines are for performing benchmarks remains to be seen.

Boost.Hana has a gh-dataset branch, where data-sets of information can be committed automatically by the travis script. It then uses javascript in doxygen to load the datasets from this branch and display graphs.

I was trying to see if cpm could help me here somehow.

wichtounet commented 9 years ago

I think it could help, but you'll have to write the benchmark and then run cpm after each commit, but that is exactly what cpm is for.