WIP: started porting benchmarking to airspeed velocity.

cgranade commented 8 years ago

This PR is an experimental effort to port the benchmarking suite to use airspeed velocity. Doing so would allow us to simplify the test-writing and to host a gh-pages branch that tracks the historical performance of QuTiP. This is very much so a work in progress, and there's a lot that still needs to be done in order for the PR to be useful:

[ ] Split different suites into separate modules.
[ ] Figure out how to install packages from non-default conda channels (see spacetelescope/asv#405).
[ ] Increase benchmarking coverage (possibly use a coverage tool to check this automatically?)
[ ] Better parameterize qobj and type="super" tests to allow for comparing different dimensions.

hodgestar commented 2 years ago

@cgranade You will be happy to know that we are finally implementing this idea as part of this years GSoC. A series of PRs by @xspronken should arrive over the next few weeks. Xavier already has a hacky version up and running in his own fork.

hodgestar commented 1 year ago

The new benchmark plots are up at https://qutip.org/qutip-benchmark/ so closing this PR. \o/

qutip / qutip-benchmark

WIP: started porting benchmarking to airspeed velocity. #1