Closed tjjarvinen closed 10 months ago
@CheukHinHoJerry -- when you have time, can you please take a look and familiarize yourself with this? If you are happy with this then I'll merge it and then we should make a new PR to add actual benchmarks.
Happy for this to be merged as is. Thanks.
@tjjarvinen -- could you maybe add the instructions to a developer documentation page in the docs? Then I'll go ahead and make the merge.
Is this ready now?
yes
Thank you.
This adds Benchmarks with PkgBenchmark.jl.
To use benchmarks you can
To control benchmarks e.g. number of threads
To save benchmarks to a file
Compare to a different branch - note you need to commit your changes (also both branches need to have same benchmarks)
Automatic benchmarks on pull requests
I added support for BenchmarkCI.jl, so by adding a label "Run Benchmarks" on PR CI will run benchmarks and compare to main branch. (Note this only works after this PR has been merged)
There is also an option to store benchmarks in the repo, but I have commented that out.
You should also be able to add more benchmarks yourself based on the
benchmarks.jl
file.