JuliaCI / PkgTemplates.jl

Create new Julia packages, the easy way
https://juliaci.github.io/PkgTemplates.jl
MIT License
635 stars 101 forks source link

Benchmarks and benchmark CI #401

Open Krastanov opened 1 year ago

Krastanov commented 1 year ago

A number of packages in the ecosystem run benchmarks are part of pull request tests, e.g.

https://github.com/aviatesk/JET.jl/blob/master/.github/workflows/benchmark.yml https://github.com/aviatesk/JET.jl/blob/master/.github/workflows/benchmark-comment.yml

gdalle commented 1 year ago

Linked to #86 and #261

gdalle commented 9 months ago

Partial answer in #261

In addition to CI scripts, another nice addition would be automatic creation of benchmark/Project.toml and benchmark/Manifest.toml

Perhaps even testing that PkgBenchmark.jl runs correctly?