performance tracking integrated into the development process

ziglang / zig

General-purpose programming language and toolchain for maintaining robust, optimal, and reusable software.

https://ziglang.org

MIT License

34.48k stars 2.52k forks source link

performance tracking integrated into the development process #3199

Open andrewrk opened 5 years ago

andrewrk commented 5 years ago

Once the self-hosted compiler (#89) can build meaningful programs, it needs benchmarks to test the performance of various things. Such benchmarks should be run by the CI on every commit, and it should be easy to see a comparison across commits.

Such reports should also contain resource usage as well, such as peak memory usage.

andrewrk commented 2 years ago

Implemented at https://ziglang.org/perf/. The only missing component in order to close this issue is automatically running the benchmarks with the CI.

epompeii commented 1 year ago

Would you like to use the default CI runners or a dedicated/bare metal runner?

I've been working on a continuous benchmarking tool similar to Zig Performance called Bencher: https://github.com/bencherdev/bencher So I'm curious what you are targeting for this.