Benchmarks must block PR with performance regressions past a given threshold

winglang / wing

A programming language for the cloud ☁️ A unified programming model, combining infrastructure and runtime code into one language ⚡

https://winglang.io

Other

5.02k stars 198 forks source link

Benchmarks must block PR with performance regressions past a given threshold #2210

Closed MarkMcCulloh closed 1 year ago

MarkMcCulloh commented 1 year ago

Benchmarks currently only report the numbers and publish them. It will also warn if the test takes longer than expected. Once we have a good/stable number to pin them to, each benchmark should have a certain limit to how long it should take (on avg) in CI.

github-actions[bot] commented 1 year ago

Hi,

This issue hasn't seen activity in 60 days. Therefore, we are marking this issue as stale for now. It will be closed after 7 days. Feel free to re-open this issue when there's an update or relevant information to be added. Thanks!

staycoolcall911 commented 1 year ago

Duplicates #428