Feature: BuildSense test trends

toolchainlabs / issues

Public repo just for filing bugs and feature requests

0 stars 0 forks source link

Feature: BuildSense test trends #6

Open yoav-orca opened 2 years ago

yoav-orca commented 2 years ago

Without care over time test suites get slower, I would like to be able to view the test suite performance as a whole and per test target performance.

I would also like to write alerts and notify relevant team members about the relative performance of their tests

stuhood commented 2 years ago

This is definitely something that we have considered. We're particularly interested in being able to generate per-PR comparison metrics (which we already have the data for, just not necessarily indexed):

"This PR increased test runtime by a statistically significant amount"
"This PR decreased test code coverage"
"This PR added X dependencies to this binary"