Aggregate data/metrics between codecov + sentry

[cstavitsky]

Problem Statement

Customer requested:

how is code coverage data is showing up in all our sentry errors? what % of our errors are covered and how do we observe trends?

is there any aggregate data or metrics available re: codecov and sentry? or is it literally only the highlighting per line in each error that we can observe one by one?

I spoke internally about this with the Codecov team. Currently, my understanding is:

• we don't provide aggregate data regarding the crossover between codecov + sentry at the moment. It's more line-by-line to be used from the Sentry side when debugging.
• If this kind of aggregate metrics were to be built, it would have to be done from the Sentry side rather than Codecov
• From the Codecov side, there aren't plans at this moment to build out those kinds of aggregate metrics

Solution Brainstorm

Build some way to see what % of Sentry errors are covered by Codecov

Product Area

Issues

┆Issue is synchronized with this Jira Improvement by Unito

[getsantry[bot]]

Auto-routing to @getsentry/product-owners-issues for triage ⏲️

[scttcper]

At the moment we really don't even load data from codecov until the user views the issue