search

codecov / engineering-team

This is a general repo to use with GH Projects
1 stars 1 forks source link

Coverage data seems off for certain branches #2566

Closed calvin-codecov closed 2 weeks ago

calvin-codecov commented 1 month ago

Describe the bug https://app.codecov.io/github/codecov/codecov-api/tree/sshin%2F2118 https://github.com/codecov/codecov-api/commits/sshin/2118/

This branch was created about 2 weeks ago (i think) but for the GetBranchCoverageMeasurements query, we're getting data points back to Aug 16th that have no coverage % reported. Because of this, the graph shows a huge spike up to 90+% and the 3 month trend is the same.

Image

Another example https://app.codecov.io/github/codecov/codecov-api/tree/joseph%2Fimprove-aggregate.

To Reproduce Steps to reproduce the behavior:

  1. Go to codecov coverage tab
  2. Switch to different branches
  3. Take a look at the graph and coverage % highlights.
  4. Check the data coming through from graphql.

Expected behavior I would expect the coverage trend to be closer to main and not have a huge spike since an arbitrary amount of time beforehand has null coverage %.

katia-sentry commented 2 weeks ago

related https://github.com/codecov/engineering-team/issues/2501

Showing an error message of not enough data when there is data showing, see #2501 screenshots

katia-sentry commented 2 weeks ago

@Adal3n3 to create a separate issue for the error message mismatch - closing this.