avocado-framework / avocado

Avocado is a set of tools and libraries to help with automated testing. One can call it a test framework with benefits. Native tests are written in Python and they follow the unittest pattern, but any executable can serve as a test.
https://avocado-framework.github.io/
Other
345 stars 343 forks source link

Coverage report with codecov instead of codeclimate #6039

Closed richtja closed 1 month ago

richtja commented 1 month ago

This is an update for avocado coverage workflow. It changes the coverage reporting tool from codeclimate to codecov since the codecov hasn't been reliable for some time.

For now, the coverage check is set to informational. This means that we will get the reports, but the PRs won't be blocked by changes in coverage. I plan to change this when we make sure that this workflow is stable.

Reference: #6035


You can see the working coverage report in https://github.com/richtja/avocado/pull/23

codecov[bot] commented 1 month ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 54.47%. Comparing base (5e122fd) to head (d5569ca). Report is 3357 commits behind head on master.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #6039 +/- ## =========================================== - Coverage 69.15% 54.47% -14.69% =========================================== Files 139 202 +63 Lines 17241 21874 +4633 =========================================== - Hits 11923 11915 -8 - Misses 5318 9959 +4641 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

richtja commented 1 month ago

The CI errors are fixed in #6040, when that will be merged I will do the rebase.