search

nodejs / node-core-utils

CLI tools for Node.js Core collaborators
https://nodejs.github.io/node-core-utils/
MIT License
234 stars 106 forks source link

[WIP] feat: mark and skip flaky test #746

Open marco-ippolito opened 7 months ago

marco-ippolito commented 7 months ago

Draft implementation to add flaky tests automatically to the .status file. Missing:

I'm assuming that if the failed test shows up in at least 5 pr is flaky (debatable) and can be skipped, I'd increase this number to make sure no false positive

codecov[bot] commented 6 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (6d68c99) 83.03% compared to head (1a12479) 82.95%. Report is 15 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #746 +/- ## ========================================== - Coverage 83.03% 82.95% -0.08% ========================================== Files 37 37 Lines 4178 4190 +12 ========================================== + Hits 3469 3476 +7 - Misses 709 714 +5 ``` [see 2 files with indirect coverage changes](https://app.codecov.io/gh/nodejs/node-core-utils/pull/746/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodejs)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.