One line per test report
For each report/test, mark it as OK/KO.
From there, identify:
Tests that are always passing
Tests that are always failing
Flaky tests
For failing/flaky tests, check if there is already a GH issue or create it. Then reference it in the Excel file.
Warning: Note that some fixes were applied between the first and last reports, so let's take that into account. For instance, tests failing in the first reports because of WP Rocket not being properly uninstalled should not be considerd flaky because they have been fixed in the meantime, etc.
Context We now have many test results from Rocket-E2E from Remote Destkop: https://wp-media.slack.com/archives/C05NH7JU4S2/p1729513024781269
Expected outcome
Create an excel (or google sheet) file with:
From there, identify:
For failing/flaky tests, check if there is already a GH issue or create it. Then reference it in the Excel file.
Warning: Note that some fixes were applied between the first and last reports, so let's take that into account. For instance, tests failing in the first reports because of WP Rocket not being properly uninstalled should not be considerd flaky because they have been fixed in the meantime, etc.