Whenever a codeception test finishes with an error the test fails but is not counted as a failure, it is counted as an error in the report.xml file. This makes the test appear green in the phpci UI and it should be red (because in the end the test failed).
This makes hard to test if the codeception plugin is working as expected because even when it fails all the test appear as they passed.
See this image, all the tests passed but the codeception status is marked as failed:
In this PR I make the plugin be aware of the errors not just of the failures.
Whenever a codeception test finishes with an error the test fails but is not counted as a failure, it is counted as an error in the report.xml file. This makes the test appear green in the phpci UI and it should be red (because in the end the test failed).
This makes hard to test if the codeception plugin is working as expected because even when it fails all the test appear as they passed.
See this image, all the tests passed but the codeception status is marked as failed:
In this PR I make the plugin be aware of the errors not just of the failures.