Further testing followups

Jpnock commented 4 months ago

[x] Refactors the test script in an attempt to reduce cohesion
[x] Ignores coverage and pycache files in git
[x] Attempts to always output a valid JUnit XML file
[x] Escapes XML attributes and values to prevent test results corrupting the XML output
[x] Unifies the two ways of counting passes and fails into one method for consistency (previously group names, folders, test names or test logs containing the phrase Pass would lead to a test being marked as passing in short mode)
[x] As for coloarma, I've tested on both Linux, Mac and WSL and colours seem to work fine without this dependency. Did we see a user reported bug for this? If so, it's fine to just revert 4f4212654a286cc3681184ca90511ff0c2ece5c5.
[x] Bumps the script version number

Note, this targets the further_test_improvements branch for an easier review. Although we could just target main.

Fiwo735 commented 4 months ago

Removed some newlines as it looks neater now in my opinion

Before

After

Jpnock commented 4 months ago

Removed some newlines as it looks neater now in my opinion

Before

After

Cool, I've just added colouring too which makes it nicer in verbose mode

Fiwo735 commented 4 months ago

Cool, I've just added colouring too which makes it nicer in verbose mode

And I've just gone all in on the colouring, nothing left uncoloured anymore

LangProc / langproc-cw