search

paratestphp / paratest

:computer: Parallel testing for PHPUnit
MIT License
2.32k stars 229 forks source link

Testdox summary not printed #878

Closed SherinBloemendaal closed 2 months ago

SherinBloemendaal commented 2 months ago
Q A
ParaTest version 7.5.2
PHPUnit version 11.3.1
PHP version 8.3.11

Summary

Since PHPUnit 11 the testdox summary was removed (sebastianbergmann/phpunit#5318), but it was being brought back in PHPUnit version 11.3.

Current behavior

When running ParaTest with the testdoxSummary="true" in phpunit.xml.dist no summary is shown after the tests ran. When running PHPUnit directly it is shown afterwards.

How to reproduce: command, code and error stack trace

ParaTest command: php -dpcov.enabled=1 -dmemory_limit=-1 vendor/bin/paratest -p 12 --passthru-php="'-d' 'pcov.enabled=1' '-d' 'memory_limit=-1'" --colors=never --coverage-text=php://stdout --log-junit junit_report.xml

PHPUnit command: php -dpcov.enabled=1 -dmemory_limit=-1 vendor/bin/phpunit --colors=never --coverage-text=php://stdout --log-junit junit_report.xml

Expected behavior

The testdox summary to be outputted when it is being enabled via configuration (testdoxSummary=true) or parameter (--testdox-summary).

Slamdunk commented 2 months ago

I'm sorry but this conflicts with the need of exposing PHPUnit Errors/Warnings/Deprecations, see https://github.com/paratestphp/paratest/pull/774 The way the summary is coded in PHPUnit doesn't let ParaTest have both the errors and the summary, and between the two the former is more important.