exercism / php-test-runner

GNU Affero General Public License v3.0
0 stars 6 forks source link

Solve syntax error reporting and other minor improvements #101

Closed mk-mxp closed 6 months ago

mk-mxp commented 6 months ago

Solves this forum discussion.

This replaces #97, which got no updates for a while. It is solving the problem, that syntax errors in students code fail in a way, that cannot be distinguished from failing tests, but tests are not reported by PHPUnit as failing.

I added a syntax linting step before invoking PHPUnit, which adds minimal overhead and only fails for hard syntactical errors.

While reading into the test runner specification I realized that we shouldn't write absolute pathes into the result messages. So I adjusted output to only have file names and no path at all. That fits well with the online editor only showing the file names on editor tabs, too.

I also improved the shell script and updated the README.