search

cta-wave / dpctf-test-runner

Repo for the DPCTF Test Runner
Other
0 stars 3 forks source link

report tests as "warning" as well as pass / fail #33

Open jpiesing opened 10 months ago

jpiesing commented 10 months ago

This may have too big an impact on W3C code but I thought I should ask.

We have some tests that are a "should" rather than a "shall", e.g. start-up delay. A "fail" of such a test would be more logical as a "warning" rather than a "fail".

Is "warning" supported by the W3C test runner or is it purely binary, pass / fail?

If the W3C test runner is purely binary, is there any practical way to add "warning" to the reports?

jpiesing commented 8 months ago

Deferring this as it's clearly too much for the 1st release.