search

karma-runner / karma-junit-reporter

A Karma plugin. Report results in junit xml format.
MIT License
176 stars 144 forks source link

Warnings #185

Open jchapelle opened 4 years ago

jchapelle commented 4 years ago

Would it be possible to display warnings message and their source component ?

jpaulin commented 3 years ago

@jchapelle

https://github.com/pytest-dev/pytest/issues/2717

There's ample talk about whether JUnit reporting structure (the XML schema) supports warnings at all. Seems that JUnit has been designed to take a strict stance on every test resulting either a pass or error; with an additional one state that comes from the test running environment: fail = a technical "test running issue" caused the test not to result in actually reliable information error = test itself failed pass = test itself passed

What would be a good method for showing warnings? I think it's worth considering. Probably as in other talks about this, one thing to be careful about is that warnings would not break existing test setups - otherwise it's gonna be a perhaps (too many) red blips in quality dashboards.

jchapelle commented 3 years ago

Thanks for the feddback

On Thu, Oct 8, 2020 at 9:32 AM Jukka Paulin notifications@github.com wrote:

@jchapelle https://github.com/jchapelle

pytest-dev/pytest#2717 https://github.com/pytest-dev/pytest/issues/2717

There's ample talk about whether JUnit reporting structure (the XML schema) supports warnings at all. Seems that JUnit has been designed to take a strict stance on every test resulting either a pass or error; with an additional one state that comes from the test running environment: fail = a technical "test running issue" caused the test not to result in actually reliable information error = test itself failed pass = test itself passed

What would be a good method for showing warnings? I think it's worth considering. Probably as in other talks about this, one thing to be careful about is that warnings would not break existing test setups - otherwise it's gonna be a perhaps (too many) red blips in quality dashboards.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/karma-runner/karma-junit-reporter/issues/185#issuecomment-705388154, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABPAMXJV2CR7JRXPBF6X37TSJVTIDANCNFSM4RJNI6GQ .

-- Jean Chapelle