search

webdriverio-boneyard / wdio-junit-reporter

A WebdriverIO v4 plugin. Report results in junit xml format.
http://v4.webdriver.io
MIT License
11 stars 42 forks source link

Wdio cucumber xunit reporter reports assertion errors as errors instead of failures #101

Open christian-bromann opened 6 years ago

christian-bromann commented 6 years ago

From @osmolyar on July 20, 2018 17:57

The problem

As seen in the attached xml junit reporter output file, Assertion failures are reported as 'errors' rather than 'failures'. The expected behavior would be for Assertion failures to be reported as failures and other error (navigation, etc.) to be reported as errors.

`<?xml version="1.0" encoding="UTF-8"?>

(C:/AT-ENSEMBLE/workspace/qd_cucumber_2018/features/step_definitions/LicenseKey.steps.js:37:16) at C:\Users\quality\AppData\Roaming\npm\node_modules\wdio-cucumber-framework\node_modules\wdio-sync\build\index.js:594:26 at F (C:\Users\quality\AppData\Roaming\npm\node_modules\wdio-cucumber-framework\node_modules\core-js\library\modules\_export.js:35:28) at World.executeSync (C:\Users\quality\AppData\Roaming\npm\node_modules\wdio-cucumber-framework\node_modules\wdio-sync\build\index.js:592:12) at C:\Users\quality\AppData\Roaming\npm\node_modules\wdio-cucumber-framework\node_modules\wdio-sync\build\index.js:214:29 ]]> (C:/AT-ENSEMBLE/workspace/qd_cucumber_2018/features/step_definitions/LicenseKey.steps.js:37:16) at C:\Users\quality\AppData\Roaming\npm\node_modules\wdio-cucumber-framework\node_modules\wdio-sync\build\index.js:594:26 at F (C:\Users\quality\AppData\Roaming\npm\node_modules\wdio-cucumber-framework\node_modules\core-js\library\modules\_export.js:35:28) at World.executeSync (C:\Users\quality\AppData\Roaming\npm\node_modules\wdio-cucumber-framework\node_modules\wdio-sync\build\index.js:592:12) at C:\Users\quality\AppData\Roaming\npm\node_modules\wdio-cucumber-framework\node_modules\wdio-sync\build\index.js:214:29 ]]> ` [WDIO.xunitchrome.0-0.zip](https://github.com/webdriverio/webdriverio/files/2214919/WDIO.xunitchrome.0-0.zip) ## Environment "wdio-cucumber-framework": "^1.1.0", "wdio-junit-reporter": "^0.3.1", "wdio-spec-reporter": "0.0.5", "webdriverio": "^4.6.2", Node js version: 7.5.0 wdio standalone or grid ## Details Describe in more detail the problem you have been experiencing, if necessary. ## Link to Selenium/WebdriverIO logs Create a [gist](https://gist.github.com) which is a paste of your _full_ Selenium/WebdriverIO logs, and link them here. Do _not_ paste your full Appium logs here, as it will make this issue very long and hard to read! If you are reporting a bug, _always_ include Selenium/WebdriverIO logs! ## Code To Reproduce Issue [ Good To Have ] Please remember that, with sample code; it's easier to reproduce bug and much faster to fix it. _Copied from original issue: webdriverio/webdriverio#2814_