search

unclebob / fitnesse

FitNesse -- The Acceptance Test Wiki
fitnesse.org
Other
2.04k stars 715 forks source link

Result XML for single Test run in Suite with SuiteSetUp/SuiteTearDown is not correct #1001

Open schreeedi opened 7 years ago

schreeedi commented 7 years ago

In Fitnesse v20160618 (Java) when having a structure like:

TestSuite

and you execute the TestPage as Test alone, the SuiteSetUp and SuiteTearDown gets included in the result in the browser being executed. That looks OK so far. But when going to the pageHistory of the TestPage and view the test run, they are included (with missing headlines) and there is:

SuiteSetUp: 2 right, 0 wrong, 0 ignored, 0 exceptions (88 ms) $testResult.Content TestPage: 0 right, 0 wrong, 8 ignored, 1 exceptions (8790 ms) $testResult.Content SuiteTearDown: 0 right, 0 wrong, 0 ignored, 0 exceptions (4 ms)

at the beginning of the history, which is wrong. There should only be:

TestPage: 0 right, 0 wrong, 8 ignored, 1 exceptions (8790 ms)

for example.

suratdas commented 5 years ago

This also affects test count when executed from Jenkins as it reports wrong trend. Below is the screenshot, where it includes SuiteSetUp and SuiteTearDown giving wrong test count.

image