google-code-export / mb-unit

Automatically exported from code.google.com/p/mb-unit
0 stars 0 forks source link

Gallio Echo returns the wrong code for Fatal Error #855

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
We need to be able to distinguish between test failures and infrastructure 
failures (eg. failure to load or explore the test assembly, or catastrophic 
environmental problems). I had thought that the Echo return code 3 (Fatal 
Error) would do, but in fact fatal errors still show up as simply errors (error 
code 1).

What steps will reproduce the problem?
1. Cause a fatal error (for test purposes a Stack Overflow will do):

    [TestFixture]
    public class Fixture
    {
        [Test]
        public void Method()
        {
            Method();
        }
    }

2.
3.

What is the expected output? What do you see instead?
Expect return code 3 (Fatal Error)
Instead, we get return code 1 (Error)

Please use labels and text to provide additional information.

Original issue reported on code.google.com by wayne.br...@gmail.com on 26 Aug 2011 at 6:46

GoogleCodeExporter commented 9 years ago
It appears that Echo could never in fact return ResultCode.FatalException (at 
least during Explore), since the exception is swallowed in 
DefaultTestRunner.Explore 

Original comment by wayne.br...@gmail.com on 26 Aug 2011 at 6:53