Failed MemberData doesn't show in runner app

xunit / devices.xunit

xUnit.net Runners for Devices

Other

73 stars 35 forks source link

Failed MemberData doesn't show in runner app #148

Open wcoder opened 3 years ago

wcoder commented 3 years ago

Test:

[Theory]
[MemberData(nameof(Data))]
public void Test(string p1, UIColor p2)
{
  // ...
}

When some MemberData, ClassData items fail the test, the runner app doesn't show failed, only succeeded items. InlineData works fine.

Console log:

[FAIL] Tests.Test : System.ArgumentOutOfRangeException : Specified argument was out of the range of valid values.

Expected Exception.

xUnit: v2.4.1 xUnit.Runner.Devices: v2.5.25 Platform: iOS

1Cor125 commented 3 years ago

I am also seeing this when using [Theory][MemberData(Data))]. I think this has been broken for a while. I only now caught it because I started running the tests headlessly and parsing the xunit test results file in CI.

Also on xunit 2.4.1 and xunit.runner.devices 2.5.25