paulegradie / Sailfish

Sailfish - a production friendly performance benchmark runner for .NET
https://paulgradie.com/Sailfish/
MIT License
11 stars 4 forks source link

Test Case count is incorrect if a test fails #145

Closed droyad closed 3 months ago

droyad commented 3 months ago

If a test case fails, all other test cases for that method are not run. This throws off the the test case count and the test ends with the message --- test case 16 of 32.

Possbily the easiest fix is to remove the count altogether as I'm not sure it adds value.

Alternatively you could make this is to make the count relative to the parent (i.e method) instead of globally. This should then also apply to the method. I'd be more interested in which method of this particular class, rather than overall.

Should perhaps the totals and current test number be on TestInstanceContainerProvider?