stryker-mutator / stryker-net

Mutation testing for .NET core and .NET framework!
https://stryker-mutator.io
Apache License 2.0
1.78k stars 187 forks source link

Add Testing Platform Support #3094

Open slang25 opened 2 days ago

slang25 commented 2 days ago

Today Stryker has support for VSTest as the test runner, and this is what is commonly used today by various testing frameworks.

However Microsoft have built a new replacement call the Microsoft Testing Platform, which is being adopted by all of the major players (MSTest, NUnit, xUnit).

While many of these frameworks will support both runner engines for a good while, there are also new testing frameworks that are only support on the new testing platform (the excellent TUnit for example).

It would be amazing if Stryker.NET add support for this as a new runner option.

slang25 commented 2 days ago

I'll add that it may be possible to get indirect support today by using the VSTest Bridge extension, which I haven't tested but assume would enable TUnit support today.

rouke-broersma commented 2 days ago

We are working on it, but it is a very large feature. We have to reimplement a lot of vstest features ourselves because mstest runner assumes to be self contained in the test project and this doesn't really work for us since stryker is the executing binary. A start was made by an intern at #2988

As far as I know the test framework has to provide support for vstest, and TUnit could do this using the vstest bridge if they choose.

richardwerkman commented 11 hours ago

I'm currently working on this. I'll take TUnit into account as well. Would be nice if we could support that.

slang25 commented 29 minutes ago

Awesome, I didn't realise that this was being worked on, and how much work it is. I'm going to do some experimentation and see what I can get working today with TUnit,