stryker-mutator / stryker-net

Mutation testing for .NET core and .NET framework!
https://stryker-mutator.io
Apache License 2.0
1.78k stars 188 forks source link

Improve devmode #2568

Open dupdob opened 1 year ago

dupdob commented 1 year ago

Is your feature request related to a problem? Please describe. A few years back, devmode was introduced to ease the work on mutator. Nowadays, the overall syntax parsing's design has been much improved and vastly reduced the chance of generating invalid syntax construction.

Describe the solution you'd like devmode should be changed like this:

  1. Remove abort early strategy
  2. Log source mutations only in dev mode (that would simplify issue reporting confidentiality)
  3. Possibly save mutated files to a sub folder
  4. increase log level for VsTest
  5. other suggestions are welcomed

Describe alternatives you've considered manual debug

rouke-broersma commented 1 year ago

Sounds good to me, only wary of the vstest log level suggestion. You can already set the vstest log level using the verbose option and imo having multiple ways to configure the same thing usually ends up causing mistakes somewhere along the lines.

Or perhaps we don't enable vstest logging using the Stryker log level at all anymore?

In that case we could also couple buildalyzer and libgit2sharo logging to devmode instead of Stryker loglevel.

Actually I think I quite like that.

dupdob commented 1 year ago

VsTest logs are not at verbose level, which is really verbose by the way. I had to force it while debugging the hang.