stryker-mutator / stryker-handbook

A comprehensive guide to the stryker ecosystem
Apache License 2.0
71 stars 11 forks source link

Define testrunner failures as RuntimeError #39

Closed hugo-vrijswijk closed 4 years ago

hugo-vrijswijk commented 4 years ago

If a testrunner process crashes in a non-recoverable way, such as when an OutOfMemoryError occurs, this should be defined as a RuntimeError

Mutations that crash a testrunner in a recoverable way should still be defined as Killed. For example, when a test-framework throws an exception instead of reporting a result this can be a valid (albeit strange) mutation.

@nicojs @simondel @Mobrockers @richardwerkman What do you think?