search

STAMP-project / pitest-descartes

Descartes supports developers to improve their test suites by reporting weak spots in covered code
https://hal.archives-ouvertes.fr/hal-01870976/document
GNU Lesser General Public License v3.0
126 stars 21 forks source link

False positive in xwiki-platform-rendering-macro-python #119

Open vmassol opened 4 years ago

vmassol commented 4 years ago

Hi @oscarlvp

Seems we might have hit a new false positive in xwiki-platform-rendering-macro-python. A few days ago we made changes to the code (and test) at https://github.com/xwiki/xwiki-platform/commit/ff57d35e5dfb0128142150c53d13a92f805fc600

This broke our build with:

`[ERROR] Failed to execute goal org.pitest:pitest-maven:1.4.10:mutationCoverage (pitest-check) on project xwiki-platform-rendering-macro-python: Mutation score of 0 is below threshold of 100``

However we couldn't understand 2 things: 1) The pitest says that 0 tests are found (before and now) so we don't understand how it could have had 100% mutation score 2) Why it suddenly started reporting 0%

So I compared the execution before and after the commit and we get what's on the screenshot.

Screenshot 2020-02-26 at 09 56 09

The null part seems weird. WDYT?

Thanks

oscarlvp commented 4 years ago

Hi @vmassol Did you change the PIT version and/or the version of the Junit 5 plugin?

vmassol commented 4 years ago

Hi @vmassol Did you change the PIT version and/or the version of the Junit 5 plugin?

@oscarlvp Hi. I didn't change any version of PIT/Descartes nor JUnit5 plugin.