search

STAMP-project / pitest-descartes

Descartes supports developers to improve their test suites by reporting weak spots in covered code
https://hal.archives-ouvertes.fr/hal-01870976/document
GNU Lesser General Public License v3.0
126 stars 21 forks source link

Failure to run on xwiki-commons-job #51

Closed vmassol closed 5 years ago

vmassol commented 6 years ago

When executing on xwiki-commons-job I get the following failure below.

[INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ xwiki-commons-job ---

-------------------------------------------------------
 T E S T S
-------------------------------------------------------
objc[4501]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.8.0_131.jdk/Contents/Home/jre/bin/java (0x10486d4c0) and /Library/Java/JavaVirtualMachines/jdk1.8.0_131.jdk/Contents/Home/jre/lib/libinstrument.dylib (0x10492b4e0). One of the two will be used. Which one is undefined.
Running org.xwiki.job.internal.DefaultJobStatusTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.887 sec - in org.xwiki.job.internal.DefaultJobStatusTest
Running org.xwiki.job.internal.DefaultRequestTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in org.xwiki.job.internal.DefaultRequestTest
Running org.xwiki.job.internal.DefaultJobStatusStoreTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.826 sec - in org.xwiki.job.internal.DefaultJobStatusStoreTest
Running org.xwiki.job.internal.JobStatusSerializerTest
Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.244 sec - in org.xwiki.job.internal.JobStatusSerializerTest
Running org.xwiki.job.internal.DefaultJobProgressTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec - in org.xwiki.job.internal.DefaultJobProgressTest
Running org.xwiki.job.internal.DefaultJobExecutorTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.102 sec - in org.xwiki.job.internal.DefaultJobExecutorTest
Running org.xwiki.job.internal.DefaultJobManagerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.045 sec - in org.xwiki.job.internal.DefaultJobManagerTest
Running org.xwiki.job.internal.xstream.XStreamUtilsTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in org.xwiki.job.internal.xstream.XStreamUtilsTest
Running org.xwiki.job.internal.xstream.SafeXStreamTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.035 sec - in org.xwiki.job.internal.xstream.SafeXStreamTest

Results :

Tests run: 56, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ xwiki-commons-job ---
[INFO] Building jar: /Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/target/xwiki-commons-job-10.3-SNAPSHOT.jar
[INFO] 
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ xwiki-commons-job ---
[INFO] Starting audit...
[WARN] /Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/src/main/java/org/xwiki/job/internal/xstream/SafeMessageConverter.java:109: Comment matches to-do format 'TODO'. [TodoComment]
[WARN] /Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/src/main/java/org/xwiki/job/internal/xstream/SafeXStream.java:36: Comment matches to-do format 'FIXME'. [TodoComment]
[WARN] /Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/src/main/java/org/xwiki/job/internal/xstream/SafeXStream.java:66: Comment matches to-do format 'TODO'. [TodoComment]
[WARN] /Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/src/main/java/org/xwiki/job/internal/xstream/SafeXStream.java:73: Comment matches to-do format 'FIXME'. [TodoComment]
Audit done.
[INFO] 
[INFO] --- maven-checkstyle-plugin:3.0.0:check (blocker) @ xwiki-commons-job ---
[INFO] Starting audit...
Audit done.
[INFO] 
[INFO] --- license-maven-plugin:3.0:check (default) @ xwiki-commons-job ---
[INFO] Checking licenses...
[INFO] 
[INFO] --- jacoco-maven-plugin:0.8.0:check (jacoco-check) @ xwiki-commons-job ---
[INFO] Loading execution data file /Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/target/jacoco.exec
[INFO] Analyzed bundle 'xwiki-commons-job' with 58 classes
[INFO] All coverage checks have been met.
[INFO] 
[INFO] --- pitest-maven:1.2.0:mutationCoverage (pitest-check) @ xwiki-commons-job ---
[INFO] Found plugin : JSON report plugin
[INFO] Found plugin : Default csv report plugin
[INFO] Found plugin : Default xml report plugin
[INFO] Found plugin : Default html report plugin
[INFO] Found plugin : Default limit mutations plugin
[INFO] Found plugin : Kotlin junk mutations filter
[INFO] Found shared classpath plugin : Engine for extreme mutation operators
[INFO] Found shared classpath plugin : Default mutation engine
[INFO] Adding fr.inria.stamp:descartes to SUT classpath
[INFO] Adding org.pitest:pitest to SUT classpath
[INFO] Mutating from /Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/target/classes
[INFO] Defaulting target classes to match packages in build directory
4:24:10 PM PIT >> INFO : Verbose logging is disabled. If you encounter an problem please enable it before reporting an issue.
CP is :/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/target/test-classes:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/target/classes:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-component/xwiki-commons-component-api/target/xwiki-commons-component-api-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-stability/target/xwiki-commons-stability-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-text/target/xwiki-commons-text-10.3-SNAPSHOT.jar:/Users/vmassol/.m2/repository/org/slf4j/slf4j-api/1.7.25/slf4j-api-1.7.25.jar:/Users/vmassol/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-cache/xwiki-commons-cache-api/target/xwiki-commons-cache-api-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-logging/xwiki-commons-logging-api/target/xwiki-commons-logging-api-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-observation/xwiki-commons-observation-api/target/xwiki-commons-observation-api-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-environment/xwiki-commons-environment-api/target/xwiki-commons-environment-api-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-configuration/xwiki-commons-configuration-api/target/xwiki-commons-configuration-api-10.3-SNAPSHOT.jar:/Users/vmassol/.m2/repository/commons-beanutils/commons-beanutils/1.9.3/commons-beanutils-1.9.3.jar:/Users/vmassol/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-context/target/xwiki-commons-context-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-script/target/xwiki-commons-script-10.3-SNAPSHOT.jar:/Users/vmassol/.m2/repository/commons-io/commons-io/2.6/commons-io-2.6.jar:/Users/vmassol/.m2/repository/org/apache/commons/commons-collections4/4.1/commons-collections4-4.1.jar:/Users/vmassol/.m2/repository/org/apache/commons/commons-lang3/3.7/commons-lang3-3.7.jar:/Users/vmassol/.m2/repository/org/apache/commons/commons-configuration2/2.2/commons-configuration2-2.2.jar:/Users/vmassol/.m2/repository/com/thoughtworks/xstream/xstream/1.4.10/xstream-1.4.10.jar:/Users/vmassol/.m2/repository/xmlpull/xmlpull/1.1.3.1/xmlpull-1.1.3.1.jar:/Users/vmassol/.m2/repository/xpp3/xpp3_min/1.1.4c/xpp3_min-1.1.4c.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-tools/xwiki-commons-tool-test/xwiki-commons-tool-test-component/target/xwiki-commons-tool-test-component-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-tools/xwiki-commons-tool-test/xwiki-commons-tool-test-simple/target/xwiki-commons-tool-test-simple-10.3-SNAPSHOT.jar:/Users/vmassol/.m2/repository/junit/junit/4.12/junit-4.12.jar:/Users/vmassol/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/Users/vmassol/.m2/repository/org/junit/jupiter/junit-jupiter-api/5.1.0/junit-jupiter-api-5.1.0.jar:/Users/vmassol/.m2/repository/org/apiguardian/apiguardian-api/1.0.0/apiguardian-api-1.0.0.jar:/Users/vmassol/.m2/repository/org/opentest4j/opentest4j/1.0.0/opentest4j-1.0.0.jar:/Users/vmassol/.m2/repository/org/junit/platform/junit-platform-commons/1.1.0/junit-platform-commons-1.1.0.jar:/Users/vmassol/.m2/repository/org/junit/jupiter/junit-jupiter-engine/5.1.0/junit-jupiter-engine-5.1.0.jar:/Users/vmassol/.m2/repository/org/junit/platform/junit-platform-engine/1.1.0/junit-platform-engine-1.1.0.jar:/Users/vmassol/.m2/repository/org/junit/platform/junit-platform-launcher/1.1.0/junit-platform-launcher-1.1.0.jar:/Users/vmassol/.m2/repository/org/junit/vintage/junit-vintage-engine/5.1.0/junit-vintage-engine-5.1.0.jar:/Users/vmassol/.m2/repository/org/hamcrest/hamcrest-library/1.3/hamcrest-library-1.3.jar:/Users/vmassol/.m2/repository/org/jmock/jmock/2.6.0/jmock-2.6.0.jar:/Users/vmassol/.m2/repository/org/jmock/jmock-junit4/2.6.0/jmock-junit4-2.6.0.jar:/Users/vmassol/.m2/repository/org/mockito/mockito-core/2.15.0/mockito-core-2.15.0.jar:/Users/vmassol/.m2/repository/net/bytebuddy/byte-buddy/1.7.9/byte-buddy-1.7.9.jar:/Users/vmassol/.m2/repository/net/bytebuddy/byte-buddy-agent/1.7.9/byte-buddy-agent-1.7.9.jar:/Users/vmassol/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/Users/vmassol/.m2/repository/ch/qos/logback/logback-classic/1.2.3/logback-classic-1.2.3.jar:/Users/vmassol/.m2/repository/ch/qos/logback/logback-core/1.2.3/logback-core-1.2.3.jar:/Users/vmassol/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.25/jcl-over-slf4j-1.7.25.jar:/Users/vmassol/.m2/repository/org/slf4j/log4j-over-slf4j/1.7.25/log4j-over-slf4j-1.7.25.jar:/Users/vmassol/.m2/repository/jmock/jmock/1.2.0/jmock-1.2.0.jar:/Users/vmassol/.m2/repository/jmock/jmock-cglib/1.2.0/jmock-cglib-1.2.0.jar:/Users/vmassol/.m2/repository/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-component/xwiki-commons-component-default/target/xwiki-commons-component-default-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-observation/xwiki-commons-observation-local/target/xwiki-commons-observation-local-10.3-SNAPSHOT.jar:/Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-component/xwiki-commons-component-observation/target/xwiki-commons-component-observation-10.3-SNAPSHOT.jar:/Users/vmassol/.m2/repository/fr/inria/stamp/descartes/0.2-SNAPSHOT/descartes-0.2-SNAPSHOT.jar:/Users/vmassol/.m2/repository/org/pitest/pitest/1.2.0/pitest-1.2.0.jar
4:24:10 PM PIT >> INFO : MINION : objc[4502]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.8.0_131.jdk/Contents/Home/jre/bin/java (0x10e6794c0) and /Library/Java/JavaVirtualMachines/jdk1.8.0_131.jdk/Contents/Home/jre/lib/libinstrument.dylib (0x10e705
4:24:10 PM PIT >> INFO : MINION : 4e0). One of the two will be used. Which one is undefined.

4:24:10 PM PIT >> INFO : Sending 27 test classes to minion
4:24:10 PM PIT >> INFO : Sent tests to minion
4:24:10 PM PIT >> INFO : MINION : 4:24:10 PM PIT >> INFO : Checking environment

4:24:10 PM PIT >> INFO : MINION : 4:24:10 PM PIT >> INFO : Found  56 tests

4:24:10 PM PIT >> INFO : MINION : 4:24:10 PM PIT >> INFO : Dependency analysis reduced number of potential tests by 0
4:24:10 PM PIT >> INFO : 56 tests received

4:24:11 PM PIT >> INFO : MINION : 4:24:11 PM PIT >> WARNING : More threads at end of test (5) testGetJobStatusForUnexistingJob(org.xwiki.job.internal.DefaultJobManagerTest) than start. (4)

4:24:11 PM PIT >> SEVERE : Description [testClass=org.xwiki.job.internal.DefaultJobStatusStoreTest, name=getJobStatusInOldPlace(org.xwiki.job.internal.DefaultJobStatusStoreTest)] did not pass without mutation.
4:24:11 PM PIT >> SEVERE : Description [testClass=org.xwiki.job.internal.DefaultJobStatusStoreTest, name=getJobStatusInWrongPlaceAndWithInvalidLogArgument(org.xwiki.job.internal.DefaultJobStatusStoreTest)] did not pass without mutation.
4:24:12 PM PIT >> INFO : Calculated coverage in 2 seconds.
|[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] XWiki Commons - Parent POM ......................... SUCCESS [  2.578 s]
[INFO] XWiki Commons - Tools - Parent POM ................. SUCCESS [  0.046 s]
[INFO] XWiki Commons - Tools - License Resources .......... SUCCESS [  0.954 s]
[INFO] XWiki Commons - Tools - Enforcers .................. SUCCESS [  0.756 s]
[INFO] XWiki Commons - Tools - Banned Dependencies Enforcer SUCCESS [  0.881 s]
[INFO] XWiki Commons - Tools - Verification Resources ..... SUCCESS [  8.495 s]
[INFO] XWiki Commons - Tools - Spoon Processor ............ SUCCESS [  0.342 s]
[INFO] XWiki Commons - Root POM ........................... SUCCESS [  0.885 s]
[INFO] XWiki Commons - Tools - Test Framework - Parent POM  SUCCESS [  0.850 s]
[INFO] XWiki Commons - Tools - Test Framework - Simple .... SUCCESS [  5.680 s]
[INFO] XWiki Commons - Core - Parent POM .................. SUCCESS [  0.557 s]
[INFO] XWiki Commons - Stability .......................... SUCCESS [  2.040 s]
[INFO] XWiki Commons - Text ............................... SUCCESS [  3.292 s]
[INFO] XWiki Commons - Component - Parent POM ............. SUCCESS [  0.132 s]
[INFO] XWiki Commons - Component - API .................... SUCCESS [  9.964 s]
[INFO] XWiki Commons - Observation - Parent POM ........... SUCCESS [  0.158 s]
[INFO] XWiki Commons - Observation - API .................. SUCCESS [ 10.699 s]
[INFO] XWiki Commons - Component - Observation ............ SUCCESS [  4.680 s]
[INFO] XWiki Commons - Component - Default Implementation . SUCCESS [ 16.406 s]
[INFO] XWiki Commons - Context ............................ SUCCESS [  8.160 s]
[INFO] XWiki Commons - Configuration - Parent POM ......... SUCCESS [  0.235 s]
[INFO] XWiki Commons - Configuration - API ................ SUCCESS [  0.816 s]
[INFO] XWiki Commons - Tools - Test Framework - Component . SUCCESS [  0.547 s]
[INFO] XWiki Commons - Blame .............................. SUCCESS [  0.435 s]
[INFO] XWiki Commons - Blame - API ........................ SUCCESS [  5.099 s]
[INFO] XWiki Commons - Loggging ........................... SUCCESS [  0.173 s]
[INFO] XWiki Commons - Logging - API ...................... SUCCESS [ 12.549 s]
[INFO] XWiki Commons - Diff ............................... SUCCESS [  0.179 s]
[INFO] XWiki Commons - Diff API ........................... SUCCESS [  8.062 s]
[INFO] XWiki Commons - Diff Display API ................... SUCCESS [ 10.986 s]
[INFO] XWiki Commons - Script ............................. SUCCESS [  9.102 s]
[INFO] XWiki Commons - Blame - Script Service ............. SUCCESS [  0.834 s]
[INFO] XWiki Commons - Environment - Parent POM ........... SUCCESS [  0.166 s]
[INFO] XWiki Commons - Environment - API .................. SUCCESS [  0.568 s]
[INFO] XWiki Commons - Cache - Parent POM ................. SUCCESS [  0.144 s]
[INFO] XWiki Commons - Cache - API ........................ SUCCESS [  0.923 s]
[INFO] XWiki Commons - Cache - Tests ...................... SUCCESS [  0.781 s]
[INFO] XWiki Commons - Cache - Infinispan ................. SUCCESS [ 10.365 s]
[INFO] XWiki Commons - ClassLoader - Parent POM ........... SUCCESS [  0.086 s]
[INFO] XWiki Commons - ClassLoader - API .................. SUCCESS [  0.882 s]
[INFO] XWiki Commons - ClassLoader - Protocols - Parent POM SUCCESS [  0.093 s]
[INFO] XWiki Commons - ClassLoader - Protocols - JAR ...... SUCCESS [  0.819 s]
[INFO] XWiki Commons - Component - Component Archetype .... SUCCESS [  7.673 s]
[INFO] XWiki Commons - Crypto ............................. SUCCESS [  0.270 s]
[INFO] XWiki Commons - Crypto - Common API ................ SUCCESS [08:43 min]
[INFO] XWiki Commons - Crypto - Cipher API ................ SUCCESS [ 18.577 s]
[INFO] XWiki Commons - Crypto - Password API .............. SUCCESS [ 36.317 s]
[INFO] XWiki Commons - Crypto - Signer API ................ SUCCESS [ 19.847 s]
[INFO] XWiki Commons - Crypto - PKI API ................... SUCCESS [ 42.393 s]
[INFO] XWiki Commons - Crypto - Store ..................... SUCCESS [  0.267 s]
[INFO] XWiki Commons - Cryptographic Services - Storage API SUCCESS [  0.910 s]
[INFO] XWiki Commons - Cryptographic Services - Storage Filesystem SUCCESS [  8.149 s]
[INFO] XWiki Commons - Environment - Common ............... SUCCESS [  0.647 s]
[INFO] XWiki Commons - Environment - Standard ............. SUCCESS [  5.194 s]
[INFO] XWiki Commons - Environment - Servlet .............. SUCCESS [  6.037 s]
[INFO] XWiki Commons - Properties ......................... SUCCESS [ 21.143 s]
[INFO] XWiki Commons - Observation - Local ................ SUCCESS [  3.933 s]
[INFO] XWiki Commons - Job ................................ FAILURE [  7.789 s]
[INFO] XWiki Commons - Logging - Logback .................. SKIPPED
[INFO] XWiki Commons - Extension - Parent POM ............. SKIPPED
[INFO] XWiki Commons - Extension - API .................... SKIPPED
[INFO] XWiki Commons - Extension - Maven .................. SKIPPED
[INFO] XWiki Commons - Extension - Handler - Parent POM ... SKIPPED
[INFO] XWiki Commons - Extension - Handler - JAR .......... SKIPPED
[INFO] XWiki Commons - Extension - Repository - Parent POM  SKIPPED
[INFO] XWiki Commons - Extension - Repository - HTTP ...... SKIPPED
[INFO] XWiki Commons - Extension - Repository - Maven ..... SKIPPED
[INFO] XWiki Commons - Repository ......................... SKIPPED
[INFO] XWiki Commons - Repository - Model ................. SKIPPED
[INFO] XWiki Commons - Repository - API ................... SKIPPED
[INFO] XWiki Commons - Extension - Repository - XWiki ..... SKIPPED
[INFO] XWiki Commons - Extension - Repository - Maven - Snapshots Default Repository SKIPPED
[INFO] XWiki Commons - Filter - Parent POM ................ SKIPPED
[INFO] XWiki Commons - Filter - API ....................... SKIPPED
[INFO] XWiki Commons - XML ................................ SKIPPED
[INFO] XWiki Commons - Filter - XML ....................... SKIPPED
[INFO] XWiki Commons - Filter - Test framework ............ SKIPPED
[INFO] XWiki Commons - Filter - Events .................... SKIPPED
[INFO] XWiki Commons - Filter - Event - Extension ......... SKIPPED
[INFO] XWiki Commons - Filter - Streams ................... SKIPPED
[INFO] XWiki Commons - Filter - Stream - Generic XML ...... SKIPPED
[INFO] XWiki Commons - Groovy ............................. SKIPPED
[INFO] XWiki Commons - Management ......................... SKIPPED
[INFO] XWiki Commons - Velocity ........................... SKIPPED
[INFO] XWiki Commons - Diff Script API .................... SKIPPED
[INFO] XWiki Commons - Tools - Extension Plugin ........... SKIPPED
[INFO] XWiki Commons - Tools - XAR Tools .................. SKIPPED
[INFO] XWiki Commons - Tools - XAR Tools - XAR Plugin ..... SKIPPED
[INFO] XWiki Commons - Tools - XAR Tools - XAR Handlers ... SKIPPED
[INFO] XWiki Commons - Tools - WEBJAR XAR Handlers ........ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14:05 min
[INFO] Finished at: 2018-03-27T16:24:12+02:00
[INFO] Final Memory: 160M/1023M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.pitest:pitest-maven:1.2.0:mutationCoverage (pitest-check) on project xwiki-commons-job: Execution pitest-check of goal org.pitest:pitest-maven:1.2.0:mutationCoverage failed: All tests did not pass without mutation when calculating line coverage. Mutation testing requires a green suite.
[ERROR] See http://pitest.org for more details.

Any idea?

oscarlvp commented 6 years ago

Sometimes a green test fails with PIT a workaround is to remove the test from the analysis. The class in question seems to be org.xwiki.job.internal.DefaultJobStatusStoreTest from the SEVERE message in the output.

vmassol commented 6 years ago

Yes I know how to exclude stuff but IMO there's something to fix to make the tool better (hence the reporting).

vmassol commented 6 years ago

Same problem with Descartes 1.1.

oscarlvp commented 6 years ago

Do the problem persist in the latest version?

vmassol commented 6 years ago

Just tested with descartes 1.2 (and pitest 1.4.0) with the command line: mvn clean install -Pquality -Dxwiki.pitest.skip=false

And got this error:

[INFO] --- pitest-maven:1.4.0:mutationCoverage (pitest-check) @ xwiki-commons-job ---
[INFO] Found plugin : JSON report plugin
[INFO] Found plugin : Produces a JSON file reporting mutation results aggregated by method and each method classfied according to its mutation status
[INFO] Found plugin : Generates an HTML document containing classes and methods with found testing issues
[INFO] Found plugin : Default csv report plugin
[INFO] Found plugin : Default xml report plugin
[INFO] Found plugin : Default html report plugin
[INFO] Found plugin : Removes mutation in methods which are of no interest
[INFO] Found plugin : Static initializer code detector plugin
[INFO] Found plugin : Static initializer filter plugin
[INFO] Found plugin : Excluded annotations plugin
[INFO] Found plugin : Inlined finally block filter plugin
[INFO] Found plugin : Try with resources filter
[INFO] Found plugin : Implicit null check filter
[INFO] Found plugin : For each loop filter
[INFO] Found plugin : Logging calls filter
[INFO] Found plugin : Infinite for loop filter
[INFO] Found plugin : Long running iterator loop filter
[INFO] Found plugin : For loop counter filter
[INFO] Found plugin : Kotlin junk mutations filter
[INFO] Found plugin : Max mutations per class limit
[INFO] Found plugin : Equals shortcut equivalent mutant filter
[INFO] Found plugin : Trivial return vals equivalence filter
[INFO] Found plugin : Mutant export plugin
[INFO] Found shared classpath plugin : Engine for extreme mutation operators
[INFO] Found shared classpath plugin : Default mutation engine
[INFO] Found shared classpath plugin : JUnit 5 test framework support
[INFO] Found shared classpath plugin : JUnit plugin
[INFO] Found shared classpath plugin : TestNG plugin
[INFO] Adding org.pitest:pitest-junit5-plugin to SUT classpath
[INFO] Adding eu.stamp-project:descartes to SUT classpath
[INFO] Adding org.pitest:pitest to SUT classpath
[INFO] Mutating from /Users/vmassol/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job/target/classes
[INFO] Defaulting target classes to match packages in build directory
9:43:41 AM PIT >> INFO : Verbose logging is disabled. If you encounter an problem please enable it before reporting an issue.
9:43:41 AM PIT >> INFO : MINION : objc[70102]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.8.0_131.jdk/Contents/Home/jre/bin/java (0x1032854c0) and /Library/Java/JavaVirtualMachines/jdk1.8.0_131.jdk/Contents/Home/jre/lib/libinstrument.dylib (0x10331
9:43:41 AM PIT >> INFO : MINION : 14e0). One of the two will be used. Which one is undefined.

9:43:41 AM PIT >> INFO : Sending 81 test classes to minion
9:43:41 AM PIT >> INFO : Sent tests to minion
9:43:41 AM PIT >> INFO : MINION : 9:43:41 AM PIT >> INFO : Checking environment

9:43:42 AM PIT >> INFO : MINION : 9:43:42 AM PIT >> INFO : Found  56 tests

9:43:42 AM PIT >> INFO : MINION : 9:43:42 AM PIT >> INFO : Dependency analysis reduced number of potential tests by 0
9:43:42 AM PIT >> INFO : 56 tests received

9:43:43 AM PIT >> INFO : MINION : 9:43:43 AM PIT >> WARNING : More threads at end of test (5) testGetJobStatusForUnexistingJob than start. (4)

9:43:43 AM PIT >> INFO : MINION : 9:43:43 AM PIT >> SEVERE : Description [testClass=org.xwiki.job.internal.DefaultJobStatusStoreTest, name=getJobStatusInOldPlace]
java.lang.AssertionError
    at org.junit.Assert.fail(Assert.java:86)
    at org.junit.Assert.assertTrue(Assert.java:41)
    at org.juni
9:43:43 AM PIT >> INFO : MINION : t.Assert.assertNotNull(Assert.java:712)
    at org.junit.Assert.assertNotNull(Assert.java:722)
    at org.xwiki.job.internal.DefaultJobStatusStoreTest.getJobStatusInOldPlace(DefaultJobStatusStoreTest.java:106)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Nat
9:43:43 AM PIT >> INFO : MINION : ive Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.junit.runne
9:43:43 AM PIT >> INFO : MINION : rs.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
    at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
    at org.jun
9:43:43 AM PIT >> INFO : MINION : it.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
    at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
    at org.xwiki.test.mockito.MockitoComponentMockingRule$1.evaluate(MockitoComponentMockingRule.java:
9:43:43 AM PIT >> INFO : MINION : 188)
    at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
    at org.junit
9:43:43 AM PIT >> INFO : MINION : .runners.ParentRunner$3.run(ParentRunner.java:290)
    at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
    at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
    at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
9:43:43 AM PIT >> INFO : MINION : 
    at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
    at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
    at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
    at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
    at org.junit.
9:43:43 AM PIT >> INFO : MINION : vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:39)
    at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
    at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
    at java.util.Iterator.forEach
9:43:43 AM PIT >> INFO : MINION : Remaining(Iterator.java:116)
    at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
    at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPip
9:43:43 AM PIT >> INFO : MINION : eline.java:471)
    at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
    at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
    at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:2
9:43:43 AM PIT >> INFO : MINION : 34)
    at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
    at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:79)
    at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:70)
    a
9:43:43 AM PIT >> INFO : MINION : t org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:170)
    at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:154)
    at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:90
9:43:43 AM PIT >> INFO : MINION : )
    at org.pitest.junit5.JUnit5TestUnit.execute(JUnit5TestUnit.java:88)
    at org.pitest.coverage.execute.CoverageDecorator.execute(CoverageDecorator.java:50)
    at org.pitest.testapi.execute.containers.UnContainer.execute(UnContainer.java:31)
    at org.pitest.te
9:43:43 AM PIT >> INFO : MINION : stapi.execute.Pitest.executeTests(Pitest.java:57)
    at org.pitest.testapi.execute.Pitest.run(Pitest.java:48)
    at org.pitest.coverage.execute.CoverageWorker.run(CoverageWorker.java:51)
    at org.pitest.coverage.execute.CoverageMinion.main(CoverageMinion.java:9
9:43:43 AM PIT >> INFO : MINION : 0)

9:43:43 AM PIT >> INFO : MINION : 9:43:43 AM PIT >> SEVERE : Description [testClass=org.xwiki.job.internal.DefaultJobStatusStoreTest, name=getJobStatusInWrongPlaceAndWithInvalidLogArgument]
java.lang.AssertionError
    at org.junit.Assert.fail(Assert.java:86)
    at org.junit.Assert.assertTrue(A
9:43:43 AM PIT >> INFO : MINION : ssert.java:41)
    at org.junit.Assert.assertNotNull(Assert.java:712)
    at org.junit.Assert.assertNotNull(Assert.java:722)
    at org.xwiki.job.internal.DefaultJobStatusStoreTest.getJobStatusInWrongPlaceAndWithInvalidLogArgument(DefaultJobStatusStoreTest.java:117
9:43:43 AM PIT >> INFO : MINION : )
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.refl
9:43:43 AM PIT >> INFO : MINION : ect.Method.invoke(Method.java:498)
    at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
    at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    at org.junit.runners.model.FrameworkMethod.
9:43:43 AM PIT >> INFO : MINION : invokeExplosively(FrameworkMethod.java:47)
    at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
    at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
    at org.xwiki.test.mockito.MockitoComponentMo
9:43:43 AM PIT >> INFO : MINION : ckingRule$1.evaluate(MockitoComponentMockingRule.java:188)
    at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
    at org.junit.runners.BlockJUnit4ClassRunner.
9:43:43 AM PIT >> INFO : MINION : runChild(BlockJUnit4ClassRunner.java:57)
    at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
    at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
    at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
    at org.junit
9:43:43 AM PIT >> INFO : MINION : .runners.ParentRunner.access$000(ParentRunner.java:58)
    at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
    at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
    at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
    at org.junit.r
9:43:43 AM PIT >> INFO : MINION : unner.JUnitCore.run(JUnitCore.java:115)
    at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:39)
    at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
    at java.util.stream.ReferencePipeline$3$1.accept(Refe
9:43:43 AM PIT >> INFO : MINION : rencePipeline.java:193)
    at java.util.Iterator.forEachRemaining(Iterator.java:116)
    at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
    at java.ut
9:43:43 AM PIT >> INFO : MINION : il.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
    at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
    at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
    at java.util.st
9:43:43 AM PIT >> INFO : MINION : ream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
    at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)
    at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:79)
    at org.junit.vintage.engine.V
9:43:43 AM PIT >> INFO : MINION : intageTestEngine.execute(VintageTestEngine.java:70)
    at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:170)
    at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:154)
    at org.junit.platform.launche
9:43:43 AM PIT >> INFO : MINION : r.core.DefaultLauncher.execute(DefaultLauncher.java:90)
    at org.pitest.junit5.JUnit5TestUnit.execute(JUnit5TestUnit.java:88)
    at org.pitest.coverage.execute.CoverageDecorator.execute(CoverageDecorator.java:50)
    at org.pitest.testapi.execute.containers.UnCo
9:43:43 AM PIT >> INFO : MINION : ntainer.execute(UnContainer.java:31)
    at org.pitest.testapi.execute.Pitest.executeTests(Pitest.java:57)
    at org.pitest.testapi.execute.Pitest.run(Pitest.java:48)
    at org.pitest.coverage.execute.CoverageWorker.run(CoverageWorker.java:51)
    at org.pitest.cove
9:43:43 AM PIT >> INFO : MINION : rage.execute.CoverageMinion.main(CoverageMinion.java:90)

9:43:43 AM PIT >> SEVERE : Description [testClass=org.xwiki.job.internal.DefaultJobStatusStoreTest, name=getJobStatusInOldPlace] did not pass without mutation.
9:43:43 AM PIT >> SEVERE : Description [testClass=org.xwiki.job.internal.DefaultJobStatusStoreTest, name=getJobStatusInWrongPlaceAndWithInvalidLogArgument] did not pass without mutation.
9:43:44 AM PIT >> INFO : Calculated coverage in 2 seconds.
|[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 22.949 s
[INFO] Finished at: 2018-05-28T09:43:44+02:00
[INFO] Final Memory: 54M/568M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.pitest:pitest-maven:1.4.0:mutationCoverage (pitest-check) on project xwiki-commons-job: Execution pitest-check of goal org.pitest:pitest-maven:1.4.0:mutationCoverage failed: All tests did not pass without mutation when calculating line coverage. Mutation testing requires a green suite.
[ERROR] See http://pitest.org for more details.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
vmassol ~/dev/xwiki/xwiki-commons/xwiki-commons-core/xwiki-commons-job (master *) $
oscarlvp commented 5 years ago

This works as of revision 91897b88ebcfdf3f073c8a2d3baaacf31379324b. Issue will be closed with the next release.

vmassol commented 5 years ago

Cool. Thanks Oscar!

vmassol commented 5 years ago

@oscarlvp any idea when the next release will be done? I'd like to modify the xwiki pom.xml to execute Descartes on xwiki-commons-job? Thx

oscarlvp commented 5 years ago

@vmassol it should be done by the end of the month. I'm fixing several issues before the release.

vmassol commented 5 years ago

Cool I see that Descartes 1.2.6 has been released 10 minutes ago. I guess it should arrive on https://search.maven.org/search?q=g:eu.stamp-project%20AND%20a:descartes&core=gav soon :)

vmassol commented 5 years ago

I retested and confirmed it works fine on commons-job. Thanks!