search

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
1.47k stars 24.88k forks source link

Test failures in the :client:rest gradle subproject do not include reproduction lines #69944

Open dakrone opened 3 years ago

dakrone commented 3 years ago

Here's an example of a forced failure:

$ ./gradlew :client:rest:check
...
> Task :client:rest:validateElasticPom UP-TO-DATE
> Task :client:rest:validatePom UP-TO-DATE
> Task :client:rest:precommit UP-TO-DATE

> Task :client:rest:test FAILED
WARNING: Illegal reflective access by org.mockito.cglib.core.ReflectUtils$2 (file:/home/hinmanm/.gradle/caches/modules-2/files-2.1/org.elasticsearch/securemock/1.2/98201d4ad5ac93f6b415ae9172d52b5e7cda490e/securemock-1.2.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)

org.elasticsearch.client.RestClientMultipleHostsIntegTests > testCancelAsyncRequests FAILED
    java.lang.AssertionError: thing
        at __randomizedtesting.SeedInfo.seed([47F1224188E0BBB4:FCDF1D3F5A384A38]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.elasticsearch.client.RestClientMultipleHostsIntegTests.testCancelAsyncRequests(RestClientMultipleHostsIntegTests.java:236)
WARNING: Illegal reflective access by org.mockito.cglib.core.ReflectUtils$2 (file:/home/hinmanm/.gradle/caches/modules-2/files-2.1/org.elasticsearch/securemock/1.2/98201d4ad5ac93f6b415ae9172d52b5e7cda490e/securemock-1.2.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)

Suite: Test class org.elasticsearch.client.RestClientMultipleHostsIntegTests
  2> java.lang.AssertionError: thing
        at __randomizedtesting.SeedInfo.seed([47F1224188E0BBB4:FCDF1D3F5A384A38]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.elasticsearch.client.RestClientMultipleHostsIntegTests.testCancelAsyncRequests(RestClientMultipleHostsIntegTests.java:236)
WARNING: Illegal reflective access by org.mockito.cglib.core.ReflectUtils$2 (file:/home/hinmanm/.gradle/caches/modules-2/files-2.1/org.elasticsearch/securemock/1.2/98201d4ad5ac93f6b415ae9172d52b5e7cda490e/securemock-1.2.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
WARNING: Illegal reflective access by org.mockito.cglib.core.ReflectUtils$2 (file:/home/hinmanm/.gradle/caches/modules-2/files-2.1/org.elasticsearch/securemock/1.2/98201d4ad5ac93f6b415ae9172d52b5e7cda490e/securemock-1.2.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)

Tests with failures:
 - org.elasticsearch.client.RestClientMultipleHostsIntegTests.testCancelAsyncRequests

91 tests completed, 1 failed

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':client:rest:test'.
> There were failing tests. See the report at: file:///home/hinmanm/es/elasticsearch/client/rest/build/reports/tests/test/index.html

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3s
28 actionable tasks: 2 executed, 26 up-to-date

However, there's no reproduction line. According to @mark-vieira this is because the tests do not inherit from ESTestCase. It would still be useful to have reproduction lines however.

elasticmachine commented 3 years ago

Pinging @elastic/es-delivery (Team:Delivery)