googleapis / google-cloud-java

Google Cloud Client Library for Java
https://cloud.google.com/java/docs/reference
Apache License 2.0
1.88k stars 1.06k forks source link

[Dialogflow] Flaky test - ITSystemTest.detectIntentTest, ITSystemTest:listContextsTest #10491

Open zhumin8 opened 4 months ago

zhumin8 commented 4 months ago

Test failed in GraalVM JDK 17 Nightly.

See below for the error message, and full log

Failures (2):
  JUnit Vintage:ITSystemTest:detectIntentTest
    MethodSource [className = 'com.google.cloud.dialogflow.v2.it.ITSystemTest', methodName = 'detectIntentTest', methodParameterTypes = '']
    => org.junit.ComparisonFailure: expected:<[test-event-4dd663d7-78b4-4d1c-9929-41a37329bfe0]> but was:<[]>
       org.junit.Assert.assertEquals(Assert.java:117)
       org.junit.Assert.assertEquals(Assert.java:146)
       com.google.cloud.dialogflow.v2.it.ITSystemTest.detectIntentTest(ITSystemTest.java:282)
       java.base@17.0.8/java.lang.reflect.Method.invoke([Method.java:568](https://cs.corp.google.com/#search/&sq=package:%5Epiper$%20project:openjdk21&q=java/lang/reflect/Method.java:568))
       org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
       org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
       org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
       [...]
  JUnit Vintage:ITSystemTest:listContextsTest
    MethodSource [className = 'com.google.cloud.dialogflow.v2.it.ITSystemTest', methodName = 'listContextsTest', methodParameterTypes = '']
    => org.junit.ComparisonFailure: expected:<...7cbd351578/contexts/[test-context-4df7c3ac]> but was:<...7cbd351578/contexts/[__system_counters__]>
       org.junit.Assert.assertEquals(Assert.java:117)
       org.junit.Assert.assertEquals(Assert.java:146)
       com.google.cloud.dialogflow.v2.it.ITSystemTest.listContextsTest(ITSystemTest.java:293)
       java.base@17.0.8/java.lang.reflect.Method.invoke([Method.java:568](https://cs.corp.google.com/#search/&sq=package:%5Epiper$%20project:openjdk21&q=java/lang/reflect/Method.java:568))
       org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
       org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
       org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
       [...]
diegomarquezp commented 4 months ago

It failed again for GraalVM 17 Nightly

See https://fusion2.corp.google.com/invocations/aea036df-fa1c-4cd6-95a4-fa7e5486c96e/targets/cloud-devrel%2Fclient-libraries%2Fjava%2Fgoogle-cloud-java%2Fnightly%2Fgraalvm-sub-jobs%2Fnative-17%2Fgraalvm-native-17-5;config=default/log