search

apache / pulsar

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org/
Apache License 2.0
13.95k stars 3.53k forks source link

Flaky-test: V1_ProxyAuthenticationTest.anonymousSocketTest #17933

Open lhotari opened 1 year ago

lhotari commented 1 year ago

Search before asking

Example failure

https://github.com/apache/pulsar/actions/runs/3184651648/jobs/5193461550#step:10:1372

Exception stacktrace

 Error:  Tests run: 16, Failures: 1, Errors: 0, Skipped: 15, Time elapsed: 64.371 s <<< FAILURE! - in org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest
  Error:  anonymousSocketTest(org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest)  Time elapsed: 2.403 s  <<< FAILURE!
  java.lang.AssertionError: lists don't have the same size expected [5] but found [10]
    at org.testng.Assert.fail(Assert.java:99)
    at org.testng.Assert.failNotEquals(Assert.java:1037)
    at org.testng.Assert.assertEqualsImpl(Assert.java:140)
    at org.testng.Assert.assertEquals(Assert.java:122)
    at org.testng.Assert.assertEquals(Assert.java:907)
    at org.testng.Assert.assertEquals(Assert.java:1089)
    at org.testng.Assert.assertEquals(Assert.java:1065)
    at org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest.socketTest(V1_ProxyAuthenticationTest.java:149)
    at org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest.anonymousSocketTest(V1_ProxyAuthenticationTest.java:159)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:568)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:833)

Are you willing to submit a PR?

shibd commented 1 year ago

another: https://github.com/apache/pulsar/actions/runs/3217598688/jobs/5262602494

shibd commented 1 year ago 
Error:  anonymousSocketTest(org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest)  Time elapsed: 10.691 s  <<< FAILURE!
  org.testng.internal.thread.ThreadTimeoutException: Method org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest.anonymousSocketTest() didn't finish within the time-out 10000
    at org.testng.internal.MethodInvocationHelper.invokeWithTimeoutWithNewExecutor(MethodInvocationHelper.java:371)
    at org.testng.internal.MethodInvocationHelper.invokeWithTimeout(MethodInvocationHelper.java:282)
    at org.testng.internal.TestInvoker.invokeMethod(TestInvoker.java:605)
    at org.testng.internal.TestInvoker.retryFailed(TestInvoker.java:214)
    at org.testng.internal.MethodRunner.runInSequence(MethodRunner.java:58)
    at org.testng.internal.TestInvoker$MethodInvocationAgent.invoke(TestInvoker.java:822)
    at org.testng.internal.TestInvoker.invokeTestMethods(TestInvoker.java:147)
    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:146)
    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:128)
    at java.base/java.util.ArrayList.forEach(ArrayList.java:1[511](https://github.com/apache/pulsar/actions/runs/3217598688/jobs/5262602494#step:10:512))
    at org.testng.TestRunner.privateRun(TestRunner.java:764)
    at org.testng.TestRunner.run(TestRunner.java:585)
    at org.testng.SuiteRunner.runTest(SuiteRunner.java:384)
    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:378)
    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:337)
    at org.testng.SuiteRunner.run(SuiteRunner.java:286)
    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:53)
    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:96)
    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1218)
    at org.testng.TestNG.runSuitesLocally(TestNG.java:1140)
    at org.testng.TestNG.runSuites(TestNG.java:1069)
    at org.testng.TestNG.run(TestNG.java:1037)
    at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:135)
    at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeSingleClass(TestNGDirectoryTestSuite.java:112)
    at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeLazy(TestNGDirectoryTestSuite.java:123)
    at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:90)
    at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:146)
    at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
    at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
    at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
    at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
lhotari commented 1 year ago

Reopening. Problem persists: https://github.com/apache/pulsar/actions/runs/3545605005/jobs/5953957450#step:10:719

  Error:  Tests run: 36, Failures: 1, Errors: 0, Skipped: 35, Time elapsed: 35.034 s <<< FAILURE! - in org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest
  Error:  anonymousSocketTest(org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest)  Time elapsed: 10.066 s  <<< FAILURE!
  org.testng.internal.thread.ThreadTimeoutException: Method org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest.anonymousSocketTest() didn't finish within the time-out 10000
    at java.base@17.0.5/java.lang.Thread.sleep(Native Method)
    at java.base@17.0.5/java.lang.Thread.sleep(Thread.java:337)
    at java.base@17.0.5/java.util.concurrent.TimeUnit.sleep(TimeUnit.java:446)
    at app//org.awaitility.core.Uninterruptibles.sleepUninterruptibly(Uninterruptibles.java:35)
    at app//org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:117)
    at app//org.awaitility.core.AssertionCondition.await(AssertionCondition.java:119)
    at app//org.awaitility.core.AssertionCondition.await(AssertionCondition.java:31)
    at app//org.awaitility.core.ConditionFactory.until(ConditionFactory.java:985)
    at app//org.awaitility.core.ConditionFactory.untilAsserted(ConditionFactory.java:769)
    at app//org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest.socketTest(V1_ProxyAuthenticationTest.java:134)
    at app//org.apache.pulsar.websocket.proxy.v1.V1_ProxyAuthenticationTest.anonymousSocketTest(V1_ProxyAuthenticationTest.java:147)
    at java.base@17.0.5/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base@17.0.5/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
    at java.base@17.0.5/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base@17.0.5/java.lang.reflect.Method.invoke(Method.java:568)
    at app//org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:139)
    at app//org.testng.internal.invokers.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:47)
    at app//org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:76)
    at app//org.testng.internal.invokers.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base@17.0.5/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base@17.0.5/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base@17.0.5/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base@17.0.5/java.lang.Thread.run(Thread.java:833)
lhotari commented 1 year ago

@nodece would you like to try to address this flaky test?

nodece commented 1 year ago

I tried to fix this test but still is a flaky test. Do you have any ideas?

github-actions[bot] commented 1 year ago

The issue had no activity for 30 days, mark with Stale label.