streamnative / kop

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
https://streamnative.io/docs/kop
Apache License 2.0
450 stars 137 forks source link

Flaky-test: MultiLedgerTest.testListOffsetForEmptyRolloverLedger #1542

Open Demogorgon314 opened 2 years ago

Demogorgon314 commented 2 years ago

MultiLedgerTest is flaky. The testListOffsetForEmptyRolloverLedger test method fails sporadically.

example failure

Error:  Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 20.967 s <<< FAILURE! - in io.streamnative.pulsar.handlers.kop.MultiLedgerTest
Error:  testListOffsetForEmptyRolloverLedger(io.streamnative.pulsar.handlers.kop.MultiLedgerTest)  Time elapsed: 3.974 s  <<< FAILURE!
org.awaitility.core.ConditionTimeoutException: Condition with io.streamnative.pulsar.handlers.kop.MultiLedgerTest was not fulfilled within 3 seconds.
    at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:165)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:78)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:26)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:895)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:864)
    at io.streamnative.pulsar.handlers.kop.MultiLedgerTest.testListOffsetForEmptyRolloverLedger(MultiLedgerTest.java:223)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:568)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
    at org.testng.internal.Invoker.invokeMethod(Invoker.java:583)
    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719)
    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989)
    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:[109](https://github.com/streamnative/kop/actions/runs/3289289774/jobs/5420643729#step:13:110))
    at org.testng.TestRunner.privateRun(TestRunner.java:648)
    at org.testng.TestRunner.run(TestRunner.java:505)
    at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)
    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)
    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)
    at org.testng.SuiteRunner.run(SuiteRunner.java:364)
    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)
    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208)
    at org.testng.TestNG.runSuitesLocally(TestNG.java:1137)
    at org.testng.TestNG.runSuites(TestNG.java:1049)
    at org.testng.TestNG.run(TestNG.java:1017)
    at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:135)
    at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeSingleClass(TestNGDirectoryTestSuite.java:[112](https://github.com/streamnative/kop/actions/runs/3289289774/jobs/5420643729#step:13:113))
    at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:99)
    at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:146)
    at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
    at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
    at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:[126](https://github.com/streamnative/kop/actions/runs/3289289774/jobs/5420643729#step:13:127))
    at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
Demogorgon314 commented 1 year ago

Another failure

Error:  Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 25.774 s <<< FAILURE! - in io.streamnative.pulsar.handlers.kop.MultiLedgerTest
Error:  testListOffsetForEmptyRolloverLedger(io.streamnative.pulsar.handlers.kop.MultiLedgerTest)  Time elapsed: 11.255 s  <<< FAILURE!
org.awaitility.core.ConditionTimeoutException: Condition with io.streamnative.pulsar.handlers.kop.MultiLedgerTest was not fulfilled within 10 seconds.
    at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:165)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:78)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:26)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:895)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:864)
    at io.streamnative.pulsar.handlers.kop.MultiLedgerTest.testListOffsetForEmptyRolloverLedger(MultiLedgerTest.java:223)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:568)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
    at org.testng.internal.Invoker.invokeMethod(Invoker.java:583)
    at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:719)
    at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:989)
    at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
    at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
    at org.testng.TestRunner.privateRun(TestRunner.java:648)
    at org.testng.TestRunner.run(TestRunner.java:505)
    at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)
    at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)
    at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)
    at org.testng.SuiteRunner.run(SuiteRunner.java:364)
    at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
    at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)
    at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208)
    at org.testng.TestNG.runSuitesLocally(TestNG.java:1137)
    at org.testng.TestNG.runSuites(TestNG.java:1049)
    at org.testng.TestNG.run(TestNG.java:1017)
    at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:135)
    at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeSingleClass(TestNGDirectoryTestSuite.java:112)
    at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:99)
    at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:146)
    at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
    at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
    at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
    at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
BewareMyPower commented 1 year ago

Another failure

Error:  testListOffsetForEmptyRolloverLedger(io.streamnative.pulsar.handlers.kop.MultiLedgerTest)  Time elapsed: 12.055 s  <<< FAILURE!
org.awaitility.core.ConditionTimeoutException: Condition with io.streamnative.pulsar.handlers.kop.MultiLedgerTest was not fulfilled within 10 seconds.
    at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:165)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:78)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:26)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:895)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:864)
    at io.streamnative.pulsar.handlers.kop.MultiLedgerTest.testListOffsetForEmptyRolloverLedger(MultiLedgerTest.java:223)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
    at 

From https://github.com/streamnative/kop/pull/1833

BewareMyPower commented 1 year ago

Another failure

Error:  testListOffsetForEmptyRolloverLedger(io.streamnative.pulsar.handlers.kop.e2e.MultiLedgerTest)  Time elapsed: 16.381 s  <<< FAILURE!
org.awaitility.core.ConditionTimeoutException: Condition with io.streamnative.pulsar.handlers.kop.e2e.MultiLedgerTest was not fulfilled within 15 seconds.
    at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:165)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:78)
    at org.awaitility.core.CallableCondition.await(CallableCondition.java:26)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:895)
    at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:864)
    at io.streamnative.pulsar.handlers.kop.e2e.MultiLedgerTest.testListOffsetForEmptyRolloverLedger(MultiLedgerTest.java:225)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:[77](https://github.com/streamnative/kop/actions/runs/5710941560/job/15471829345?pr=1979#step:8:78))
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:568)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:54)
    at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:44)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:[83](https://github.com/streamnative/kop/actions/runs/5710941560/job/15471829345?pr=1979#step:8:84)3)

From https://github.com/streamnative/kop/pull/1979