search

streamnative / kop

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
https://streamnative.io/docs/kop
Apache License 2.0
450 stars 136 forks source link

Flaky-test: UpgradeTest.testConsumeLatest #1229

Open Demogorgon314 opened 2 years ago

Demogorgon314 commented 2 years ago

UpgradeTest is flaky. The testConsumeLatest test method fails sporadically.

example failure

Error:  testConsumeLatest(io.streamnative.pulsar.handlers.kop.UpgradeTest)  Time elapsed: 4.365 s  <<< FAILURE!
java.lang.AssertionError: lists don't have the same size expected [1] but found [0]
    at org.testng.Assert.fail(Assert.java:96)
    at org.testng.Assert.failNotEquals(Assert.java:776)
    at org.testng.Assert.assertEqualsImpl(Assert.java:137)
    at org.testng.Assert.assertEquals(Assert.java:118)
    at org.testng.Assert.assertEquals(Assert.java:652)
    at org.testng.Assert.assertEquals(Assert.java:819)
    at org.testng.Assert.assertEquals(Assert.java:796)
    at io.streamnative.pulsar.handlers.kop.UpgradeTest$TestTopic.testConsumeLatest(UpgradeTest.java:218)
    at io.streamnative.pulsar.handlers.kop.UpgradeTest.testConsumeLatest(UpgradeTest.java:103)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:54)
    at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:44)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:[266](https://github.com/streamnative/kop/runs/5858286648?check_suite_focus=true#step:5:266))
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:750)
Demogorgon314 commented 1 year ago

Another failure

Error:  Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 45.86 s <<< FAILURE! - in io.streamnative.pulsar.handlers.kop.UpgradeTest
Error:  testConsumeLatest(io.streamnative.pulsar.handlers.kop.UpgradeTest)  Time elapsed: 3.654 s  <<< FAILURE!
java.lang.AssertionError: lists don't have the same size expected [1] but found [0]
    at org.testng.Assert.fail(Assert.java:96)
    at org.testng.Assert.failNotEquals(Assert.java:776)
    at org.testng.Assert.assertEqualsImpl(Assert.java:137)
    at org.testng.Assert.assertEquals(Assert.java:118)
    at org.testng.Assert.assertEquals(Assert.java:652)
    at org.testng.Assert.assertEquals(Assert.java:819)
    at org.testng.Assert.assertEquals(Assert.java:796)
    at io.streamnative.pulsar.handlers.kop.UpgradeTest$TestTopic.testConsumeLatest(UpgradeTest.java:218)
    at io.streamnative.pulsar.handlers.kop.UpgradeTest.testConsumeLatest(UpgradeTest.java:103)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:568)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:54)
    at org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:44)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:[113](https://github.com/streamnative/kop/actions/runs/4353484350/jobs/7607582505#step:13:114)6)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:833)