search

apache / pulsar

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org/
Apache License 2.0
14.13k stars 3.57k forks source link

Flaky-test: ReplicatorTest.testTopicReplicatedAndProducerCreate #11700

Closed lhotari closed 2 years ago

lhotari commented 3 years ago

ReplicatorTest is flaky. The testTopicReplicatedAndProducerCreate test method fails sporadically.

example failure

Error:  testTopicReplicatedAndProducerCreate(org.apache.pulsar.broker.service.ReplicatorTest)  Time elapsed: 34.34 s  <<< FAILURE!
org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:33811 after 30000 ms
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1074)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:33811 after 30000 ms
    at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
    at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:93)
    ... 13 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:33811 after 30000 ms
    at org.apache.pulsar.client.impl.HttpClient.lambda$get$1(HttpClient.java:204)
    at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859)
    at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837)
    at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
    at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
    at org.asynchttpclient.netty.NettyResponseFuture.abort(NettyResponseFuture.java:273)
    at org.asynchttpclient.netty.request.NettyRequestSender.abort(NettyRequestSender.java:473)
    at org.asynchttpclient.netty.timeout.TimeoutTimerTask.expire(TimeoutTimerTask.java:43)
    at org.asynchttpclient.netty.timeout.ReadTimeoutTimerTask.run(ReadTimeoutTimerTask.java:56)
    at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:669)
    at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:744)
    at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:469)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    ... 1 more
Caused by: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:33811 after 30000 ms
    ... 7 more
lhotari commented 2 years ago

Flaky-test: org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate Number of failures: 8

org.apache.pulsar.broker.service.ReplicatorTest is flaky. The testTopicReplicatedAndProducerCreate test method fails sporadically.

org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'4310156082089158516', 'remote':'localhost/127.0.0.1:39607', 'local':'/127.0.0.1:51742'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click. example failure 2021-10-25T01:15:32.2955001Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'4310156082089158516', 'remote':'localhost/127.0.0.1:39607', 'local':'/127.0.0.1:51742'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)


org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'3308556667308142110', 'remote':'localhost/127.0.0.1:38159', 'local':'/127.0.0.1:55610'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click. example failure 2021-10-25T03:45:36.8665312Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'3308556667308142110', 'remote':'localhost/127.0.0.1:38159', 'local':'/127.0.0.1:55610'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)


org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'211859161139307773', 'remote':'localhost/127.0.0.1:33061', 'local':'/127.0.0.1:46206'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click. example failure 2021-10-25T15:31:02.4416467Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'211859161139307773', 'remote':'localhost/127.0.0.1:33061', 'local':'/127.0.0.1:46206'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)


org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:32915 after 30000 ms
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1074)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click. example failure 2021-10-28T17:26:29.9970104Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:32915 after 30000 ms
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1074)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:32915 after 30000 ms
    at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
    at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:89)
    ... 13 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:32915 after 30000 ms
    at org.apache.pulsar.client.impl.HttpClient.lambda$get$1(HttpClient.java:204)
    at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859)
    at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837)
    at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
    at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
    at org.asynchttpclient.netty.NettyResponseFuture.abort(NettyResponseFuture.java:273)
    at org.asynchttpclient.netty.request.NettyRequestSender.abort(NettyRequestSender.java:473)
    at org.asynchttpclient.netty.timeout.TimeoutTimerTask.expire(TimeoutTimerTask.java:43)
    at org.asynchttpclient.netty.timeout.ReadTimeoutTimerTask.run(ReadTimeoutTimerTask.java:56)
    at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:669)
    at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:744)
    at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:469)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    ... 1 more
Caused by: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:32915 after 30000 ms
    ... 7 more


org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'3635007631584495181', 'remote':'localhost/127.0.0.1:43905', 'local':'/127.0.0.1:37422'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click. example failure 2021-10-26T01:28:25.9787405Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'3635007631584495181', 'remote':'localhost/127.0.0.1:43905', 'local':'/127.0.0.1:37422'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)


org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:46763 after 30000 ms
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1074)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click. example failure 2021-10-25T03:25:43.2761181Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:46763 after 30000 ms
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1074)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:46763 after 30000 ms
    at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
    at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:89)
    ... 13 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:46763 after 30000 ms
    at org.apache.pulsar.client.impl.HttpClient.lambda$get$1(HttpClient.java:204)
    at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859)
    at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837)
    at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
    at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
    at org.asynchttpclient.netty.NettyResponseFuture.abort(NettyResponseFuture.java:273)
    at org.asynchttpclient.netty.request.NettyRequestSender.abort(NettyRequestSender.java:473)
    at org.asynchttpclient.netty.timeout.TimeoutTimerTask.expire(TimeoutTimerTask.java:43)
    at org.asynchttpclient.netty.timeout.ReadTimeoutTimerTask.run(ReadTimeoutTimerTask.java:56)
    at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:669)
    at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:744)
    at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:469)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    ... 1 more
Caused by: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:46763 after 30000 ms
    ... 7 more


org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:36065 after 30000 ms
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1074)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click. example failure 2021-10-29T15:56:45.9148693Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:36065 after 30000 ms
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1074)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:36065 after 30000 ms
    at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395)
    at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:89)
    ... 13 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:36065 after 30000 ms
    at org.apache.pulsar.client.impl.HttpClient.lambda$get$1(HttpClient.java:204)
    at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859)
    at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:837)
    at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
    at java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088)
    at org.asynchttpclient.netty.NettyResponseFuture.abort(NettyResponseFuture.java:273)
    at org.asynchttpclient.netty.request.NettyRequestSender.abort(NettyRequestSender.java:473)
    at org.asynchttpclient.netty.timeout.TimeoutTimerTask.expire(TimeoutTimerTask.java:43)
    at org.asynchttpclient.netty.timeout.ReadTimeoutTimerTask.run(ReadTimeoutTimerTask.java:56)
    at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:669)
    at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:744)
    at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:469)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
    ... 1 more
Caused by: java.util.concurrent.TimeoutException: Read timeout to localhost/127.0.0.1:36065 after 30000 ms
    ... 7 more


org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'3966781303670930927', 'remote':'localhost/127.0.0.1:41625', 'local':'/127.0.0.1:53118'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click. example failure 2021-10-25T16:49:58.0173045Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$TimeoutException: request timeout {'durationMs': '30000', 'reqId':'3966781303670930927', 'remote':'localhost/127.0.0.1:41625', 'local':'/127.0.0.1:53118'}
    at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1008)
    at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:91)
    at org.apache.pulsar.broker.service.ReplicatorTest.testTopicReplicatedAndProducerCreate(ReplicatorTest.java:1102)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:566)
    at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
    at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
    at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
    at java.base/java.lang.Thread.run(Thread.java:829)
codelipenghui commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.