colinsurprenant
commented
4 years ago probably related to elastic/logstash#11603
Open vbohata opened 5 years ago
colinsurprenant
commented
4 years ago probably related to elastic/logstash#11603
In Logstash 6.4, kafka input plugin 8.2.0 sometimes if sync timeout occurs it just crashes the whole logstash. So the following error follows crash:
Exception in thread "Ruby-0-Thread-28: /opt/logstash/vendor/bundle/jruby/2.3.0/gems/logstash-input-kafka-8.2.0/lib/logstash/inputs/kafka.rb:242" Exception in thread "Ruby-0-Thread-35: /opt/logstash/vendor/bundle/jruby/2.3.0/gems/logstash-input-kafka-8.2.0/lib/logstash/inputs/kafka.rb:242" Exception in thread "Ruby-0-Thread-32: /opt/logstash/vendor/bundle/jruby/2.3.0/gems/logstash-input-kafka-8.2.0/lib/logstash/inputs/kafka.rb:242" org.apache.kafka.common.KafkaException: Unexpected error from SyncGroup: The request timed out. at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java:638) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java:611) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java:894) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java:874) at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(org/apache/kafka/clients/consumer/internals/RequestFuture.java:204) at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(org/apache/kafka/clients/consumer/internals/RequestFuture.java:167) at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(org/apache/kafka/clients/consumer/internals/RequestFuture.java:127) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(org/apache/kafka/clients/consumer/internals/ConsumerNetworkClient.java:586) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(org/apache/kafka/clients/consumer/internals/ConsumerNetworkClient.java:400)