search

manub / scalatest-embedded-kafka

A library that provides an in-memory Kafka instance to run your tests against.
MIT License
295 stars 87 forks source link

Wakeup timeouts in failing tests #73

Open ivanopagano opened 7 years ago

ivanopagano commented 7 years ago

Hi, not sure this is tied to the library or somehow to the client used for tests.

Our test suites fail quite regularly if we configure timeouts for our kafka consumer (which uses the akka-stream-kafka library) as follows:

  wakeup-timeout = 1s
  max-wakeups = 5

I have no stack-trace to provide, but the log errors are 

[ERROR][2017-04-07 10:12:52,819][akka.kafka.KafkaConsumerActor]WakeupException limit exceeded, stopping.
[ERROR][2017-04-07 10:12:52,820][akka.kafka.KafkaConsumerActor]WakeupException limit exceeded, stopping.
[ERROR][2017-04-07 10:12:52,820][akka.kafka.KafkaConsumerActor]WakeupException limit exceeded, stopping.
[ERROR][2017-04-07 10:12:52,820][akka.kafka.KafkaConsumerActor]WakeupException limit exceeded, stopping.
[ERROR][2017-04-07 10:12:52,820][akka.kafka.KafkaConsumerActor]WakeupException limit exceeded, stopping.
[ERROR][2017-04-07 10:12:53,911][akka.kafka.KafkaConsumerActor]WakeupException limit exceeded, stopping.

If somehow it comes out that the error is not related to the library, I'll escalate to the kafka-stream project.

manub commented 7 years ago

I had a similar problem with the wakeup-timeout using akka-kafka. Honestly I don't think this is library related but I'll have a look anyway.