C#.NET Confluent Kafka Error: Disconnected (after XYZms in state UP)

[ShaibalKantiShil]

Description

Application connects properly with the Kafka broker. But, sometimes, we get an error similar to: “Disconnected (after XYZms in state UP)” Once this error is thrown, the Kafka consumer stops polling Kafka. The error is not re-tried automatically.

How to reproduce

Unsure. This error happens randomly.

Checklist

Please provide the following information:

• [ ] A complete (i.e. we can run it), minimal program demonstrating the problem. No need to supply a project file.
• [X] Confluent.Kafka nuget version. Confluent.Kafka 2.3.0.0
• [X] Apache Kafka version. 3.3.1 on MSK
• [ ] Client configuration.
• [X] Operating system. Windows
• [x] Provide logs (with "debug" : "..." as necessary in configuration). NA
• [ ] Provide broker log excerpts.
• [ ] Critical issue. No

[anchitj]

Do you have any debug logs available?

[ShaibalKantiShil]

Hello @anchitj, please find the related redacted error log attached. 2024-03-14 - Redacted.txt

[christian-ber]

I believe we have the same issue. This happens after consumer is idle for a longer period.

Librdkafka: [thrd:app]: <redacted>#consumer-1: sasl_ssl://<broker-url>:9092/2: Disconnected (after 117130718ms in state UP) After this message is logged, no messages are consumed until the service is restarted.

We're using: Confluent.Kafka" Version="2.5.2"