Azure Event Hubs Error: Disconnected while requesting ApiVersion

[craifiskerinc]

Description

We are trying to connect to azure eventhubs and we're seeing these ApiVersion errors. We're using broker version >1.0.0 and have tried a variety of properties including these:

How to reproduce

Connect to azure eventhubs with this library

Checklist

Please provide the following information:

• [X] confluent-kafka-go and librdkafka version (LibraryVersion()): tried 2.0.0,2.1.0,2.2.0,2.3.0
• [X] Apache Kafka broker version: > 1.0.0
• [X] Client configuration: ConfigMap{...} config.txt

  KAFKA_HOSTS: "xxx.servicebus.windows.net:9093"
  KAFKA_METADATA_BROKER_LIST: "xxx.servicebus.windows.net:9093"
  KAFKA_SECURITY_PROTOCOL: "sasl_ssl"
  KAFKA_SASL_MECHANISMS: "PLAIN"
  KAFKA_SSL_VERIFY: "false"
  KAFKA_PARTITION_ASSIGNMENT_STRATEGY: "cooperative-sticky"
  KAFKA_GO_BATCH_CONSUMER: "true"
  KAFKA_BATCH_NUM_MESSAGES: "50000"
  KAFKA_BATCH_SIZE: "1000000"
  KAFKA_LINGER_MS: "50"
  KAFKA_QUEUE_BUFFERING_MAX_MESSAGES: "10000000"
  KAFKA_QUEUE_BUFFERING_MAX_TYPE: "10000000"
  KAFKA_COMPRESSION_TYPE: none
  KAFKA_SOCKET_KEEPALIVE_ENABLE: "true"
  KAFKA_METADATA_MAX_AGE_MS: "180000"
  KAFKA_CONNECTIONS_MAX_IDLE_MS: "180000"
  KAFKA_MESSAGE_SEND_MAX_RETRIES: "2"
  KAFKA_COMPRESSION_CODEC: "none"
  KAFKA_HEARTBEAT_INTERVAL_MS: "3000"
  KAFKA_SESSION_TIMEOUT_MS: "30000"
  KAFKA_MAX_POLL_INTERVAL_MS: "300000"
  KAFKA_API_VERSION_REQUEST: "false"
  KAFKA_BROKER_VERSION_FALLBACK: "1.0.0"
  KAFKA_API_VERSION_FALLBACK_MS: "0"
  KAFKA_LOG_LEVEL: "3"

• [X] Operating system: linux
• [ ] Provide client logs (with "debug": ".." as necessary)
• [X] Provide broker log excerpts

  19:16:43 UTC | env:xxx,service:xxx
  %6|1708111002.798|FAIL|rdkafka#producer-1| [thrd:[xxx.servicebus.windows.net:9093/bootstrap](http://xxx.servicebus.windows.net:9093/bootstrap)]: [xxx.servicebus.windows.net:9093/bootstrap](http://xxx.servicebus.windows.net:9093/bootstrap): Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY, 4 identical error(s) suppressed)

• [ ] Critical issue

[rafi-fisker]

We are also seeing these errors

Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 1ms in state APIVERSION_QUERY, 4 identical error(s) suppressed)