Closed myNameIsPatrick closed 4 years ago
For posterity - @myNameIsPatrick had logs that showed around 100ms RTT talking to the dev.hop.scimma.org brokers. Between opening a TCP connection, fetching a list of broker addresses from the bootstrap broker, opening a TLS connection, and doing an SSL handshake, there are a lot of roundtrips when first connecting to Kafka, adding up to around 2.0s-2.5s typically. But the Producer's timeout clock starts immediately, before the connection is established, so it was common for the first message to timeout without this change.
See title. There were issues using the 2s timeout since that also includes the time spent to initially connect to a broker, so this has been increased to 10s. Note that the default timeout if not set is 300s.
Ideally, there would be two separate timeouts:
but I didn't see anything more fine-grained in looking at the various librdkafka settings. Could've have easily missed the magic setting though.