KafkaSinkCluster: Support new consumer protocol

[rukai]

Kafka is introducing a new consumer group protocol, at the moment nothing uses it, but having now researched it its fairly straightforward to implement, so lets do so.

Details: https://cwiki.apache.org/confluence/display/KAFKA/KIP-848:+The+Next+Generation+of+the+Consumer+Rebalance+Protocol#KIP848:TheNextGenerationoftheConsumerRebalanceProtocol-ConsumerGroupHeartbeatAPI

But the TL;DR is just that there is a new message type ConsumerGroupHeartbeat that we need to route to the group coordinator.

To actually test the message type we need to set a broker config to enable this functionality as a kind of "early access", since we already have a kafka 3.9 specific test case, I added this config to the kakfa 3.9 test and added a specific test case to the 3.9 test, to test the new consumer protocol.

[codspeed-hq[bot]]

CodSpeed Performance Report

Merging #1825 will not alter performance

_{Comparing rukai:consumer_protocol (4f6169a) with main (229c9ce)}

Summary

✅ 38 untouched benchmarks