Currently we have a rather complex process to consume messages dynamically via the InlineConsumer. I recently discovered that the Kafka client can fetch messages directly via the fetch_messages API call. This can hugely simplify the implementation and also make it way faster (it can take several seconds right now because it actually starts and stops a consumer).
dorner
commented
3 months ago
Currently we have a rather complex process to consume messages dynamically via the InlineConsumer. I recently discovered that the Kafka client can fetch messages directly via the
fetch_messagesAPI call. This can hugely simplify the implementation and also make it way faster (it can take several seconds right now because it actually starts and stops a consumer).