Enable Kafka transport to use partitioned Kafka topics. On the Rayvens side, Ray actor-wrapped Kafka Consumers need to be established to consume events from the different topic partitions. This allows Ray to scale down the number of Kafka Consumers to match demand. The Kafka Consumers will then forward the captured events to the list of subscribers to the Rayvens Stream.
doru1004
commented
2 years ago
Enable Kafka transport to use partitioned Kafka topics. On the Rayvens side, Ray actor-wrapped Kafka Consumers need to be established to consume events from the different topic partitions. This allows Ray to scale down the number of Kafka Consumers to match demand. The Kafka Consumers will then forward the captured events to the list of subscribers to the Rayvens Stream.