k2v-academy / K2View-Academy

Other
0 stars 0 forks source link

Boadway - Consuming Kafka Topic from external Interface #97

Closed ghost closed 4 years ago

ghost commented 4 years ago

Is it possible to use broadway to consume/subscribe to kafka topics from a external source using interfaces?

When trying to implement it, with the Broadway Kafka example and changing the interface from Memory to the interface and running the debugger, Broadway can't get the schema of the message and always shows it as empty array.

tZajFGR0CidT8AVERBHw8puD36HY6oWViykmIIb commented 4 years ago

Broadway supports Apache Kafka and JMS Queue / Topic by any JMS provider. Note that the message type to be processed by the Broadway Pub / Sub functionality must be aligned with the Data type defined on the Interface and is limited to: String, byte[], JSON, long. The message type of an in-memory broker is not limited to any specific types. Please refer to the KB Item Pub/Sub Actors for the full explanation about the Pub / Sub asynchronous message handling. The below flow example displays a JSON data type which is published to Kafka topic: image The message is: image