For the upcoming release, we will model the data that goes into Kafka using Apache Avro. This will affect not the raw tweets that we pull from Twitter, but only the sanitized and enriched tweets that we push into separate topics. Model these messages using Apache Avro and integrate Avro as serialization strategy using a dedicated Codec implementation that can be used with the existing Kafka producers and consumers.
For the upcoming release, we will model the data that goes into Kafka using Apache Avro. This will affect not the raw tweets that we pull from Twitter, but only the sanitized and enriched tweets that we push into separate topics. Model these messages using Apache Avro and integrate Avro as serialization strategy using a dedicated Codec implementation that can be used with the existing Kafka producers and consumers.