linkedin / li-apache-kafka-clients

li-apache-kafka-clients is a wrapper library for the Apache Kafka vanilla clients. It provides additional features such as large message support and auditing to the Java producer and consumer in the open source Apache Kafka.
BSD 2-Clause "Simplified" License
131 stars 52 forks source link

use extended serde interface for sdc testing #171

Closed sudoa closed 4 years ago

sudoa commented 4 years ago

Compression/Decompression will be implemented by extending Extended{Serializer, Deserializer} interface and adding a delegate avro serializer/deserializer. So Serde with (de)compression will be passed in from "Linkedin bits" and used in the client. At produce time, we first serialize and then compress, at consume time, we first decompress then serialize.