search

linkedin / li-apache-kafka-clients

li-apache-kafka-clients is a wrapper library for the Apache Kafka vanilla clients. It provides additional features such as large message support and auditing to the Java producer and consumer in the open source Apache Kafka.
BSD 2-Clause "Simplified" License
131 stars 52 forks source link

Introduce new version to process LM segments with record header #179

Closed bgeng7 closed 4 years ago

bgeng7 commented 4 years ago
  1. Introduce the new version mark, V3, is (byte)2;
  2. Add a new interface of MsgAssmbler which accpets record header as a parameter;
  3. Add validation check for LMHeaderValue which will check the version mark and if there is invalid values of its fields;
  4. Add a new constructor for LMSegment;
  5. Add compatibility test for checking if records from Producer without record header can be handled by Consumer with both record header and payload header support.