search

fdelbrayelle / generator-jhipster-kafka

A JHipster module that generates Apache Kafka consumers and producers and more!
Apache License 2.0
28 stars 10 forks source link

consumer: Manage poisonned data #28

Open fdelbrayelle opened 4 years ago

fdelbrayelle commented 4 years ago

The goal is to anticipate the consumption of poisonned data which could lead to an Exception, an logged error and to close the consumer without to know what is the poisonned data.

See: https://jonboulineau.me/blog/kafka/dealing-with-bad-records-in-kafka

fdelbrayelle commented 4 years ago

@pascalgrimaud Not reproduced because it's linked with Avro and schema registry that are not yet implemented in the module. It could be done in a near future (see #63).

Let's keep open the issue for this purpose.

fdelbrayelle commented 4 years ago

PR #65 will partially resolve this issue which should be kept opened to deal with the Avro case later.