flipp-oss / deimos

Framework to work with Kafka, Avro and ActiveRecord
Other
59 stars 22 forks source link

ActiveRecordConsumer to allow skipping messages based on condition #100

Closed etam-pro closed 3 years ago

etam-pro commented 3 years ago

ActiveRecordConsumer currently consumes everything from a topic. This could be devastating when handling large topics and you want to skip the processing of some of the messages that you don't care.

It would be great if we are allowed to override a predicate method e.g. process_payload? to allow conditionally skip some of the messages going through the consumer.

csingh commented 3 years ago

Feature has been added :)