Remarks in regards to Kafka and Karafka

[mensfeld]

Hey, I found your repo and wanted to give you some hints:

• you use deprecated and no longer recommended producer: https://github.com/b0bd3v/kafka_vs_rabbitmq/blob/1ac2b507300b9f788ac0bb1d0be28be8e5b3ead6/producer_kafka/producer.rb#L5 - you can use https://github.com/karafka/waterdrop and produce_many_sync or async. That way messages can be effectively bulk inserted to Kafka.
• https://github.com/b0bd3v/kafka_vs_rabbitmq/blob/1ac2b507300b9f788ac0bb1d0be28be8e5b3ead6/consumer_kafka/consumer.rb - same here - this library (which I was contributor as well) is no longer recommended and has severe errors.
• https://github.com/b0bd3v/kafka_vs_rabbitmq/tree/1ac2b507300b9f788ac0bb1d0be28be8e5b3ead6/consumer_rails_karafka - karafka can work without rails for both consuming and producing. Waterdrop (karafka component) is a standalone producer

Efficient usage of Karafka is often about configuration for particular case. Especially if we are talking about utilizing Karafka parallel capabilities (multi-threaded) as well as batch dispatches. Ping me if you have any questions :)

[b0bd3v]

Hi @mensfeld

Thanks for your feedback and for introducing me to waterdrop. In the next update of the repository, I will apply your suggestions.