fix(out_rdkafka2): fixed a bug where it is not respecting the Buffer sections' `chunk_limit_records` and `chunk_limit_size` options

fluent / fluent-plugin-kafka

Kafka input and output plugin for Fluentd

Other

303 stars 176 forks source link

fix(out_rdkafka2): fixed a bug where it is not respecting the Buffer sections' `chunk_limit_records` and `chunk_limit_size` options #466

Closed raytung closed 2 years ago

raytung commented 2 years ago

Fixes https://github.com/fluent/fluent-plugin-kafka/issues/462

Additionally, I just realised there's also a slight behavior change made in https://github.com/fluent/fluent-plugin-kafka/pull/454.

Prior to that commit, we were fetching Kafka topic related metadata only for the given topics, but that commit changes it such that the plugin fetches metadata for all topics. I don't think this will cause too much of an impact in production, but worth calling it out anyway.

raytung commented 2 years ago

Hey @ashie for sure interested, I'm happy to help out whenever I can! However, I can't promise to be super on top of everything due to life / work etc if that's okay.

ashie commented 2 years ago

I've Invited you. Please check e-mail.

Hey @ashie for sure interested, I'm happy to help out whenever I can! However, I can't promise to be super on top of everything due to life / work etc if that's okay.

Yeah of course it's O.K., we Fluentd maintenance team also continue to maintain it. Since our man-power isn't always enough to maintain all plugins, your contribution is very helpful for us! Thanks a lot for joining us!