Currently, producers will stay connected with a broker after each micro-batch, thus causing a broker-side producer spam issue and eventually affecting the broker's performance.
Modifications
call producer.close() when clean up
Verifying this change
[ ] Make sure that the change passes the CI checks.
(Please pick either of the following options)
[ ] This change is a trivial rework / code cleanup without any test coverage.
[ ] This change is already covered by existing tests, such as:
[ ] This change added tests and can be verified as follows:
Motivation
fix #136
Currently, producers will stay connected with a broker after each micro-batch, thus causing a broker-side producer spam issue and eventually affecting the broker's performance.
Modifications
call
producer.close()
when clean upVerifying this change
(Please pick either of the following options)
[ ] This change is a trivial rework / code cleanup without any test coverage.
[ ] This change is already covered by existing tests, such as:
[ ] This change added tests and can be verified as follows:
Documentation
Check the box below.
Need to update docs?
doc-required
no-need-doc
doc