streamnative / pulsar-spark

Spark Connector to read and write with Pulsar
Apache License 2.0
113 stars 50 forks source link

close producer during cleanup #137

Closed nlu90 closed 1 year ago

nlu90 commented 1 year ago

Motivation

fix #136

Currently, producers will stay connected with a broker after each micro-batch, thus causing a broker-side producer spam issue and eventually affecting the broker's performance.

Modifications

call producer.close() when clean up

Verifying this change

(Please pick either of the following options)

Documentation

Check the box below.

Need to update docs?