aliyun / aliyun-log-python-sdk

Use python to manage, produce and consume data with Aliyun Log Service.
http://aliyun-log-python-sdk.readthedocs.io/
MIT License
167 stars 118 forks source link

fix dup consume on multiple workers #264

Closed crimson-gao closed 9 months ago

crimson-gao commented 1 year ago

There could be duplicated consumptions when there are multiple workers in the same consume group. The worker stops heartbeat first when shutting down, and then flush checkpoint. Other worker may acquire the outdated checkpoint and consume duplicated logs.