crawlab-team / crawlab-sdk

SDK for Crawlab, including SDK for different programming languages such as Python, Node.js and Java, and a CLI Tool written in Python.
https://crawlab.cn
BSD 3-Clause "New" or "Revised" License
55 stars 50 forks source link

save_item 数据保存数据库,连接不释放问题 #27

Closed TigerShuai closed 1 year ago

TigerShuai commented 1 year ago

入库环境是:mysql; save_item 保存数据库,测试发现采集器即便采集结束,连接依然被占用,同时启动多个采集器,发现数据库就连接不上了,查询后,发现采集器连接未释放,显示Sleep 状态,单个采集器占用连接都是上千个,占用连接和采集的数据量可能存在关系,严重bug😢😢😢😢😢😢,我更换批量写入再次测试下,麻烦作者尽快回复哈