crawlab-team / crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
https://www.crawlab.cn
BSD 3-Clause "New" or "Revised" License
11.37k stars 1.79k forks source link

crawlab-server 占用内存过高问题 #1437

Open mayuanyuan199625 opened 10 months ago

mayuanyuan199625 commented 10 months ago

Bug 描述 crawlab 长时间运行后 内存占用逐渐升高

复现步骤 该 Bug 复现步骤如下

期望结果 能把内存降下去

截屏

image image
Shinku-Chen commented 8 months ago
image
Shinku-Chen commented 8 months ago
image
Shinku-Chen commented 8 months ago
image