crawlab-team / crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
https://www.crawlab.cn
BSD 3-Clause "New" or "Revised" License
11.38k stars 1.8k forks source link

定时任务堆积(待定状态),但实际执行器中并没有满 #1333

Closed 2145579473 closed 1 year ago

2145579473 commented 1 year ago

定时任务开启多个时,任务会堆积,出现一大堆任务待定,但实际每个节点只执行了一到两个任务 1.开启多个定时任务

1687141061155

2.实际节点中执行器情况

6dc3dc027bd65ea4784e4295f9467ca

3.任务堆积,大量待定状态

6c32801627fccacaced3528a9dd8cac
tikazyq commented 1 year ago

是否可以上传一下docker日志?

tikazyq commented 1 year ago

Attempt to fix in https://github.com/crawlab-team/crawlab-core/commit/94f5d1d63c04ea30e86033dc2cc7a942206a1b1e

tikazyq commented 1 year ago

最新版本是否已经修复?