crawlab-team / crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
https://www.crawlab.cn
BSD 3-Clause "New" or "Revised" License
11.37k stars 1.79k forks source link

Crawlab Pro !Abnormal status on tasks #1388

Closed Voyewodayer closed 11 months ago

Voyewodayer commented 1 year ago

Describe the bug Certain tasks show !Abnormal status after running them for few hours but there aren't any errors shown either in task logs or in docker logs. Few hours later they tend to change to finished status even though they do not finish properly. Resource use for underlying node is in norm (less than 60% on every metric) and there aren't any availability issues.

To Reproduce Steps to reproduce the behavior:

  1. Schedule task
  2. Wait few hours
  3. !Abnormal status is being shown.
  4. Few hours later task shows finished status but it didn't finish correctly.

Expected behavior Task finishes with successful status or with error with proper logs

Screenshots obraz

tikazyq commented 1 year ago

Hi @Voyewodayer ,

Thanks for the feedback. The Abnormal status means the tasks were pending/running and somehow the server/node restarted so it's set as abnormal. You can check the docker logs to find out what happened to your master node.