crawlab-team / crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
https://www.crawlab.cn
BSD 3-Clause "New" or "Revised" License
11.38k stars 1.8k forks source link

Anomaly detection does not report errors #925

Closed palle-k closed 2 years ago

palle-k commented 3 years ago

Describe the bug
When running a task that completes with at least one error log output, the task is not marked as having any anomalies (as shown in the documentation) and an error_log_count of 0 is reported to web hooks.

The following messages have been logged:

Traceback (most recent call last):
ValueError: fake value error
2021-03-16 20:24:39 [root] ERROR this is some logged error message

The messages are highlighted in red and partially underlined in the task log shown on the Crawlab interface, indicating that they should have been detected as anomalies.

To Reproduce
Steps to reproduce the behavior:

  1. Create a spider that produces some error log messages
  2. Optional: Add a web hook to the spider
  3. Run the spider

Expected behavior
The task should be reported as having produced an anomaly.

Notes

tikazyq commented 3 years ago

It could be short issue thing. You can try longer tasks, just in case.