crawlab-team / crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
https://www.crawlab.cn
BSD 3-Clause "New" or "Revised" License
11.37k stars 1.79k forks source link

Clearing scraped data statistics after deleting task #1398

Open Voyewodayer opened 1 year ago

Voyewodayer commented 1 year ago

During development and testing of scrapers I often find myself deleting tasks for reasons such as them being faulty due to my code or some other issues. At the same time Crawlab keeps statistics of how much data was scraped despite me deleting the tasks in question.

In general I think it would be nice for scraped data stats and other task related statistics to be deleted once the task itself is deleted. That way I could easily monitor the real or the actually valuable to me state of my operations rather than statistic accumulating everything I've ever done no matter what which quickly makes it so the stat in question becomes useless.

Ehsan-U commented 5 months ago

Getting same issue