During development and testing of scrapers I often find myself deleting tasks for reasons such as them being faulty due to my code or some other issues. At the same time Crawlab keeps statistics of how much data was scraped despite me deleting the tasks in question.
In general I think it would be nice for scraped data stats and other task related statistics to be deleted once the task itself is deleted. That way I could easily monitor the real or the actually valuable to me state of my operations rather than statistic accumulating everything I've ever done no matter what which quickly makes it so the stat in question becomes useless.
Ehsan-U
commented
4 months ago
During development and testing of scrapers I often find myself deleting tasks for reasons such as them being faulty due to my code or some other issues. At the same time Crawlab keeps statistics of how much data was scraped despite me deleting the tasks in question.
In general I think it would be nice for scraped data stats and other task related statistics to be deleted once the task itself is deleted. That way I could easily monitor the real or the actually valuable to me state of my operations rather than statistic accumulating everything I've ever done no matter what which quickly makes it so the stat in question becomes useless.