Open chrishaensel opened 1 year ago
When the crawler gets an error response from the server (i.e. CF protection) which makes the whole crawl fail, display an error message. At the moment, it fails without any notice.
Will add a reason to the status bar at the bottom for why a crawl has finished. As well as surface the debug messages for adv. users.
When the crawler gets an error response from the server (i.e. CF protection) which makes the whole crawl fail, display an error message. At the moment, it fails without any notice.