Open mikeshultz opened 9 years ago
There needs to be a way to signify document fetching errors and report them to the user. Whether that be user-agent/robot/scraper blocks, or bad URLs, the user should probably know about it so they can rectify it if possible.
There needs to be a way to signify document fetching errors and report them to the user. Whether that be user-agent/robot/scraper blocks, or bad URLs, the user should probably know about it so they can rectify it if possible.