Closed swapab closed 10 years ago
As you're probably aware, it looks like the link it's failing on is a zip archive, not an HTML page.
I think Upton probably should skip non-html pages by default; we can, I think, skip responses where "Content-Type" header is "application/zip" or any number of other non-html types. Do you think that makes sense as a way to deal with this, @swapnilabnave?
Renaming the issue.
Though to be honest, I can't reproduce the issue. It works fine for me with a stock copy of Upton.
You can try out the content-types branch and see if that works for you. That'll skip the .zip page on the basis of its content type.
Hey @swapnilabnave , have you had a chance to try this out again? I'd love to push a fix, if necessary.
Happy to reopen this, @swapnilabnave, if you get a chance to test out my fix. But since I can't replicate the error, I'm closing this for now.
Am trying to scrape all the links on a site. So for example I tried -
Then it gives encoding error on
Stack Trace