search

samwize / python-email-crawler

Search on Google, and crawls for emails related to the result
292 stars 127 forks source link

Empty spaces in the URL can be rendered properly #12

Open corleonis opened 8 years ago

corleonis commented 8 years ago

I've example URL: http://www.website.com/Search/in/Alderley Edge and it failed to fetch the page even though it exists. I've got this as response:

[22:57:43] ERROR::email_crawler - Exception at url: http://www.website.com/Search/in/Alderley Edge HTTP Error 400: Bad Request

BeOleg commented 7 years ago

I guess you need to url encode the space to %20