search

samwize / python-email-crawler

Search on Google, and crawls for emails related to the result
292 stars 127 forks source link

Service Unavailable #15

Open sarment0 opened 7 years ago

sarment0 commented 7 years ago

[00:19:27] ERROR::email_crawler - Exception at url: http://www.google.com/search?q=something&start=0 HTTP Error 503: Service Unavailable [00:19:27] ERROR::email_crawler - EXCEPTION: expected string or buffer

kevingatera commented 7 years ago

This is now solved by reducing the number of queries from 500 to 150. It was due to the fact that the script was querying google too many times and hence it was getting blocked.