Open sarment0 opened 7 years ago
[00:19:27] ERROR::email_crawler - Exception at url: http://www.google.com/search?q=something&start=0 HTTP Error 503: Service Unavailable [00:19:27] ERROR::email_crawler - EXCEPTION: expected string or buffer
This is now solved by reducing the number of queries from 500 to 150. It was due to the fact that the script was querying google too many times and hence it was getting blocked.
[00:19:27] ERROR::email_crawler - Exception at url: http://www.google.com/search?q=something&start=0 HTTP Error 503: Service Unavailable [00:19:27] ERROR::email_crawler - EXCEPTION: expected string or buffer