search

MA3STR0 / kimsufi-crawler

Crawler that will send you an email alert as soon as servers on OVH/Kimsufi become available for purchase
MIT License
194 stars 62 forks source link

Timing out #19

Closed ghost closed 9 years ago

ghost commented 9 years ago

Keep getting these 

2015-02-17 07:20:51,581 HTTP Error: HTTP 599: Timeout
2015-02-17 07:23:51,506 HTTP Error: HTTP 599: Timeout
2015-02-17 07:24:21,438 HTTP Error: HTTP 599: Timeout
2015-02-17 07:44:51,524 HTTP Error: HTTP 599: Timeout
2015-02-17 07:59:21,704 HTTP Error: HTTP 599: Timeout
2015-02-17 08:05:06,058 HTTP Error: HTTP 500: Internal Server Error
2015-02-17 08:06:51,498 HTTP Error: HTTP 599: Timeout
2015-02-17 11:28:04,438 HTTP Error: HTTP 500: Internal Server Error
2015-02-17 13:18:51,432 HTTP Error: HTTP 599: Timeout
2015-02-17 13:38:04,602 HTTP Error: HTTP 500: Internal Server Error
2015-02-17 17:24:03,527 HTTP Error: HTTP 500: Internal Server Error

Any idea why? It's never sending any emails

MA3STR0 commented 9 years ago

It looks like a connection error, maybe your network had issues. You can increase the timeout by adding following to the beginning of crawler.py:

import socket
socket.setdefaulttimeout(60)

Also, try to track some popular server (ie KS-3); it is available a couple of times every day, so you can check if email notifications work for you. Some others, like KS-1, are extremely rare.