Sometimes the program will be blocked due to unknown reasons

VijayQin / DMHY-spider

This project aims at crawling on DMHY, and store the html and torrent of each animation in our local file systems and in database(SQLite3). The future work will be filtering animation we want by the given rules and alert us to those updated every day.

14 stars 2 forks source link

Sometimes the program will be blocked due to unknown reasons #8

Open VijayQin opened 8 years ago

VijayQin commented 8 years ago

Sometimes the program will be blocked due to unknown reasons. It seems like the connection is closed by the server while the program is waiting for data with no timeout limit.

VijayQin commented 8 years ago

while sometimes it will not be blocked with no changes in code.