Faster and easier overflow management

taganaka / polipus

Polipus: distributed and scalable web-crawler framework

MIT License

92 stars 32 forks source link

Faster and easier overflow management #39

Closed taganaka closed 10 years ago

taganaka commented 10 years ago

Overflow Management is now more reliable and the task can be distributed among different crawling jobs

coveralls commented 10 years ago

Coverage increased (+0.37%) when pulling 251329173ded9e45c526dcbcf3ee85c9f73a406a on faster_overflow into da3b927acb1b50c26276ed458da0a365c22fd98b on master.