CrawlUri instead of DataMessage in the Fetcher

retresco / Spyder

A Python web crawler using Tornado and ZeroMQ

http://retresco.github.com/Spyder/

Apache License 2.0

141 stars 19 forks source link

Open truemped opened 13 years ago

truemped commented 13 years ago

This is not bad, but it would be nice, if the fetcher would work on the CrawlUri and not the DataMessage. It's cleaner