search

taganaka / polipus

Polipus: distributed and scalable web-crawler framework
MIT License
92 stars 32 forks source link

Propagate user_data values from redis message to fetched pages. #70

Closed stefanofontanelli closed 9 years ago