allow following uris with www

taganaka / polipus

Polipus: distributed and scalable web-crawler framework

MIT License

92 stars 32 forks source link

allow following uris with www #3

Closed hendricius closed 10 years ago

taganaka commented 10 years ago

I see the point. Here is what I implemented. So you can also specify multiple domains:

https://github.com/taganaka/polipus/pull/4

taganaka commented 10 years ago

Addressed by https://github.com/taganaka/polipus/pull/4

hendricius commented 10 years ago

kk nice. thanks!

On Fri, Dec 13, 2013 at 2:23 AM, Francesco Laurita <notifications@github.com

wrote:

Addressed by #4 https://github.com/taganaka/polipus/pull/4

— Reply to this email directly or view it on GitHubhttps://github.com/taganaka/polipus/pull/3#issuecomment-30479028 .