search

taganaka / polipus

Polipus: distributed and scalable web-crawler framework
MIT License
92 stars 32 forks source link

[WIP] HTTP compression handling #21

Closed taganaka closed 10 years ago

taganaka commented 10 years ago

This PR is going to fix the current broken implementation reported here: https://github.com/taganaka/polipus/issues/20

tmaier commented 10 years ago

Why do we need a new option for this? Let us simply do it...

taganaka commented 10 years ago

sounds good to me