Investigate Files Compressed by the Server

PDX-Capstone-Team-C / scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

http://scrapy.org

BSD 3-Clause "New" or "Revised" License

0 stars 4 forks source link

Investigate Files Compressed by the Server #2

Closed mjsiegfried closed 8 years ago

mjsiegfried commented 8 years ago

Sometimes the response body is sent in compressed form when it is sent by the server. Investigate how the default storage backend handles this and note any issues it may cause for our implementation choices.