search

openzim / python-scraperlib

Collection of Python code to re-use across Python-based scrapers
GNU General Public License v3.0
18 stars 16 forks source link

Enable returning headers in download module #27

Closed satyamtg closed 4 years ago

satyamtg commented 4 years ago

We can make the download module better by allowing it to return headers if requested. This would allow us to solve https://github.com/openzim/openedx/pull/38#issuecomment-650333460

kelson42 commented 4 years ago

I believe this is necessary that we can easily - beside the data (and maybe other information) - get the mime-type of the HTTP response from the usptream remote backend.