search

Gerapy / GerapyPlaywright

Downloader Middleware to support Playwright in Scrapy & Gerapy
106 stars 24 forks source link

gzip.BadGzipFile: Not a gzipped file (b'<!') #13

Open legend-zl opened 2 years ago

legend-zl commented 2 years ago

使用Sscrapy的时候，利用

yield PlaywrightRequest(article_url, callback=self.parse_result, wait_until='domcontentloaded', headers=self.headers)

出现错误：gzip.BadGzipFile: Not a gzipped file (b'<!')

gdszps commented 2 years ago

metoo

wAnFen1017 commented 1 year ago

修改 downloadermiddlewares.py中的378行 headers=response.headers, 改为 headers=headers,

作者在380-382行已经修复了这个问题，但是居然没有引用处理后的headers