Error: <twisted.python.failure.Failure builtins.OSError: Not a gzipped file (b'<!')>

[Ian4869]

@Germey 你好，当存在 middleware 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware': 时 使用PlaywrightRequest 会报题目所示错误

[Germey]

你好，可以提供下如下信息吗：

• 系统和版本
• Python 和版本
• Gerapy Playwright 的版本
• 你的具体操作说明

[Ian4869]

macOS Mojave 10.14.6 python 3.7.10 scrapy 2.5.1 Gerapy Playwright 0.2.0 测试网址 http://www.jggw.suzhou.gov.cn/

meta_info = {
    "origin_url": url,
    "job_id": self.job_id,
    "source": "",
    "AJAX": self.ajax,
    "depth": 0,
    "internal": True,
    "source_tag": "",
    "proxy_strategy": self.proxy_strategy
}

yield PlaywrightRequest(url, callback=self.parse_page, errback=self.proc_error, meta=meta_info)```

[zhutuo]

`

改成如下，可解决问题

            # Necessary to bypass the compression middleware (?)
            headers = response.headers
            headers.pop('content-encoding', None)
            headers.pop('Content-Encoding', None)
            response = HtmlResponse(
                page.url,
                status=response.status,
                headers=headers,
                body=content,
                encoding='utf-8',
                request=request
            )
            return response

`

[Germey]

@zhutuo 感谢，我修复一下

[Germey]

Fixed in 0.2.3, please have a try.