Closed hotpeppeper closed 2 years ago
经测试在爬虫类里面自己实现_build_request方法,使用PlaywrightRequest替换掉原来的默认Request
def _build_request(self, rule_index, link):
logger.debug('build request via PlaywrightRequest')
return PlaywrightRequest(
url=link.url,
callback=self._callback,
errback=self._errback,
meta=dict(rule=rule_index, link_text=link.text),
)
请问一下gerapy_playwright怎样与CrawlSpider结合使用?谢谢。