Replace scrapy.Selector with parsel.Selector for better UX for HTML parsing

scrapfly / python-scrapfly

Scrapfly Python SDK for headless browsers and proxy rotation

https://scrapfly.io/docs/sdk/python

Other

28 stars 8 forks source link

Replace scrapy.Selector with parsel.Selector for better UX for HTML parsing #9

Closed Granitosaurus closed 10 months ago

Granitosaurus commented 10 months ago

Since Scrapy is using parsel anyways this patch allows to use ScrapeApiResponse.selector property by installing only parsel or scrapy. This approach skips a lot of heavy scrapy dependancies like twisted etc. for users who just need HTML parsing.