search

scrapy-plugins / scrapy-playwright

🎭 Playwright integration for Scrapy
BSD 3-Clause "New" or "Revised" License
911 stars 101 forks source link

scrapy-playwright connect to remote firefox instance #277

Open Ehsan-U opened 1 week ago

Ehsan-U commented 1 week ago

Currently, scrapy-playwright only supports Chromium for connecting to remote browser instances over CDP (Chrome DevTools Protocol). Firefox is quite effective in bypassing detections against some anti-bot measures. Is there any possibility to add support for connecting to remote Firefox instances? I understand that it's not possible over CDP, but Playwright provides a connect() method which allows connecting to remote Firefox instance. I have tried it with browserless platform, its working fine but scrapy-playwright only support connect_over_cdp() method at the moment.

elacuesta commented 1 week ago

Sounds like a good feature to have, thanks for the request.