I'm using selenium-stealth with Scrapy. While it helped to evade bot detection, the javascripts running on the page being crawled are not working anymore, e.g. asyn loading of certain data which we do need to fetch. Is there any way to isolate / specify which js code segments/libraries to disable?
I'm using selenium-stealth with Scrapy. While it helped to evade bot detection, the javascripts running on the page being crawled are not working anymore, e.g. asyn loading of certain data which we do need to fetch. Is there any way to isolate / specify which js code segments/libraries to disable?