search

20326 / scrapy-selenium

Do What The F*ck You Want To Public License
1 stars 0 forks source link

Need to change referrer #1

Open varna9000 opened 2 years ago

varna9000 commented 2 years ago

Hi, how can I pass to the driver a new referrer, as described here in selenium-wire example?

varna9000 commented 2 years ago

Managed to do it. Maybe this could be added as argument to SeleniumRequest class.

I had to add this function in middleware.py:

def interceptor(self,request):
        del request.headers['Referer']  # Remember to delete the header first
        request.headers['Referer'] = 'your new referrer'  # Spoof the referer

and add this at line 134 in middleware.py as well (before self.driver.get(request.url)):

self.driver.request_interceptor = self.interceptor