wkeeling / selenium-wire

Extends Selenium's Python bindings to give you the ability to inspect requests made by the browser.
MIT License
1.9k stars 251 forks source link

Missing responses #610

Open noackoli opened 1 year ago

noackoli commented 1 year ago

Hi, I'm currently implementing a web crawler using selenium-wire. To double-check the results I run it both with chromedriver and geckodriver. When I try to crawl the website www.chaoxing.com I get different results for chrome and firefox.

To be specific: Under chrome the get-request to http://www.chaoxing.com/video/srys.mp4 is sent but a response never arrives, while using firefox a '206 Partial Content' response arrives shortly after. (Firefox also does some firefox specific requests in the beginning which I think can be ignored)

Is this a bug or a misconfiguration on my behalf? (logs and code are attached) crawler.py.txt log.log