add user agent to FBRef webdriver

oseymour / ScraperFC

Python package for scraping soccer data from a variety of sources

GNU General Public License v3.0

222 stars 49 forks source link

add user agent to FBRef webdriver #6

Closed ojengwa closed 1 year ago

ojengwa commented 2 years ago

Noticed that FBRef stopped working because they've started blocking headless agents. This PR adds a standard User Agent to the chrome web driver configuration to bypass this.

hedonistrh commented 1 year ago

Hey @ojengwa, I tried that to address #7 actually but did not work out for me though. 🤔 Maybe I am missing something but just fyi.

oseymour commented 1 year ago

Hey @ojengwa! I'm so sorry I didn't see this PR sooner! I don't know how I missed it. I just pushed a new version with the same change you made, so I'm going to close this PR (again, sorry I missed this). Thank you for contributing and please send any other PR's you have! I promise I'll be better about checking them.

The whole FBRef module is having issues right now but I've been too busy to fix them. Fixes are coming in the next week or 2 though!