search

GeminidSystems / GoogleNewsScraper

A Python package that scrapes Google News article data while remaining undetected by Google. Our scraper can scrape page data up until the last page and never trigger a CAPTCHA (download stats: https://pepy.tech/project/GoogleNewsScraper)
https://pypi.org/project/GoogleNewsScraper/
MIT License
11 stars 5 forks source link

Feature - Add support for ChromeDriverManager #3

Open karlgunst opened 3 years ago

karlgunst commented 3 years ago

@abnoviello23

Our scraper current allows for the caller to use their own driver or use the static driver

We want to replace the static driver to use ChromeDriverManager (see working in example/app.py)

The user must still be allowed to pass their own driver in as shown below

GoogleNewsScraper(my_driver)

If there is no driver passed in, we want to use ChromeDriverManager to install the latest version of the chrome driver

abnoviello23 commented 3 years ago

@karlgunst I just got the ChromeDriverManager working - it's actually a lot easier than trying to have the driver set up yourself!