meggnotec
commented
11 months ago I have the same issue. Any solutions?
Open Jonathan-Garcia1 opened 11 months ago
meggnotec
commented
11 months ago I have the same issue. Any solutions?
Jonathan-Garcia1
commented
10 months ago "I recently figured out what was causing the issue. It was because my Chrome browser version was too new, and there wasn't a compatible chromedriver available yet. In such cases you can either wait for the updated driver version to be available or like I did, I hard-coded a specific browser and driver path. I opted to install the Chrome Beta browser, which had a compatible driver version available. This lead me to rewrite the get_driver function entirely.
you can check out my project here, where I used a modified version of the scraper in combination with tor to scrape google maps.
I followed the readme including installing dependencies to new environment. when I try to run on terminal, i get the following error. I tried tracing it back, not familiar with chormedriver manager.
in the instructions I downloaded chromedriver and placed it in the root dir of the scraper just in case.
(google_maps_scrape) jg@J-MacBook-Pro googlemaps-scraper % python scraper.py --N 50 --i urls_1.txt Traceback (most recent call last): File "/Users/folder/googlemaps-scraper/scraper.py", line 43, in
with GoogleMapsScraper(debug=args.debug) as scraper:
File "/Users/folder/googlemaps-scraper/googlemaps.py", line 31, in init
self.driver = self.__get_driver()
File "/Users/folder/googlemaps-scraper/googlemaps.py", line 377, in __get_driver
input_driver = webdriver.Chrome(executable_path=ChromeDriverManager(log_level=0).install(), options=options)
File "/usr/local/anaconda3/envs/google_maps_scrape/lib/python3.10/site-packages/webdriver_manager/chrome.py", line 32, in install
driver_path = self._get_driver_path(self.driver)
File "/usr/local/anaconda3/envs/google_maps_scrape/lib/python3.10/site-packages/webdriver_manager/manager.py", line 23, in _get_driver_path
driver_version = driver.get_version()
File "/usr/local/anaconda3/envs/google_maps_scrape/lib/python3.10/site-packages/webdriver_manager/driver.py", line 41, in get_version
return self.get_latest_release_version()
File "/usr/local/anaconda3/envs/google_maps_scrape/lib/python3.10/site-packages/webdriver_manager/driver.py", line 74, in get_latest_release_version
validate_response(resp)
File "/usr/local/anaconda3/envs/google_maps_scrape/lib/python3.10/site-packages/webdriver_manager/utils.py", line 80, in validate_response
raise ValueError("There is no such driver by url {}".format(resp.url))
ValueError: There is no such driver by url https://chromedriver.storage.googleapis.com/LATEST_RELEASE_118.0.5993
(google_maps_scrape) jg@J-MacBook-Pro googlemaps-scraper %
pip list:
Package Version
appnope 0.1.3 asttokens 2.4.1 backcall 0.2.0 beautifulsoup4 4.6.0 certifi 2022.12.7 charset-normalizer 2.0.12 colorama 0.4.5 comm 0.1.4 configparser 5.2.0 crayons 0.4.0 debugpy 1.8.0 decorator 5.1.1 exceptiongroup 1.1.3 executing 2.0.0 idna 3.3 ipykernel 6.26.0 ipython 8.16.1 jedi 0.19.1 jupyter_client 8.5.0 jupyter_core 5.4.0 matplotlib-inline 0.1.6 nest-asyncio 1.5.8 numpy 1.23.0 packaging 23.2 pandas 1.4.3 parso 0.8.3 pexpect 4.8.0 pickleshare 0.7.5 pip 23.3 platformdirs 3.11.0 prompt-toolkit 3.0.39 psutil 5.9.6 ptyprocess 0.7.0 pure-eval 0.2.2 Pygments 2.16.1 pymongo 3.9.0 python-dateutil 2.8.2 python-dotenv 1.0.0 pytz 2022.1 pyzmq 25.1.1 requests 2.31.0 selenium 3.14.0 setuptools 68.0.0 six 1.16.0 stack-data 0.6.3 termcolor 1.1.0 tornado 6.3.3 traitlets 5.12.0 urllib3 2.0.7 wcwidth 0.2.8 webdriver-manager 3.5.2 wheel 0.41.2