search

tasos-py / Search-Engines-Scraper

Search google, bing, yahoo, and other search engines with python
MIT License
511 stars 137 forks source link

google result has problem it can only give out single result #43

Closed braindevices closed 2 years ago

braindevices commented 2 years ago 
$ python3 search_engines_cli.py -e google -q 'search engines scraper' -p 1
Searching Google                                                                                                             

Google results                                                                                                               
1   https://en.wikipedia.org/wiki/Search_engine_scraping

The project googlesearch is able to yield correct result. So far it seems the only tool can correctly scrap the google search engine.

tasos-py commented 2 years ago

They made some small changes to their html structure, and we had to adjust our selectors. Thanks for bringing this to my attention