search

geekcomputers / Python

My Python Examples
http://www.thegeekblog.co.uk
MIT License
30.53k stars 12.08k forks source link

Google search result scraper #522

Open MarvinKweyu opened 4 years ago

MarvinKweyu commented 4 years ago

I've noticed I can't seem to scrape the results anymore. On my debug console:

soup.select('.r a') = []

An empty list. Despite the fact the results are under the class .r with links in the a element. Anyone else having trouble?

MeNsaaH commented 4 years ago

Checkout https://github.com/bisoncorps/search-engine-parser. It provides easy to use API for scraping

MarvinKweyu commented 4 years ago

That's a really nice project you got :clap: :clap: :. Looking forward to some contribution