Blacklisted by Google News?

Iceloof / GoogleNews

Script for GoogleNews

https://pypi.org/project/GoogleNews/

MIT License

316 stars 88 forks source link

Blacklisted by Google News? #47

Closed gtangg12 closed 3 years ago

gtangg12 commented 3 years ago

I have a script that returns nothing, but my friend can scrape using the same script. I assume Google ip banned me? I only scraped like 200 article urls.

HurinHu commented 3 years ago

Are you able to get the result at first try? I assume your IP is blocked by Google, to avoid this, you can add some random delay between the requests.

gtangg12 commented 3 years ago

No, unfortunately. Apparently, Google sets limited requests from a IP per month/period of time or something. I was able to scrape using sitemap of the news site. Too lazy to look into changing ip etc...