search

abenassi / Google-Search-API

Python based api for searching google web, images, calc, and currency conversion.
552 stars 218 forks source link

Error accessing #26

Open GonLou opened 7 years ago

GonLou commented 7 years ago

Hi, Search works first times and after a while gives error accessing for all pages. Is there a limit? \ty

nikked commented 7 years ago

I have the same problem..

D0cRandom commented 7 years ago

Same problem here!

Harshilpatel134 commented 7 years ago

google ban your ip after multiple search from python.just use a vpn than try again it will work for around 100 search than again change your ip

hisenan commented 7 years ago

I faced the same problem. Can anyone please resolve this?

TianqiJiang commented 7 years ago

Same problem here. I am wondering what's the limit rule and how to solve it.

OsakaStarbux commented 7 years ago

Same here. I used a VPN and the problem went away. Suspect rate limiting. Is there a delay option? I found this web scraping reference useful. For example:

import time

for term in ["web scraping", "web crawling", "scrape this site"]:
    t0 = time.time()
    r = requests.get("http://example.com/search", params=dict(
        query=term
    ))
    response_delay = time.time() - t0
    time.sleep(10*response_delay)  # wait 10x longer than it took them to respond