search

NikolaiT / GoogleScraper

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
https://scrapeulous.com/
Apache License 2.0
2.6k stars 734 forks source link

An updated working program example? #200

Open mlu-sfbayarea opened 6 years ago

mlu-sfbayarea commented 6 years ago

Hi there, is it possible to post an updated example using with Python scripts? current examples are giving some error messages. Thanks in advance!

sid6224 commented 6 years ago

Same issue. I try using the example of GoogleScraper from within python script,

I am using the config part as:

def basic_usage():

See in the config.cfg file for possible values

config = {
    'SCRAPING': {
        '192.168.8.101': 'True',
        'keyword': 'python courses',
        'search_engines': 'google',
        'num_pages_for_keyword': 1
    },
    'SELENIUM': {
        'sel_browser': 'chrome',
    },
    'GLOBAL': {
        'do_caching': 'False'
    }
}

192.168.8.101 is the DHCP address I get on my Windows machine from "ipconfig" output. But It yeids nothing. So I get an error saying:

image

I tried finding the config.cfg file to check if I'm putting the correct values, but I couldn't find it.