NikolaiT / GoogleScraper

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
https://scrapeulous.com/
Apache License 2.0
2.64k stars 740 forks source link

Is it possible to also save the gray tagline in google search results? #69

Open helenaxwang opened 9 years ago

helenaxwang commented 9 years ago

For example, for the query "ippudo ramen new york", it returns a Yelp result with the title "Ippudo NY - East Village - New York, NY | Yelp". Currently you save the title, text snippet, and the link.

But on Google you also get a gray tagline/preview "Rating: 4 - ‎6,709 reviews - ‎Price range: $$" for this result, which is currently not saved.

Is it possible to save this?

NikolaiT commented 9 years ago

Nope not right now. Maybe I will add a feature in the coming days that allows user to specify arbitrary css-selectors (to target the data you want) such that you can also scrape gray tagline/preview.