NikolaiT / GoogleScraper

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
https://scrapeulous.com/
Apache License 2.0
2.63k stars 735 forks source link

Search quantity (this probably came up before, no hate pls) #225

Open bradib0y opened 5 years ago

bradib0y commented 5 years ago

Is there a realiable way to determine how many times people are searching for certain keywords? Is it possible in this project to create a new feature like that?

Please note the I'm aware of search quantity analysis being a highly demanded and hardly implemented feature of related software solutions. I intended to start a positive, open discussion, since I haven't found anything about this, neither in past issues, nor in documentation.

NikolaiT commented 5 years ago

As far as I know its not possible. Only the search engine providers do have the exact logs of the searches occurring.

I suspect you can infer the search quantities for certain keywords yourself with different methods and estimations, but you simply cannot know because you don't have the data the provider has.

bradib0y commented 5 years ago

If you are interested, there is a pretty dope chrome extension I use. It has been running under the name "Keyword Research Tool" or somelike that for a while, now it is renamed to "keywordkeg.com" if I'm getting it right. I highly doubt that it provides very accurate estimations but at least it does something.

This is certainly a fascinating topic, and it tells a lot about how Google is always playing the good boy of the industry and throwing away free stuff all the time, but at the same time keeping the most valuable data on planet Earth. The amount of intel you can get from keyword quantities is basically endless, from business, political, social, science, technology and all kinds of other perspectives.

bradib0y commented 5 years ago

Breaking: according to this website, Google actually releases this data through API.

"Only Google releases their search volume. Amazon, YouTube and other websites do not release this volume."

https://keywordseverywhere.com/frequently-asked-questions.html#WhatIsKeywordsEverywhere