GeneralMills / pytrends

Pseudo API for Google Trends
Other
3.28k stars 821 forks source link

Getting incomplete data requesting timeframe=all #551

Open RogerRendon opened 1 year ago

RogerRendon commented 1 year ago

So Im searching for a specific term and my request gets back with a data gap, while checking the data on the google website and donwloading data comes complete. Also when requesting data for the specific gap I get the correct data points.

` kw_list = ['Arbeitslosigkeit'] pytrends.build_payload(kw_list, cat=0, timeframe='2010-01-01 2012-12-25', geo='DE', gprop='')

pytrends.build_payload(kw_list, cat=0, timeframe='all', geo='DE', gprop='')

`

pic1 marcc

nicktba commented 1 year ago

I opened an issue already for this a few weeks ago. After doing some digging, it seems Google has changed their API and is now creating "holes" in the data for scraped info.

It is also happening on large keyword tools such as Keywords Everywhere

There is now a new user in the headers, one called 'USER_TYPE_LEGIT_USER' and the other 'USER_TYPE_SCRAPER' The scraper user has the "holes" while the legit user doesn't.

If anyone can figure out how to fix this PLEASE help. It has caused so many headaches.