search

pat310 / google-trends-api

An API layer on top of google trends
https://www.npmjs.com/package/google-trends-api
MIT License
874 stars 174 forks source link

Realtime trends limit #169

Open Paktas opened 1 year ago

Paktas commented 1 year ago

How come Realtime Trends is only returning 13 results? Desktop UI has Load More that can continue for at least few hundred entries.

Aassifh commented 1 year ago

@Paktas Google trends now detects scrapers and if you inspect the requests : you will see "userConfig": {"userType": "USER_TYPE_SCRAPER"} from scraping

Mustafa-Ellebody commented 1 year ago

Try using this API: https://rapidapi.com/odlica-odlica-default/api/trendly

fasani-tx commented 1 year ago

Can we modify the user-agent, I had a similar issue before with Twitter when scraping with puppeteer but if I fake the user agent it was fine. 

 // Twitter does not like puppeteer user agent ;-)
await page.setUserAgent(
  "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36"
);