search

christophebe / serp

Google Search SERP Scraper
101 stars 23 forks source link

add page pagination for scrapping google search results #12

Closed cnscorpions closed 4 years ago

cnscorpions commented 4 years ago

Hi, thank you for creating a very awesome tool. And I'm inspired by your code. Why not add page pagination? It can be a very powerful feature. :)

christophebe commented 4 years ago

Hello,

Do you have some use cases for that ? Getting a SERP with 100 results is quite fast

cnscorpions commented 4 years ago

I'd like to conduct real-time scraping at over 1000 results for an API call from a web app. The estimated average concurrent users in the web app will be over 100.

cnscorpions commented 4 years ago

okay, easy to implement. so close it.