serpapi / public-roadmap

Public Roadmap for SerpApi, LLC (https://serpapi.com)
56 stars 6 forks source link

[Google Maps Contributor Reviews API] Scrape number of contributor reviews from reviews page #2008

Open sonika-serpapi opened 1 month ago

sonika-serpapi commented 1 month ago

Currently we scrape the number of reviews from the contributor's profile which appears correctly in the response in the reviews field: Screenshot 2024-10-08 at 5 14 14 PM

Google also shows a different number of reviews on the contributor reviews page as seen below which we don't scrape currently: Screenshot 2024-10-08 at 5 15 15 PM

Public links: Playground Example 1 | Playground Example 2

hilmanski commented 1 month ago

Hi @sonika-serpapi It's probably not a bug as stated by Yicheng on the PR. It turns out these numbers are available upon clicking on the avatar.

sonika-serpapi commented 1 month ago

Thank you @hilmanski and @zyc9012. I'll mark this as a feature, edit the description, and change the priority to freezer for now until we get a request for it. I also do want to add - since our goal is to scrape the information for the contributor reviews page in this API, we should be scraping number of reviews from this page instead of from contributor's profile page. But this could be a technicality, and indeed we do not know which one is correct, and why there are 2 numbers on Google's end in the first place.