serpapi / public-roadmap

Public Roadmap for SerpApi, LLC (https://serpapi.com)
47 stars 3 forks source link

[Google Search API] Don't Show `next` and `next_link` on Last Page #857

Open schaferyan opened 1 year ago

schaferyan commented 1 year ago

A customer has requested that the next and next_link not be provided in the JSON for the final page of results.

Screenshot 2023-05-16 at 10 47 48 AM

Can we provide this? If we can do this, we can also omit the appropriate urls from other_pages.

I haven't found a consistent indication from Google when the last page is reached. For example, this is what the last and second to last pages in a search for "coffee have:

Screenshot 2023-05-16 at 10 44 20 AM Screenshot 2023-05-16 at 10 44 35 AM

Playground(last page) | Playground(second to last page) | Intercom | Search Inspector

schaferyan commented 1 year ago

Another customer requested this.

Intercom

zyc9012 commented 9 months ago

I didn't find a clear way to identify the last page for continuous-scrolling pagination pages. Posting my findings here:

The element that triggers the page to auto-fetch the next page when scrolled to the bottom is #botstuff [jsname='EvDH1d']

martin-serpapi commented 9 months ago

Another customer requested this.

Intercom