search

ispras / web-scraper-chrome-extension

Web data extraction tool implemented as chrome extension
GNU Lesser General Public License v3.0
214 stars 68 forks source link

Pagination on non-ajax sites #113

Closed koseduhemak closed 2 years ago

koseduhemak commented 2 years ago

Hi there!

I am struggling to create a pagination for a "next"-link (which changes the URL NOT using JavaScript to dynamically load new content). E.g. have a look at https://www.ader-paris.fr/en/catalog/121109?offset=0.

On the mentioned page I want to cycle through all pages (1-7) using the "Next" link and extract the data shown below.

Is something like this possible with this extension? I found no way how to do it...

Would be great if you can give me a hint how this can be achieved!

Thank you for your help!

Best wishes, koseduhemak

Yatskov commented 2 years ago

Yes it is possible. You can create selector next_page which links to the next_page. Then all extraction selectors should have this next_page also as the parent selector. And this next_page selector should have itself as the parent selector. You can read more abouth this in the docs.

koseduhemak commented 2 years ago

Thank you very much for the quick response - works as expected! Wasn't aware of the docs...