search

andrew-d / goscrape

Structured scraper for Go
25 stars 4 forks source link

Page limitation #6

Closed suntong closed 8 years ago

suntong commented 8 years ago

How to set page limitation?

Sometimes we don't want to scrap till that 99+ pages, but only the first few.

So it is nice to have page limitation defined when scraping.

Thanks

andrew-d commented 8 years ago

Hi there! You can set the MaxPages option in ScrapeOptions, like here.

suntong commented 8 years ago

embarrassed that's the only example that I haven't skim through. :( Thank!