Hook for before-next-page?

matthewmueller / x-ray

The next web scraper. See through the <html> noise.

MIT License

5.87k stars 349 forks source link

Hook for before-next-page? #172

Open ivawzh opened 8 years ago

ivawzh commented 8 years ago

I am using pagination to fetch a long list of pages. I am wondering if there is any way that I can save the obtained data from this page to database before I go to the next page. So that I don't need to spend a huge amount of memory to store the current data.