At the moment we only scraping data on the first page only because we do not place a lot of bets and most of them are resolved when the script runs overnight.
Moving forward we would like to run multiple cron jobs during the day and depending on the user's activity that might result in the list of Unsettled bets populating more than one page on the betting history. Therefore we will need to be able to switch between different pages.
Figure 1. A snapshot of the Betting History page showing links to multiple pages.
At the moment we only scraping data on the first page only because we do not place a lot of bets and most of them are resolved when the script runs overnight.
Moving forward we would like to run multiple cron jobs during the day and depending on the user's activity that might result in the list of Unsettled bets populating more than one page on the betting history. Therefore we will need to be able to switch between different pages.