A situation may arise when you need to view many pages on scholar, but in the middle of scholar it is banned for some time for automatic requests. The user may not be able to change the IP. But if it interrupts the execution of the script, it will not save any result. Even on those pages that have been processed. I added the ability to safely interrupt sending requests after a ban. And also I added the ability to specify a range of pages to download, so that you can continue to process pages from the one on which the ban was received.
This branch includes the changes that I posted in another pull request. #25 Please review the previous pull request first.
A situation may arise when you need to view many pages on scholar, but in the middle of scholar it is banned for some time for automatic requests. The user may not be able to change the IP. But if it interrupts the execution of the script, it will not save any result. Even on those pages that have been processed. I added the ability to safely interrupt sending requests after a ban. And also I added the ability to specify a range of pages to download, so that you can continue to process pages from the one on which the ban was received.
This branch includes the changes that I posted in another pull request. #25 Please review the previous pull request first.