Closed ghost closed 2 years ago
This is doable, but without more extensive changes there will almost certainly be some repetition of urls when you restart. I consider this (that is, the duplicate urls) a fairly minor problem and am unlikely to prioritize fixing it, though if it is very bothersome to you I may be open to persuasion. As for missing urls, this usually happens when the sort order of the results changes while the downloader is running. In order to avoid urls being dropped because of sort order changes, I strongly recommend always sorting by date so that the order remains consistent.
Dev notes: use same logic as in main downloader to allow starting from the page you left off on. Dependent upon changes from #49
...