cbanack / comic-vine-scraper

An add-on script for ComicRack that lets you copy details from Comic Vine into your comic books.
244 stars 47 forks source link

Allow continuation after ComicVine time out #404

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
When scraping a large amount of issues, if comicvine times out the scraper pops 
up a window and leaves you to pick up where it left off. I suggest an option to 
"Try to continue" or something like that, maybe with a countdown, so that large 
batches can be done without having to reselect the issues it skipped.

Original issue reported on code.google.com by Rurik...@gmail.com on 5 Feb 2015 at 10:31

GoogleCodeExporter commented 9 years ago
Hi, thanks for the suggestion.

The best way to deal with the timeout problem that you are seeing is to use the 
SCRAPE_DELAY feature, described here:

http://comicrack.cyolito.com/forum/32-news-and-announcements/33534-comic-vine-sc
raper?start=470#39770

That link also explains why I haven't already implemented the feature you are 
asking for.

Another useful tip is here:

http://comicrack.cyolito.com/forum/8-help/38668-solved-show-unscraped-files#4162
5

This should help you easily discover your currently unscraped comics, in case 
you do hit the timeout and your need to pick up where you left off.

Original comment by cban...@gmail.com on 5 Feb 2015 at 6:02