suryakencana007 / comic-vine-scraper

Automatically exported from code.google.com/p/comic-vine-scraper
0 stars 0 forks source link

Request: Cache scraping when looking up multiples #124

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
Awesome script. One request, would be nice if when looking up more than one 
book you could simply go through and identify each one without scraping the 
full data.  

Then, once all issues were identified the script could batch scrape all data.

This would allow people to (relatively) quickly go through and identify all 
issues and then leave the script running to take care of the details. If a flag 
was added for each success, then this would also allow the script to resume 
later if the connection to comic vine is lost.

Original issue reported on code.google.com by ChipCadd...@gmail.com on 17 Aug 2010 at 2:39

GoogleCodeExporter commented 9 years ago
Thanks for the suggestion; it's a good idea.

It's a tricky one to implement in the scraper's current architecture, though.  
Probably I would need to implement a separate background thread to do the 
actual scraping...so this will need to be filed under "long term plans".

Original comment by cban...@gmail.com on 17 Aug 2010 at 3:28

GoogleCodeExporter commented 9 years ago
No complaints here, thanks again for the great addition to comicrack!

Original comment by ChipCadd...@gmail.com on 17 Aug 2010 at 11:28

GoogleCodeExporter commented 9 years ago

Original comment by cban...@gmail.com on 24 Jan 2012 at 6:30