suryakencana007 / comic-vine-scraper

Automatically exported from code.google.com/p/comic-vine-scraper
0 stars 0 forks source link

Modify behavior of scraper info dowload #126

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
Scrape only the data for selected issues if you enable the option, and the 
issues are numbered. IE, not having to download the data for 700 issues of 
batman to get the info for 6

Original issue reported on code.google.com by flamecsm...@gmail.com on 25 Aug 2010 at 4:20

GoogleCodeExporter commented 9 years ago
Thanks for the suggestion.

I'd make this change in an instant, if I could.  The problem is, the 
inefficiency you've pointed out is unavoidable until comicvine changes their 
API to let me query by issue number.  See:

http://www.comicvine.com/forums/bug-reporting/2/api-issue-numbers-queries-are-in
efficient/532378/

and:

http://www.comicvine.com/forums/api-developers/2334/will-you-continue-work-on-th
e-api/555182/#2

if you're curious.

FWIW, the scraper does cache the issue numbers for all 700 issues of batman (in 
your example), so at least the slow part only happens once.

Original comment by cban...@gmail.com on 25 Aug 2010 at 4:39