suryakencana007 / comic-vine-scraper

Automatically exported from code.google.com/p/comic-vine-scraper
0 stars 0 forks source link

Creator data not being populated. #110

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
DESCRIBE THE PROBLEM:
Not sure what is going on here. Basically some comics aren't pulling creator 
data. No idea why.
I was sorting my Comics and had the tags and web columns inside ComicRack 
ticked on, as well at Writer, Cover Artist etc; so I could quickly sort through 
and see which comics had been scrapped and had hooks to ComicVine, but didn't 
have their creators filled in.

I was doing this because I figured I'd fill them in myself as ComicVines site, 
but the first couple books I ended up checking, turned out the creator data was 
already on ComicVine, just not filled in on my comic.
So I rescrapped the books, nothing got pulled. Cleared the tags and notes and 
rescraped again, one at a one and picked the books from list one at a time, 
then checked the weblinks to make sure they were pointing to the right 
ComicVine entry. They all were, but still creator data wasn't getting pulled. I 
took at books whose data was getting pulled, and at the books whose data 
wasn't, and I don't really see an obvious reason for why one is working, and 
the other isn't.

WHAT STEPS WILL REPRODUCE THIS PROBLEM? (Please include the exact name of
the eComic book that you were trying to scrape, if possible.)
Here is two examples;
1.The Amazing Spider-Man Annual #34 - 
http://www.comicvine.com/the-amazing-spider-man-annual-passages/37-143313/

Creator data present in ComciVine entry, not being pulled by scraper.

2.The Amazing Spider-Man Annual #36 - 
http://www.comicvine.com/the-amazing-spider-man-annual-peter-parker-must-die/37-
163378/

Creator data present in ComicVine entry, being pulled by scraper with no issue

WHAT VERSION OF COMICVINESCRAPER ARE YOU USING?
1.0.24

Original issue reported on code.google.com by mr.carver on 14 Jun 2010 at 2:25

GoogleCodeExporter commented 9 years ago
Nevermind, caught it myself, creators are present, but not labeled correctly.
Think these are really old entires in CV that haven't been filled in right.

Original comment by mr.carver on 14 Jun 2010 at 2:37

GoogleCodeExporter commented 9 years ago
Issue 111 has been merged into this issue.

Original comment by cban...@gmail.com on 14 Jun 2010 at 3:56

GoogleCodeExporter commented 9 years ago
Ah yes, I see.  Good catch (and thanks for the bug report, even though it 
turned out to be a problem with ComicVine).

Looks like the creators' names are there for the comic you linked to (Amazing 
Spider-Man Annual 34), but their "roles"  (i.e. writer, artist, colorer, etc.) 
are not set for each creator, as you say.

You could easily add those roles in if you log into Comic Vine and edit the 
comics that are missing this data.  If you haven't edited a lot of Comic Vine 
comics before, you will need to wait a day or so for your changes to take 
effect, because one of the comic vine moderators has to approve everything.   
But you get "points" for each approved edit, and after you have enough points, 
you get to do your edits without moderation.

Original comment by cban...@gmail.com on 14 Jun 2010 at 4:02

GoogleCodeExporter commented 9 years ago
Yeah, I've been doing that now. Once the "roles" are filled in, the scrap works 
as intended. Explains why some issues have odd gaps. I think CV used to just 
have a generic system for creators and swapped over to this more refined role 
system later on. Noticed the same thing with their Plot section once. All these 
comics with undefined roles tend to be fairly old issues that do in fact have 
all the correct creators filled in, but don't have their roles filled in right.

Hoping cYo implements clickable hyperlinks in the web column view in an 
upcoming release to speed up the process of correcting these gaps.

Original comment by mr.carver on 14 Jun 2010 at 4:09

GoogleCodeExporter commented 9 years ago
re clickable hyperlinks:  I hear ya there.  :)

I think I saw someone already asked for that in the forums, too.

Original comment by cban...@gmail.com on 14 Jun 2010 at 4:16