suryakencana007 / comic-vine-scraper

Automatically exported from code.google.com/p/comic-vine-scraper
0 stars 0 forks source link

Cannot find Uncanny X-men #528 #149

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
DESCRIBE THE PROBLEM:
I am trying to scrape data for Uncanny X-Men #528. I see that the issue is 
definitely up in Comic Vine but once I do a scrape it does not show up in the 
list of available issues.

WHAT STEPS WILL REPRODUCE THIS PROBLEM? (Please include the exact name of
the eComic book that you were trying to scrape, if possible.)
1. Select issue documented under uncanny X-Men and #528
2. Search for Uncanny X-Men under the scraper list.
3. Select the series "The Uncanny X-Men" and it is not there. Looking on the 
site it is there.

WHAT VERSION OF COMICVINESCRAPER ARE YOU USING?

PLEASE PROVIDE ANY ADDITIONAL INFORMATION THAT MAY BE OF USE

Original issue reported on code.google.com by gilbert....@gmail.com on 14 Oct 2010 at 7:37

GoogleCodeExporter commented 9 years ago
Hmmm...could you try it again, and see if anything has changed?  I just tried 
scraping that comic, and Issue #528 showed up for me, no problem:

Here's what I did:

1. run the scraper on the issue #528
2. select "The Uncanny X-men" (1981, 388 issues)
   -if that search isn't available, click "Search Again" and search for "uncanny"
3. click "Show Issues", and scroll to the bottom of the list

It's possible that this issue was added very recently, so maybe it was visible 
on the website for a short time before it became visible to the scraper.

Also, you should make sure you are using the latest version of Comic Vine 
Scraper (1.0.32), as there was a bug in previous versions that would cause the 
Issues dialog to "lose" some issues now and then.

Let me know how it goes.

Original comment by cban...@gmail.com on 15 Oct 2010 at 3:33

GoogleCodeExporter commented 9 years ago
I can verify i had trouble adding this specific issue too. Same exact problem. 
I managed to scrape it by manually adding the CVDBXXXX with the right number 
pulled directly from the URL for the issue from comic vine.

Could it be something related to the series already being cached? Since this 
one had the problem with the count displayed not matching the number of issues 
avaible (ie, it shows 388 when more are available), perphaps the cache was 
messing this up?

Original comment by joaomigu...@gmail.com on 25 Oct 2010 at 5:13

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
@joaomiguelcorreia:

Sorry for taking so long to respond; somehow I missed the google e-mail 
notifying me about your response.   Yes, it is certainly possible that 
something is messed up in the cache, there were a number of changes to the way 
the cache operates in the latest scraper release.  The fact that this series 
had issues with the number of issues available makes it even more likely.

If you clear the data from that comic (including CVDB tag) and try to scrape it 
now, do you still get this problem?  If so, I can give you instructions on how 
to send me a copy of your (relevant) cache file, which would be a great help in 
tracking this bug down.

@gilbert.paul:  are you still seeing this bug?

Original comment by cban...@gmail.com on 2 Nov 2010 at 11:44

GoogleCodeExporter commented 9 years ago
I am totally having that problem still. It's even gotten to the point now where 
a new issue has appeared in the series and my issue 528 is still not in the 
list of Show issues. Anything I can do to look it up would be great.

Original comment by gilbert....@gmail.com on 3 Nov 2010 at 12:09

GoogleCodeExporter commented 9 years ago
@gilbert.paul:  just to be sure--you're definitely using the latest Comic Vine 
Scraper?  (i.e. version 1.0.32-- you can see the version number of Comic Vine 
Scraper in the title bar of the first window that appears when you run it.)   
There was a bug in the older versions of Comic Vine Scraper that caused the 
exact problem that you are seeing.

Original comment by cban...@gmail.com on 3 Nov 2010 at 2:01

GoogleCodeExporter commented 9 years ago
Anyhow, I'll assume both you guys are indeed using the latest version of CVS.  
In that case, can you (please!) send me a copy of your cache files so I can see 
what's wrong (it is very likely something to do with the caching.)

The file I need is called "3092.dat", or "3092.cache".   You may well have both 
files, in which case, send me both of them (there is an "attach a file" link 
here in the Google Code bug page that you can use to send them to me.)

If you are using Windows 7 or Windows Vista, you should be able to find the 
file(s) here:

C:\Users\<YOUR USER NAME>\AppData\Roaming\cYo\ComicRack\Scripts\Comic Vine 
Scraper\localCache\comicvine\30\

it might also show up here:

C:\Users\<YOUR USER NAME>\AppData\Roaming\cYo\ComicRack\Scripts\Comic Vine 
Scraper\localCache\comicvine\

or even here:

C:\Users\<YOUR USER NAME>\AppData\Roaming\cYo\ComicRack\Scripts\Comic Vine 
Scraper\localCache\

...depending on how long you've been using the software.

******************

If you send me those files, I should be able to figure out what's going wrong.

Meanwhile, if you want to fix the bug for yourself, here's 3 things you can do:

1) be sure you are using the latest Comic Vine Scraper.
2) if that doesn't work, DELETE those 3092.dat and 3092.cache files I mentioned.
3) if that doesn't work, add the tag "CVDB235335" to that comic book 
(joaomiguelcorreia's solution) using the Info dialog in ComicRack.

Thanks for your help guys.

Original comment by cban...@gmail.com on 3 Nov 2010 at 2:12

GoogleCodeExporter commented 9 years ago
First, sorry for the amazing time it took me to get back to you. I got no 
notification there was a reply here, even tho i had it checked.

Back on topic, yes, i have last version (just reinstalled it to be sure), and 
yes, i still have the problem if i remove the tags from the file and rescrape 
it. It only fetches the data if i manually set the tag with the right issue id. 

Attached is the file you asked for, hope it helps. Also, i'm pretty sure i've 
hit this with another file, which i solved the same way, but unfortunately i 
can't recall exactly what it was. As soon as i can, if i can, i'll post here.

Original comment by joaomigu...@gmail.com on 12 Nov 2010 at 2:09

Attachments:

GoogleCodeExporter commented 9 years ago
No worries, I had the same problem with google notifying me (see comment 5). :)

Hmm...now looking at the file you attached, it's in an obsolete cache file 
format--in other words, it was not created (nor is it read or used by) the 
latest version of the scraper.   It could be an old, unused cache file hanging 
around from a previous version of CVS.

Are you sure that there aren't any other 3092.dat or 3092.cache files at any of 
the other spots I mentioned in the localCache directory?  Or maybe you're doing 
something special (like storing ComicRack data locally) so the localCache 
directory that you are currently using is not in the "usual" spot?

I'm pretty sure that deleting your localCache directory entirely (or even just 
all the 3092.* files within it) will solve this problem for you, but I'd sure 
like to figure out what's causing it in the first place.   

Another option (assuming you're comfortable with me knowing what comic books 
series you've searched for) is you could just zip up your entire localCache 
directory and send the whole thing to me.  Then I could duplicate your running 
profile (and hopefully this bug).

Original comment by cban...@gmail.com on 12 Nov 2010 at 3:05

GoogleCodeExporter commented 9 years ago
Found another one at 
C:\Users\Administrator\AppData\Roaming\cYo\ComicRack\Scripts\Comic Vine 
Scraper\localCache\comicvine

Attached.

Original comment by joaomigu...@gmail.com on 14 Nov 2010 at 8:43

Attachments:

GoogleCodeExporter commented 9 years ago
[deleted comment]
GoogleCodeExporter commented 9 years ago
Perfect--that file is just what I needed!  I was able to duplicate the problem 
on my own computer, and I've now fixed it for the next release of the Scraper.

In the meantime, as I mentioned about, deleting the cache file(s) for the 
problem series will solve this issue if you encounter it again.  Or simply 
deleting your entire localCache directory should permanently get rid of the 
problem, since it is caused by a mishandling of old-format cache data.

Thanks again for reporting and helping me solve this bug.

Original comment by cban...@gmail.com on 15 Nov 2010 at 12:36