search

eksopl / fuuka

Fuuka Imageboard Archiver
http://code.google.com/p/fuuka/
Other
58 stars 7 forks source link

Strange parse errors in dumper #37

Closed voh closed 12 years ago

voh commented 12 years ago

Fairly frequently, the dumper will start outputting what appears to be the entire page or multiple pages of the board

http://pastebin.com/b43MtGuY -last section of the output, where the uninitialized values are

http://nyafuu.org/temp/dumper-error.txt -FULL log, everything, all the crap it throws out, pastebin wouldn't let me paste it so here's a .txt, if you care to have it (warning ,~4000 lines)

http://pastebin.com/SGxD2s4H This happened this time before the mass output, not sure if its related, the first line might just be my scrolling up in PuTTY which is what I used to catch the output.

eksopl commented 12 years ago

Can I see your panic.txt too?

voh commented 12 years ago

http://nyafuu.org/temp/panic.txt

eksopl commented 12 years ago

Oh jeez, it's 50 megs.

Might be easier if you just gzip it on the server or something.

voh commented 12 years ago

http://nyafuu.org/temp/panic.txt.gz (yeah no i think i broke something wile doing that, how do i make it compress right rather than give me lots of invalid encoding)

if that wasn't already obvious

oh and I forgot to mention, I can't exactly tell if it kills the dumper or not

eksopl commented 12 years ago

It won't kill the dumper. It's just the generic output the dumper gives when it can't parse threads. In your case, it seems to think that there's threads with two OP (usually a 4chan glitch).

It's also giving out some weird errors regarding "wide characters in print", but that probably has to do with your locale not being UTF-8 or something.

Anyway -- I'm checking now.

eksopl commented 12 years ago

I can't reproduce this, using the same HTML output that was logged in your files. Fuuka dumper parses that fine for me.

What version of fuuka are you running? Is it still doing this?

voh commented 12 years ago

As far as I know its the version just before the one on your repo, r142_2 if the included .sql files are anything to go by. That or 58f7105.

As for if its still doing it, I'll have to wait a while, it did this morning when I opened the issue.

I'll try updating again just in case.

voh commented 12 years ago

and again just now, using a git clone i downloaded an hour or so ago.

http://nyafuu.org/temp/panic2.txt

eksopl commented 12 years ago

I really can't seem to reproduce this with the output you're giving me. So strange.

I wonder what could be different in your setup.

voh commented 12 years ago

If you'd care to see any specifics, just tell me what and where. Don't be too surprised if its~, less than professional, this is a computer downstairs from me, not exactly a production server.

voh commented 12 years ago

Yeah nix that, re-installed server and found out the ribbon cable connected to my archive's drive had a piece missing from one of the wires, replaced it.

I'll close if I don't get any more problems within a day or so, and if I do I'll probably still close it as some mistake I keep making

eksopl commented 12 years ago

That leaves me even more confused, as I don't think a hardware problem could trigger that kind of error (you'd be getting Blue Screens or kernel panics instead). But reopen this if you get that kind of errors again.

voh commented 12 years ago

Oh I still get the errors, panic.txt is 4mb after having deleted it about 12 hours ago. I just closed issue as some mistake I keep making even after a brand-new install on my server, haven't a clue what I'm doing though, unless I'm not supposed to install perl modules using cpan or something.

and as for the faulty cable, it wasn't the cable connected to the drive linux was on, it was the one going to the drive where the archive directory is.

eksopl commented 12 years ago

Now that I think about it, it's probably related to something annoying, like Windows line endings or something.

What version of Perl are you using? Also, are you using an ActivePerl flavor, or something?

voh commented 12 years ago

No longer windows, just what ships with ubuntu server 11.10. If its anything to note, I did need to cpan install the modules the wiki mentions I should already have, but then I guess that doesn't account for a completely new installation.

GXTX commented 12 years ago

Isn't 10.04 still under LTS?

eksopl commented 12 years ago

Well, I rewrote enough stuff in Yotsuba.pm for the new HTML, so while I have no fucking idea of why this was happening to you, I'm 99% sure this won't be a problem again to you after the new HTML is rolled out.

If anything, you'll get a different error message. Please make a new issue if you get errors after the new HTML comes out.