kaitz / paq8pxd

GNU General Public License v2.0
68 stars 7 forks source link

Compact Disc Images Are Corrupted When Extracted #19

Closed nopeynope60 closed 3 years ago

nopeynope60 commented 3 years ago

I'm attempting to preprocess (-s0) compact disc images stored in (BIN+CUE) or (BIN+GDI) formats and paq8pxd v104 is producing a corrupted output.

paq8px v205fix1 doesn't seem to have this problem so I've been using that for now, but I'm running into the file size limit of 2GiB which is too limiting for what I want to use it for.

I am running Windows 10 and using the provided binary here on the github.

As a side note, anything I extract always produces this message: "DeCompressing FileDisk: unable to open file (No such file or directory)"

dillfrescott commented 3 years ago

Hopefully kaitz comes out with a new version that addresses this issue you are having.

dillfrescott commented 3 years ago

@nopeynope60 You could optionally circumvent the 2 GB limit by breaking up the files using 7zip and compressing each piece. Given, I'm not sure how well it would compress being broken up like that...

nopeynope60 commented 3 years ago

I'm dealing with a lot of data repetition so the output needs to be wholly intact for deduplicating.

kaitz commented 3 years ago

How big is input file? I have no problems with CD images with (m2/f1), also mdf works fine. If block is larger then 2GB then it is limited to 2GB. https://github.com/kaitz/paq8pxd/blob/708c14924902777abb725d4d1aada2534dae9afa/paq8pxd.cpp#L21501

To make all detectable blocks larger then 2GB needs lot of work.

nopeynope60 commented 3 years ago

First Image: 750,643,152 Second Image: 1,185,760,800

Packed individually. Both end up corrupted.

I should really emphasize that I'm merely only using paq8pxd for its preprocessing (-s0) capabilities because it's offering me better compression when processing these images.

kaitz commented 3 years ago

Can you provide first file for downloading?

nopeynope60 commented 3 years ago

Disclaimer: I do not condone the downloading of the following because the legality is questionable and varies from country to country. I will edit/delete this once finished because I don't want to get banned for trying to report a bug because I don't have a better way of offering what I'm testing.

EDIT: REMOVED QUESTIONABLY LEGAL LINKS. PROBLEM FIXED. SEE BELOW

kaitz commented 3 years ago

Downloading, will report back in a week or so.

nopeynope60 commented 3 years ago

So I've been running this over and over like the insane person I am... and suddenly the second image is compressing and extracting correctly now. Last night when I was testing it I couldn't get it to compress and extract correctly and now it's fine. I don't know what to make of this. All I can suspect is that maybe my hardware hates me or something or maybe a sign that something is failing or just freak cosmic occurrences.

The first image, however, is still being corrupted.

Why have I been repeatedly testing this? Because I don't want to waste anyone's time here. I happen to appreciate the work that's gone into a tool like this.

EDIT: Tested on another system because I forgot to. First image still corrupted. Second image ended up being fine. When checksumming the corrupted image from both systems, they produced the same checksums so at least it's consistent.

kaitz commented 3 years ago

Fixed in: https://github.com/kaitz/paq8pxd/releases/tag/v105