Images: Broken: 2D43FFBFD51B4871FE65995A9D38C032

plazi / Biodiversity-Literature-Repository

covers the creating, maintenance and upload to the BLR

3 stars 0 forks source link

Images: Broken: 2D43FFBFD51B4871FE65995A9D38C032 #7

Open myrmoteras opened 6 years ago

myrmoteras commented 6 years ago

https://zenodo.org/record/270192#.Wbkdu6iCzAQ

2D43FFBFD51B4871FE65995A9D38C032

gsautter commented 6 years ago

Will check ... looks like a GGI issue to me, though, please close this one.

As a rule of thumb:

if a PDF or image is missing altogether in BLR, links are garbled, metadata wrong, etc., it belongs in this tracker, as it has to do with transferring the data to BLR rather than with decoding the original PDF
if images are mis-decoded, fonts are wrong, etc., it belongs in the GGI tracker, as it is a problem in the original PDF decoding process

gsautter commented 6 years ago

The good news is this: the latest build of GGI does properly decode these images:

Will have to figure out how this could go wrong ...

gsautter commented 6 years ago

Now this is one hell of an IMF ... 3.2 GB (as an IMD, i.e., uncompressed). With well north of 1,000 images, and more than half of these images north of 600 DPI.

A cornucopia of really great, high quality data, but also quite some stretch to our infrastructure. Took well over 10 minutes to decode, and taking up quite a bit of disk space. I can imagine it might drive Zenodo to the edge just the same, just for the sheer amount of data.

gsautter commented 6 years ago

The images come up just fine, though, most likely each and every one of them (I only sampled around, as more than 1,000 individual images are a bit too much to really go through one by one).

Hard to tell why the images on Zenodo ended up garbled ... I won't rule out a data volume issue altogether here ...

myrmoteras commented 6 years ago

can you upload them to BLR - or where to go from here to fix this problem? I have not clue

gsautter commented 6 years ago

I'll try and put this IMF on the server ... as stated above, it's some 3.2 GB in total - not sure the server will take that as well.

Let's just hope we don't get as many of these behemoths before we get more disk space ... the disk with the IMFs has only some 185 GB left.