UCSCLibrary / dams_project_mgmt

DAMS purpose is to provide access to digitized and born-digital UCSC Special Collections content. This repository is used for project planning. It holds the task tickets and roadmap for the different projects under DAMS.
2 stars 0 forks source link

Fix ingest of jpegs & compressed TIFFs #186

Open NedHenry opened 4 years ago

NedHenry commented 4 years ago

Descriptive Summary

When ingesting JPEG files, as ingest server attempts to create JPEG2000 derivatives, the "kdu_compress" command (from kakadu) fails to execute correctly for compressed TIFFs and JPEGs. We need it to work correctly. The error message indicates that either we are still using the demo version instead of the compiled full version for this command, or that we are using the full version but need to recompile it with different settings.

Background

We recently implemented Kakadu and started creating JPEG2000 derivatives for each of our imported images, which vastly improved the speed of our IIIF image viewing experience. The Kakadu software is a third party extension that we now have a six month evaluation license for, and we are planning to purchase a long term license if we can negotiate favorable terms. I recently compiled and installed the full version of this software (I believe) and we have only tried one ingest since then. It is to be expected that there are a few hiccups when implementing a new software package like this. Most of our files are uncompressed TIFFs, and they already work fine in our current ingest workflow.

Acceptance Criteria

This is what done looks like

NedHenry commented 4 years ago

This is related to #150

NedHenry commented 4 years ago

We need to resolve this before ingesting any large new collections, especially the Aerial Photo collection (#168)

NedHenry commented 3 years ago

This remains an unresolved issue with the bulk ingest software, and should be included in the "bulk operations overhaul" epic if we create one. However, we have workarounds that would allow us to ingest image collections in the mean time, with some extra attention.