pulibrary / figgy

Valkyrie-based digital repository backend.
Other
35 stars 4 forks source link

1890 Trenton Sanborns are missing. Re-Ingest & Ensure Figgy Uses existing ARKs #3650

Closed eliotjordan closed 4 years ago

eliotjordan commented 4 years ago

These were among the list of missing TIFFs when we ingested into Figgy. Patron is asking for them.

Solutions:

  1. Attempt to find the old JPEG2000 derivative images and ingest those.
  2. Re-photograph the atlas.
  3. Ingest JPEG2000s to start and them re-shoot the maps later.

The last solution seems best.

See 1890 here: https://library.princeton.edu/libraries/firestone/rbsc/aids/sanborn/mercer/trenton.html

escowles commented 4 years ago

@roelmoon We think re-photographing this is the best way forward, since otherwise we'd lose the full-resolution images. How much work are these to photograph?

tpendragon commented 4 years ago

@kelea99 I'm putting the PO review label on this, can you get a hold of @roelmoon?

kelea99 commented 4 years ago

yup, @tpendragon . standby.

roelmoon commented 4 years ago

Not hard to photograph. Looks like 42 maps?

kelea99 commented 4 years ago

@roelmoon remembers doing a bunch Sanborn about 10 years ago--tiffs--for John Delaney, who then handed them off to Wangyal for jp2 creation and ingest to GIS.

eliotjordan commented 4 years ago

@kelea99 @roelmoon We have the JP2s, but not the tiffs. Chances of finding the original images are pretty much nil at this point. So re-photographing is probably the best way to move forward.

kelea99 commented 4 years ago

thanks @eliotjordan! @roelmoon was going to have one last quick look on the isilon tonight/tomorrow, just to make sure the Delaney files are not still backed up in an old PUDL collection on it. If nil? then re-photographing should only take a day or so whenever back in the studio.

escowles commented 4 years ago

How much work would it be to ingest the JP2s? Given the uncertainty of when we'll be able to rephotograph these, it might make sense to do that if we really can't find the original TIFFs anywhere.

kelea99 commented 4 years ago

@eliotjordan : @roelmoon found tiff backups on the isilon for the GIS stuff (what they are, unknown...but there is a lot of them. thousands). In the PUDL share on the isilon: Its in Vol4_pudl_merged_rm. There are 2 subdirectories there for the GIS Archive (/Volumes/pudl/Vol4_pudl_merged_rm/gis
). we don't know what the numbers mean post PUmap_xxxx.? Is this what you are looking for? Also @escowles re: JP2 bulk ingest into figgy. Is this a question for us? in theory its doable but would figgy try to create jp2s from the jp2s because that's what it does?

eliotjordan commented 4 years ago

@kelea99 I did some digging around. Unfortunately, the images in /Volumes/pudl/Vol4_pudl_merged_rm/gis are just copies of images in another Isilon share. I think tracking down and ingesting the JPEG2000 derivatives is the only way to proceed in a timely manner. As far as I know, we don't have a way of ingesting JPEG2000 images directly as original files, but that is something we can work on.

kelea99 commented 4 years ago

@eliotjordan , alas and I'm so sorry it was a no-go with locating the tiffs. Would it faster for us to convert the jp2s to tiffs pre-ingest for this time, while you all work on the future of jp2 ingest? @roelmoon and/or I could do it, I'm sure?

kelea99 commented 4 years ago

Just a heads up, @eliotjordan : spoke with @roelmoon and conversion of JP2s to TIFFs for approx 40 files would take about an hour if he connects to one of the studio machines--if you put them somewhere where he can point one of the machines to it (PUDL share would be great).

eliotjordan commented 4 years ago

Completed. Images uploaded and links work.

https://maps.princeton.edu/catalog/princeton-7s75df087

tpendragon commented 4 years ago

Good work!

kelea99 commented 4 years ago

YAY!

hackartisan commented 4 years ago

yay!