pulibrary / figgy

Valkyrie-based digital repository backend.
Other
35 stars 4 forks source link

Ingest "Engineering in the Modern World" (pudl0090) #1609

Closed tpendragon closed 5 years ago

tpendragon commented 5 years ago

Notes: SHOULD WORK EXCEPT BAYONNE, which can't go up anyway.

@jpstroop @joycebcat What's "bayonne" and why can't it go up?

tpendragon commented 5 years ago

Files: https://drive.google.com/drive/u/0/folders/0B4Wo5hgOEFY3ZlZGUU5OS3FIbDA

joycebcat commented 5 years ago

@tpendragon I can't access the file you referenced, but "Bayonne" refers to plans for the Bayonne Bridge which we don't have permission to put up.

jpstroop commented 5 years ago

You'll see it there--bayonne.mets.

jpstroop commented 5 years ago

@joycebcat I granted you access to that folder, not that it's anything interesting--a bunch of tarballs containing METS similar to those we use to populate the PUDL.

tpendragon commented 5 years ago

http://pudl.princeton.edu/collections/pudl0090

hackartisan commented 5 years ago

Question: where should the bayonne images / mets go since they're not going into figgy? should they just be deleted?

hackartisan commented 5 years ago

There is an image in the drive for this collection that doesn't have a mets file:

$ ls /mnt/hydra_sources/pudl/pudl0090/
1380014  1433926  1741879  428041  bayonne
$ ls /mnt/hydra_sources/ingest_scratch/METS/pudl0090/
1380014.mets  1433926.mets  1741879.mets
tpendragon commented 5 years ago

@hackmastera There's only three in the PUDL collection, I'm guessing one got shot after we stopped ingesting items into PUDL. @joycebcat @jpstroop is that the case?

joycebcat commented 5 years ago

I don't know whether we need to keep (or should keep) the Bayonne images at all or not. As far as the one without a mets file goes, I think your guess is probably correct. These were initially treated as simple new additions until somebody alerted us to the background and then the usual workflow was stopped.

hackartisan commented 5 years ago

the one with no mets looks like it might be volumes 8-43 of this journal: https://catalog.princeton.edu/catalog/428041

$ ls /mnt/hydra_sources/pudl/pudl0090/428041/
008  010  012  014  016  018  020  022  024  026  028  030  032  034  036  038  040  042  044
009  011  013  015  017  019  021  023  025  027  029  031  033  035  037  039  041  043
deploy@figgy-staging1:/opt/figgy/current$ ls /mnt/hydra_sources/pudl/pudl0090/428041/008/
000000002.tif  000000039.tif  000000076.tif ...
joycebcat commented 5 years ago

Argh! It can't be issues 8-43 related to that bib record, because that bib only covers v. 70 onwards. I don't have any memory at all of this title or the titles it absorbed from the PUDL days. We didn't tend to put serials into PUDL anyway. I can't even guess what bib record they might really apply to without seeing the images.

hackartisan commented 5 years ago

Hm, it does look like that title, though. Here is one image 000000006

tpendragon commented 5 years ago

Maybe https://catalog.princeton.edu/catalog/2051096 ?

hackartisan commented 5 years ago

All ingested fine on staging except one of the objects wasn't added to the collection. not sure why; possibly because it's a multivolume work? there may be a bug in the code when it comes to MVWs. regardless, I can add it manually.

hackartisan commented 5 years ago

@jpstroop do we need to keep the bayonne mets / images? If so, where should they go?

joycebcat commented 5 years ago

@tpendragon Ah, yes, the image helps. You are quite right that this belongs to record 2051096. The other volumes probably do not belong to that record. It appears that this thing changed its name a lot. Volume 8 is from 1881, the record cover until 1882 and then it turns into record 2049799 until 1887 (up to probably issue 18) and then it turns into record 2045531 for volumes 19-49, so this should be the last record involved in this grouping.

hackartisan commented 5 years ago

These are ingested at https://figgy.princeton.edu/?f%5Bmember_of_collection_titles_ssim%5D%5B%5D=pudl0090

2 issues new issues for the loose ends here: https://github.com/pulibrary/figgy/issues/1719 https://github.com/pulibrary/figgy/issues/1718

jpstroop commented 5 years ago

Sorry, catching up. I think we should ingest Bayonne and just keep it private with a note.

On Wed, Aug 22, 2018, 8:27 PM hackmastera notifications@github.com wrote:

These are ingested at https://figgy.princeton.edu/?f%5Bmember_of_collection_titles_ssim%5D%5B%5D=pudl0090

2 issues new issues for the loose ends here:

1719 https://github.com/pulibrary/figgy/issues/1719

1718 https://github.com/pulibrary/figgy/issues/1718

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/pulibrary/figgy/issues/1609#issuecomment-415150046, or mute the thread https://github.com/notifications/unsubscribe-auth/AA9BFSPKXA2KH8oh_auzG4zYHJQlm2K4ks5uTbCFgaJpZM4VktpX .