emory-libraries / dlp-curate

Digital curation and preservation workbench for the Emory Preservation Repository.
11 stars 4 forks source link

Run preprocessor on Office of Alumni Pubs photos boxes 8 and 9 csv #1624

Closed kmichaelis closed 3 years ago

kmichaelis commented 3 years ago

Please run the preprocessor on the csv for files in boxes 8 and 9 of the Office of Alumni Publications Photographs.

CSV file

This can be run in the Langmuir mode.

See the Langmuir notes in the Rake Tasks Tutorial.

When finished, please save the CSV in the FY21 processed folder.

bwatson78 commented 3 years ago

@kmichaelis Preprocessor is expecting metadata for this item:

{:metadata=>nil, :filesets=>{2=>#<CSV::Row "source_row":466 "deduplication_key":"EUA0179_B008_F002_I0034" "type":"fileset" "fileset_label":nil "preservation_master_file":"dmfiles/MARBL/Archives/EUA_0179_AlumniPubs/B008/F002/ARCH/EUA0179_B008_F002_I0034_P002_ARCH.tif" "intermediate_file":"dmfiles/MARBL/Archives/EUA_0179_AlumniPubs/B008/F002/PROD/EUA0179_B008_F002_I0034_P002_PROD.tif" "other_identifiers":nil "abstract":nil "administrative_unit":nil "local_call_number":nil "creator":nil "date_created":nil "Desc - Date Created - Date Precision":nil "date_issued":nil "content_genres":nil "holding_repository":nil "institution":nil "publisher":nil "emory_rights_statements":nil "rights_statement":nil "subject_names":nil "subject_geo":nil "keywords":nil "subject_topics":nil "title":nil "content_type":nil "data_classifications":nil "Ingest.workflow_notes":nil "Digital Object - Parent Identifier":nil "visibility":nil "Directory Path":nil "File Size":nil "Filename":nil "Path":nil "Ingest.workflow_rights_basis":nil "Ingest.workflow_rights_basis_date":nil "Accession.workflow_rights_basis":nil "Accession.workflow_rights_basis_date":nil "Accession.workflow_rights_basis_reviewer":nil "Accession.workflow_rights_basis_note":nil "sensitive_material":nil "extent":nil "sublocation":nil "source_collection_id":nil>}}
kmichaelis commented 3 years ago

@bwatson78 I can't tell what's wrong with the metadata for that work so I removed it and reuploaded the csv. Let me know if you have any other issues.

bwatson78 commented 3 years ago

@kmichaelis Same issue as above, but now at this item:

{:metadata=>nil, :filesets=>{2=>#<CSV::Row "source_row":818 "deduplication_key":"EUA0179_B008_F003_I0053" "type":"fileset" "fileset_label":nil "preservation_master_file":"dmfiles/MARBL/Archives/EUA_0179_AlumniPubs/B008/F003/ARCH/EUA0179_B008_F003_I0053_P002_ARCH.tif" "intermediate_file":"dmfiles/MARBL/Archives/EUA_0179_AlumniPubs/B008/F003/PROD/EUA0179_B008_F003_I0053_P002_PROD.tif" "other_identifiers":nil "abstract":nil "administrative_unit":nil "local_call_number":nil "creator":nil "date_created":nil "Desc - Date Created - Date Precision":nil "date_issued":nil "content_genres":nil "holding_repository":nil "institution":nil "publisher":nil "emory_rights_statements":nil "rights_statement":nil "subject_names":nil "subject_geo":nil "keywords":nil "subject_topics":nil "title":nil "content_type":nil "data_classifications":nil "Ingest.workflow_notes":nil "Digital Object - Parent Identifier":nil "visibility":nil "Directory Path":nil "File Size":nil "Filename":nil "Path":nil "Ingest.workflow_rights_basis":nil "Ingest.workflow_rights_basis_date":nil "Accession.workflow_rights_basis":nil "Accession.workflow_rights_basis_date":nil "Accession.workflow_rights_basis_reviewer":nil "Accession.workflow_rights_basis_note":nil "sensitive_material":nil "extent":nil "sublocation":nil "source_collection_id":nil>}}
kmichaelis commented 3 years ago

@bwatson78 edited and reuploaded csv

bwatson78 commented 3 years ago

@kmichaelis Same issue as above, but now at this item:

{:metadata=>nil, :filesets=>{2=>#<CSV::Row "source_row":2428 "deduplication_key":"EUA0179_B008_F007_I0068" "type":"fileset" "fileset_label":nil "preservation_master_file":"dmfiles/MARBL/Archives/EUA_0179_AlumniPubs/B008/F007/ARCH/EUA0179_B008_F007_I0068_P002_ARCH.tif" "intermediate_file":"dmfiles/MARBL/Archives/EUA_0179_AlumniPubs/B008/F007/PROD/EUA0179_B008_F007_I0068_P002_PROD.tif" "other_identifiers":nil "abstract":nil "administrative_unit":nil "local_call_number":nil "creator":nil "date_created":nil "Desc - Date Created - Date Precision":nil "date_issued":nil "content_genres":nil "holding_repository":nil "institution":nil "publisher":nil "emory_rights_statements":nil "rights_statement":nil "subject_names":nil "subject_geo":nil "keywords":nil "subject_topics":nil "title":nil "content_type":nil "data_classifications":nil "Ingest.workflow_notes":nil "Digital Object - Parent Identifier":nil "visibility":nil "Directory Path":nil "File Size":nil "Filename":nil "Path":nil "Ingest.workflow_rights_basis":nil "Ingest.workflow_rights_basis_date":nil "Accession.workflow_rights_basis":nil "Accession.workflow_rights_basis_date":nil "Accession.workflow_rights_basis_reviewer":nil "Accession.workflow_rights_basis_note":nil "sensitive_material":nil "extent":nil "sublocation":nil "source_collection_id":nil>}}
kmichaelis commented 3 years ago

@bwatson78 edited and reuploaded csv

bwatson78 commented 3 years ago

@kmichaelis Same issue as above, but now at this item:

{:metadata=>nil, :filesets=>{2=>#<CSV::Row "source_row":3586 "deduplication_key":"EUA0179_B009_F004_I0003" "type":"fileset" "fileset_label":nil "preservation_master_file":"dmfiles/MARBL/Archives/EUA_0179_AlumniPubs/B009/F004/ARCH/EUA0179_B009_F004_I0003_P002_ARCH.tif" "intermediate_file":"dmfiles/MARBL/Archives/EUA_0179_AlumniPubs/B009/F004/PROD/EUA0179_B009_F004_I0003_P002_PROD.tif" "other_identifiers":nil "abstract":nil "administrative_unit":nil "local_call_number":nil "creator":nil "date_created":nil "Desc - Date Created - Date Precision":nil "date_issued":nil "content_genres":nil "holding_repository":nil "institution":nil "publisher":nil "emory_rights_statements":nil "rights_statement":nil "subject_names":nil "subject_geo":nil "keywords":nil "subject_topics":nil "title":nil "content_type":nil "data_classifications":nil "Ingest.workflow_notes":nil "Digital Object - Parent Identifier":nil "visibility":nil "Directory Path":nil "File Size":nil "Filename":nil "Path":nil "Ingest.workflow_rights_basis":nil "Ingest.workflow_rights_basis_date":nil "Accession.workflow_rights_basis":nil "Accession.workflow_rights_basis_date":nil "Accession.workflow_rights_basis_reviewer":nil "Accession.workflow_rights_basis_note":nil "sensitive_material":nil "extent":nil "sublocation":nil "source_collection_id":nil>}}
kmichaelis commented 3 years ago

@bwatson78 edited and replaced csv

bwatson78 commented 3 years ago

@kmichaelis Processed file is in the folder indicated above.