search

DSpace-Labs / SAFBuilder

Builds a Simple Archive Format package from files and a spreadsheet
https://wiki.duraspace.org/display/DSPACE/Simple+Archive+Format+Packager
45 stars 35 forks source link

SAF builder content #12

Closed salmanbbhat closed 8 years ago

salmanbbhat commented 8 years ago

Hii,

I wanted to know if there is a way to ensure that the item folders are created only if the corresponding files are located in the main directory. At the moment SAFBuilder creates all the item listed in the CSV files without checking if the files do exist or not and we have to sort the folders without content files manually before uploading them to Dspace.

peterdietz commented 8 years ago

Hi @salmanbbhat

When you run the SAFBuilder, it will give you output that indicates if your CSV mentioned files that didn't exist, or you have files that were never used by SAFBuilder:

There is no file named Bass Rivier Saving Bank book 1 in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_153
There is no file named 1844-09-27 (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_405
There is no file named 1844-09-27 (2) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_406
There is no file named Users/chloekrueger/Dropbox/DHS/HENRY HOMER SEARS COLLECTION/Letters & Documents/PDFs/Watermark PDFs/1872-xx-xx (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_439
There is no file named Henry Homer Sears - DOCUMENTS AND LETTERS.doc in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_510
File: 1860-12-27 - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times.
File: 1872-xx-xx (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times.
File: 1873-02-xx (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times.
File: 1882-04-21 - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times.
File: 1882-04-23 - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times.
File: 1882-04-30 (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times.
File: Bass Rivier Saving Bank book 1.pdf has been used 0 times.
File: CK_WORKSHEET_Groups 26-30 & Vintage Album 4.xlsx has been used 0 times.
File: Group 30 Photos - Henry Homer Sears - Group 30.pdf has been used 0 times.
File: Photo0192.pdf has been used 0 times.
File: Photo0193.pdf has been used 0 times.
salmanbbhat commented 8 years ago

Dear Peter,

I want a way have the output of these files saved to a file. Also is there a way for SAF builder to skip creating of item folders for files that do not exist.

Regards,

On Wed, Jan 27, 2016 at 5:39 PM, Peter Dietz notifications@github.com wrote:

Hi @salmanbbhat https://github.com/salmanbbhat

When you run the SAFBuilder, it will give you output that indicates if your CSV mentioned files that didn't exist, or you have files that were never used by SAFBuilder:

There is no file named Bass Rivier Saving Bank book 1 in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_153 There is no file named 1844-09-27 (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_405 There is no file named 1844-09-27 (2) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_406 There is no file named Users/chloekrueger/Dropbox/DHS/HENRY HOMER SEARS COLLECTION/Letters & Documents/PDFs/Watermark PDFs/1872-xx-xx (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_439 There is no file named Henry Homer Sears - DOCUMENTS AND LETTERS.doc in /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo while making /Users/peterdietz/Projects/clients/dhs/batches/2016-01-22/combo/SimpleArchiveFormat/item_510 File: 1860-12-27 - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times. File: 1872-xx-xx (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times. File: 1873-02-xx (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times. File: 1882-04-21 - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times. File: 1882-04-23 - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times. File: 1882-04-30 (1) - Henry Homer Sears - DOCUMENTS AND LETTERS.pdf has been used 0 times. File: Bass Rivier Saving Bank book 1.pdf has been used 0 times. File: CK_WORKSHEET_Groups 26-30 & Vintage Album 4.xlsx has been used 0 times. File: Group 30 Photos - Henry Homer Sears - Group 30.pdf has been used 0 times. File: Photo0192.pdf has been used 0 times. File: Photo0193.pdf has been used 0 times.

— Reply to this email directly or view it on GitHub https://github.com/DSpace-Labs/SAFBuilder/issues/12#issuecomment-175660184 .

peterdietz commented 8 years ago

You can write the output to a log file, by redirecting standard output:

./safbuilder.sh -c /path/to/sheet.csv > /path/to/log.file

You would have to build your own customization to have SAFBuilder skip incomplete rows. Perhaps more correct behavior, would be to have SAFBuilder abort if you have incomplete input. I would never batch import an incomplete SAFBuilder output. Instead, give your users a copy of the log, and tell them to fix the spreadsheet.

salmanbbhat commented 8 years ago

Dear Peter,

Thank you so much for your help.

Regards,

On Wed, Jan 27, 2016 at 6:47 PM, Peter Dietz notifications@github.com wrote:

You can write the output to a log file, by redirecting standard output:

./safbuilder.sh -c /path/to/sheet.csv > /path/to/log.file

You would have to build your own customization to have SAFBuilder skip incomplete rows. Perhaps more correct behavior, would be to have SAFBuilder abort if you have incomplete input. I would never batch import an incomplete SAFBuilder output. Instead, give your users a copy of the log, and tell them to fix the spreadsheet.

— Reply to this email directly or view it on GitHub https://github.com/DSpace-Labs/SAFBuilder/issues/12#issuecomment-175696289 .