fcrepo-exts / fcrepo-import-export

Apache License 2.0
15 stars 19 forks source link

Naive import of Mailbag into empty Fedora 6 repo appears to succeed, does nothing? #165

Open dmoles opened 1 year ago

dmoles commented 1 year ago

I have a Mailbag created with mailbagit that I'm trying to import into a new, empty, Fedora 6 repository. The import appears to succeed, but nothing seems to be added to the repo, and the only output in the Fedora logs is for a couple of GET and HEAD requests.

I suspect I'm missing something basic (& quite possibly conceptual), but what?

Import command:

$ java -jar fcrepo-import-export/fcrepo-import-export-1.1.0.jar \                                                                                                                              
  --mode import \
  --binaries \
  --auditLog \
  --resource http://localhost:18080/fcrepo/rest \
  --user fedoraAdmin:fedoraAdmin \
  --bag-profile beyondtherepository \
  --bag-config fcrepo-import-export/bagit-config.yml \
  --dir mailbag/mailbag-2022-12-01

WARN 17:09:12.069 (ProfileValidationUtil) bag-info does not contain the recommended field Bag-Count
WARN 17:09:12.070 (ProfileValidationUtil) bag-info does not contain the recommended field Organization-Address
WARN 17:09:12.070 (ProfileValidationUtil) bag-info does not contain the recommended field Bag-Group-Identifier
WARN 17:09:12.070 (ProfileValidationUtil) bag-info does not contain the recommended field Internal-Sender-Identifier
WARN 17:09:12.070 (ProfileValidationUtil) bag-info does not contain the recommended field Contact-Email
WARN 17:09:12.070 (ProfileValidationUtil) bag-info does not contain the recommended field Bag-Producing-Organization
WARN 17:09:12.070 (ProfileValidationUtil) bag-info does not contain the recommended field Internal-Sender-Description
INFO 17:09:13.271 (Importer) Running importer...
INFO 17:09:13.364 (RdfWriterHelper) Loading JENA 3.1.1 Patched RDF Output Writers

(Note: port 18080 is the host port mapped to the Docker container port 8080.)

Fedora logs (Docker):

unraveling-fedora-1  | INFO 01:09:13.491 [http-nio-8080-exec-10] (FedoraLdp) HEAD for: 
unraveling-fedora-1  | INFO 01:09:13.512 [http-nio-8080-exec-4] (FedoraLdp) GET resource ''
unraveling-fedora-1  | INFO 01:09:13.533 [http-nio-8080-exec-6] (FedoraLdp) HEAD for: 

Audit log:

2022-12-03 17:09:13,539 Finished import... 0 resources imported
whikloj commented 1 year ago

Hi @dmoles, MailbagIt is relatively new and there has not been a use case for adding that profile support to Fedora yet, so I'm guessing some work is needed. I'm going to ping @mikejritter as I think he did the initial work on BagIt support and can fact check me.

dmoles commented 1 year ago

Thanks, @whikloj. I did have to tweak the bag-info.txt to add Source-Organization to get it to load at all.

mikejritter commented 1 year ago

Hi @dmoles, looking at the beyondtherepository profile, the Source-Organization field is required so that makes sense (also I thought we had a place online to view the profiles but admittedly I haven't thought about this in ~2 years). I also thought we had it log if anything in the profile failed to validate against the bag being imported. I see the output for recommended fields so I wonder if the error is being swallowed somewhere.

whikloj commented 1 year ago

Hey @dmoles, was this answered to your satisfaction or is there more here you need?

dmoles commented 1 year ago

Hi @whikloj, it doesn't really explain why the process appears to succeed but nothing is loaded, but I've moved on from this project (and ended up giving up on Fedora for it anyway), so 🤷.