search

artefactual-labs / enduro

A tool to support ingest and automation in digital preservation workflows
https://enduroproject.netlify.com
Apache License 2.0
12 stars 8 forks source link

Problem: batch functionality can't deal with hidden files #571

Open sevein opened 1 year ago

sevein commented 1 year ago

User experiences problems with SIPs including hidden files, e.g. bag validation issues. The Batch API and the submission web interface should provide a new option to configure the batch process to exclude hidden files before processing.

scollazo commented 5 months ago

This is not working as expected, when launching a batch , hidden files are launched instead of the batch: image

joel-simpson commented 5 months ago

After further testing / analysis - it seems that this is a new issue. The original issue was about removing hidden files from SIPs - and this appears to work as expected. The problem scollazo points out occurs when there are hidden files in the Batch directory. We believe this wasn't a problem before the 0.41.0 release; so this may have been introduced as a side effect (and explains why we didn't see this in earlier testing).