artefactual-sdps / enduro

A tool to support ingest and automation in digital preservation workflows
https://enduro.readthedocs.io/
Apache License 2.0
4 stars 3 forks source link

Add local watched dir to dev environment #911

Closed djjuhasz closed 8 months ago

djjuhasz commented 8 months ago

Fixes #874

djjuhasz commented 8 months ago

Copying a file to the enduro-internal /home/enduro/sips directory (with kubectl cp) successfully starts the processing workflow, but it fails on the download activity.

image

The file is in the enduro-internal container's /home/enduro/sips directory:

❯ kubectl cp ~/Desktop/small.zip enduro-internal-b59dd4596-42zq5:/home/enduro/sips/small.zip
Defaulted container "enduro-internal" out of: enduro-internal, check-temporal (init)
❯ kubectl exec --stdin --tty enduro-internal-b59dd4596-42zq5 -- /bin/sh
Defaulted container "enduro-internal" out of: enduro-internal, check-temporal (init)
/ $ ls -l /home/enduro/sips/
total 5
-rw-r--r--    1 enduro   enduro         339 Apr  2 22:31 small.zip
codecov[bot] commented 8 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 48.12%. Comparing base (e67eff0) to head (8da4b94).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #911 +/- ## ========================================== + Coverage 48.04% 48.12% +0.07% ========================================== Files 103 103 Lines 5561 5561 ========================================== + Hits 2672 2676 +4 + Misses 2644 2642 -2 + Partials 245 243 -2 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

djjuhasz commented 8 months ago

The download activity is failing because the watched directory is only available in the "enduro-internal" container, so when the a3m worker tries to download it, the path is not available. I'll have to set up a shared volume in kubernetes that can be mounted in both the enduro-internal and a3m-worker containers.