nomad-coe / nomad

NOMAD lets you manage and share your materials science data in a way that makes it truly useful to you, your group, and the community.
https://nomad-lab.eu
Apache License 2.0
71 stars 16 forks source link

Upload processing fails when it encounters broken soft symlink #24

Open ondracka opened 3 years ago

ondracka commented 3 years ago

See upload id an7fhANaSm-hJWTcneQ-8g at the beta server. Upload processing fails with: Upload processing has errors: FileNotFoundError: [Errno 2] No such file or directory: '.volumes/fs/staging/a/an7fhANaSm-hJWTcneQ-8g/raw/LOBSTER/Ti/POTCAR'

The upload has the obvious problem that there are symlinks pointing to directory that was not included. However it should be probably handled more gracefully, i.e., treat the broken symlink like a standard file with size 0 and not abort the whole Upload processing at the first encounter.