irods-contrib / metalnx-web

Metalnx Web Application
https://metalnx.github.io/
BSD 3-Clause "New" or "Revised" License
36 stars 36 forks source link

Upload works only for some file types. #201

Closed fh-afk closed 3 years ago

fh-afk commented 3 years ago

I just installed metalnx and I am in the state of trying out its capabilities. I can upload jpg, pdf or gif files (file name endings do not matter), but when I try random data or mp4s, avi or mp3 the process hangs like this

image

I do not get any error in rodsLog and the only thing suspicious from the docker container is:

metalnx_1 | 2021-02-22 13:20:24 WARN ResourceAOImpl:621 - unable to format resourceFreeSpace for value: setting to 0

I already tried switching the settings

irodsext.datatyper.detailed.determination and irodsext.datatyper.persist.data.types

in metalnx.properties, it does not change the behaviour. At this moment, I am running out of ideas. I would very much prefer a solution that is agnostic about file types. Side Info: using iput instead of metalnx to get those files into IRODS does not cause any issues.

michael-conway commented 3 years ago

this is probably length related...I've got some upload changes for upload/download length pending so I'll link this to that issue and follow up

On Mon, Feb 22, 2021 at 8:32 AM fh-afk notifications@github.com wrote:

I just installed metalnx and I am in the state of trying out its capabilities. I can upload jpg, pdf or gif files (file name endings do not matter), but when I try random data or mp4s, avi or mp3 the process hangs like this

[image: image] https://user-images.githubusercontent.com/79457640/108713940-32b09e80-7519-11eb-8698-7f15733a8a0a.png

I do not get any error in rodsLog and the only thing suspicious from the docker container is:

metalnx_1 | 2021-02-22 13:20:24 WARN ResourceAOImpl:621 - unable to format resourceFreeSpace for value: setting to 0

I already tried switching the settings

irodsext.datatyper.detailed.determination and irodsext.datatyper.persist.data.types

in metalnx.properties, it does not change the behaviour. At this moment, I am running out of ideas. I would very much prefer a solution that is agnostic about file types. Side Info: using iput instead of metalnx to get those files into IRODS does not cause any issues.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/irods-contrib/metalnx-web/issues/201, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAIL4LO3HHABGEFFKDLJFBTTAJMGLANCNFSM4YAQ6JGA .

fh-afk commented 3 years ago

Thanks for the quick reply! I can confirm that a small random file lile dd if=/dev/urandom of=test bs=5K count=1 uploads as expected. This is probably insufficient for our scientists, but I have to try out more. I will close this with the suggestion to implement throwing an error instead of just hanging and letting the user wait in such situations.